Compare commits

Home / Compare 48d99187 .. 3f58d713

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.781=0.000
σ0.046-0.048=-0.001
min70.747-70.744=0.003
max70.910-70.911=-0.002
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.158-0.159=-0.001
σ0.005-0.004=0.001
min0.152-0.152=-0.000
max0.168-0.165=0.003
cache=y
dps=1
iters=10
policies=100
mean21.493-21.492=0.000
σ0.003-0.003=0.000
min21.490-21.489=0.001
max21.501-21.498=0.002
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.065-0.065=-0.000
σ0.002-0.003=-0.001
min0.063-0.063=0.000
max0.070-0.074=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.125-1754.094=0.031
σ0.361-0.361=0.000
min1753.564-1753.536=0.028
max1754.713-1754.675=0.038
mean1645.300-1635.050=10.250
σ624.646-597.424=27.222
min631.000-656.000=-25.000
max2694.000-2434.000=260.000
mean2.771-2.841=-0.071
σ0.278-0.141=0.137
min2.156-2.569=-0.413
max3.521-3.168=0.352

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.952-271.954=-0.001
σ0.010-0.004=0.007
min271.938-271.948=-0.010
max271.964-271.959=0.005
mean2694.000-2434.000=260.000
σ0.000
min2694.000-2434.000=260.000
max2694.000-2434.000=260.000
mean0.377-0.380=-0.003
σ0.007-0.002=0.005
min0.373-0.378=-0.006
max0.389-0.382=0.007
iters=5
new-facts=1
prior-facts=6402
mean1932.347-1932.321=0.026
σ0.011-0.013=-0.003
min1932.329-1932.299=0.031
max1932.359-1932.334=0.025
mean2694.000-2434.000=260.000
σ0.000
min2694.000-2434.000=260.000
max2694.000-2434.000=260.000
mean3.076-3.061=0.016
σ0.089-0.053=0.037
min2.994-3.014=-0.020
max3.202-3.127=0.075
iters=5
new-facts=6402
prior-facts=1
mean4756.111-4753.092=3.019
σ7.541-0.895=6.646
min4752.601-4752.584=0.017
max4769.599-4754.682=14.917
mean2694.000-2434.000=260.000
σ0.000
min2694.000-2434.000=260.000
max2694.000-2434.000=260.000
mean8.477-8.424=0.053
σ0.482-0.381=0.101
min7.912-7.879=0.033
max9.124-8.927=0.196
iters=5
new-facts=6402
prior-facts=6402
mean4943.445-4943.481=-0.036
σ0.202-0.176=0.026
min4943.222-4943.169=0.053
max4943.605-4943.573=0.032
mean2973.200-2881.200=92.000
σ232.269-380.524=-148.256
min2694.000-2434.000=260.000
max3294.000-3411.000=-117.000
mean8.506-8.347=0.159
σ0.147-0.046=0.100
min8.368-8.290=0.078
max8.744-8.398=0.346

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.116-1.872=-0.756
σ0.261-0.084=0.177
min0.908-1.759=-0.851
max1.462-1.993=-0.531

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.983-468.653=-0.671
σ573.577-574.927=-1.349
min181.182-181.185=-0.003
max1328.349-1331.043=-2.695
mean88.250
σ8.500
min84.000
max101.000
mean2694.000-2434.000=260.000
σ0.000
min2694.000-2434.000=260.000
max2694.000-2434.000=260.000
mean0.559-0.540=0.019
σ0.549-0.507=0.042
min0.281-0.285=-0.004
max1.382-1.300=0.082
policies=20
mean1812.138-1812.209=-0.071
σ0.387-0.393=-0.006
min1811.892-1811.946=-0.055
max1812.713-1812.788=-0.075
mean840.000
σ0.000
min840.000
max840.000
mean2694.000-2434.000=260.000
σ0.000
min2694.000-2434.000=260.000
max2694.000-2434.000=260.000
mean2.814-2.848=-0.034
σ0.019-0.008=0.010
min2.798-2.838=-0.041
max2.839-2.855=-0.016
policies=200
mean18128.989-18129.075=-0.086
σ0.589-0.614=-0.025
min18128.578-18128.713=-0.135
max18129.839-18129.994=-0.155
mean8400.000
σ0.000
min8400.000
max8400.000
mean2694.000-2434.000=260.000
σ0.000
min2694.000-2434.000=260.000
max2694.000-2434.000=260.000
mean28.324-28.706=-0.382
σ0.054-0.119=-0.065
min28.254-28.533=-0.280
max28.377-28.796=-0.419