Compare commits

Home / Compare 625f3c41 .. ec76fd0b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.732-70.730=0.002
σ0.043-0.044=-0.001
min70.706-70.708=-0.002
max70.852-70.853=-0.001
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.159-0.161=-0.002
σ0.005-0.004=0.001
min0.152-0.157=-0.005
max0.167-0.167=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.446-21.450=-0.004
σ0.004-0.012=-0.008
min21.443-21.442=0.000
max21.453-21.482=-0.029
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.066-0.066=0.000
σ0.003-0.002=0.001
min0.064-0.063=0.000
max0.074-0.070=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.527-1716.603=37.925
σ0.360-169.591=-169.231
min1753.954-996.091=757.863
max1755.108-1755.111=-0.003
mean1661.550-1644.600=16.950
σ631.362-613.457=17.905
min623.000-638.000=-15.000
max2667.000-2470.000=197.000
mean2.831-2.773=0.059
σ0.110-0.339=-0.229
min2.639-1.447=1.192
max3.080-3.096=-0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.609-273.609=0.000
σ0.007-0.009=-0.002
min273.599-273.594=0.005
max273.615-273.614=0.000
mean2667.000-2470.000=197.000
σ0.000
min2667.000-2470.000=197.000
max2667.000-2470.000=197.000
mean0.388-0.391=-0.002
σ0.011-0.009=0.002
min0.380-0.380=0.000
max0.403-0.403=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1933.995-1933.999=-0.004
σ0.003-0.010=-0.007
min1933.990-1933.988=0.002
max1933.997-1934.015=-0.018
mean2667.000-2470.000=197.000
σ0.000
min2667.000-2470.000=197.000
max2667.000-2470.000=197.000
mean3.101-2.970=0.131
σ0.108-0.183=-0.075
min2.999-2.764=0.235
max3.232-3.164=0.067
iters=5
new-facts=6402
prior-facts=1
mean4754.614-4754.698=-0.084
σ0.651-0.555=0.096
min4754.245-4754.247=-0.002
max4755.776-4755.668=0.108
mean2667.000-2470.000=197.000
σ0.000
min2667.000-2470.000=197.000
max2667.000-2470.000=197.000
mean8.859-8.415=0.444
σ0.196-0.694=-0.499
min8.604-7.723=0.881
max9.134-9.136=-0.002
iters=5
new-facts=6402
prior-facts=6402
mean4945.230-4945.221=0.009
σ0.018-0.016=0.002
min4945.208-4945.200=0.008
max4945.256-4945.239=0.017
mean3007.400-3014.800=-7.400
σ257.967-311.788=-53.821
min2667.000-2569.000=98.000
max3307.000-3370.000=-63.000
mean8.636-8.718=-0.083
σ0.159-0.257=-0.098
min8.464-8.416=0.048
max8.894-8.994=-0.100

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.081-1.675=-0.593
σ0.147-0.161=-0.014
min0.940-1.428=-0.488
max1.244-1.838=-0.594

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.846-472.832=0.014
σ574.934-574.926=0.008
min185.369-185.364=0.004
max1335.247-1335.221=0.026
mean88.250
σ8.500
min84.000
max101.000
mean2667.000-2470.000=197.000
σ0.000
min2667.000-2470.000=197.000
max2667.000-2470.000=197.000
mean0.560-0.569=-0.009
σ0.532-0.558=-0.025
min0.290-0.286=0.003
max1.359-1.405=-0.046
policies=20
mean1853.983-1853.947=0.036
σ0.378-0.369=0.009
min1853.720-1853.697=0.023
max1854.540-1854.490=0.050
mean840.000
σ0.000
min840.000
max840.000
mean2667.000-2470.000=197.000
σ0.000
min2667.000-2470.000=197.000
max2667.000-2470.000=197.000
mean2.872-2.907=-0.035
σ0.031-0.055=-0.024
min2.844-2.859=-0.015
max2.903-2.982=-0.080
policies=200
mean18546.719-18546.490=0.230
σ0.458-0.493=-0.036
min18546.453-18546.184=0.269
max18547.405-18547.227=0.178
mean8400.000
σ0.000
min8400.000
max8400.000
mean2667.000-2470.000=197.000
σ0.000
min2667.000-2470.000=197.000
max2667.000-2470.000=197.000
mean28.819-28.901=-0.083
σ0.075-0.054=0.021
min28.708-28.848=-0.140
max28.874-28.963=-0.089