Compare commits

Home / Compare e883bbf5 .. 8400bf2e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.557-70.558=-0.001
σ0.044-0.049=-0.005
min70.535-70.530=0.005
max70.681-70.696=-0.015
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.161-0.160=0.002
σ0.004-0.004=0.000
min0.153-0.157=-0.004
max0.167-0.168=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.288-21.287=0.001
σ0.003-0.003=0.001
min21.284-21.284=-0.000
max21.294-21.291=0.003
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.066-0.065=0.000
σ0.003-0.003=-0.000
min0.064-0.064=0.000
max0.073-0.073=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.175-1753.175=-0.000
σ0.362-0.359=0.003
min1752.603-1752.608=-0.006
max1753.759-1753.754=0.006
mean1657.400-1672.700=-15.300
σ630.659-640.520=-9.861
min678.000-676.000=2.000
max2608.000-2708.000=-100.000
mean2.837-2.859=-0.022
σ0.155-0.139=0.016
min2.304-2.458=-0.154
max3.102-3.183=-0.081

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.621-271.615=0.006
σ0.005-0.006=-0.001
min271.613-271.607=0.005
max271.625-271.621=0.004
mean2608.000-2708.000=-100.000
σ0.000
min2608.000-2708.000=-100.000
max2608.000-2708.000=-100.000
mean0.388-0.380=0.008
σ0.012-0.000=0.011
min0.379-0.379=-0.000
max0.405-0.381=0.025
iters=5
new-facts=1
prior-facts=6402
mean1932.039-1932.039=0.000
σ0.007-0.012=-0.005
min1932.028-1932.021=0.007
max1932.046-1932.055=-0.009
mean2608.000-2708.000=-100.000
σ0.000
min2608.000-2708.000=-100.000
max2608.000-2708.000=-100.000
mean2.979-3.014=-0.036
σ0.158-0.078=0.079
min2.742-2.937=-0.195
max3.142-3.108=0.034
iters=5
new-facts=6402
prior-facts=1
mean4752.629-4752.799=-0.170
σ0.650-0.864=-0.214
min4752.289-4752.314=-0.025
max4753.787-4754.338=-0.551
mean2608.000-2708.000=-100.000
σ0.000
min2608.000-2708.000=-100.000
max2608.000-2708.000=-100.000
mean8.533-8.525=0.009
σ0.450-0.339=0.110
min8.004-7.988=0.016
max8.904-8.930=-0.026
iters=5
new-facts=6402
prior-facts=6402
mean4943.229-4943.230=-0.000
σ0.016-0.022=-0.006
min4943.214-4943.205=0.010
max4943.251-4943.259=-0.008
mean2948.000-2977.200=-29.200
σ345.924-229.933=115.991
min2608.000-2708.000=-100.000
max3442.000-3304.000=138.000
mean8.438-8.483=-0.045
σ0.163-0.109=0.054
min8.309-8.317=-0.008
max8.722-8.577=0.145

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.263-1.103=0.160
σ0.336-0.261=0.075
min0.932-0.933=-0.001
max1.607-1.529=0.078

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.006-472.010=-0.004
σ575.354-575.354=0.000
min184.325-184.323=0.002
max1335.037-1335.041=-0.004
mean88.250
σ8.500
min84.000
max101.000
mean2608.000-2708.000=-100.000
σ0.000
min2608.000-2708.000=-100.000
max2608.000-2708.000=-100.000
mean0.578-0.557=0.022
σ0.561-0.548=0.013
min0.297-0.264=0.033
max1.420-1.379=0.042
policies=20
mean1843.538-1843.560=-0.022
σ0.358-0.375=-0.016
min1843.306-1843.287=0.019
max1844.068-1844.108=-0.041
mean840.000
σ0.000
min840.000
max840.000
mean2608.000-2708.000=-100.000
σ0.000
min2608.000-2708.000=-100.000
max2608.000-2708.000=-100.000
mean2.901-2.919=-0.018
σ0.043-0.039=0.004
min2.868-2.870=-0.003
max2.963-2.954=0.008
policies=200
mean18442.084-18442.147=-0.063
σ0.468-0.384=0.085
min18441.677-18441.919=-0.242
max18442.759-18442.720=0.039
mean8400.000
σ0.000
min8400.000
max8400.000
mean2608.000-2708.000=-100.000
σ0.000
min2608.000-2708.000=-100.000
max2608.000-2708.000=-100.000
mean29.001-28.939=0.061
σ0.126-0.130=-0.004
min28.887-28.835=0.053
max29.122-29.118=0.004