Compare commits

Home / Compare d8367874 .. e0d7dc04

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.734-70.732=0.002
σ0.045-0.048=-0.003
min70.707-70.700=0.007
max70.859-70.863=-0.004
mean419.000-415.000=4.000
σ0.000
min419.000-415.000=4.000
max419.000-415.000=4.000
mean0.160-0.158=0.002
σ0.003-0.004=-0.001
min0.156-0.150=0.006
max0.165-0.163=0.001
cache=y
dps=1
iters=10
policies=100
mean21.445-21.446=-0.001
σ0.004-0.003=0.001
min21.440-21.442=-0.002
max21.452-21.450=0.002
mean419.000-415.000=4.000
σ0.000
min419.000-415.000=4.000
max419.000-415.000=4.000
mean0.063-0.065=-0.002
σ0.004-0.002=0.002
min0.059-0.063=-0.004
max0.073-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.526-1754.526=-0.001
σ0.360-0.359=0.001
min1753.957-1753.954=0.003
max1755.104-1755.102=0.002
mean1660.700-1643.000=17.700
σ626.007-631.259=-5.252
min628.000-640.000=-12.000
max2838.000-2860.000=-22.000
mean2.784-2.829=-0.045
σ0.137-0.162=-0.026
min2.340-2.284=0.056
max2.968-3.079=-0.111

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.611-273.609=0.002
σ0.006-0.010=-0.004
min273.602-273.600=0.002
max273.617-273.625=-0.008
mean2838.000-2860.000=-22.000
σ0.000
min2838.000-2860.000=-22.000
max2838.000-2860.000=-22.000
mean0.386-0.395=-0.010
σ0.005-0.010=-0.005
min0.381-0.382=-0.001
max0.394-0.411=-0.017
iters=5
new-facts=1
prior-facts=6402
mean1934.003-1933.996=0.007
σ0.007-0.011=-0.005
min1933.993-1933.980=0.014
max1934.011-1934.008=0.003
mean2838.000-2860.000=-22.000
σ0.000
min2838.000-2860.000=-22.000
max2838.000-2860.000=-22.000
mean2.901-3.024=-0.123
σ0.320-0.167=0.152
min2.387-2.855=-0.468
max3.179-3.253=-0.074
iters=5
new-facts=6402
prior-facts=1
mean4754.776-4754.625=0.151
σ0.833-0.944=-0.111
min4754.310-4753.885=0.425
max4756.259-4756.274=-0.015
mean2838.000-2860.000=-22.000
σ0.000
min2838.000-2860.000=-22.000
max2838.000-2860.000=-22.000
mean8.411-8.739=-0.328
σ0.463-0.357=0.107
min7.682-8.460=-0.778
max8.859-9.349=-0.490
iters=5
new-facts=6402
prior-facts=6402
mean4945.151-4945.218=-0.067
σ0.141-0.025=0.116
min4944.901-4945.184=-0.282
max4945.241-4945.246=-0.006
mean3057.800-3052.400=5.400
σ229.327-255.442=-26.116
min2838.000-2860.000=-22.000
max3295.000-3450.000=-155.000
mean8.825-8.503=0.322
σ0.360-0.222=0.137
min8.440-8.344=0.096
max9.355-8.873=0.482

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.001-1.047=-0.045
σ0.140-0.129=0.011
min0.933-0.934=-0.000
max1.252-1.251=0.001

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.845-472.842=0.003
σ574.928-574.927=0.000
min185.375-185.370=0.005
max1335.236-1335.233=0.003
mean88.250
σ8.500
min84.000
max101.000
mean2838.000-2860.000=-22.000
σ0.000
min2838.000-2860.000=-22.000
max2838.000-2860.000=-22.000
mean0.477-0.450=0.027
σ0.358-0.304=0.054
min0.298-0.297=0.000
max1.014-0.906=0.108
policies=20
mean1854.030-1854.001=0.029
σ0.369-0.375=-0.006
min1853.756-1853.727=0.029
max1854.567-1854.546=0.021
mean840.000
σ0.000
min840.000
max840.000
mean2838.000-2860.000=-22.000
σ0.000
min2838.000-2860.000=-22.000
max2838.000-2860.000=-22.000
mean2.963-2.947=0.017
σ0.006-0.013=-0.007
min2.955-2.936=0.019
max2.967-2.964=0.003
policies=200
mean18546.762-18546.565=0.197
σ0.432-0.442=-0.011
min18546.485-18546.183=0.302
max18547.406-18547.202=0.203
mean8400.000
σ0.000
min8400.000
max8400.000
mean2838.000-2860.000=-22.000
σ0.000
min2838.000-2860.000=-22.000
max2838.000-2860.000=-22.000
mean29.233-29.051=0.182
σ0.441-0.446=-0.004
min28.796-28.635=0.161
max29.753-29.657=0.096