Compare commits

Home / Compare cf01fea4 .. 99fec616

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.728-70.730=-0.002
σ0.053-0.053=0.000
min70.694-70.699=-0.005
max70.876-70.877=-0.002
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.155-0.159=-0.004
σ0.006-0.004=0.002
min0.146-0.155=-0.009
max0.165-0.169=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.445-21.446=-0.001
σ0.003-0.003=0.000
min21.440-21.442=-0.001
max21.450-21.450=-0.000
mean416.600-415.000=1.600
σ0.516-0.000=0.516
min416.000-415.000=1.000
max417.000-415.000=2.000
mean0.063-0.065=-0.002
σ0.004-0.002=0.002
min0.059-0.061=-0.002
max0.073-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1717.366-1755.288=-37.921
σ169.601-0.361=169.240
min996.812-1754.708=-757.897
max1755.867-1755.872=-0.004
mean1625.950-1653.350=-27.400
σ608.872-629.319=-20.448
min624.000-623.000=1.000
max2462.000-2850.000=-388.000
mean2.817-2.889=-0.072
σ0.324-0.081=0.244
min1.480-2.739=-1.259
max3.071-3.039=0.032

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean274.366-274.366=-0.000
σ0.003-0.013=-0.011
min274.363-274.353=0.010
max274.369-274.382=-0.012
mean2462.000-2850.000=-388.000
σ0.000
min2462.000-2850.000=-388.000
max2462.000-2850.000=-388.000
mean0.386-0.385=0.001
σ0.005-0.001=0.003
min0.383-0.383=-0.001
max0.394-0.386=0.008
iters=5
new-facts=1
prior-facts=6402
mean1934.751-1934.757=-0.006
σ0.008-0.023=-0.015
min1934.742-1934.730=0.012
max1934.759-1934.790=-0.031
mean2462.000-2850.000=-388.000
σ0.000
min2462.000-2850.000=-388.000
max2462.000-2850.000=-388.000
mean3.055-2.873=0.182
σ0.057-0.267=-0.209
min3.001-2.405=0.596
max3.135-3.051=0.084
iters=5
new-facts=6402
prior-facts=1
mean4755.500-4755.373=0.127
σ0.914-1.018=-0.104
min4754.950-4754.504=0.447
max4757.128-4757.137=-0.008
mean2462.000-2850.000=-388.000
σ0.000
min2462.000-2850.000=-388.000
max2462.000-2850.000=-388.000
mean8.675-8.925=-0.251
σ0.506-0.211=0.294
min7.941-8.592=-0.651
max9.259-9.094=0.165
iters=5
new-facts=6402
prior-facts=6402
mean4945.982-4945.988=-0.006
σ0.019-0.017=0.002
min4945.962-4945.970=-0.008
max4946.007-4946.007=-0.000
mean2986.200-3027.600=-41.400
σ260.942-200.993=59.949
min2633.000-2850.000=-217.000
max3297.000-3340.000=-43.000
mean8.544-8.563=-0.019
σ0.132-0.085=0.047
min8.420-8.437=-0.017
max8.744-8.674=0.070

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.722-1.059=0.663
σ0.176-0.270=-0.094
min1.440-0.934=0.506
max1.854-1.542=0.312

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.835-472.845=-0.011
σ574.928-574.940=-0.012
min185.366-185.367=-0.001
max1335.226-1335.255=-0.029
mean88.250
σ8.500
min84.000
max101.000
mean2462.000-2850.000=-388.000
σ0.000
min2462.000-2850.000=-388.000
max2462.000-2850.000=-388.000
mean0.585-0.449=0.136
σ0.583-0.295=0.288
min0.288-0.298=-0.010
max1.460-0.891=0.569
policies=20
mean1853.987-1853.999=-0.011
σ0.368-0.370=-0.002
min1853.739-1853.711=0.029
max1854.532-1854.536=-0.005
mean840.000
σ0.000
min840.000
max840.000
mean2462.000-2850.000=-388.000
σ0.000
min2462.000-2850.000=-388.000
max2462.000-2850.000=-388.000
mean2.887-2.961=-0.073
σ0.042-0.009=0.033
min2.853-2.952=-0.099
max2.949-2.973=-0.024
policies=200
mean18546.741-18546.725=0.016
σ0.502-0.505=-0.003
min18546.435-18546.402=0.033
max18547.490-18547.476=0.014
mean8400.000
σ0.000
min8400.000
max8400.000
mean2462.000-2850.000=-388.000
σ0.000
min2462.000-2850.000=-388.000
max2462.000-2850.000=-388.000
mean28.866-29.378=-0.511
σ0.078-0.463=-0.385
min28.764-28.883=-0.119
max28.955-29.817=-0.862