Compare commits

Home / Compare 1b7a8808 .. 07016060

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.730-70.729=0.001
σ0.047-0.048=-0.000
min70.706-70.703=0.003
max70.864-70.864=0.000
mean411.000-416.000=-5.000
σ0.000
min411.000-416.000=-5.000
max411.000-416.000=-5.000
mean0.161-0.155=0.006
σ0.003-0.005=-0.002
min0.158-0.148=0.010
max0.166-0.161=0.005
cache=y
dps=1
iters=10
policies=100
mean21.446-21.445=0.000
σ0.003-0.003=-0.001
min21.441
max21.450-21.452=-0.002
mean411.000-417.000=-6.000
σ0.000
min411.000-417.000=-6.000
max411.000-417.000=-6.000
mean0.066-0.063=0.003
σ0.004-0.004=0.000
min0.063-0.058=0.005
max0.073-0.069=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.527-1754.527=0.001
σ0.361-0.358=0.003
min1753.956-1753.954=0.002
max1755.125-1755.106=0.018
mean1643.550-1659.450=-15.900
σ628.225-627.792=0.433
min623.000-626.000=-3.000
max2853.000-2840.000=13.000
mean2.827-2.825=0.002
σ0.165-0.100=0.065
min2.399-2.452=-0.054
max3.216-2.967=0.249

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.611-273.611=-0.000
σ0.008-0.005=0.003
min273.602-273.605=-0.003
max273.621-273.617=0.005
mean2853.000-2840.000=13.000
σ0.000
min2853.000-2840.000=13.000
max2853.000-2840.000=13.000
mean0.388-0.385=0.003
σ0.006-0.007=-0.001
min0.384-0.380=0.003
max0.398-0.398=0.001
iters=5
new-facts=1
prior-facts=6402
mean1934.002-1934.002=0.000
σ0.009-0.007=0.001
min1933.990-1933.990=0.000
max1934.014-1934.007=0.007
mean2853.000-2840.000=13.000
σ0.000
min2853.000-2840.000=13.000
max2853.000-2840.000=13.000
mean2.893-3.098=-0.204
σ0.335-0.183=0.152
min2.308-2.927=-0.618
max3.132-3.369=-0.236
iters=5
new-facts=6402
prior-facts=1
mean4754.771-4754.617=0.154
σ0.833-0.949=-0.116
min4754.312-4753.784=0.528
max4756.253-4756.254=-0.001
mean2853.000-2840.000=13.000
σ0.000
min2853.000-2840.000=13.000
max2853.000-2840.000=13.000
mean8.472-8.679=-0.207
σ0.519-0.241=0.278
min7.610-8.345=-0.735
max8.949-8.901=0.047
iters=5
new-facts=6402
prior-facts=6402
mean4945.002-4945.226=-0.224
σ0.182-0.023=0.158
min4944.834-4945.207=-0.374
max4945.206-4945.259=-0.053
mean3084.000-3047.600=36.400
σ241.436-223.022=18.414
min2853.000-2840.000=13.000
max3334.000-3378.000=-44.000
mean8.705-8.613=0.092
σ0.232-0.192=0.040
min8.382-8.443=-0.061
max9.034-8.905=0.129

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.039-0.993=0.046
σ0.226-0.149=0.077
min0.933-0.920=0.013
max1.443-1.259=0.184

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.849-472.837=0.012
σ574.939-574.929=0.009
min185.368-185.366=0.002
max1335.257-1335.231=0.026
mean88.250
σ8.500
min84.000
max101.000
mean2853.000-2840.000=13.000
σ0.000
min2853.000-2840.000=13.000
max2853.000-2840.000=13.000
mean0.478-0.450=0.028
σ0.354-0.301=0.053
min0.300-0.297=0.003
max1.009-0.902=0.107
policies=20
mean1854.020-1854.000=0.020
σ0.375-0.371=0.004
min1853.727-1853.723=0.004
max1854.563-1854.540=0.024
mean840.000
σ0.000
min840.000
max840.000
mean2853.000-2840.000=13.000
σ0.000
min2853.000-2840.000=13.000
max2853.000-2840.000=13.000
mean2.954-2.943=0.012
σ0.004-0.013=-0.010
min2.951-2.923=0.027
max2.958-2.952=0.006
policies=200
mean18546.749-18546.761=-0.011
σ0.459-0.471=-0.012
min18546.448-18546.516=-0.068
max18547.430-18547.467=-0.037
mean8400.000
σ0.000
min8400.000
max8400.000
mean2853.000-2840.000=13.000
σ0.000
min2853.000-2840.000=13.000
max2853.000-2840.000=13.000
mean29.212-29.246=-0.034
σ0.430-0.456=-0.025
min28.959-28.808=0.151
max29.856-29.767=0.089