Compare commits

Home / Compare 987476cf .. 3a0326cb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.733-70.729=0.005
σ0.046-0.048=-0.001
min70.700-70.705=-0.005
max70.861-70.862=-0.001
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.156-0.158=-0.001
σ0.004-0.004=0.001
min0.150-0.155=-0.005
max0.165-0.164=0.001
cache=y
dps=1
iters=10
policies=100
mean21.445-21.446=-0.001
σ0.003-0.003=-0.000
min21.440-21.442=-0.002
max21.448-21.451=-0.003
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.065-0.065=-0.000
σ0.002-0.003=-0.001
min0.063-0.063=-0.000
max0.069-0.072=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.527-1754.527=0.000
σ0.363-0.360=0.002
min1753.953-1753.957=-0.005
max1755.117-1755.118=-0.002
mean1659.650-1659.350=0.300
σ638.362-638.720=-0.358
min641.000
max2837.000-2838.000=-1.000
mean2.771-2.826=-0.055
σ0.221-0.186=0.035
min2.157-2.366=-0.209
max3.042-3.255=-0.213

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.611-273.607=0.004
σ0.007-0.006=0.001
min273.600-273.600=-0.001
max273.617-273.615=0.003
mean2837.000-2838.000=-1.000
σ0.000
min2837.000-2838.000=-1.000
max2837.000-2838.000=-1.000
mean0.384-0.383=0.000
σ0.007-0.006=0.001
min0.380-0.380=0.000
max0.396-0.395=0.002
iters=5
new-facts=1
prior-facts=6402
mean1934.003-1933.995=0.009
σ0.011-0.013=-0.002
min1933.996-1933.979=0.017
max1934.023-1934.015=0.008
mean2837.000-2838.000=-1.000
σ0.000
min2837.000-2838.000=-1.000
max2837.000-2838.000=-1.000
mean3.077-2.962=0.115
σ0.278-0.114=0.164
min2.780-2.769=0.011
max3.527-3.068=0.460
iters=5
new-facts=6402
prior-facts=1
mean4754.761-4754.619=0.142
σ0.819-0.647=0.172
min4754.301-4754.208=0.093
max4756.217-4755.762=0.455
mean2837.000-2838.000=-1.000
σ0.000
min2837.000-2838.000=-1.000
max2837.000-2838.000=-1.000
mean8.449-8.857=-0.408
σ0.501-0.451=0.050
min7.639-8.263=-0.623
max8.923-9.449=-0.526
iters=5
new-facts=6402
prior-facts=6402
mean4945.140-4945.230=-0.090
σ0.175-0.020=0.155
min4944.831-4945.210=-0.378
max4945.254-4945.255=-0.001
mean3047.200-3015.600=31.600
σ225.900-196.048=29.852
min2837.000-2838.000=-1.000
max3382.000-3314.000=68.000
mean8.623-8.659=-0.037
σ0.253-0.117=0.136
min8.294-8.560=-0.266
max8.938-8.856=0.082

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.005-1.064=-0.059
σ0.142-0.165=-0.023
min0.935-0.943=-0.008
max1.259-1.245=0.014

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.865-472.865=-0.000
σ574.930-574.940=-0.010
min185.393-185.391=0.002
max1335.260-1335.275=-0.016
mean88.250
σ8.500
min84.000
max101.000
mean2837.000-2838.000=-1.000
σ0.000
min2837.000-2838.000=-1.000
max2837.000-2838.000=-1.000
mean0.486-0.496=-0.010
σ0.375-0.375=-0.000
min0.296-0.304=-0.008
max1.049-1.059=-0.010
policies=20
mean1854.272-1854.249=0.023
σ0.371-0.372=-0.001
min1854.003-1853.970=0.033
max1854.814-1854.786=0.029
mean840.000
σ0.000
min840.000
max840.000
mean2837.000-2838.000=-1.000
σ0.000
min2837.000-2838.000=-1.000
max2837.000-2838.000=-1.000
mean2.945-2.954=-0.009
σ0.014-0.005=0.009
min2.931-2.949=-0.018
max2.964-2.961=0.003
policies=200
mean18549.181-18549.052=0.129
σ0.488-0.396=0.092
min18548.888-18548.825=0.063
max18549.908-18549.644=0.265
mean8400.000
σ0.000
min8400.000
max8400.000
mean2837.000-2838.000=-1.000
σ0.000
min2837.000-2838.000=-1.000
max2837.000-2838.000=-1.000
mean29.250-29.166=0.084
σ0.452-0.425=0.028
min28.823-28.824=-0.000
max29.795-29.706=0.089