Compare commits

Home / Compare c6f40f7d .. e4918834

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.973-35.974=-0.001
σ0.106-0.106=-0.000
min35.927-35.924=0.003
max36.274-36.276=-0.001
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.078-0.078=0.001
σ0.004-0.004=0.000
min0.075-0.075=0.000
max0.084-0.083=0.001
cache=y
dps=1
iters=10
policies=100
mean26.208-26.209=-0.000
σ0.004-0.003=0.000
min26.203-26.203=-0.000
max26.215-26.216=-0.001
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.061-0.062=-0.001
σ0.003-0.002=0.001
min0.058-0.059=-0.001
max0.068-0.067=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.364-1758.364=-0.000
σ0.373-0.370=0.003
min1757.790-1757.790=-0.001
max1758.962-1758.960=0.002
mean1639.150-1655.800=-16.650
σ625.460-649.412=-23.953
min642.000-672.000=-30.000
max2836.000-2755.000=81.000
mean2.374-2.390=-0.015
σ0.108-0.099=0.009
min2.278-2.289=-0.012
max2.763-2.659=0.104

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.514-279.511=0.004
σ0.005-0.007=-0.002
min279.508-279.505=0.004
max279.521-279.521=-0.000
mean2836.000-2755.000=81.000
σ0.000
min2836.000-2755.000=81.000
max2836.000-2755.000=81.000
mean0.407-0.412=-0.005
σ0.002-0.007=-0.005
min0.405-0.408=-0.002
max0.410-0.424=-0.014
iters=5
new-facts=1
prior-facts=6402
mean2178.425-2178.440=-0.015
σ0.025-0.016=0.008
min2178.383-2178.422=-0.040
max2178.442-2178.460=-0.018
mean2836.000-2755.000=81.000
σ0.000
min2836.000-2755.000=81.000
max2836.000-2755.000=81.000
mean3.333-3.415=-0.082
σ0.283-0.123=0.160
min2.867-3.249=-0.381
max3.553-3.542=0.010
iters=5
new-facts=6402
prior-facts=1
mean5056.277-5056.365=-0.088
σ0.748-0.995=-0.247
min5055.803-5055.779=0.024
max5057.603-5058.133=-0.531
mean2836.000-2755.000=81.000
σ0.000
min2836.000-2755.000=81.000
max2836.000-2755.000=81.000
mean8.809-9.129=-0.321
σ0.674-0.425=0.250
min8.322-8.404=-0.082
max9.932-9.530=0.402
iters=5
new-facts=6402
prior-facts=6402
mean5193.686-5193.745=-0.058
σ0.127-0.081=0.047
min5193.498-5193.681=-0.183
max5193.856-5193.859=-0.003
mean3307.200-3294.800=12.400
σ365.011-480.357=-115.346
min2836.000-2755.000=81.000
max3664.000-3947.000=-283.000
mean9.032-8.861=0.171
σ0.409-0.116=0.293
min8.690-8.687=0.002
max9.738-8.972=0.766

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.951-1.006=-0.055
σ0.010-0.159=-0.149
min0.944-0.927=0.017
max0.968-1.290=-0.322

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.493-465.487=0.006
σ572.659-572.682=-0.023
min179.157-179.139=0.018
max1324.481-1324.509=-0.028
mean79.500
σ7.000
min76.000
max90.000
mean2836.000-2755.000=81.000
σ0.000
min2836.000-2755.000=81.000
max2836.000-2755.000=81.000
mean0.439-0.557=-0.118
σ0.299-0.547=-0.248
min0.287-0.282=0.006
max0.888-1.378=-0.490
policies=20
mean1791.861-1791.667=0.193
σ0.345-0.345=0.001
min1791.620-1791.449=0.172
max1792.367-1792.181=0.187
mean760.000
σ0.000
min760.000
max760.000
mean2836.000-2755.000=81.000
σ0.000
min2836.000-2755.000=81.000
max2836.000-2755.000=81.000
mean2.872-2.813=0.059
σ0.011-0.020=-0.008
min2.862-2.796=0.066
max2.887-2.840=0.047
policies=200
mean17923.802-17923.238=0.564
σ0.743-0.503=0.239
min17923.046-17922.939=0.107
max17924.566-17923.990=0.575
mean7600.000
σ0.000
min7600.000
max7600.000
mean2836.000-2755.000=81.000
σ0.000
min2836.000-2755.000=81.000
max2836.000-2755.000=81.000
mean28.537-28.261=0.276
σ0.395-0.099=0.296
min28.068-28.144=-0.076
max28.992-28.381=0.611