Compare commits

Home / Compare 5d80ec0f .. 8aba8a36

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.374-70.374=0.000
σ0.057-0.060=-0.002
min70.335-70.334=0.000
max70.533-70.541=-0.008
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.161-0.155=0.006
σ0.003-0.005=-0.002
min0.158-0.149=0.009
max0.167-0.162=0.005
cache=y
dps=1
iters=10
policies=100
mean21.143-21.144=-0.001
σ0.002-0.003=-0.001
min21.139-21.140=-0.000
max21.145-21.147=-0.002
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.064-0.064=-0.000
σ0.002-0.003=-0.000
min0.062-0.063=-0.000
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.201-1752.201=-0.000
σ0.362-0.363=-0.001
min1751.629-1751.626=0.003
max1752.791-1752.787=0.004
mean1659.500-1644.100=15.400
σ626.191-646.753=-20.562
min682.000-617.000=65.000
max2745.000-2730.000=15.000
mean2.817-2.848=-0.031
σ0.088-0.134=-0.046
min2.658-2.456=0.202
max2.997-3.065=-0.068

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.930-269.928=0.002
σ0.006-0.007=-0.001
min269.927-269.921=0.006
max269.941-269.938=0.003
mean2745.000-2730.000=15.000
σ0.000
min2745.000-2730.000=15.000
max2745.000-2730.000=15.000
mean0.374-0.373=0.001
σ0.004-0.004=0.000
min0.371-0.370=0.001
max0.381-0.379=0.002
iters=5
new-facts=1
prior-facts=6402
mean1930.389-1930.394=-0.005
σ0.014-0.008=0.006
min1930.374-1930.383=-0.009
max1930.407-1930.403=0.004
mean2745.000-2730.000=15.000
σ0.000
min2745.000-2730.000=15.000
max2745.000-2730.000=15.000
mean2.613-2.609=0.003
σ0.094-0.170=-0.076
min2.445-2.453=-0.008
max2.665-2.809=-0.144
iters=5
new-facts=6402
prior-facts=1
mean4750.859-4750.740=0.118
σ0.886-0.617=0.268
min4750.325-4750.399=-0.074
max4752.436-4751.839=0.597
mean2745.000-2730.000=15.000
σ0.000
min2745.000-2730.000=15.000
max2745.000-2730.000=15.000
mean8.674-8.752=-0.078
σ0.594-0.704=-0.110
min7.808-7.633=0.175
max9.215-9.399=-0.184
iters=5
new-facts=6402
prior-facts=6402
mean4941.264-4941.326=-0.062
σ0.210-0.095=0.115
min4940.925-4941.233=-0.308
max4941.448-4941.433=0.015
mean3067.000-3035.800=31.200
σ308.680-223.992=84.689
min2745.000-2730.000=15.000
max3372.000-3323.000=49.000
mean8.743-8.548=0.195
σ0.431-0.109=0.322
min8.284-8.383=-0.099
max9.399-8.655=0.745

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.138-1.081=0.057
σ0.245-0.109=0.136
min0.933-0.945=-0.013
max1.564-1.250=0.315

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.918-465.919=-0.002
σ575.771-575.773=-0.002
min178.027-178.021=0.006
max1329.574-1329.578=-0.005
mean81.750
σ7.500
min78.000
max93.000
mean2745.000-2730.000=15.000
σ0.000
min2745.000-2730.000=15.000
max2745.000-2730.000=15.000
mean0.532-0.533=-0.001
σ0.504-0.489=0.015
min0.278-0.283=-0.005
max1.288-1.266=0.022
policies=20
mean1780.483-1780.479=0.004
σ0.357-0.352=0.004
min1780.237-1780.243=-0.007
max1781.012-1781.003=0.009
mean780.000
σ0.000
min780.000
max780.000
mean2745.000-2730.000=15.000
σ0.000
min2745.000-2730.000=15.000
max2745.000-2730.000=15.000
mean2.779-2.759=0.020
σ0.005-0.020=-0.015
min2.773-2.743=0.030
max2.784-2.787=-0.004
policies=200
mean17811.408-17811.551=-0.143
σ0.578-0.530=0.048
min17811.096-17811.275=-0.179
max17812.274-17812.346=-0.072
mean7800.000
σ0.000
min7800.000
max7800.000
mean2745.000-2730.000=15.000
σ0.000
min2745.000-2730.000=15.000
max2745.000-2730.000=15.000
mean27.990-28.054=-0.065
σ0.075-0.200=-0.124
min27.936-27.894=0.042
max28.101-28.347=-0.245