Compare commits

Home / Compare fc100512 .. 7eed102e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.770-30.769=0.001
σ0.049-0.048=0.001
min30.729-30.734=-0.005
max30.903-30.902=0.002
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.076-0.075=0.001
σ0.005-0.005=0.000
min0.071-0.070=0.000
max0.086-0.084=0.001
cache=y
dps=1
iters=10
policies=100
mean21.060-21.061=-0.001
σ0.002-0.003=-0.000
min21.057-21.056=0.000
max21.062-21.065=-0.003
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.060-0.064=-0.004
σ0.003-0.003=0.000
min0.058-0.062=-0.004
max0.066-0.071=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.422-1751.417=0.004
σ0.362-0.360=0.002
min1750.850-1750.854=-0.004
max1752.021-1751.999=0.022
mean1650.750-1645.950=4.800
σ621.992-619.151=2.841
min682.000-679.000=3.000
max2649.000-2638.000=11.000
mean2.819-2.867=-0.048
σ0.179-0.149=0.030
min2.311-2.552=-0.240
max3.108-3.233=-0.125

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.753-275.755=-0.002
σ0.007-0.009=-0.002
min275.746-275.744=0.002
max275.764-275.765=-0.000
mean2649.000-2638.000=11.000
σ0.000
min2649.000-2638.000=11.000
max2649.000-2638.000=11.000
mean0.405-0.401=0.004
σ0.010-0.003=0.007
min0.396-0.398=-0.003
max0.421-0.406=0.015
iters=5
new-facts=1
prior-facts=6402
mean2168.282-2168.277=0.005
σ0.010-0.012=-0.003
min2168.272-2168.264=0.008
max2168.294-2168.297=-0.003
mean2649.000-2638.000=11.000
σ0.000
min2649.000-2638.000=11.000
max2649.000-2638.000=11.000
mean2.906-3.026=-0.120
σ0.113-0.210=-0.097
min2.741-2.781=-0.040
max3.027-3.320=-0.293
iters=5
new-facts=6402
prior-facts=1
mean5048.092-5048.109=-0.017
σ0.928-0.978=-0.050
min5047.586-5047.578=0.008
max5049.747-5049.851=-0.104
mean2649.000-2638.000=11.000
σ0.000
min2649.000-2638.000=11.000
max2649.000-2638.000=11.000
mean8.938-9.073=-0.134
σ0.471-0.535=-0.064
min8.134-8.249=-0.115
max9.317-9.722=-0.405
iters=5
new-facts=6402
prior-facts=6402
mean5179.238-5179.099=0.139
σ0.081-0.209=-0.128
min5179.165-5178.811=0.354
max5179.338-5179.341=-0.003
mean3274.000-3228.000=46.000
σ380.699-371.032=9.667
min2736.000-2695.000=41.000
max3733.000-3692.000=41.000
mean9.916-9.956=-0.040
σ0.328-0.222=0.106
min9.560-9.628=-0.068
max10.205-10.197=0.007

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.212-1.234=-0.022
σ0.432-0.312=0.120
min0.950-0.963=-0.012
max1.947-1.759=0.189

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.572-463.572=-0.000
σ572.663-572.661=0.002
min177.237-177.238=-0.001
max1322.566-1322.563=0.003
mean79.750
σ7.500
min76.000
max91.000
mean2649.000-2638.000=11.000
σ0.000
min2649.000-2638.000=11.000
max2649.000-2638.000=11.000
mean0.558-0.562=-0.004
σ0.562-0.570=-0.008
min0.274-0.275=-0.001
max1.401-1.417=-0.016
policies=20
mean1772.636-1772.619=0.017
σ0.333-0.331=0.002
min1772.424-1772.393=0.031
max1773.132-1773.109=0.023
mean760.000
σ0.000
min760.000
max760.000
mean2649.000-2638.000=11.000
σ0.000
min2649.000-2638.000=11.000
max2649.000-2638.000=11.000
mean2.753-2.750=0.003
σ0.022-0.015=0.007
min2.737-2.736=0.001
max2.784-2.767=0.018
policies=200
mean17733.060-17732.999=0.062
σ0.518-0.518=-0.000
min17732.789-17732.576=0.214
max17733.837-17733.749=0.088
mean7600.000
σ0.000
min7600.000
max7600.000
mean2649.000-2638.000=11.000
σ0.000
min2649.000-2638.000=11.000
max2649.000-2638.000=11.000
mean27.797-27.774=0.023
σ0.138-0.137=0.001
min27.669-27.626=0.043
max27.957-27.957=-0.000