Compare commits

Home / Compare df64d8df .. 39dc277d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.770-30.773=-0.003
σ0.050-0.046=0.004
min30.745-30.752=-0.007
max30.912-30.904=0.008
mean411.000-416.000=-5.000
σ0.000
min411.000-416.000=-5.000
max411.000-416.000=-5.000
mean0.077-0.078=-0.001
σ0.005-0.004=0.001
min0.070-0.075=-0.006
max0.085-0.086=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.061-21.059=0.002
σ0.002-0.002=-0.000
min21.058-21.055=0.002
max21.065-21.064=0.001
mean411.000-416.000=-5.000
σ0.000
min411.000-416.000=-5.000
max411.000-416.000=-5.000
mean0.064-0.063=0.000
σ0.003-0.002=0.001
min0.062-0.062=0.000
max0.072-0.069=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.234-1751.237=-0.002
σ0.362-0.365=-0.003
min1750.662-1750.670=-0.007
max1751.822-1751.818=0.004
mean1644.600-1677.100=-32.500
σ622.230-644.811=-22.581
min676.000-683.000=-7.000
max2641.000-2718.000=-77.000
mean2.820-2.861=-0.041
σ0.166-0.107=0.058
min2.483-2.512=-0.030
max3.236-3.011=0.226

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.560-275.570=-0.009
σ0.007-0.006=0.001
min275.552-275.565=-0.013
max275.568-275.580=-0.012
mean2641.000-2718.000=-77.000
σ0.000
min2641.000-2718.000=-77.000
max2641.000-2718.000=-77.000
mean0.404-0.400=0.004
σ0.010-0.007=0.003
min0.395-0.394=0.000
max0.416-0.409=0.007
iters=5
new-facts=1
prior-facts=6402
mean2168.093-2168.089=0.003
σ0.006-0.018=-0.012
min2168.083-2168.074=0.010
max2168.097-2168.117=-0.020
mean2641.000-2718.000=-77.000
σ0.000
min2641.000-2718.000=-77.000
max2641.000-2718.000=-77.000
mean3.007-2.964=0.043
σ0.158-0.123=0.035
min2.838-2.774=0.065
max3.160-3.074=0.086
iters=5
new-facts=6402
prior-facts=1
mean5047.669-5047.777=-0.108
σ1.095-1.038=0.057
min5046.747-5046.750=-0.003
max5049.488-5049.517=-0.030
mean2641.000-2718.000=-77.000
σ0.000
min2641.000-2718.000=-77.000
max2641.000-2718.000=-77.000
mean8.837-8.857=-0.020
σ0.445-0.459=-0.014
min8.204-8.104=0.100
max9.400-9.281=0.118
iters=5
new-facts=6402
prior-facts=6402
mean5178.984-5179.045=-0.061
σ0.222-0.090=0.132
min5178.613-5178.963=-0.350
max5179.181-5179.164=0.017
mean3217.000-3233.200=-16.200
σ387.074-361.481=25.594
min2682.000-2718.000=-36.000
max3700.000-3687.000=13.000
mean10.122-9.840=0.283
σ0.350-0.499=-0.149
min9.727-9.347=0.380
max10.670-10.555=0.115

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.202-1.131=0.071
σ0.366-0.085=0.282
min0.943-1.063=-0.120
max1.824-1.255=0.569

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.202-463.206=-0.004
σ572.661-572.658=0.003
min176.868-176.863=0.004
max1322.194-1322.193=0.001
mean77.500
σ7.000
min74.000
max88.000
mean2641.000-2718.000=-77.000
σ0.000
min2641.000-2718.000=-77.000
max2641.000-2718.000=-77.000
mean0.555-0.557=-0.003
σ0.546-0.539=0.007
min0.275-0.285=-0.010
max1.374-1.366=0.008
policies=20
mean1768.942-1768.933=0.009
σ0.341-0.331=0.010
min1768.723-1768.737=-0.014
max1769.450-1769.428=0.022
mean740.000
σ0.000
min740.000
max740.000
mean2641.000-2718.000=-77.000
σ0.000
min2641.000-2718.000=-77.000
max2641.000-2718.000=-77.000
mean2.756-2.743=0.014
σ0.020-0.025=-0.005
min2.739-2.715=0.024
max2.784-2.767=0.017
policies=200
mean17696.124-17696.143=-0.018
σ0.504-0.586=-0.082
min17695.783-17695.746=0.037
max17696.869-17697.009=-0.140
mean7400.000
σ0.000
min7400.000
max7400.000
mean2641.000-2718.000=-77.000
σ0.000
min2641.000-2718.000=-77.000
max2641.000-2718.000=-77.000
mean27.693-27.596=0.097
σ0.090-0.090=-0.000
min27.610-27.495=0.115
max27.807-27.707=0.100