Compare commits

Home / Compare 61ea4720 .. 9828b56a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.990-35.990=-0.000
σ0.101-0.102=-0.001
min35.948-35.945=0.003
max36.278-36.280=-0.003
mean3871.000-3949.000=-78.000
σ0.000
min3871.000-3949.000=-78.000
max3871.000-3949.000=-78.000
mean0.076-0.075=0.000
σ0.002-0.003=-0.000
min0.074-0.072=0.002
max0.080-0.080=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.211-26.214=-0.003
σ0.005-0.003=0.002
min26.206-26.207=-0.001
max26.224-26.218=0.006
mean3871.000-3949.000=-78.000
σ0.000
min3871.000-3949.000=-78.000
max3871.000-3949.000=-78.000
mean0.056-0.059=-0.003
σ0.001-0.003=-0.002
min0.055-0.056=-0.000
max0.057-0.063=-0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.366-1756.366=0.000
σ0.372-0.373=-0.000
min1755.796-1755.788=0.008
max1756.963-1756.968=-0.005
mean1633.850-1659.500=-25.650
σ621.881-629.297=-7.417
min629.000-620.000=9.000
max2837.000-2660.000=177.000
mean2.271-2.300=-0.029
σ0.147-0.219=-0.072
min2.130-2.137=-0.007
max2.793-3.036=-0.243

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.696-278.698=-0.002
σ0.014-0.012=0.002
min278.683-278.686=-0.003
max278.720-278.718=0.002
mean2837.000-2660.000=177.000
σ0.000
min2837.000-2660.000=177.000
max2837.000-2660.000=177.000
mean0.419-0.429=-0.010
σ0.002-0.011=-0.010
min0.416-0.418=-0.001
max0.420-0.441=-0.021
iters=5
new-facts=1
prior-facts=6402
mean2268.868-2268.876=-0.008
σ0.010-0.005=0.005
min2268.854-2268.871=-0.017
max2268.877-2268.883=-0.006
mean2837.000-2660.000=177.000
σ0.000
min2837.000-2660.000=177.000
max2837.000-2660.000=177.000
mean3.059-2.895=0.164
σ0.168-0.130=0.039
min2.870-2.736=0.134
max3.201-3.092=0.109
iters=5
new-facts=6402
prior-facts=1
mean4952.221-4952.217=0.004
σ0.745-0.838=-0.093
min4951.847-4951.777=0.070
max4953.552-4953.714=-0.162
mean2837.000-2660.000=177.000
σ0.000
min2837.000-2660.000=177.000
max2837.000-2660.000=177.000
mean7.764-7.961=-0.197
σ0.137-0.247=-0.110
min7.613-7.752=-0.139
max7.918-8.349=-0.431
iters=5
new-facts=6402
prior-facts=6402
mean5166.917-5166.920=-0.002
σ0.008-0.010=-0.002
min5166.906-5166.913=-0.006
max5166.929-5166.938=-0.009
mean3331.400-3353.400=-22.000
σ392.164-447.775=-55.611
min2837.000-2768.000=69.000
max3871.000-3949.000=-78.000
mean9.254-9.430=-0.176
σ0.195-0.233=-0.038
min9.021-9.041=-0.021
max9.457-9.638=-0.181

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.126-1.005=0.121
σ0.277-0.125=0.151
min0.939-0.946=-0.006
max1.558-1.229=0.329

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.260-460.260=-0.001
σ572.608-572.607=0.001
min173.956-173.956=-0.000
max1319.171-1319.171=0.001
mean79.500
σ7.000
min76.000
max90.000
mean435.000-438.000=-3.000
σ0.000
min435.000-438.000=-3.000
max435.000-438.000=-3.000
mean0.558-0.551=0.007
σ0.565-0.551=0.014
min0.271-0.269=0.001
max1.405-1.377=0.028
policies=20
mean1740.061-1740.036=0.025
σ0.336-0.331=0.005
min1739.816-1739.810=0.006
max1740.553-1740.523=0.030
mean760.000
σ0.000
min760.000
max760.000
mean446.250-447.250=-1.000
σ10.308-9.032=1.275
min435.000-438.000=-3.000
max455.000
mean2.660-2.660=0.000
σ0.024-0.016=0.008
min2.631-2.648=-0.017
max2.680-2.683=-0.003
policies=200
mean17409.865-17409.804=0.062
σ0.097-0.155=-0.058
min17409.741-17409.642=0.099
max17409.975-17409.954=0.021
mean7600.000
σ0.000
min7600.000
max7600.000
mean489.500-491.250=-1.750
σ2.646-2.754=-0.108
min487.000-488.000=-1.000
max493.000-494.000=-1.000
mean26.925-26.977=-0.052
σ0.076-0.143=-0.067
min26.842-26.858=-0.016
max27.019-27.145=-0.127