Compare commits

Home / Compare 2ed05cb5 .. a959c44a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-35.789=-5.020
σ0.051-0.106=-0.055
min30.741-35.734=-4.993
max30.912-36.089=-5.177
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.077-0.077=0.000
σ0.003-0.004=-0.001
min0.072-0.074=-0.002
max0.085-0.083=0.002
cache=y
dps=1
iters=10
policies=100
mean21.061-26.064=-5.003
σ0.003-0.002=0.001
min21.055-26.060=-5.005
max21.066-26.068=-5.002
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.063-0.060=0.003
σ0.003-0.004=-0.001
min0.059-0.056=0.003
max0.070-0.070=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.234-1751.238=-0.004
σ0.363-0.362=0.001
min1750.667-1750.672=-0.005
max1751.819-1751.818=0.001
mean1661.000-1638.550=22.450
σ622.741-616.315=6.426
min640.000-630.000=10.000
max2508.000-2476.000=32.000
mean2.823-2.828=-0.005
σ0.102-0.122=-0.020
min2.537-2.369=0.168
max3.004-2.969=0.035

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.569-275.566=0.003
σ0.007-0.007=-0.000
min275.561-275.557=0.004
max275.577-275.573=0.004
mean2508.000-2476.000=32.000
σ0.000
min2508.000-2476.000=32.000
max2508.000-2476.000=32.000
mean0.402-0.392=0.009
σ0.008-0.009=-0.001
min0.397-0.385=0.012
max0.415-0.404=0.012
iters=5
new-facts=1
prior-facts=6402
mean2168.098-2168.101=-0.003
σ0.007-0.006=0.001
min2168.091-2168.094=-0.003
max2168.109-2168.109=-0.000
mean2508.000-2476.000=32.000
σ0.000
min2508.000-2476.000=32.000
max2508.000-2476.000=32.000
mean2.973-3.014=-0.040
σ0.170-0.176=-0.006
min2.774-2.777=-0.002
max3.171-3.169=0.001
iters=5
new-facts=6402
prior-facts=1
mean5047.581-5047.675=-0.094
σ1.235-0.366=0.869
min5046.155-5047.384=-1.229
max5049.521-5048.308=1.213
mean2508.000-2476.000=32.000
σ0.000
min2508.000-2476.000=32.000
max2508.000-2476.000=32.000
mean8.681-8.856=-0.175
σ0.488-0.513=-0.025
min8.101-8.098=0.003
max9.265-9.439=-0.174
iters=5
new-facts=6402
prior-facts=6402
mean5178.969-5179.047=-0.078
σ0.122-0.080=0.041
min5178.787-5178.966=-0.180
max5179.129-5179.134=-0.005
mean3217.000-3214.000=3.000
σ389.078-390.184=-1.106
min2681.000-2677.000=4.000
max3703.000-3701.000=2.000
mean9.750-9.932=-0.183
σ0.172-0.118=0.054
min9.595-9.793=-0.198
max9.958-10.092=-0.134

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.674-1.744=-0.071
σ0.128-0.184=-0.056
min1.451-1.524=-0.074
max1.763-1.983=-0.220

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.199-463.200=-0.001
σ572.653-572.646=0.007
min176.870-176.874=-0.004
max1322.179-1322.169=0.010
mean77.500
σ7.000
min74.000
max88.000
mean2508.000-2476.000=32.000
σ0.000
min2508.000-2476.000=32.000
max2508.000-2476.000=32.000
mean0.550-0.544=0.006
σ0.552-0.537=0.016
min0.269-0.274=-0.005
max1.378-1.349=0.029
policies=20
mean1768.971-1768.976=-0.005
σ0.332-0.330=0.002
min1768.762-1768.780=-0.018
max1769.465-1769.468=-0.003
mean740.000
σ0.000
min740.000
max740.000
mean2508.000-2476.000=32.000
σ0.000
min2508.000-2476.000=32.000
max2508.000-2476.000=32.000
mean2.737-2.728=0.009
σ0.030-0.028=0.002
min2.706-2.709=-0.003
max2.772-2.769=0.004
policies=200
mean17696.230-17696.236=-0.006
σ0.489-0.519=-0.030
min17695.962-17695.967=-0.005
max17696.962-17697.014=-0.052
mean7400.000
σ0.000
min7400.000
max7400.000
mean2508.000-2476.000=32.000
σ0.000
min2508.000-2476.000=32.000
max2508.000-2476.000=32.000
mean27.521-27.509=0.013
σ0.140-0.089=0.052
min27.434-27.452=-0.018
max27.730-27.640=0.090