Compare commits

Home / Compare a959c44a .. 21b6ec8b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-30.769=0.000
σ0.050-0.051=-0.001
min30.745-30.741=0.003
max30.911-30.912=-0.001
mean412.000
σ0.000
min412.000
max412.000
mean0.071-0.077=-0.006
σ0.002-0.003=-0.001
min0.069-0.072=-0.003
max0.078-0.085=-0.007
cache=y
dps=1
iters=10
policies=100
mean21.060-21.061=-0.001
σ0.002-0.003=-0.001
min21.056-21.055=0.001
max21.065-21.066=-0.001
mean412.000
σ0.000
min412.000
max412.000
mean0.059-0.063=-0.004
σ0.003-0.003=0.001
min0.057-0.059=-0.002
max0.067-0.070=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.235-1751.234=0.001
σ0.361-0.363=-0.002
min1750.665-1750.667=-0.002
max1751.822-1751.819=0.003
mean1635.850-1661.000=-25.150
σ614.917-622.741=-7.824
min625.000-640.000=-15.000
max2468.000-2508.000=-40.000
mean2.817-2.823=-0.006
σ0.132-0.102=0.031
min2.472-2.537=-0.065
max3.004-3.004=-0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.568-275.569=-0.001
σ0.009-0.007=0.002
min275.559-275.561=-0.002
max275.578-275.577=0.001
mean2468.000-2508.000=-40.000
σ0.000
min2468.000-2508.000=-40.000
max2468.000-2508.000=-40.000
mean0.404-0.402=0.003
σ0.010-0.008=0.002
min0.395-0.397=-0.001
max0.415-0.415=-0.000
iters=5
new-facts=1
prior-facts=6402
mean2168.102-2168.098=0.003
σ0.004-0.007=-0.004
min2168.097-2168.091=0.006
max2168.105-2168.109=-0.004
mean2468.000-2508.000=-40.000
σ0.000
min2468.000-2508.000=-40.000
max2468.000-2508.000=-40.000
mean3.002-2.973=0.029
σ0.222-0.170=0.051
min2.688-2.774=-0.087
max3.215-3.171=0.045
iters=5
new-facts=6402
prior-facts=1
mean5047.788-5047.581=0.208
σ0.976-1.235=-0.259
min5047.059-5046.155=0.904
max5049.486-5049.521=-0.035
mean2468.000-2508.000=-40.000
σ0.000
min2468.000-2508.000=-40.000
max2468.000-2508.000=-40.000
mean8.890-8.681=0.209
σ0.486-0.488=-0.003
min8.128-8.101=0.028
max9.352-9.265=0.087
iters=5
new-facts=6402
prior-facts=6402
mean5178.971-5178.969=0.003
σ0.215-0.122=0.093
min5178.619-5178.787=-0.167
max5179.155-5179.129=0.026
mean3220.600-3217.000=3.600
σ386.759-389.078=-2.319
min2681.000
max3708.000-3703.000=5.000
mean9.575-9.750=-0.175
σ0.427-0.172=0.255
min8.951-9.595=-0.643
max10.150-9.958=0.192

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.715-1.674=0.041
σ0.118-0.128=-0.010
min1.527-1.451=0.076
max1.848-1.763=0.085

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.199-463.199=-0.000
σ572.654-572.653=0.000
min176.867-176.870=-0.003
max1322.179-1322.179=0.000
mean77.500
σ7.000
min74.000
max88.000
mean2468.000-2508.000=-40.000
σ0.000
min2468.000-2508.000=-40.000
max2468.000-2508.000=-40.000
mean0.562-0.550=0.012
σ0.563-0.552=0.011
min0.274-0.269=0.005
max1.407-1.378=0.028
policies=20
mean1768.965-1768.971=-0.006
σ0.332-0.332=0.000
min1768.760-1768.762=-0.003
max1769.460-1769.465=-0.005
mean740.000
σ0.000
min740.000
max740.000
mean2468.000-2508.000=-40.000
σ0.000
min2468.000-2508.000=-40.000
max2468.000-2508.000=-40.000
mean2.732-2.737=-0.004
σ0.019-0.030=-0.011
min2.708-2.706=0.002
max2.754-2.772=-0.018
policies=200
mean17696.275-17696.230=0.046
σ0.532-0.489=0.043
min17696.004-17695.962=0.042
max17697.073-17696.962=0.110
mean7400.000
σ0.000
min7400.000
max7400.000
mean2468.000-2508.000=-40.000
σ0.000
min2468.000-2508.000=-40.000
max2468.000-2508.000=-40.000
mean27.550-27.521=0.028
σ0.203-0.140=0.063
min27.398-27.434=-0.036
max27.847-27.730=0.117