Compare commits

Home / Compare 39e2586c .. ef31cf57

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.986-33.988=-0.002
σ0.054-0.054=0.000
min33.954-33.959=-0.005
max34.138-34.140=-0.002
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.082-0.085=-0.003
σ0.004-0.004=0.000
min0.076-0.082=-0.005
max0.088-0.091=-0.003
cache=y
dps=1
iters=10
policies=100
mean23.324-23.324=-0.000
σ0.003-0.002=0.000
min23.319-23.321=-0.002
max23.328-23.327=0.001
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.061-0.065=-0.004
σ0.004-0.003=0.001
min0.059-0.061=-0.003
max0.069-0.072=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.725-1756.726=-0.000
σ0.366-0.364=0.002
min1756.151-1756.162=-0.011
max1757.317-1757.306=0.011
mean1675.900-1642.600=33.300
σ634.669-623.316=11.352
min671.000-625.000=46.000
max2690.000-2691.000=-1.000
mean2.357-2.411=-0.054
σ0.100-0.174=-0.074
min2.244-2.270=-0.026
max2.638-2.949=-0.311

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean325.314-325.322=-0.008
σ0.052-0.039=0.013
min325.221-325.253=-0.032
max325.341-325.349=-0.009
mean2690.000-2691.000=-1.000
σ0.000
min2690.000-2691.000=-1.000
max2690.000-2691.000=-1.000
mean0.427-0.428=-0.001
σ0.001-0.004=-0.003
min0.426-0.425=0.001
max0.429-0.433=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1985.878-1985.846=0.032
σ0.013-0.071=-0.057
min1985.854-1985.721=0.134
max1985.885-1985.891=-0.005
mean2690.000-2691.000=-1.000
σ0.000
min2690.000-2691.000=-1.000
max2690.000-2691.000=-1.000
mean2.721-2.737=-0.016
σ0.096-0.146=-0.050
min2.602-2.560=0.041
max2.848-2.944=-0.095
iters=5
new-facts=6402
prior-facts=1
mean4809.634-4809.638=-0.004
σ7.713-7.672=0.041
min4806.170-4806.177=-0.008
max4823.431-4823.361=0.069
mean2690.000-2691.000=-1.000
σ0.000
min2690.000-2691.000=-1.000
max2690.000-2691.000=-1.000
mean8.951-8.736=0.215
σ0.164-0.187=-0.023
min8.677-8.465=0.212
max9.088-8.975=0.112
iters=5
new-facts=6402
prior-facts=6402
mean4997.115-4817.030=180.085
σ0.172-402.875=-402.703
min4996.810-4096.345=900.465
max4997.213-4997.224=-0.011
mean2964.800-2978.600=-13.800
σ323.851-240.904=82.947
min2690.000-2691.000=-1.000
max3443.000-3317.000=126.000
mean8.525-8.794=-0.269
σ0.073-0.964=-0.891
min8.443-7.287=1.156
max8.625-9.637=-1.013

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.014-1.086=-0.072
σ0.145-0.080=0.065
min0.917-1.040=-0.123
max1.254-1.227=0.028

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.372-463.374=-0.002
σ574.777-574.779=-0.002
min175.977-175.983=-0.006
max1325.538-1325.543=-0.006
mean86.250
σ8.500
min82.000
max99.000
mean2690.000-2691.000=-1.000
σ0.000
min2690.000-2691.000=-1.000
max2690.000-2691.000=-1.000
mean0.551-0.546=0.005
σ0.550-0.546=0.004
min0.272-0.269=0.003
max1.376-1.365=0.010
policies=20
mean1760.132-1760.130=0.003
σ0.350-0.339=0.011
min1759.900-1759.904=-0.005
max1760.652-1760.633=0.019
mean820.000
σ0.000
min820.000
max820.000
mean2690.000-2691.000=-1.000
σ0.000
min2690.000-2691.000=-1.000
max2690.000-2691.000=-1.000
mean2.721-2.726=-0.005
σ0.035-0.016=0.019
min2.695-2.710=-0.014
max2.773-2.747=0.026
policies=200
mean17608.406-17608.300=0.106
σ0.510-0.442=0.068
min17608.103-17608.017=0.086
max17609.169-17608.958=0.212
mean8200.000
σ0.000
min8200.000
max8200.000
mean2690.000-2691.000=-1.000
σ0.000
min2690.000-2691.000=-1.000
max2690.000-2691.000=-1.000
mean27.562-27.453=0.109
σ0.179-0.084=0.095
min27.378-27.365=0.013
max27.791-27.550=0.241