Compare commits

Home / Compare 41e4a001 .. 67c9cc57

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.956-35.958=-0.001
σ0.101-0.103=-0.002
min35.909-35.913=-0.003
max36.241-36.249=-0.008
mean413.900-414.000=-0.100
σ0.316-0.000=0.316
min413.000-414.000=-1.000
max414.000
mean0.077-0.078=-0.001
σ0.003-0.004=-0.001
min0.075-0.075=-0.000
max0.084-0.084=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.203-26.203=-0.001
σ0.005-0.004=0.001
min26.195-26.198=-0.002
max26.209-26.210=-0.002
mean414.000
σ0.000
min414.000
max414.000
mean0.058-0.060=-0.002
σ0.003-0.003=-0.001
min0.057-0.058=-0.001
max0.065-0.068=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.303-1756.305=-0.002
σ0.367-0.368=-0.001
min1755.728-1755.730=-0.002
max1756.897-1756.900=-0.004
mean1658.500-1647.050=11.450
σ632.270-634.687=-2.417
min612.000-609.000=3.000
max2728.000-2596.000=132.000
mean2.370-2.376=-0.006
σ0.131-0.182=-0.051
min2.222-2.071=0.151
max2.783-2.969=-0.186

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.827-278.824=0.004
σ0.004-0.007=-0.003
min278.820-278.812=0.009
max278.830-278.831=-0.000
mean2728.000-2596.000=132.000
σ0.000
min2728.000-2596.000=132.000
max2728.000-2596.000=132.000
mean0.413-0.414=-0.001
σ0.006-0.010=-0.004
min0.407-0.405=0.001
max0.421-0.429=-0.008
iters=5
new-facts=1
prior-facts=6402
mean2268.889-2268.878=0.011
σ0.011-0.012=-0.001
min2268.877-2268.857=0.020
max2268.904-2268.886=0.018
mean2728.000-2596.000=132.000
σ0.000
min2728.000-2596.000=132.000
max2728.000-2596.000=132.000
mean3.105-2.932=0.174
σ0.131-0.049=0.082
min2.926-2.889=0.037
max3.274-3.013=0.261
iters=5
new-facts=6402
prior-facts=1
mean4954.306-4954.289=0.017
σ0.943-0.936=0.007
min4953.665-4953.706=-0.041
max4955.972-4955.952=0.021
mean2728.000-2596.000=132.000
σ0.000
min2728.000-2596.000=132.000
max2728.000-2596.000=132.000
mean7.980-7.982=-0.003
σ0.412-0.367=0.045
min7.707-7.649=0.058
max8.707-8.581=0.126
iters=5
new-facts=6402
prior-facts=6402
mean5168.827-5168.759=0.068
σ0.086-0.221=-0.135
min5168.731-5168.386=0.345
max5168.892-5168.908=-0.015
mean3366.800-3404.000=-37.200
σ410.074-445.308=-35.234
min2967.000-2806.000=161.000
max3786.000-3974.000=-188.000
mean9.306-9.356=-0.050
σ0.185-0.541=-0.356
min9.064-8.801=0.263
max9.505-10.007=-0.502

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.005-1.325=-0.321
σ0.063-0.456=-0.393
min0.952-0.943=0.009
max1.077-1.875=-0.798

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean459.816-459.814=0.003
σ571.590-571.591=-0.000
min174.017-174.014=0.002
max1317.202-1317.199=0.002
mean79.500
σ7.000
min76.000
max90.000
mean2728.000-2596.000=132.000
σ0.000
min2728.000-2596.000=132.000
max2728.000-2596.000=132.000
mean0.548-0.533=0.015
σ0.560-0.534=0.025
min0.266-0.264=0.002
max1.388-1.334=0.053
policies=20
mean1740.429-1740.426=0.003
σ0.318-0.323=-0.005
min1740.228-1740.215=0.013
max1740.904-1740.907=-0.004
mean760.000
σ0.000
min760.000
max760.000
mean2728.000-2596.000=132.000
σ0.000
min2728.000-2596.000=132.000
max2728.000-2596.000=132.000
mean2.680-2.677=0.003
σ0.013-0.018=-0.004
min2.666-2.656=0.011
max2.692-2.699=-0.007
policies=200
mean17411.279-17411.282=-0.003
σ0.469-0.475=-0.006
min17411.004-17411.037=-0.032
max17411.981-17411.995=-0.014
mean7600.000
σ0.000
min7600.000
max7600.000
mean2728.000-2596.000=132.000
σ0.000
min2728.000-2596.000=132.000
max2728.000-2596.000=132.000
mean27.041-26.927=0.114
σ0.047-0.080=-0.032
min26.988-26.856=0.131
max27.099-27.041=0.058