Compare commits

Home / Compare 96eb5fcf .. 2e355742

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.956-35.957=-0.001
σ0.103-0.102=0.001
min35.915-35.915=0.001
max36.248-36.247=0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.077-0.078=-0.001
σ0.005-0.004=0.000
min0.074-0.075=-0.001
max0.085-0.085=0.001
cache=y
dps=1
iters=10
policies=100
mean26.203-26.204=-0.001
σ0.005-0.004=0.001
min26.194-26.197=-0.004
max26.208-26.209=-0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.059-0.063=-0.004
σ0.003-0.004=-0.000
min0.056-0.060=-0.003
max0.068-0.070=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.304-1718.266=38.038
σ0.368-170.184=-169.816
min1755.729-995.238=760.491
max1756.899-1756.883=0.015
mean1656.650-1616.500=40.150
σ631.303-618.963=12.340
min611.000-618.000=-7.000
max2725.000-2673.000=52.000
mean2.366-2.349=0.017
σ0.093-0.278=-0.185
min2.273-1.361=0.912
max2.590-2.873=-0.283

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.828-278.818=0.010
σ0.004-0.019=-0.015
min278.822-278.785=0.036
max278.830-278.831=-0.001
mean2725.000-2673.000=52.000
σ0.000
min2725.000-2673.000=52.000
max2725.000-2673.000=52.000
mean0.414-0.412=0.002
σ0.009-0.002=0.007
min0.406-0.410=-0.003
max0.427-0.415=0.012
iters=5
new-facts=1
prior-facts=6402
mean2268.882-2268.886=-0.004
σ0.006-0.015=-0.008
min2268.872-2268.875=-0.004
max2268.886-2268.911=-0.025
mean2725.000-2673.000=52.000
σ0.000
min2725.000-2673.000=52.000
max2725.000-2673.000=52.000
mean2.995-3.146=-0.152
σ0.108-0.165=-0.058
min2.888-2.918=-0.031
max3.119-3.365=-0.246
iters=5
new-facts=6402
prior-facts=1
mean4954.281-4954.269=0.012
σ0.838-0.951=-0.113
min4953.803-4953.694=0.108
max4955.775-4955.952=-0.176
mean2725.000-2673.000=52.000
σ0.000
min2725.000-2673.000=52.000
max2725.000-2673.000=52.000
mean7.974-8.117=-0.143
σ0.217-0.347=-0.130
min7.722-7.837=-0.115
max8.267-8.608=-0.341
iters=5
new-facts=6402
prior-facts=6402
mean5168.753-5168.822=-0.069
σ0.224-0.090=0.134
min5168.375-5168.719=-0.345
max5168.911-5168.897=0.014
mean3503.800-3447.400=56.400
σ490.698-477.946=12.752
min2858.000-2890.000=-32.000
max4178.000-4139.000=39.000
mean9.399-9.221=0.178
σ0.236-0.240=-0.004
min9.050-9.015=0.035
max9.655-9.597=0.058

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.095-0.947=0.148
σ0.189-0.010=0.179
min0.943-0.940=0.003
max1.347-0.964=0.383

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean459.822-460.350=-0.528
σ571.585-572.651=-1.066
min174.023-174.015=0.008
max1317.199-1319.326=-2.127
mean79.500
σ7.000
min76.000
max90.000
mean2725.000-2673.000=52.000
σ0.000
min2725.000-2673.000=52.000
max2725.000-2673.000=52.000
mean0.522-0.529=-0.007
σ0.503-0.519=-0.016
min0.269-0.267=0.002
max1.276-1.307=-0.031
policies=20
mean1740.426-1740.423=0.004
σ0.309-0.322=-0.013
min1740.229-1740.227=0.002
max1740.887-1740.904=-0.017
mean760.000
σ0.000
min760.000
max760.000
mean2725.000-2673.000=52.000
σ0.000
min2725.000-2673.000=52.000
max2725.000-2673.000=52.000
mean2.679-2.691=-0.013
σ0.018-0.010=0.009
min2.664-2.680=-0.017
max2.705-2.700=0.004
policies=200
mean17411.283-17411.315=-0.032
σ0.455-0.524=-0.069
min17411.019-17411.028=-0.009
max17411.962-17412.100=-0.139
mean7600.000
σ0.000
min7600.000
max7600.000
mean2725.000-2673.000=52.000
σ0.000
min2725.000-2673.000=52.000
max2725.000-2673.000=52.000
mean27.049-27.017=0.032
σ0.043-0.064=-0.021
min27.018-26.928=0.090
max27.111-27.075=0.036