Compare commits

Home / Compare e4c345f8 .. 08611921

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.979=-0.000
σ0.049-0.047=0.002
min33.951-33.950=0.000
max34.114-34.109=0.005
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.082-0.081=0.000
σ0.006-0.004=0.001
min0.077-0.077=-0.000
max0.092-0.090=0.002
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=0.001
σ0.003-0.002=0.001
min23.313-23.314=-0.001
max23.323-23.319=0.003
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.065-0.065=0.001
σ0.002-0.002=-0.000
min0.064-0.061=0.003
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.364-1757.301=0.063
σ0.364-0.364=0.000
min1756.787-1756.729=0.058
max1757.952-1757.893=0.059
mean1654.150-1663.400=-9.250
σ626.539-627.574=-1.035
min678.000-669.000=9.000
max2601.000-2611.000=-10.000
mean2.388-2.358=0.030
σ0.131-0.104=0.027
min2.255-2.236=0.019
max2.717-2.657=0.061

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.504-326.439=0.064
σ0.056-0.054=0.001
min326.405-326.342=0.063
max326.541-326.465=0.076
mean2601.000-2611.000=-10.000
σ0.000
min2601.000-2611.000=-10.000
max2601.000-2611.000=-10.000
mean0.431-0.425=0.006
σ0.004-0.003=0.001
min0.427-0.419=0.007
max0.436-0.427=0.010
iters=5
new-facts=1
prior-facts=6402
mean1988.663-1988.618=0.045
σ0.020-0.004=0.015
min1988.637-1988.615=0.022
max1988.677-1988.625=0.052
mean2601.000-2611.000=-10.000
σ0.000
min2601.000-2611.000=-10.000
max2601.000-2611.000=-10.000
mean2.813-2.660=0.152
σ0.191-0.096=0.095
min2.637-2.515=0.123
max3.039-2.778=0.261
iters=5
new-facts=6402
prior-facts=1
mean4813.441-4813.455=-0.013
σ7.435-7.717=-0.282
min4810.009-4809.916=0.092
max4826.740-4827.258=-0.518
mean2601.000-2611.000=-10.000
σ0.000
min2601.000-2611.000=-10.000
max2601.000-2611.000=-10.000
mean8.238-8.817=-0.579
σ0.465-0.363=0.102
min7.799-8.394=-0.595
max8.892-9.205=-0.313
iters=5
new-facts=6402
prior-facts=6402
mean5001.076-5000.939=0.137
σ0.020-0.170=-0.150
min5001.051-5000.635=0.417
max5001.098-5001.024=0.073
mean2948.200-2967.000=-18.800
σ366.153-266.278=99.875
min2601.000-2611.000=-10.000
max3448.000-3299.000=149.000
mean9.906-9.525=0.381
σ0.107-0.431=-0.324
min9.776-8.784=0.992
max10.023-9.870=0.153

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.223-1.225=-0.002
σ0.261-0.374=-0.112
min0.914-0.909=0.005
max1.595-1.767=-0.172

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.503-464.436=0.067
σ574.785-574.794=-0.009
min177.108-177.037=0.071
max1326.680-1326.627=0.053
mean88.250
σ8.500
min84.000
max101.000
mean2601.000-2611.000=-10.000
σ0.000
min2601.000-2611.000=-10.000
max2601.000-2611.000=-10.000
mean0.548-0.568=-0.020
σ0.547-0.591=-0.044
min0.272-0.271=0.001
max1.368-1.454=-0.086
policies=20
mean1771.379-1770.737=0.642
σ0.352-0.367=-0.014
min1771.152-1770.493=0.659
max1771.903-1771.282=0.621
mean840.000
σ0.000
min840.000
max840.000
mean2601.000-2611.000=-10.000
σ0.000
min2601.000-2611.000=-10.000
max2601.000-2611.000=-10.000
mean2.733-2.737=-0.004
σ0.019-0.037=-0.018
min2.707-2.706=0.002
max2.754-2.782=-0.028
policies=200
mean17721.117-17714.794=6.322
σ0.505-0.445=0.060
min17720.781-17714.456=6.324
max17721.868-17715.441=6.427
mean8400.000
σ0.000
min8400.000
max8400.000
mean2601.000-2611.000=-10.000
σ0.000
min2601.000-2611.000=-10.000
max2601.000-2611.000=-10.000
mean27.683-27.523=0.160
σ0.195-0.268=-0.073
min27.501-27.273=0.229
max27.909-27.894=0.015