Compare commits

Home / Compare a2854df8 .. c2e467f1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.981=-0.002
σ0.049-0.049=-0.001
min33.952-33.952=0.001
max34.114-34.117=-0.003
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.085-0.087=-0.002
σ0.004-0.004=-0.000
min0.082-0.084=-0.002
max0.090-0.095=-0.005
cache=y
dps=1
iters=10
policies=100
mean23.316-23.318=-0.002
σ0.003-0.002=0.001
min23.314-23.315=-0.002
max23.321-23.322=-0.000
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.063-0.066=-0.003
σ0.003-0.002=0.001
min0.059-0.064=-0.005
max0.069-0.072=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.494-1757.492=0.002
σ0.365-0.365=0.000
min1756.920-1756.921=-0.000
max1758.085-1758.084=0.001
mean1658.050-1647.600=10.450
σ618.163-633.346=-15.183
min666.000-632.000=34.000
max2586.000-2855.000=-269.000
mean2.364-2.393=-0.029
σ0.125-0.099=0.025
min2.151-2.256=-0.105
max2.743-2.639=0.104

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.645-326.637=0.008
σ0.029-0.049=-0.020
min326.594-326.553=0.041
max326.666-326.675=-0.009
mean2586.000-2855.000=-269.000
σ0.000
min2586.000-2855.000=-269.000
max2586.000-2855.000=-269.000
mean0.422-0.430=-0.009
σ0.001-0.005=-0.005
min0.421-0.425=-0.004
max0.423-0.437=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1988.799-1988.793=0.006
σ0.013-0.024=-0.011
min1988.783-1988.773=0.009
max1988.814-1988.820=-0.005
mean2586.000-2855.000=-269.000
σ0.000
min2586.000-2855.000=-269.000
max2586.000-2855.000=-269.000
mean2.713-2.712=0.001
σ0.146-0.169=-0.023
min2.594-2.584=0.009
max2.956-3.003=-0.047
iters=5
new-facts=6402
prior-facts=1
mean4813.221-4813.554=-0.333
σ7.962-7.825=0.138
min4809.014-4809.707=-0.693
max4827.435-4827.546=-0.111
mean2586.000-2855.000=-269.000
σ0.000
min2586.000-2855.000=-269.000
max2586.000-2855.000=-269.000
mean8.703-8.934=-0.231
σ0.563-0.532=0.031
min7.736-8.168=-0.432
max9.081-9.503=-0.422
iters=5
new-facts=6402
prior-facts=6402
mean5001.202-5001.130=0.072
σ0.020-0.163=-0.143
min5001.182-5000.841=0.341
max5001.228-5001.235=-0.007
mean2957.200-3015.200=-58.000
σ281.132-183.130=98.002
min2586.000-2855.000=-269.000
max3326.000-3302.000=24.000
mean9.771-9.604=0.167
σ0.069-0.555=-0.486
min9.681-8.755=0.927
max9.868-10.264=-0.397

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.274-1.043=0.232
σ0.373-0.129=0.244
min0.936-0.923=0.013
max1.783-1.238=0.545

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.629-464.638=-0.009
σ574.776-574.770=0.006
min177.236-177.243=-0.006
max1326.793-1326.794=-0.001
mean88.250
σ8.500
min84.000
max101.000
mean2586.000-2855.000=-269.000
σ0.000
min2586.000-2855.000=-269.000
max2586.000-2855.000=-269.000
mean0.551-0.437=0.114
σ0.557-0.310=0.247
min0.271-0.279=-0.008
max1.386-0.902=0.484
policies=20
mean1772.682-1772.715=-0.033
σ0.362-0.366=-0.004
min1772.441-1772.464=-0.023
max1773.219-1773.258=-0.039
mean840.000
σ0.000
min840.000
max840.000
mean2586.000-2855.000=-269.000
σ0.000
min2586.000-2855.000=-269.000
max2586.000-2855.000=-269.000
mean2.732-2.791=-0.059
σ0.018-0.013=0.004
min2.711-2.777=-0.066
max2.754-2.808=-0.054
policies=200
mean17734.064-17733.970=0.094
σ0.521-0.493=0.028
min17733.784-17733.512=0.272
max17734.846-17734.663=0.183
mean8400.000
σ0.000
min8400.000
max8400.000
mean2586.000-2855.000=-269.000
σ0.000
min2586.000-2855.000=-269.000
max2586.000-2855.000=-269.000
mean27.553-27.921=-0.368
σ0.151-0.507=-0.355
min27.387-27.306=0.081
max27.750-28.501=-0.751