Compare commits

Home / Compare 29241d19 .. 2d5ea204

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.978=0.001
σ0.050-0.051=-0.001
min33.946-33.941=0.005
max34.119-34.120=-0.001
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.084-0.082=0.003
σ0.004-0.005=-0.001
min0.082-0.076=0.005
max0.091-0.090=0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.001
σ0.003-0.003=-0.001
min23.311-23.314=-0.002
max23.322-23.326=-0.003
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.065-0.065=0.000
σ0.003-0.003=0.000
min0.064-0.063=0.001
max0.072-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.304-1757.303=0.001
σ0.365-0.365=0.000
min1756.727-1756.731=-0.004
max1757.896-1757.891=0.005
mean1659.800-1666.600=-6.800
σ621.192-627.958=-6.766
min670.000-672.000=-2.000
max2592.000-2615.000=-23.000
mean2.319-2.369=-0.050
σ0.114-0.072=0.042
min2.213-2.287=-0.075
max2.732-2.566=0.166

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.447-326.454=-0.007
σ0.055-0.027=0.028
min326.350-326.406=-0.057
max326.486-326.471=0.014
mean2592.000-2615.000=-23.000
σ0.000
min2592.000-2615.000=-23.000
max2592.000-2615.000=-23.000
mean0.435-0.422=0.013
σ0.012-0.001=0.011
min0.423-0.421=0.002
max0.447-0.424=0.023
iters=5
new-facts=1
prior-facts=6402
mean1988.613-1988.616=-0.002
σ0.009-0.012=-0.003
min1988.598-1988.598=0.000
max1988.620-1988.630=-0.010
mean2592.000-2615.000=-23.000
σ0.000
min2592.000-2615.000=-23.000
max2592.000-2615.000=-23.000
mean2.717-2.717=-0.000
σ0.089-0.106=-0.017
min2.634-2.640=-0.007
max2.815-2.889=-0.074
iters=5
new-facts=6402
prior-facts=1
mean4813.471-4813.328=0.143
σ7.710-7.758=-0.049
min4809.986-4809.407=0.580
max4827.262-4827.198=0.064
mean2592.000-2615.000=-23.000
σ0.000
min2592.000-2615.000=-23.000
max2592.000-2615.000=-23.000
mean9.068-8.669=0.399
σ0.311-0.332=-0.021
min8.625-8.188=0.437
max9.472-9.123=0.349
iters=5
new-facts=6402
prior-facts=6402
mean5001.008-5001.010=-0.002
σ0.023-0.023=0.000
min5000.983-5000.983=-0.000
max5001.035-5001.033=0.002
mean2966.600-3010.000=-43.400
σ260.052-293.102=-33.049
min2632.000-2615.000=17.000
max3305.000-3386.000=-81.000
mean9.474-9.769=-0.294
σ0.315-0.152=0.162
min9.170-9.584=-0.414
max9.939-10.004=-0.065

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.269-1.132=0.138
σ0.373-0.292=0.081
min0.921-0.918=0.003
max1.837-1.552=0.284

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.436-464.442=-0.005
σ574.790-574.784=0.006
min177.035-177.040=-0.005
max1326.621-1326.618=0.004
mean88.250
σ8.500
min84.000
max101.000
mean2592.000-2615.000=-23.000
σ0.000
min2592.000-2615.000=-23.000
max2592.000-2615.000=-23.000
mean0.557-0.548=0.009
σ0.568-0.546=0.022
min0.269-0.271=-0.003
max1.409-1.368=0.042
policies=20
mean1770.731-1770.762=-0.031
σ0.351-0.358=-0.007
min1770.493-1770.522=-0.030
max1771.253-1771.294=-0.041
mean840.000
σ0.000
min840.000
max840.000
mean2592.000-2615.000=-23.000
σ0.000
min2592.000-2615.000=-23.000
max2592.000-2615.000=-23.000
mean2.718-2.737=-0.019
σ0.012-0.025=-0.014
min2.707-2.711=-0.005
max2.735-2.768=-0.034
policies=200
mean17714.862-17714.912=-0.050
σ0.532-0.474=0.058
min17714.484-17714.657=-0.173
max17715.650-17715.622=0.028
mean8400.000
σ0.000
min8400.000
max8400.000
mean2592.000-2615.000=-23.000
σ0.000
min2592.000-2615.000=-23.000
max2592.000-2615.000=-23.000
mean27.446-27.511=-0.065
σ0.122-0.082=0.039
min27.293-27.424=-0.132
max27.569-27.611=-0.042