Compare commits

Home / Compare 4f9d117a .. b4dca2ea

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.979=0.000
σ0.050-0.048=0.001
min33.951-33.952=-0.001
max34.116-34.112=0.004
mean411.000-415.000=-4.000
σ0.000
min411.000-415.000=-4.000
max411.000-415.000=-4.000
mean0.083-0.082=0.001
σ0.003-0.004=-0.001
min0.077-0.077=-0.000
max0.090-0.089=0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.316=0.000
σ0.002-0.003=-0.001
min23.313-23.312=0.000
max23.321-23.320=0.001
mean411.000-415.000=-4.000
σ0.000
min411.000-415.000=-4.000
max411.000-415.000=-4.000
mean0.063-0.062=0.001
σ0.004-0.004=-0.000
min0.060-0.059=0.001
max0.070-0.070=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.430-1757.430=-0.001
σ0.365-0.365=0.000
min1756.855-1756.855=0.000
max1758.018-1758.020=-0.002
mean1661.900-1665.100=-3.200
σ627.530-621.694=5.836
min667.000-672.000=-5.000
max2610.000-2591.000=19.000
mean2.370-2.352=0.018
σ0.112-0.122=-0.010
min2.264-2.189=0.074
max2.687-2.703=-0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.578-326.575=0.002
σ0.034-0.045=-0.010
min326.518-326.497=0.022
max326.608-326.610=-0.002
mean2610.000-2591.000=19.000
σ0.000
min2610.000-2591.000=19.000
max2610.000-2591.000=19.000
mean0.424-0.426=-0.003
σ0.003-0.005=-0.002
min0.422-0.423=-0.001
max0.430-0.435=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1988.736-1988.744=-0.008
σ0.015-0.005=0.010
min1988.717-1988.735=-0.018
max1988.752-1988.750=0.002
mean2610.000-2591.000=19.000
σ0.000
min2610.000-2591.000=19.000
max2610.000-2591.000=19.000
mean2.676-2.730=-0.054
σ0.124-0.110=0.013
min2.483-2.633=-0.149
max2.798-2.917=-0.119
iters=5
new-facts=6402
prior-facts=1
mean4813.575-4813.633=-0.058
σ7.743-7.707=0.037
min4810.039-4810.059=-0.020
max4827.427-4827.418=0.009
mean2610.000-2591.000=19.000
σ0.000
min2610.000-2591.000=19.000
max2610.000-2591.000=19.000
mean8.824-8.809=0.015
σ0.264-0.761=-0.497
min8.598-7.790=0.808
max9.222-9.812=-0.590
iters=5
new-facts=6402
prior-facts=6402
mean5001.073-5001.135=-0.062
σ0.170-0.024=0.146
min5000.769-5001.102=-0.332
max5001.157-5001.162=-0.004
mean2995.200-3002.000=-6.800
σ277.609-260.426=17.183
min2610.000-2616.000=-6.000
max3305.000-3311.000=-6.000
mean9.840-9.516=0.324
σ0.321-0.272=0.049
min9.482-9.052=0.430
max10.335-9.767=0.568

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.213-1.314=-0.101
σ0.335-0.335=0.001
min0.923-0.921=0.003
max1.632-1.732=-0.100

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.568-464.561=0.007
σ574.781-574.771=0.009
min177.172-177.169=0.003
max1326.739-1326.718=0.021
mean88.250
σ8.500
min84.000
max101.000
mean2610.000-2591.000=19.000
σ0.000
min2610.000-2591.000=19.000
max2610.000-2591.000=19.000
mean0.546-0.540=0.006
σ0.546-0.531=0.015
min0.271-0.270=0.001
max1.365-1.336=0.028
policies=20
mean1772.041-1772.030=0.011
σ0.358-0.340=0.018
min1771.804-1771.798=0.006
max1772.573-1772.534=0.039
mean840.000
σ0.000
min840.000
max840.000
mean2610.000-2591.000=19.000
σ0.000
min2610.000-2591.000=19.000
max2610.000-2591.000=19.000
mean2.728-2.698=0.029
σ0.034-0.049=-0.015
min2.693-2.626=0.067
max2.765-2.733=0.032
policies=200
mean17727.481-17727.412=0.069
σ0.602-0.628=-0.026
min17727.123-17727.003=0.121
max17728.379-17728.348=0.031
mean8400.000
σ0.000
min8400.000
max8400.000
mean2610.000-2591.000=19.000
σ0.000
min2610.000-2591.000=19.000
max2610.000-2591.000=19.000
mean27.503-27.554=-0.051
σ0.087-0.103=-0.016
min27.408-27.445=-0.037
max27.618-27.694=-0.075