Compare commits

Home / Compare 1ccba77d .. bf0f2a9a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.979=-0.001
σ0.049-0.050=-0.001
min33.945-33.946=-0.000
max34.115-34.119=-0.004
mean415.000
σ0.000
min415.000
max415.000
mean0.082-0.084=-0.003
σ0.004-0.004=0.001
min0.075-0.082=-0.006
max0.087-0.091=-0.004
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=0.000
σ0.004-0.003=0.001
min23.311-23.311=-0.001
max23.322-23.322=0.000
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.064-0.065=-0.001
σ0.004-0.003=0.001
min0.059-0.064=-0.005
max0.072-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.303-1757.304=-0.001
σ0.364-0.365=-0.001
min1756.729-1756.727=0.001
max1757.890-1757.896=-0.006
mean1665.850-1659.800=6.050
σ626.958-621.192=5.767
min672.000-670.000=2.000
max2612.000-2592.000=20.000
mean2.345-2.319=0.025
σ0.137-0.114=0.023
min2.127-2.213=-0.085
max2.746-2.732=0.014

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.439-326.447=-0.008
σ0.058-0.055=0.003
min326.335-326.350=-0.014
max326.480-326.486=-0.006
mean2612.000-2592.000=20.000
σ0.000
min2612.000-2592.000=20.000
max2612.000-2592.000=20.000
mean0.424-0.435=-0.011
σ0.006-0.012=-0.006
min0.420-0.423=-0.003
max0.435-0.447=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1988.597-1988.613=-0.017
σ0.003-0.009=-0.006
min1988.594-1988.598=-0.005
max1988.601-1988.620=-0.019
mean2612.000-2592.000=20.000
σ0.000
min2612.000-2592.000=20.000
max2612.000-2592.000=20.000
mean2.735-2.717=0.019
σ0.121-0.089=0.032
min2.635-2.634=0.001
max2.931-2.815=0.116
iters=5
new-facts=6402
prior-facts=1
mean4813.332-4813.471=-0.139
σ7.778-7.710=0.069
min4809.455-4809.986=-0.532
max4827.240-4827.262=-0.022
mean2612.000-2592.000=20.000
σ0.000
min2612.000-2592.000=20.000
max2612.000-2592.000=20.000
mean8.977-9.068=-0.091
σ0.359-0.311=0.048
min8.364-8.625=-0.261
max9.242-9.472=-0.230
iters=5
new-facts=6402
prior-facts=6402
mean5001.010-5001.008=0.002
σ0.022-0.023=-0.001
min5000.986-5000.983=0.003
max5001.029-5001.035=-0.006
mean3015.800-2966.600=49.200
σ305.686-260.052=45.633
min2612.000-2632.000=-20.000
max3410.000-3305.000=105.000
mean9.781-9.474=0.307
σ0.156-0.315=-0.159
min9.599-9.170=0.429
max9.992-9.939=0.053

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.255-1.269=-0.015
σ0.395-0.373=0.022
min0.924-0.921=0.003
max1.769-1.837=-0.067

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.440-464.436=0.004
σ574.793-574.790=0.003
min177.039-177.035=0.004
max1326.629-1326.621=0.007
mean88.250
σ8.500
min84.000
max101.000
mean2612.000-2592.000=20.000
σ0.000
min2612.000-2592.000=20.000
max2612.000-2592.000=20.000
mean0.544-0.557=-0.013
σ0.535-0.568=-0.034
min0.272-0.269=0.004
max1.346-1.409=-0.063
policies=20
mean1770.765-1770.731=0.034
σ0.378-0.351=0.026
min1770.513-1770.493=0.020
max1771.326-1771.253=0.073
mean840.000
σ0.000
min840.000
max840.000
mean2612.000-2592.000=20.000
σ0.000
min2612.000-2592.000=20.000
max2612.000-2592.000=20.000
mean2.762-2.718=0.044
σ0.019-0.012=0.008
min2.744-2.707=0.038
max2.787-2.735=0.052
policies=200
mean17714.919-17714.862=0.057
σ0.473-0.532=-0.059
min17714.627-17714.484=0.142
max17715.624-17715.650=-0.026
mean8400.000
σ0.000
min8400.000
max8400.000
mean2612.000-2592.000=20.000
σ0.000
min2612.000-2592.000=20.000
max2612.000-2592.000=20.000
mean27.404-27.446=-0.041
σ0.098-0.122=-0.024
min27.287-27.293=-0.006
max27.509-27.569=-0.060