Compare commits

Home / Compare ec3c8069 .. 080c2b32

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.979=0.001
σ0.051-0.050=0.001
min33.942-33.946=-0.003
max34.121-34.119=0.002
mean420.000-415.000=5.000
σ0.000
min420.000-415.000=5.000
max420.000-415.000=5.000
mean0.085-0.084=0.001
σ0.003-0.004=-0.000
min0.083-0.082=0.001
max0.092-0.091=0.001
cache=y
dps=1
iters=10
policies=100
mean23.318-23.317=0.001
σ0.003-0.003=0.000
min23.315-23.311=0.004
max23.324-23.322=0.002
mean421.000-415.000=6.000
σ0.000
min421.000-415.000=6.000
max421.000-415.000=6.000
mean0.065-0.065=-0.000
σ0.003-0.003=0.000
min0.063-0.064=-0.001
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.301-1757.304=-0.003
σ0.365-0.365=-0.000
min1756.726-1756.727=-0.002
max1757.893-1757.896=-0.002
mean1664.650-1659.800=4.850
σ619.884-621.192=-1.307
min670.000
max2604.000-2592.000=12.000
mean2.358-2.319=0.038
σ0.135-0.114=0.021
min2.231-2.213=0.018
max2.693-2.732=-0.039

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.454-326.447=0.007
σ0.020-0.055=-0.035
min326.420-326.350=0.070
max326.471-326.486=-0.015
mean2604.000-2592.000=12.000
σ0.000
min2604.000-2592.000=12.000
max2604.000-2592.000=12.000
mean0.427-0.435=-0.008
σ0.006-0.012=-0.006
min0.423-0.423=-0.000
max0.435-0.447=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1988.618-1988.613=0.004
σ0.003-0.009=-0.005
min1988.614-1988.598=0.016
max1988.623-1988.620=0.003
mean2604.000-2592.000=12.000
σ0.000
min2604.000-2592.000=12.000
max2604.000-2592.000=12.000
mean2.668-2.717=-0.048
σ0.077-0.089=-0.011
min2.545-2.634=-0.089
max2.748-2.815=-0.067
iters=5
new-facts=6402
prior-facts=1
mean4813.451-4813.471=-0.020
σ7.711-7.710=0.001
min4809.951-4809.986=-0.035
max4827.244-4827.262=-0.018
mean2604.000-2592.000=12.000
σ0.000
min2604.000-2592.000=12.000
max2604.000-2592.000=12.000
mean8.704-9.068=-0.364
σ0.345-0.311=0.034
min8.347-8.625=-0.278
max9.083-9.472=-0.390
iters=5
new-facts=6402
prior-facts=6402
mean5001.006-5001.008=-0.002
σ0.027-0.023=0.004
min5000.973-5000.983=-0.010
max5001.036-5001.035=0.001
mean2997.600-2966.600=31.000
σ261.667-260.052=1.615
min2611.000-2632.000=-21.000
max3308.000-3305.000=3.000
mean9.631-9.474=0.157
σ0.445-0.315=0.130
min8.864-9.170=-0.306
max9.949-9.939=0.010

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.176-1.269=-0.093
σ0.398-0.373=0.024
min0.922-0.921=0.000
max1.843-1.837=0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.433-464.436=-0.003
σ574.780-574.790=-0.010
min177.036-177.035=0.001
max1326.603-1326.621=-0.019
mean88.250
σ8.500
min84.000
max101.000
mean2604.000-2592.000=12.000
σ0.000
min2604.000-2592.000=12.000
max2604.000-2592.000=12.000
mean0.560-0.557=0.003
σ0.576-0.568=0.007
min0.265-0.269=-0.004
max1.424-1.409=0.014
policies=20
mean1770.752-1770.731=0.021
σ0.367-0.351=0.016
min1770.504-1770.493=0.011
max1771.296-1771.253=0.044
mean840.000
σ0.000
min840.000
max840.000
mean2604.000-2592.000=12.000
σ0.000
min2604.000-2592.000=12.000
max2604.000-2592.000=12.000
mean2.730-2.718=0.012
σ0.013-0.012=0.001
min2.717-2.707=0.011
max2.748-2.735=0.014
policies=200
mean17714.967-17714.862=0.105
σ0.501-0.532=-0.031
min17714.663-17714.484=0.178
max17715.716-17715.650=0.067
mean8400.000
σ0.000
min8400.000
max8400.000
mean2604.000-2592.000=12.000
σ0.000
min2604.000-2592.000=12.000
max2604.000-2592.000=12.000
mean27.437-27.446=-0.009
σ0.150-0.122=0.028
min27.256-27.293=-0.036
max27.622-27.569=0.053