Compare commits

Home / Compare 27f253cb .. 40427deb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.979=0.001
σ0.049-0.050=-0.002
min33.943-33.942=0.001
max34.116-34.118=-0.002
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.083-0.085=-0.002
σ0.004-0.005=-0.000
min0.077-0.081=-0.004
max0.091-0.094=-0.003
cache=y
dps=1
iters=10
policies=100
mean23.319-23.318=0.001
σ0.003-0.004=-0.000
min23.313-23.311=0.002
max23.324-23.324=0.000
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.064-0.065=-0.001
σ0.003-0.002=0.001
min0.060-0.063=-0.003
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.303-1757.303=0.000
σ0.364-0.365=-0.001
min1756.728-1756.728=-0.000
max1757.892-1757.889=0.003
mean1648.100-1669.800=-21.700
σ627.316-614.872=12.444
min636.000-670.000=-34.000
max2821.000-2590.000=231.000
mean2.373-2.384=-0.011
σ0.102-0.173=-0.071
min2.261-2.270=-0.009
max2.719-3.084=-0.365

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.451-326.445=0.006
σ0.030-0.044=-0.014
min326.400-326.368=0.031
max326.475-326.481=-0.006
mean2821.000-2590.000=231.000
σ0.000
min2821.000-2590.000=231.000
max2821.000-2590.000=231.000
mean0.425-0.425=-0.000
σ0.005-0.005=-0.000
min0.420-0.421=-0.001
max0.429-0.433=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1988.618-1988.605=0.014
σ0.004-0.017=-0.013
min1988.614-1988.584=0.029
max1988.624-1988.625=-0.001
mean2821.000-2590.000=231.000
σ0.000
min2821.000-2590.000=231.000
max2821.000-2590.000=231.000
mean2.717-2.758=-0.041
σ0.090-0.166=-0.076
min2.646-2.523=0.122
max2.851-2.920=-0.069
iters=5
new-facts=6402
prior-facts=1
mean4813.112-4813.452=-0.340
σ7.924-7.732=0.192
min4808.864-4809.912=-1.049
max4827.260-4827.282=-0.022
mean2821.000-2590.000=231.000
σ0.000
min2821.000-2590.000=231.000
max2821.000-2590.000=231.000
mean8.635-8.550=0.084
σ0.441-0.520=-0.079
min8.040-7.779=0.261
max9.075-9.241=-0.166
iters=5
new-facts=6402
prior-facts=6402
mean5000.802-5001.018=-0.216
σ0.189-0.033=0.156
min5000.636-5000.983=-0.347
max5001.021-5001.055=-0.034
mean3052.400-2981.600=70.800
σ242.153-363.102=-120.948
min2821.000-2590.000=231.000
max3400.000-3487.000=-87.000
mean9.813-9.927=-0.114
σ0.148-0.137=0.012
min9.614-9.796=-0.182
max9.976-10.078=-0.102

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.943-1.166=-0.223
σ0.059-0.328=-0.269
min0.905-0.914=-0.009
max1.047-1.708=-0.661

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.438-464.437=0.001
σ574.775-574.779=-0.005
min177.042-177.042=-0.000
max1326.600-1326.606=-0.007
mean88.250
σ8.500
min84.000
max101.000
mean2821.000-2590.000=231.000
σ0.000
min2821.000-2590.000=231.000
max2821.000-2590.000=231.000
mean0.435-0.568=-0.133
σ0.308-0.594=-0.286
min0.278-0.269=0.009
max0.896-1.459=-0.562
policies=20
mean1770.770-1770.757=0.013
σ0.353-0.346=0.008
min1770.526-1770.524=0.002
max1771.293-1771.270=0.023
mean840.000
σ0.000
min840.000
max840.000
mean2821.000-2590.000=231.000
σ0.000
min2821.000-2590.000=231.000
max2821.000-2590.000=231.000
mean2.780-2.702=0.078
σ0.006-0.016=-0.010
min2.774-2.689=0.085
max2.789-2.720=0.068
policies=200
mean17714.867-17714.797=0.070
σ0.355-0.595=-0.240
min17714.594-17714.425=0.169
max17715.380-17715.686=-0.306
mean8400.000
σ0.000
min8400.000
max8400.000
mean2821.000-2590.000=231.000
σ0.000
min2821.000-2590.000=231.000
max2821.000-2590.000=231.000
mean27.900-27.470=0.431
σ0.407-0.085=0.322
min27.550-27.352=0.198
max28.366-27.555=0.811