Compare commits

Home / Compare f233f771 .. 15077563

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.562=0.001
σ0.046-0.046=0.001
min70.541-70.534=0.008
max70.692-70.690=0.003
mean415.600-411.000=4.600
σ0.516-0.000=0.516
min415.000-411.000=4.000
max416.000-411.000=5.000
mean0.158-0.155=0.003
σ0.005-0.005=0.000
min0.151-0.149=0.002
max0.167-0.165=0.002
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=0.001
σ0.003-0.003=0.001
min21.284-21.285=-0.001
max21.295-21.293=0.002
mean416.000-411.000=5.000
σ0.000
min416.000-411.000=5.000
max416.000-411.000=5.000
mean0.065-0.065=0.000
σ0.002-0.002=-0.000
min0.063-0.063=-0.000
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.570-1753.569=0.001
σ0.362-0.361=0.000
min1753.000-1752.993=0.007
max1754.153-1754.152=0.001
mean1655.700-1664.300=-8.600
σ637.906-628.357=9.549
min631.000-684.000=-53.000
max2852.000-2775.000=77.000
mean2.810-2.831=-0.020
σ0.179-0.110=0.069
min2.417-2.584=-0.167
max3.061-3.048=0.013

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.018-272.016=0.002
σ0.008-0.008=0.000
min272.009-272.003=0.006
max272.029-272.024=0.005
mean2852.000-2775.000=77.000
σ0.000
min2852.000-2775.000=77.000
max2852.000-2775.000=77.000
mean0.390-0.389=0.000
σ0.012-0.006=0.006
min0.376-0.379=-0.003
max0.406-0.393=0.013
iters=5
new-facts=1
prior-facts=6402
mean1932.436-1932.435=0.000
σ0.006-0.009=-0.002
min1932.429-1932.422=0.007
max1932.444-1932.443=0.000
mean2852.000-2775.000=77.000
σ0.000
min2852.000-2775.000=77.000
max2852.000-2775.000=77.000
mean3.077-2.989=0.088
σ0.177-0.141=0.036
min2.951-2.752=0.199
max3.369-3.131=0.238
iters=5
new-facts=6402
prior-facts=1
mean4753.167-4753.021=0.146
σ0.865-0.647=0.219
min4752.691-4752.618=0.072
max4754.708-4754.170=0.538
mean2852.000-2775.000=77.000
σ0.000
min2852.000-2775.000=77.000
max2852.000-2775.000=77.000
mean8.522-8.757=-0.235
σ0.465-0.266=0.200
min7.859-8.463=-0.604
max8.949-9.107=-0.158
iters=5
new-facts=6402
prior-facts=6402
mean4943.623-4943.489=0.134
σ0.024-0.171=-0.147
min4943.590-4943.297=0.294
max4943.656-4943.625=0.032
mean3083.600-2993.600=90.000
σ238.367-225.975=12.392
min2852.000-2775.000=77.000
max3428.000-3326.000=102.000
mean8.588-8.486=0.101
σ0.187-0.092=0.095
min8.368-8.401=-0.032
max8.850-8.635=0.214

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.089-0.992=0.097
σ0.121-0.141=-0.019
min0.941-0.926=0.015
max1.278-1.243=0.035

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.080-473.083=-0.003
σ575.923-575.914=0.009
min185.115-185.119=-0.004
max1336.964-1336.954=0.010
mean88.250
σ8.500
min84.000
max101.000
mean2852.000-2775.000=77.000
σ0.000
min2852.000-2775.000=77.000
max2852.000-2775.000=77.000
mean0.488-0.485=0.003
σ0.378-0.371=0.008
min0.297-0.299=-0.001
max1.055-1.041=0.014
policies=20
mean1851.459-1851.443=0.016
σ0.367-0.333=0.034
min1851.184-1851.193=-0.009
max1851.993-1851.933=0.060
mean840.000
σ0.000
min840.000
max840.000
mean2852.000-2775.000=77.000
σ0.000
min2852.000-2775.000=77.000
max2852.000-2775.000=77.000
mean2.952-2.888=0.064
σ0.012-0.084=-0.072
min2.943-2.845=0.097
max2.970-3.014=-0.044
policies=200
mean18521.039-18521.153=-0.114
σ0.430-0.482=-0.051
min18520.623-18520.867=-0.244
max18521.641-18521.873=-0.232
mean8400.000
σ0.000
min8400.000
max8400.000
mean2852.000-2775.000=77.000
σ0.000
min2852.000-2775.000=77.000
max2852.000-2775.000=77.000
mean29.169-28.747=0.422
σ0.437-0.036=0.401
min28.753-28.703=0.050
max29.648-28.777=0.872