Compare commits

Home / Compare 347cfc33 .. e0e6f0ed

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.980=-0.001
σ0.048-0.050=-0.002
min33.938-33.938=0.001
max34.112-34.119=-0.007
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.084-0.082=0.002
σ0.005-0.005=-0.000
min0.077-0.076=0.000
max0.090-0.090=0.000
cache=y
dps=1
iters=10
policies=100
mean23.319-23.319=0.000
σ0.003-0.003=0.000
min23.313-23.313=-0.001
max23.323-23.324=-0.001
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.065-0.065=0.000
σ0.002-0.005=-0.003
min0.063-0.059=0.004
max0.071-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1719.361-1757.303=-37.942
σ169.689-0.365=169.324
min998.435-1756.732=-758.296
max1757.891-1757.893=-0.002
mean1632.400-1657.550=-25.150
σ599.529-644.006=-44.477
min667.000-626.000=41.000
max2610.000-2824.000=-214.000
mean2.321-2.353=-0.032
σ0.226-0.072=0.154
min1.483-2.274=-0.790
max2.693-2.565=0.128

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.437-326.448=-0.011
σ0.054-0.035=0.019
min326.340-326.388=-0.048
max326.469-326.479=-0.010
mean2610.000-2824.000=-214.000
σ0.000
min2610.000-2824.000=-214.000
max2610.000-2824.000=-214.000
mean0.423-0.427=-0.004
σ0.001-0.006=-0.006
min0.423-0.421=0.002
max0.424-0.434=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1988.608-1988.605=0.003
σ0.011-0.016=-0.005
min1988.592-1988.586=0.006
max1988.620-1988.620=0.000
mean2610.000-2824.000=-214.000
σ0.000
min2610.000-2824.000=-214.000
max2610.000-2824.000=-214.000
mean2.811-2.682=0.129
σ0.189-0.067=0.122
min2.647-2.636=0.011
max3.030-2.800=0.231
iters=5
new-facts=6402
prior-facts=1
mean4813.448-4813.266=0.182
σ7.728-7.900=-0.171
min4809.913-4808.830=1.083
max4827.272-4827.366=-0.093
mean2610.000-2824.000=-214.000
σ0.000
min2610.000-2824.000=-214.000
max2610.000-2824.000=-214.000
mean8.575-8.781=-0.206
σ0.505-0.619=-0.114
min7.815-7.802=0.013
max9.225-9.436=-0.211
iters=5
new-facts=6402
prior-facts=6402
mean5000.935-5001.012=-0.076
σ0.181-0.027=0.154
min5000.612-5000.982=-0.370
max5001.035-5001.041=-0.006
mean2978.000-3031.200=-53.200
σ405.144-213.774=191.370
min2610.000-2824.000=-214.000
max3551.000-3332.000=219.000
mean9.730-9.808=-0.078
σ0.328-0.149=0.179
min9.350-9.704=-0.354
max10.033-10.068=-0.034

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.104-1.041=0.063
σ0.338-0.132=0.206
min0.915-0.921=-0.007
max1.701-1.248=0.453

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.441-464.443=-0.002
σ574.782-574.775=0.007
min177.044-177.047=-0.003
max1326.614-1326.605=0.009
mean88.250
σ8.500
min84.000
max101.000
mean2610.000-2824.000=-214.000
σ0.000
min2610.000-2824.000=-214.000
max2610.000-2824.000=-214.000
mean0.564-0.434=0.130
σ0.568-0.307=0.260
min0.273-0.279=-0.007
max1.416-0.895=0.520
policies=20
mean1770.764-1770.777=-0.013
σ0.356-0.360=-0.004
min1770.533-1770.540=-0.007
max1771.293-1771.312=-0.019
mean840.000
σ0.000
min840.000
max840.000
mean2610.000-2824.000=-214.000
σ0.000
min2610.000-2824.000=-214.000
max2610.000-2824.000=-214.000
mean2.732-2.780=-0.047
σ0.013-0.002=0.010
min2.724-2.778=-0.054
max2.751-2.783=-0.032
policies=200
mean17714.835-17715.005=-0.170
σ0.438-0.450=-0.012
min17714.453-17714.671=-0.218
max17715.464-17715.668=-0.204
mean8400.000
σ0.000
min8400.000
max8400.000
mean2610.000-2824.000=-214.000
σ0.000
min2610.000-2824.000=-214.000
max2610.000-2824.000=-214.000
mean27.537-27.810=-0.273
σ0.140-0.375=-0.234
min27.394-27.439=-0.045
max27.679-28.219=-0.540