Compare commits

Home / Compare 8400bf2e .. ba29f91f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.553-70.557=-0.004
σ0.046-0.044=0.002
min70.526-70.535=-0.009
max70.683-70.681=0.002
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.160-0.161=-0.002
σ0.003-0.004=-0.001
min0.156-0.153=0.003
max0.166-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.291-21.288=0.002
σ0.012-0.003=0.009
min21.282-21.284=-0.002
max21.324-21.294=0.030
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.065-0.066=-0.000
σ0.002-0.003=-0.001
min0.063-0.064=-0.001
max0.070-0.073=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.173-1753.175=-0.002
σ0.360-0.362=-0.001
min1752.604-1752.603=0.001
max1753.751-1753.759=-0.008
mean1650.000-1657.400=-7.400
σ640.675-630.659=10.016
min629.000-678.000=-49.000
max2865.000-2608.000=257.000
mean2.833-2.837=-0.004
σ0.111-0.155=-0.044
min2.557-2.304=0.253
max3.003-3.102=-0.098

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.616-271.621=-0.004
σ0.007-0.005=0.002
min271.609-271.613=-0.004
max271.625-271.625=-0.001
mean2865.000-2608.000=257.000
σ0.000
min2865.000-2608.000=257.000
max2865.000-2608.000=257.000
mean0.383-0.388=-0.006
σ0.006-0.012=-0.006
min0.379-0.379=-0.000
max0.393-0.405=-0.013
iters=5
new-facts=1
prior-facts=6402
mean1932.041-1932.039=0.002
σ0.004-0.007=-0.003
min1932.037-1932.028=0.009
max1932.046-1932.046=0.000
mean2865.000-2608.000=257.000
σ0.000
min2865.000-2608.000=257.000
max2865.000-2608.000=257.000
mean3.033-2.979=0.054
σ0.090-0.158=-0.068
min2.908-2.742=0.166
max3.132-3.142=-0.011
iters=5
new-facts=6402
prior-facts=1
mean4752.822-4752.629=0.193
σ0.783-0.650=0.134
min4752.353-4752.289=0.064
max4754.217-4753.787=0.430
mean2865.000-2608.000=257.000
σ0.000
min2865.000-2608.000=257.000
max2865.000-2608.000=257.000
mean8.103-8.533=-0.430
σ0.461-0.450=0.011
min7.666-8.004=-0.338
max8.840-8.904=-0.063
iters=5
new-facts=6402
prior-facts=6402
mean4943.233-4943.229=0.004
σ0.012-0.016=-0.004
min4943.217-4943.214=0.002
max4943.250-4943.251=-0.002
mean3079.800-2948.000=131.800
σ293.622-345.924=-52.302
min2865.000-2608.000=257.000
max3536.000-3442.000=94.000
mean8.490-8.438=0.053
σ0.095-0.163=-0.068
min8.383-8.309=0.074
max8.632-8.722=-0.091

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.999-1.263=-0.264
σ0.146-0.336=-0.190
min0.929-0.932=-0.003
max1.259-1.607=-0.348

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean471.797-472.006=-0.209
σ574.937-575.354=-0.417
min184.323-184.325=-0.002
max1334.203-1335.037=-0.834
mean88.250
σ8.500
min84.000
max101.000
mean2865.000-2608.000=257.000
σ0.000
min2865.000-2608.000=257.000
max2865.000-2608.000=257.000
mean0.449-0.578=-0.129
σ0.304-0.561=-0.257
min0.291-0.297=-0.006
max0.906-1.420=-0.515
policies=20
mean1843.601-1843.538=0.064
σ0.376-0.358=0.017
min1843.312-1843.306=0.006
max1844.139-1844.068=0.071
mean840.000
σ0.000
min840.000
max840.000
mean2865.000-2608.000=257.000
σ0.000
min2865.000-2608.000=257.000
max2865.000-2608.000=257.000
mean2.977-2.901=0.077
σ0.026-0.043=-0.017
min2.959-2.868=0.091
max3.016-2.963=0.054
policies=200
mean18442.154-18442.084=0.070
σ0.573-0.468=0.105
min18441.683-18441.677=0.006
max18442.953-18442.759=0.194
mean8400.000
σ0.000
min8400.000
max8400.000
mean2865.000-2608.000=257.000
σ0.000
min2865.000-2608.000=257.000
max2865.000-2608.000=257.000
mean29.319-29.001=0.318
σ0.403-0.126=0.277
min28.908-28.887=0.020
max29.873-29.122=0.751