Compare commits

Home / Compare cab2bcac .. 381f6fb8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.735-70.736=-0.001
σ0.051-0.052=-0.001
min70.704-70.704=0.001
max70.877-70.882=-0.005
mean418.000-412.000=6.000
σ0.000
min418.000-412.000=6.000
max418.000-412.000=6.000
mean0.160-0.163=-0.003
σ0.003-0.009=-0.006
min0.156-0.155=0.001
max0.166-0.187=-0.021
cache=y
dps=1
iters=10
policies=100
mean21.448-21.449=-0.001
σ0.003-0.003=-0.000
min21.443-21.443=0.000
max21.453-21.453=0.000
mean418.000-412.000=6.000
σ0.000
min418.000-412.000=6.000
max418.000-412.000=6.000
mean0.066-0.066=-0.000
σ0.003-0.002=0.001
min0.064-0.063=0.001
max0.074-0.072=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.881-1751.881=0.000
σ0.360-0.361=-0.001
min1751.310-1751.304=0.006
max1752.469-1752.459=0.011
mean1663.500-1651.750=11.750
σ631.049-646.842=-15.793
min678.000-636.000=42.000
max2713.000-2844.000=-131.000
mean2.788-2.800=-0.011
σ0.211-0.195=0.016
min2.293-2.243=0.050
max3.038-3.025=0.014

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.972-270.971=0.001
σ0.005-0.002=0.002
min270.966-270.967=-0.001
max270.978-270.974=0.004
mean2713.000-2844.000=-131.000
σ0.000
min2713.000-2844.000=-131.000
max2713.000-2844.000=-131.000
mean0.372-0.379=-0.007
σ0.005-0.005=0.000
min0.369-0.376=-0.008
max0.381-0.387=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1931.347-1931.349=-0.002
σ0.021-0.006=0.015
min1931.329-1931.341=-0.013
max1931.381-1931.357=0.024
mean2713.000-2844.000=-131.000
σ0.000
min2713.000-2844.000=-131.000
max2713.000-2844.000=-131.000
mean3.017-3.034=-0.017
σ0.035-0.044=-0.008
min2.969-2.978=-0.009
max3.067-3.092=-0.025
iters=5
new-facts=6402
prior-facts=1
mean4752.129-4752.158=-0.029
σ0.929-0.866=0.064
min4751.547-4751.656=-0.109
max4753.781-4753.697=0.084
mean2713.000-2844.000=-131.000
σ0.000
min2713.000-2844.000=-131.000
max2713.000-2844.000=-131.000
mean8.553-8.346=0.207
σ0.432-0.380=0.052
min8.116-7.913=0.203
max9.216-8.788=0.427
iters=5
new-facts=6402
prior-facts=6402
mean4942.584-4942.521=0.063
σ0.014-0.148=-0.135
min4942.570-4942.257=0.313
max4942.602-4942.605=-0.003
mean2994.800-3011.800=-17.000
σ315.414-190.643=124.771
min2713.000-2844.000=-131.000
max3445.000-3309.000=136.000
mean8.406-8.710=-0.305
σ0.043-0.365=-0.322
min8.376-8.358=0.018
max8.479-9.298=-0.819

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.173-1.065=0.109
σ0.226-0.107=0.118
min0.928-0.928=-0.000
max1.523-1.229=0.294

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.059-466.068=-0.009
σ574.936-574.937=-0.001
min178.588-178.591=-0.004
max1328.463-1328.474=-0.010
mean86.250
σ8.500
min82.000
max99.000
mean2713.000-2844.000=-131.000
σ0.000
min2713.000-2844.000=-131.000
max2713.000-2844.000=-131.000
mean0.571-0.479=0.092
σ0.585-0.378=0.207
min0.272-0.287=-0.015
max1.449-1.046=0.403
policies=20
mean1786.139-1786.182=-0.043
σ0.372-0.365=0.007
min1785.910-1785.922=-0.012
max1786.695-1786.720=-0.025
mean820.000
σ0.000
min820.000
max820.000
mean2713.000-2844.000=-131.000
σ0.000
min2713.000-2844.000=-131.000
max2713.000-2844.000=-131.000
mean2.775-2.862=-0.087
σ0.018-0.010=0.008
min2.756-2.850=-0.094
max2.792-2.874=-0.082
policies=200
mean17868.521-17868.447=0.074
σ0.491-0.510=-0.018
min17868.205-17868.006=0.198
max17869.253-17869.138=0.116
mean8200.000
σ0.000
min8200.000
max8200.000
mean2713.000-2844.000=-131.000
σ0.000
min2713.000-2844.000=-131.000
max2713.000-2844.000=-131.000
mean27.893-28.497=-0.604
σ0.124-0.550=-0.426
min27.728-27.894=-0.166
max27.998-29.169=-1.171