Compare commits

Home / Compare 80cb28fe .. 32940fdd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.566=-0.003
σ0.045-0.045=-0.000
min70.537-70.537=0.000
max70.690-70.690=-0.000
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.161-0.159=0.002
σ0.004-0.003=0.000
min0.157-0.154=0.003
max0.166-0.167=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.287-21.286=0.001
σ0.003-0.002=0.000
min21.283-21.283=-0.001
max21.292-21.291=0.001
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.064-0.060=0.004
σ0.002-0.003=-0.001
min0.063-0.058=0.005
max0.070-0.067=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.374-1753.377=-0.003
σ0.362-0.361=0.001
min1752.804-1752.803=0.000
max1753.958-1753.956=0.002
mean1661.250-1663.300=-2.050
σ638.835-633.864=4.972
min610.000-616.000=-6.000
max2814.000-2766.000=48.000
mean2.765-2.801=-0.036
σ0.146-0.168=-0.022
min2.286-2.265=0.021
max2.944-3.064=-0.121

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.756-271.753=0.003
σ0.006-0.005=0.001
min271.749-271.747=0.001
max271.761-271.760=0.001
mean2814.000-2766.000=48.000
σ0.000
min2814.000-2766.000=48.000
max2814.000-2766.000=48.000
mean0.384-0.378=0.006
σ0.004-0.002=0.002
min0.381-0.375=0.006
max0.392-0.381=0.011
iters=5
new-facts=1
prior-facts=6402
mean1932.177-1932.179=-0.002
σ0.009-0.011=-0.002
min1932.164-1932.165=-0.002
max1932.187-1932.196=-0.009
mean2814.000-2766.000=48.000
σ0.000
min2814.000-2766.000=48.000
max2814.000-2766.000=48.000
mean2.944-2.982=-0.038
σ0.071-0.186=-0.115
min2.866-2.764=0.102
max3.023-3.266=-0.243
iters=5
new-facts=6402
prior-facts=1
mean4752.772-4752.913=-0.141
σ0.581-0.849=-0.268
min4752.446-4752.414=0.032
max4753.807-4754.421=-0.614
mean2814.000-2766.000=48.000
σ0.000
min2814.000-2766.000=48.000
max2814.000-2766.000=48.000
mean8.561-8.441=0.120
σ0.333-0.518=-0.185
min8.166-7.610=0.555
max8.912-8.947=-0.035
iters=5
new-facts=6402
prior-facts=6402
mean4943.300-4943.381=-0.081
σ0.164-0.015=0.150
min4943.007-4943.361=-0.354
max4943.384-4943.396=-0.012
mean3002.600-3046.600=-44.000
σ203.337-242.591=-39.254
min2814.000-2766.000=48.000
max3305.000-3395.000=-90.000
mean8.745-8.807=-0.063
σ0.247-0.254=-0.008
min8.480-8.468=0.012
max9.059-9.181=-0.122

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.024-0.995=0.029
σ0.136-0.136=-0.001
min0.935-0.931=0.004
max1.248-1.239=0.008

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.864-467.857=0.007
σ575.927-575.928=-0.001
min179.888-179.888=-0.000
max1331.754-1331.749=0.005
mean86.250
σ8.500
min82.000
max99.000
mean2814.000-2766.000=48.000
σ0.000
min2814.000-2766.000=48.000
max2814.000-2766.000=48.000
mean0.480-0.440=0.040
σ0.395-0.307=0.088
min0.281-0.281=0.001
max1.072-0.901=0.172
policies=20
mean1799.178-1799.131=0.048
σ0.364-0.253=0.111
min1798.928-1798.936=-0.008
max1799.719-1799.501=0.218
mean820.000
σ0.000
min820.000
max820.000
mean2814.000-2766.000=48.000
σ0.000
min2814.000-2766.000=48.000
max2814.000-2766.000=48.000
mean2.807-2.864=-0.057
σ0.016-0.082=-0.066
min2.787-2.796=-0.009
max2.820-2.979=-0.158
policies=200
mean17998.374-17998.244=0.130
σ0.603-0.918=-0.315
min17998.053-17997.061=0.993
max17999.279-17999.301=-0.023
mean8200.000
σ0.000
min8200.000
max8200.000
mean2814.000-2766.000=48.000
σ0.000
min2814.000-2766.000=48.000
max2814.000-2766.000=48.000
mean28.206-28.264=-0.059
σ0.138-0.107=0.031
min28.078-28.175=-0.097
max28.397-28.417=-0.020