Compare commits

Home / Compare 050e404a .. 7d6f2f3b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.867-70.869=-0.003
σ0.044-0.047=-0.003
min70.841-70.839=0.002
max70.989-70.999=-0.011
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.160-0.159=0.001
σ0.003-0.005=-0.002
min0.157-0.151=0.006
max0.166-0.166=0.000
cache=y
dps=1
iters=10
policies=100
mean21.493-21.493=-0.000
σ0.002-0.002=0.000
min21.489-21.490=-0.001
max21.496-21.497=-0.000
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.066-0.066=0.000
σ0.003-0.003=-0.000
min0.063-0.060=0.003
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.095-1754.094=0.000
σ0.361-0.361=0.001
min1753.534-1753.536=-0.002
max1754.674-1754.685=-0.012
mean1629.600-1643.550=-13.950
σ593.858-603.242=-9.384
min640.000-651.000=-11.000
max2421.000-2456.000=-35.000
mean2.873-2.800=0.073
σ0.116-0.195=-0.079
min2.747-2.312=0.435
max3.240-3.165=0.075

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.599-271.599=-0.000
σ0.006-0.006=0.000
min271.591-271.589=0.002
max271.605-271.604=0.001
mean2421.000-2456.000=-35.000
σ0.000
min2421.000-2456.000=-35.000
max2421.000-2456.000=-35.000
mean0.380-0.381=-0.001
σ0.003-0.004=-0.001
min0.377-0.379=-0.002
max0.386-0.389=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1931.999-1931.997=0.002
σ0.011-0.012=-0.002
min1931.985-1931.979=0.005
max1932.011-1932.007=0.004
mean2421.000-2456.000=-35.000
σ0.000
min2421.000-2456.000=-35.000
max2421.000-2456.000=-35.000
mean2.504-2.554=-0.050
σ0.122-0.100=0.022
min2.381-2.445=-0.063
max2.707-2.686=0.021
iters=5
new-facts=6402
prior-facts=1
mean4752.778-4752.694=0.084
σ0.848-0.943=-0.094
min4752.166-4752.205=-0.039
max4754.266-4754.377=-0.111
mean2421.000-2456.000=-35.000
σ0.000
min2421.000-2456.000=-35.000
max2421.000-2456.000=-35.000
mean8.434-8.980=-0.546
σ0.655-0.278=0.377
min7.642-8.658=-1.016
max9.351-9.233=0.118
iters=5
new-facts=6402
prior-facts=6402
mean4943.204-4943.199=0.005
σ0.022-0.012=0.010
min4943.168-4943.186=-0.018
max4943.224-4943.213=0.011
mean3002.000-3023.000=-21.000
σ280.008-285.103=-5.095
min2607.000-2616.000=-9.000
max3345.000-3378.000=-33.000
mean8.585-8.516=0.068
σ0.223-0.097=0.126
min8.389-8.401=-0.012
max8.886-8.621=0.265

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.793-1.708=0.086
σ0.036-0.128=-0.093
min1.750-1.570=0.180
max1.844-1.896=-0.052

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean479.655-479.751=-0.096
σ596.975-597.171=-0.196
min181.162-181.165=-0.003
max1375.117-1375.508=-0.391
mean88.250
σ8.500
min84.000
max101.000
mean2421.000-2456.000=-35.000
σ0.000
min2421.000-2456.000=-35.000
max2421.000-2456.000=-35.000
mean0.577-0.574=0.002
σ0.579-0.579=0.000
min0.286-0.282=0.004
max1.446-1.443=0.003
policies=20
mean1811.948-1811.951=-0.002
σ0.389-0.380=0.009
min1811.685-1811.703=-0.018
max1812.523-1812.512=0.011
mean840.000
σ0.000
min840.000
max840.000
mean2421.000-2456.000=-35.000
σ0.000
min2421.000-2456.000=-35.000
max2421.000-2456.000=-35.000
mean2.819-2.835=-0.016
σ0.012-0.020=-0.008
min2.801-2.809=-0.008
max2.829-2.858=-0.029
policies=200
mean18126.829-18126.769=0.060
σ0.435-0.490=-0.056
min18126.499-18126.510=-0.011
max18127.469-18127.504=-0.034
mean8400.000
σ0.000
min8400.000
max8400.000
mean2421.000-2456.000=-35.000
σ0.000
min2421.000-2456.000=-35.000
max2421.000-2456.000=-35.000
mean28.654-28.480=0.174
σ0.158-0.039=0.119
min28.529-28.441=0.088
max28.875-28.529=0.346