Compare commits

Home / Compare 2185ec46 .. 5d57c83a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.565-70.565=-0.001
σ0.049-0.045=0.004
min70.536-70.542=-0.006
max70.701-70.692=0.009
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.160-0.161=-0.001
σ0.003-0.003=0.000
min0.157-0.159=-0.002
max0.167-0.166=0.001
cache=y
dps=1
iters=10
policies=100
mean21.287-21.288=-0.002
σ0.002-0.003=-0.001
min21.284-21.283=0.001
max21.289-21.291=-0.003
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.060-0.065=-0.005
σ0.004-0.003=0.001
min0.057-0.063=-0.006
max0.070-0.072=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.375-1753.374=0.001
σ0.362-0.360=0.002
min1752.808-1752.800=0.008
max1753.956-1753.938=0.018
mean1653.000-1648.100=4.900
σ644.729-641.253=3.476
min634.000-631.000=3.000
max2884.000-2877.000=7.000
mean2.760-2.811=-0.051
σ0.199-0.152=0.047
min2.258-2.437=-0.180
max3.001-3.118=-0.117

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.756-271.733=0.023
σ0.005-0.005=0.000
min271.751-271.725=0.027
max271.763-271.738=0.024
mean2884.000-2877.000=7.000
σ0.000
min2884.000-2877.000=7.000
max2884.000-2877.000=7.000
mean0.388-0.383=0.005
σ0.006-0.010=-0.004
min0.380-0.372=0.008
max0.395-0.399=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1932.168-1932.180=-0.012
σ0.016-0.013=0.004
min1932.152-1932.166=-0.014
max1932.186-1932.201=-0.014
mean2884.000-2877.000=7.000
σ0.000
min2884.000-2877.000=7.000
max2884.000-2877.000=7.000
mean3.025-3.024=0.000
σ0.082-0.230=-0.148
min2.924-2.705=0.219
max3.110-3.322=-0.212
iters=5
new-facts=6402
prior-facts=1
mean4752.899-4752.786=0.112
σ0.853-0.646=0.207
min4752.389-4752.411=-0.022
max4754.416-4753.925=0.490
mean2884.000-2877.000=7.000
σ0.000
min2884.000-2877.000=7.000
max2884.000-2877.000=7.000
mean8.735-8.576=0.159
σ0.339-0.580=-0.240
min8.396-7.581=0.815
max9.233-8.956=0.277
iters=5
new-facts=6402
prior-facts=6402
mean4943.376-4943.373=0.003
σ0.015-0.011=0.003
min4943.357-4943.359=-0.003
max4943.391-4943.390=0.000
mean3034.200-3076.200=-42.000
σ176.182-212.011=-35.829
min2884.000-2877.000=7.000
max3315.000-3387.000=-72.000
mean8.485-8.568=-0.083
σ0.064-0.224=-0.160
min8.387-8.371=0.017
max8.553-8.939=-0.385

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.054-1.023=0.030
σ0.126-0.137=-0.011
min0.939-0.933=0.007
max1.246-1.244=0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.860-472.857=0.004
σ575.924-575.927=-0.003
min184.890-184.889=0.001
max1336.746-1336.747=-0.000
mean88.250
σ8.500
min84.000
max101.000
mean2884.000-2877.000=7.000
σ0.000
min2884.000-2877.000=7.000
max2884.000-2877.000=7.000
mean0.452-0.484=-0.032
σ0.305-0.373=-0.068
min0.298-0.296=0.002
max0.909-1.044=-0.134
policies=20
mean1849.230-1849.225=0.005
σ0.369-0.367=0.002
min1848.960-1848.948=0.012
max1849.766-1849.759=0.008
mean840.000
σ0.000
min840.000
max840.000
mean2884.000-2877.000=7.000
σ0.000
min2884.000-2877.000=7.000
max2884.000-2877.000=7.000
mean2.957-2.952=0.006
σ0.024-0.007=0.017
min2.937-2.942=-0.005
max2.992-2.957=0.035
policies=200
mean18498.693-18498.759=-0.067
σ0.356-0.471=-0.115
min18498.465-18498.454=0.012
max18499.217-18499.458=-0.241
mean8400.000
σ0.000
min8400.000
max8400.000
mean2884.000-2877.000=7.000
σ0.000
min2884.000-2877.000=7.000
max2884.000-2877.000=7.000
mean29.358-29.215=0.143
σ0.511-0.484=0.027
min28.915-28.778=0.137
max29.968-29.772=0.196