Compare commits

Home / Compare 7c704e48 .. d269ee9e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.564-70.567=-0.003
σ0.048-0.046=0.002
min70.539-70.539=0.000
max70.699-70.697=0.003
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.160-0.162=-0.002
σ0.004-0.003=0.001
min0.154-0.158=-0.004
max0.169-0.167=0.002
cache=y
dps=1
iters=10
policies=100
mean21.291-21.287=0.004
σ0.010-0.003=0.008
min21.283-21.283=0.001
max21.319-21.291=0.028
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.065-0.063=0.002
σ0.003-0.003=-0.001
min0.063-0.060=0.003
max0.072-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.175-1753.174=0.001
σ0.362-0.360=0.002
min1752.601-1752.604=-0.003
max1753.756-1753.755=0.001
mean1644.550-1660.950=-16.400
σ632.173-642.892=-10.718
min629.000-634.000=-5.000
max2767.000-2807.000=-40.000
mean2.850-2.903=-0.052
σ0.117-0.164=-0.047
min2.476-2.543=-0.067
max3.018-3.259=-0.241

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.615-271.621=-0.006
σ0.005-0.006=-0.001
min271.609-271.615=-0.006
max271.622-271.628=-0.006
mean2767.000-2807.000=-40.000
σ0.000
min2767.000-2807.000=-40.000
max2767.000-2807.000=-40.000
mean0.380-0.385=-0.005
σ0.001-0.008=-0.007
min0.379-0.381=-0.002
max0.381-0.399=-0.018
iters=5
new-facts=1
prior-facts=6402
mean1932.043-1932.039=0.004
σ0.012-0.008=0.004
min1932.028-1932.026=0.002
max1932.062-1932.047=0.015
mean2767.000-2807.000=-40.000
σ0.000
min2767.000-2807.000=-40.000
max2767.000-2807.000=-40.000
mean3.084-3.074=0.010
σ0.166-0.183=-0.017
min2.965-2.963=0.002
max3.365-3.386=-0.021
iters=5
new-facts=6402
prior-facts=1
mean4752.851-4752.672=0.179
σ0.799-0.669=0.130
min4752.418-4752.250=0.168
max4754.279-4753.853=0.426
mean2767.000-2807.000=-40.000
σ0.000
min2767.000-2807.000=-40.000
max2767.000-2807.000=-40.000
mean7.970-8.565=-0.595
σ0.335-0.690=-0.355
min7.686-7.513=0.173
max8.514-9.248=-0.734
iters=5
new-facts=6402
prior-facts=6402
mean4943.230-4943.165=0.065
σ0.012-0.158=-0.146
min4943.213-4942.883=0.329
max4943.246-4943.248=-0.001
mean3019.200-3082.200=-63.000
σ296.862-275.000=21.862
min2767.000-2807.000=-40.000
max3455.000-3357.000=98.000
mean8.425-8.676=-0.251
σ0.115-0.274=-0.159
min8.349-8.379=-0.030
max8.626-9.006=-0.380

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.016-1.079=-0.063
σ0.127-0.112=0.015
min0.926-0.944=-0.018
max1.215-1.256=-0.041

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.288-472.294=-0.006
σ575.920-575.926=-0.005
min184.324-184.322=0.003
max1336.168-1336.183=-0.015
mean88.250
σ8.500
min84.000
max101.000
mean2767.000-2807.000=-40.000
σ0.000
min2767.000-2807.000=-40.000
max2767.000-2807.000=-40.000
mean0.485-0.450=0.035
σ0.377-0.301=0.076
min0.291-0.298=-0.006
max1.050-0.901=0.149
policies=20
mean1843.575-1843.584=-0.009
σ0.356-0.380=-0.024
min1843.316-1843.305=0.011
max1844.093-1844.136=-0.043
mean840.000
σ0.000
min840.000
max840.000
mean2767.000-2807.000=-40.000
σ0.000
min2767.000-2807.000=-40.000
max2767.000-2807.000=-40.000
mean2.959-2.964=-0.005
σ0.118-0.007=0.111
min2.862-2.958=-0.096
max3.123-2.972=0.150
policies=200
mean18442.192-18442.200=-0.009
σ0.409-0.504=-0.096
min18441.916-18441.915=0.001
max18442.800-18442.955=-0.155
mean8400.000
σ0.000
min8400.000
max8400.000
mean2767.000-2807.000=-40.000
σ0.000
min2767.000-2807.000=-40.000
max2767.000-2807.000=-40.000
mean29.025-29.122=-0.097
σ0.087-0.303=-0.216
min28.895-28.795=0.100
max29.076-29.512=-0.436