Compare commits

Home / Compare 9ee898f6 .. bd7acba2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.564
σ0.050-0.047=0.003
min70.538-70.536=0.003
max70.704-70.695=0.009
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.158-0.157=0.001
σ0.004-0.005=-0.001
min0.152-0.149=0.003
max0.165-0.165=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.291-21.288=0.003
σ0.012-0.003=0.009
min21.282-21.284=-0.002
max21.322-21.294=0.029
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.065-0.065=0.000
σ0.003-0.003=0.000
min0.063-0.063=0.000
max0.073-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.175-1753.174=0.000
σ0.362-0.361=0.000
min1752.605-1752.606=-0.001
max1753.761-1753.760=0.001
mean1645.050-1670.900=-25.850
σ629.324-630.998=-1.674
min633.000-669.000=-36.000
max2850.000-2776.000=74.000
mean2.784-2.873=-0.089
σ0.181-0.093=0.088
min2.380-2.631=-0.250
max3.007-3.050=-0.043

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.623-271.619=0.004
σ0.008-0.008=0.001
min271.616-271.609=0.008
max271.636-271.628=0.009
mean2850.000-2776.000=74.000
σ0.000
min2850.000-2776.000=74.000
max2850.000-2776.000=74.000
mean0.388-0.372=0.015
σ0.007-0.006=0.002
min0.380-0.369=0.011
max0.396-0.382=0.014
iters=5
new-facts=1
prior-facts=6402
mean1932.040-1932.049=-0.009
σ0.007-0.013=-0.006
min1932.032-1932.039=-0.006
max1932.049-1932.069=-0.020
mean2850.000-2776.000=74.000
σ0.000
min2850.000-2776.000=74.000
max2850.000-2776.000=74.000
mean3.114-2.917=0.197
σ0.167-0.267=-0.100
min2.937-2.455=0.483
max3.358-3.113=0.245
iters=5
new-facts=6402
prior-facts=1
mean4752.705-4752.541=0.164
σ0.873-0.663=0.209
min4751.944-4751.941=0.003
max4754.212-4753.677=0.535
mean2850.000-2776.000=74.000
σ0.000
min2850.000-2776.000=74.000
max2850.000-2776.000=74.000
mean8.041-8.429=-0.388
σ0.427-0.543=-0.117
min7.699-7.563=0.136
max8.701-8.957=-0.255
iters=5
new-facts=6402
prior-facts=6402
mean4943.159-4943.168=-0.009
σ0.161-0.149=0.012
min4942.873-4942.902=-0.029
max4943.263-4943.256=0.008
mean3053.200-3007.800=45.400
σ260.175-229.352=30.824
min2850.000-2776.000=74.000
max3446.000-3339.000=107.000
mean8.444-8.556=-0.112
σ0.112-0.256=-0.144
min8.322-8.389=-0.067
max8.621-9.002=-0.381

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.065-1.087=-0.022
σ0.146-0.270=-0.124
min0.938-0.933=0.006
max1.300-1.559=-0.259

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.321-472.315=0.006
σ575.926-575.926=-0.000
min184.346-184.347=-0.001
max1336.211-1336.205=0.006
mean88.250
σ8.500
min84.000
max101.000
mean2850.000-2776.000=74.000
σ0.000
min2850.000-2776.000=74.000
max2850.000-2776.000=74.000
mean0.488-0.526=-0.038
σ0.381-0.362=0.020
min0.292-0.289=0.003
max1.060-1.056=0.004
policies=20
mean1843.811-1843.818=-0.007
σ0.372-0.372=0.001
min1843.548-1843.576=-0.028
max1844.351-1844.366=-0.014
mean840.000
σ0.000
min840.000
max840.000
mean2850.000-2776.000=74.000
σ0.000
min2850.000-2776.000=74.000
max2850.000-2776.000=74.000
mean2.984-2.867=0.117
σ0.025-0.032=-0.007
min2.967-2.830=0.137
max3.022-2.897=0.124
policies=200
mean18444.549-18444.531=0.018
σ0.509-0.572=-0.063
min18444.126-18444.170=-0.045
max18445.280-18445.378=-0.098
mean8400.000
σ0.000
min8400.000
max8400.000
mean2850.000-2776.000=74.000
σ0.000
min2850.000-2776.000=74.000
max2850.000-2776.000=74.000
mean29.389-28.955=0.435
σ0.481-0.108=0.373
min29.046-28.867=0.179
max30.089-29.091=0.998