Compare commits

Home / Compare 2ba9d2bd .. eff0a7f2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.710-53.707=0.002
σ0.366-0.363=0.003
min53.571-53.571=0.000
max54.750-54.739=0.011
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.139-0.138=0.001
σ0.004-0.005=-0.000
min0.134-0.131=0.003
max0.148-0.147=0.001
cache=y
dps=1
iters=10
policies=100
mean42.978-42.979=-0.001
σ0.006-0.005=0.001
min42.965-42.973=-0.008
max42.985-42.990=-0.005
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.121-0.119=0.001
σ0.003-0.003=0.000
min0.117-0.114=0.003
max0.126-0.125=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean995.221-995.217=0.004
σ1.195-1.209=-0.015
min994.684-994.629=0.055
max1000.232-1000.273=-0.041
mean1058.850-1052.050=6.800
σ312.336-303.527=8.809
min608.000-628.000=-20.000
max1630.000-1516.000=114.000
mean1.498-1.480=0.018
σ0.085-0.075=0.010
min1.392-1.390=0.002
max1.653-1.663=-0.010

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.318-297.308=0.010
σ0.008-0.034=-0.026
min297.311-297.248=0.063
max297.332-297.332=-0.000
mean1630.000-1516.000=114.000
σ0.000
min1630.000-1516.000=114.000
max1630.000-1516.000=114.000
mean0.386-0.403=-0.016
σ0.001-0.012=-0.011
min0.385-0.384=0.001
max0.388-0.414=-0.026
iters=5
new-facts=1
prior-facts=6402
mean1299.019-1299.032=-0.013
σ0.089-0.064=0.025
min1298.861-1298.919=-0.058
max1299.071-1299.072=-0.001
mean1630.000-1516.000=114.000
σ0.000
min1630.000-1516.000=114.000
max1630.000-1516.000=114.000
mean1.994-2.051=-0.057
σ0.161-0.284=-0.124
min1.858-1.752=0.106
max2.222-2.440=-0.218
iters=5
new-facts=6402
prior-facts=1
mean1719.178-1719.197=-0.018
σ6.926-6.920=0.006
min1715.926-1716.007=-0.080
max1731.563-1731.573=-0.010
mean1630.000-1516.000=114.000
σ0.000
min1630.000-1516.000=114.000
max1630.000-1516.000=114.000
mean3.206-2.980=0.226
σ0.441-0.257=0.185
min2.764-2.760=0.004
max3.692-3.414=0.278
iters=5
new-facts=6402
prior-facts=6402
mean1981.925-1981.930=-0.006
σ0.032-0.034=-0.002
min1981.869-1981.871=-0.002
max1981.945-1981.957=-0.012
mean1808.400-1800.000=8.400
σ176.350-233.327=-56.977
min1630.000-1536.000=94.000
max2060.000-2130.000=-70.000
mean3.298-3.300=-0.003
σ0.418-0.413=0.006
min2.948-2.950=-0.002
max4.022-4.011=0.012

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.189-1.466=-0.276
σ0.347-0.239=0.108
min0.912-1.195=-0.283
max1.756-1.739=0.017

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.459-440.448=0.011
σ573.040-573.024=0.016
min153.936-153.931=0.006
max1300.018-1299.984=0.034
mean94.250
σ8.500
min90.000
max107.000
mean1630.000-1516.000=114.000
σ0.000
min1630.000-1516.000=114.000
max1630.000-1516.000=114.000
mean0.540-0.535=0.004
σ0.560-0.559=0.002
min0.255-0.255=-0.000
max1.380-1.373=0.007
policies=20
mean1539.611-1539.608=0.003
σ0.299-0.308=-0.009
min1539.424-1539.396=0.028
max1540.057-1540.064=-0.007
mean900.000
σ0.000
min900.000
max900.000
mean1630.000-1516.000=114.000
σ0.000
min1630.000-1516.000=114.000
max1630.000-1516.000=114.000
mean2.565-2.567=-0.002
σ0.006-0.011=-0.005
min2.560-2.554=0.006
max2.573-2.579=-0.006
policies=200
mean15403.974-15404.038=-0.064
σ0.100-0.119=-0.019
min15403.875-15403.879=-0.004
max15404.113-15404.164=-0.050
mean9000.000
σ0.000
min9000.000
max9000.000
mean1630.000-1516.000=114.000
σ0.000
min1630.000-1516.000=114.000
max1630.000-1516.000=114.000
mean25.959-26.007=-0.048
σ0.153-0.151=0.002
min25.807-25.841=-0.034
max26.109-26.195=-0.086