Compare commits

Home / Compare bf38cfd7 .. 504cf4da

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.653-53.653=0.000
σ0.366-0.366=0.000
min53.518-53.517=0.001
max54.695-54.694=0.000
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.135-0.136=-0.001
σ0.005-0.005=0.001
min0.129-0.131=-0.002
max0.145-0.145=-0.001
cache=y
dps=1
iters=10
policies=100
mean42.980-42.981=-0.001
σ0.007-0.007=-0.001
min42.973-42.970=0.003
max42.994-42.995=-0.001
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.121-0.120=0.001
σ0.004-0.003=0.000
min0.117-0.115=0.002
max0.128-0.125=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.974-1013.967=0.007
σ1.167-1.198=-0.031
min1013.428-1013.428=-0.000
max1018.840-1018.989=-0.149
mean1053.850-1051.400=2.450
σ316.084-315.313=0.770
min601.000
max1656.000-1654.000=2.000
mean1.639-1.612=0.027
σ0.090-0.096=-0.007
min1.558-1.497=0.061
max1.868-1.882=-0.013

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.303-299.087=0.216
σ0.192-0.229=-0.037
min299.083-298.912=0.171
max299.777-299.718=0.059
mean2041.000
σ0.000
min2041.000
max2041.000
mean0.579-0.572=0.007
σ0.026-0.020=0.006
min0.536-0.555=-0.020
max0.613-0.612=0.000

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.678-294.678=-0.001
σ0.017-0.015=0.001
min294.660-294.661=-0.002
max294.705-294.702=0.003
mean1656.000-1654.000=2.000
σ0.000
min1656.000-1654.000=2.000
max1656.000-1654.000=2.000
mean0.386-0.387=-0.001
σ0.007-0.009=-0.003
min0.380-0.379=0.001
max0.393-0.400=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1316.937-1316.931=0.005
σ0.099-0.106=-0.007
min1316.872-1316.858=0.015
max1317.112-1317.119=-0.007
mean1656.000-1654.000=2.000
σ0.000
min1656.000-1654.000=2.000
max1656.000-1654.000=2.000
mean1.976-1.997=-0.020
σ0.112-0.052=0.060
min1.848-1.940=-0.092
max2.102-2.065=0.036
iters=5
new-facts=6402
prior-facts=1
mean1555.314-1555.313=0.002
σ6.835-6.839=-0.003
min1552.071-1552.021=0.050
max1567.537-1567.541=-0.004
mean1656.000-1654.000=2.000
σ0.000
min1656.000-1654.000=2.000
max1656.000-1654.000=2.000
mean2.307-2.348=-0.041
σ0.226-0.195=0.031
min2.080-2.142=-0.062
max2.564-2.555=0.009
iters=5
new-facts=6402
prior-facts=6402
mean1884.775-1884.771=0.003
σ0.033-0.042=-0.008
min1884.749-1884.745=0.004
max1884.833-1884.844=-0.012
mean1783.000-1808.600=-25.600
σ161.926-159.506=2.419
min1656.000-1654.000=2.000
max2041.000
mean3.005-3.095=-0.090
σ0.155-0.258=-0.103
min2.886-2.842=0.044
max3.242-3.431=-0.189

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.054-1.109=-0.055
σ0.162-0.129=0.033
min0.911-0.983=-0.071
max1.241-1.267=-0.026

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.661-440.658=0.003
σ573.389-573.383=0.006
min153.958-153.961=-0.003
max1300.745-1300.732=0.012
mean96.250
σ8.500
min92.000
max109.000
mean1656.000-1654.000=2.000
σ0.000
min1656.000-1654.000=2.000
max1656.000-1654.000=2.000
mean0.526-0.547=-0.021
σ0.532-0.553=-0.021
min0.258-0.267=-0.009
max1.324-1.377=-0.053
policies=20
mean1539.846-1539.856=-0.010
σ0.301-0.307=-0.005
min1539.678-1539.685=-0.007
max1540.298-1540.315=-0.017
mean920.000
σ0.000
min920.000
max920.000
mean1656.000-1654.000=2.000
σ0.000
min1656.000-1654.000=2.000
max1656.000-1654.000=2.000
mean2.590-2.590=0.001
σ0.033-0.013=0.020
min2.569-2.573=-0.003
max2.640-2.602=0.038
policies=200
mean15406.414-15406.479=-0.065
σ0.111-0.054=0.057
min15406.276-15406.402=-0.127
max15406.546-15406.526=0.020
mean9200.000
σ0.000
min9200.000
max9200.000
mean1656.000-1654.000=2.000
σ0.000
min1656.000-1654.000=2.000
max1656.000-1654.000=2.000
mean26.167-26.167=0.001
σ0.175-0.180=-0.005
min25.943-25.919=0.023
max26.335-26.349=-0.015