Compare commits

Home / Compare 4f6dc9bb .. 2d69577c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.562-70.565=-0.002
σ0.046-0.044=0.003
min70.528-70.539=-0.011
max70.691-70.685=0.007
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.156-0.153=0.003
σ0.005-0.004=0.001
min0.149-0.149=0.001
max0.165-0.161=0.003
cache=y
dps=1
iters=10
policies=100
mean21.288-21.287=0.002
σ0.003-0.002=0.001
min21.284-21.283=0.001
max21.293-21.290=0.004
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.065-0.060=0.005
σ0.003-0.002=0.001
min0.063-0.058=0.004
max0.073-0.066=0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.375-1753.375=0.000
σ0.362-0.361=0.001
min1752.806-1752.806=0.000
max1753.959-1753.976=-0.017
mean1649.600-1668.000=-18.400
σ644.287-632.382=11.905
min629.000-685.000=-56.000
max2879.000-2807.000=72.000
mean2.767-2.772=-0.005
σ0.230-0.156=0.074
min2.251-2.247=0.004
max3.005-2.907=0.099

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.759-271.754=0.004
σ0.008-0.003=0.005
min271.749-271.750=-0.001
max271.769-271.759=0.010
mean2879.000-2807.000=72.000
σ0.000
min2879.000-2807.000=72.000
max2879.000-2807.000=72.000
mean0.383-0.380=0.003
σ0.011-0.004=0.007
min0.377-0.377=-0.000
max0.403-0.388=0.015
iters=5
new-facts=1
prior-facts=6402
mean1932.175-1932.187=-0.011
σ0.012-0.015=-0.003
min1932.162-1932.172=-0.010
max1932.188-1932.212=-0.023
mean2879.000-2807.000=72.000
σ0.000
min2879.000-2807.000=72.000
max2879.000-2807.000=72.000
mean2.959-2.800=0.158
σ0.137-0.281=-0.144
min2.731-2.429=0.302
max3.073-3.064=0.009
iters=5
new-facts=6402
prior-facts=1
mean4752.925-4752.945=-0.020
σ0.912-0.900=0.012
min4752.389-4752.386=0.003
max4754.542-4754.539=0.002
mean2879.000-2807.000=72.000
σ0.000
min2879.000-2807.000=72.000
max2879.000-2807.000=72.000
mean8.470-8.190=0.279
σ0.568-0.651=-0.083
min7.644-7.557=0.087
max9.054-9.036=0.018
iters=5
new-facts=6402
prior-facts=6402
mean4943.302-4943.231=0.071
σ0.158-0.172=-0.014
min4943.021-4943.035=-0.015
max4943.397-4943.375=0.022
mean3041.400-3066.800=-25.400
σ243.415-324.181=-80.766
min2879.000-2807.000=72.000
max3425.000-3556.000=-131.000
mean8.454-8.436=0.018
σ0.098-0.089=0.009
min8.381-8.339=0.042
max8.618-8.565=0.053

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.076-1.040=0.036
σ0.107-0.180=-0.073
min0.937-0.930=0.007
max1.239-1.347=-0.109

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.861-467.855=0.006
σ575.925-575.928=-0.003
min179.889-179.887=0.002
max1331.749-1331.747=0.002
mean86.250
σ8.500
min82.000
max99.000
mean2879.000-2807.000=72.000
σ0.000
min2879.000-2807.000=72.000
max2879.000-2807.000=72.000
mean0.444-0.480=-0.036
σ0.304-0.396=-0.092
min0.290-0.277=0.013
max0.900-1.074=-0.174
policies=20
mean1799.166-1799.177=-0.011
σ0.379-0.363=0.015
min1798.900-1798.920=-0.020
max1799.723-1799.716=0.007
mean820.000
σ0.000
min820.000
max820.000
mean2879.000-2807.000=72.000
σ0.000
min2879.000-2807.000=72.000
max2879.000-2807.000=72.000
mean2.875-2.794=0.081
σ0.010-0.017=-0.007
min2.861-2.780=0.081
max2.884-2.818=0.066
policies=200
mean17998.578-17998.388=0.190
σ0.507-0.536=-0.029
min17998.258-17998.025=0.233
max17999.335-17999.175=0.160
mean8200.000
σ0.000
min8200.000
max8200.000
mean2879.000-2807.000=72.000
σ0.000
min2879.000-2807.000=72.000
max2879.000-2807.000=72.000
mean28.668-28.180=0.488
σ0.410-0.091=0.319
min28.176-28.103=0.073
max29.068-28.304=0.764