Compare commits

Home / Compare a7d9ea86 .. dff9b082

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.728-70.729=-0.001
σ0.046-0.047=-0.001
min70.701-70.705=-0.004
max70.858-70.860=-0.003
mean416.600-413.200=3.400
σ0.516-0.422=0.095
min416.000-413.000=3.000
max417.000-414.000=3.000
mean0.158-0.157=0.000
σ0.006-0.005=0.001
min0.150-0.149=0.000
max0.167-0.165=0.002
cache=y
dps=1
iters=10
policies=100
mean21.446-21.446=-0.000
σ0.002-0.002=0.000
min21.442-21.443=-0.001
max21.449-21.448=0.001
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.065-0.063=0.002
σ0.002-0.003=-0.001
min0.063-0.059=0.004
max0.071-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.526-1754.527=-0.001
σ0.358-0.357=0.001
min1753.956-1753.953=0.003
max1755.077-1755.097=-0.020
mean1673.050-1638.450=34.600
σ652.311-627.529=24.782
min641.000-640.000=1.000
max2867.000-2845.000=22.000
mean2.817-2.845=-0.028
σ0.162-0.149=0.013
min2.520-2.625=-0.105
max3.115-3.206=-0.090

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.606-273.611=-0.005
σ0.006-0.006=0.000
min273.597-273.604=-0.007
max273.612-273.616=-0.003
mean2867.000-2845.000=22.000
σ0.000
min2867.000-2845.000=22.000
max2867.000-2845.000=22.000
mean0.383-0.385=-0.002
σ0.004-0.006=-0.003
min0.380-0.381=-0.001
max0.389-0.396=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1933.996-1934.002=-0.005
σ0.012-0.009=0.003
min1933.982-1933.991=-0.009
max1934.015-1934.010=0.005
mean2867.000-2845.000=22.000
σ0.000
min2867.000-2845.000=22.000
max2867.000-2845.000=22.000
mean2.979-3.092=-0.113
σ0.151-0.170=-0.019
min2.728-2.944=-0.217
max3.110-3.356=-0.247
iters=5
new-facts=6402
prior-facts=1
mean4754.805-4754.641=0.165
σ0.807-0.931=-0.124
min4754.357-4753.881=0.477
max4756.244-4756.263=-0.019
mean2867.000-2845.000=22.000
σ0.000
min2867.000-2845.000=22.000
max2867.000-2845.000=22.000
mean8.197-8.582=-0.384
σ0.470-0.152=0.318
min7.769-8.422=-0.653
max8.862-8.748=0.114
iters=5
new-facts=6402
prior-facts=6402
mean4945.224-4945.225=-0.001
σ0.015-0.019=-0.004
min4945.208-4945.205=0.002
max4945.240-4945.248=-0.008
mean3042.000-3056.800=-14.800
σ252.492-220.174=32.317
min2867.000-2845.000=22.000
max3437.000-3370.000=67.000
mean8.384-8.606=-0.222
σ0.026-0.126=-0.101
min8.347-8.449=-0.102
max8.418-8.772=-0.354

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.994-1.028=-0.035
σ0.137-0.142=-0.006
min0.929-0.933=-0.005
max1.238-1.260=-0.022

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.845-472.836=0.009
σ574.926-574.930=-0.004
min185.377-185.365=0.013
max1335.233-1335.231=0.002
mean88.250
σ8.500
min84.000
max101.000
mean2867.000-2845.000=22.000
σ0.000
min2867.000-2845.000=22.000
max2867.000-2845.000=22.000
mean0.451-0.449=0.003
σ0.305-0.299=0.006
min0.298-0.296=0.003
max0.909-0.898=0.011
policies=20
mean1854.017-1853.996=0.020
σ0.366-0.375=-0.009
min1853.753-1853.718=0.036
max1854.551-1854.539=0.012
mean840.000
σ0.000
min840.000
max840.000
mean2867.000-2845.000=22.000
σ0.000
min2867.000-2845.000=22.000
max2867.000-2845.000=22.000
mean2.944-2.953=-0.009
σ0.014-0.003=0.011
min2.924-2.950=-0.026
max2.953-2.957=-0.004
policies=200
mean18546.729-18546.646=0.083
σ0.445-0.541=-0.097
min18546.364-18546.238=0.126
max18547.376-18547.432=-0.056
mean8400.000
σ0.000
min8400.000
max8400.000
mean2867.000-2845.000=22.000
σ0.000
min2867.000-2845.000=22.000
max2867.000-2845.000=22.000
mean29.131-29.058=0.073
σ0.518-0.501=0.016
min28.828-28.753=0.076
max29.903-29.807=0.096