Compare commits

Home / Compare 40c8538a .. 3c40a4d5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.566-70.565=0.001
σ0.045-0.046=-0.000
min70.539-70.543=-0.004
max70.691-70.693=-0.002
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.157-0.158=-0.001
σ0.005-0.004=0.001
min0.151-0.154=-0.003
max0.167-0.166=0.001
cache=y
dps=1
iters=10
policies=100
mean21.290-21.292=-0.002
σ0.002-0.011=-0.008
min21.286-21.285=0.001
max21.294-21.321=-0.027
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.065-0.065=-0.000
σ0.003-0.003=0.000
min0.063-0.063=-0.000
max0.073-0.073=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.569-1753.568=0.001
σ0.361-0.363=-0.002
min1752.995-1752.996=-0.001
max1754.154-1754.150=0.004
mean1650.000-1666.850=-16.850
σ616.512-631.374=-14.862
min689.000-685.000=4.000
max2765.000-2702.000=63.000
mean2.803-2.756=0.047
σ0.145-0.148=-0.003
min2.514-2.393=0.121
max2.986-2.940=0.046

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.012-271.990=0.021
σ0.010-0.010=0.000
min271.997-271.975=0.023
max272.025-272.001=0.024
mean2765.000-2702.000=63.000
σ0.000
min2765.000-2702.000=63.000
max2765.000-2702.000=63.000
mean0.384-0.385=-0.001
σ0.013-0.005=0.007
min0.375-0.381=-0.006
max0.407-0.394=0.012
iters=5
new-facts=1
prior-facts=6402
mean1932.438-1932.442=-0.004
σ0.007-0.009=-0.001
min1932.430-1932.434=-0.004
max1932.446-1932.455=-0.008
mean2765.000-2702.000=63.000
σ0.000
min2765.000-2702.000=63.000
max2765.000-2702.000=63.000
mean2.976-2.958=0.018
σ0.149-0.197=-0.048
min2.748-2.643=0.105
max3.120-3.189=-0.069
iters=5
new-facts=6402
prior-facts=1
mean4753.235-4753.069=0.166
σ0.922-0.912=0.010
min4752.635-4752.270=0.365
max4754.870-4754.640=0.230
mean2765.000-2702.000=63.000
σ0.000
min2765.000-2702.000=63.000
max2765.000-2702.000=63.000
mean8.300-8.381=-0.081
σ0.641-0.345=0.295
min7.778-7.821=-0.043
max9.381-8.730=0.650
iters=5
new-facts=6402
prior-facts=6402
mean4943.486-4943.631=-0.145
σ0.188-0.019=0.170
min4943.270-4943.616=-0.347
max4943.634-4943.655=-0.021
mean3028.400-3044.000=-15.600
σ325.601-283.499=42.103
min2765.000-2702.000=63.000
max3524.000-3429.000=95.000
mean8.432-8.534=-0.102
σ0.110-0.105=0.006
min8.363-8.417=-0.054
max8.625-8.634=-0.009

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.063-1.059=0.004
σ0.214-0.141=0.073
min0.936-0.921=0.015
max1.431-1.251=0.180

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.095-473.081=0.015
σ575.950-575.922=0.029
min185.110-185.111=-0.001
max1337.021-1336.963=0.058
mean88.250
σ8.500
min84.000
max101.000
mean2765.000-2702.000=63.000
σ0.000
min2765.000-2702.000=63.000
max2765.000-2702.000=63.000
mean0.604-0.561=0.043
σ0.635-0.546=0.089
min0.284-0.286=-0.001
max1.557-1.380=0.177
policies=20
mean1851.426-1851.430=-0.003
σ0.377-0.376=0.001
min1851.171-1851.175=-0.004
max1851.984-1851.985=-0.001
mean840.000
σ0.000
min840.000
max840.000
mean2765.000-2702.000=63.000
σ0.000
min2765.000-2702.000=63.000
max2765.000-2702.000=63.000
mean2.878-2.849=0.029
σ0.016-0.012=0.003
min2.858-2.831=0.027
max2.891-2.856=0.035
policies=200
mean18521.154-18521.017=0.137
σ0.461-0.478=-0.017
min18520.884-18520.712=0.172
max18521.843-18521.719=0.124
mean8400.000
σ0.000
min8400.000
max8400.000
mean2765.000-2702.000=63.000
σ0.000
min2765.000-2702.000=63.000
max2765.000-2702.000=63.000
mean28.953-28.763=0.190
σ0.035-0.040=-0.005
min28.916-28.720=0.196
max28.995-28.813=0.182