Compare commits

Home / Compare a5e56d11 .. 23e3e89e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.975-35.980=-0.005
σ0.108-0.108=0.000
min35.933-35.933=0.000
max36.281-36.283=-0.001
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.078-0.078=0.000
σ0.004-0.004=-0.000
min0.075-0.074=0.001
max0.083-0.084=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.208-26.208=-0.000
σ0.003-0.003=-0.000
min26.204-26.205=-0.000
max26.212-26.213=-0.002
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.060-0.060=0.000
σ0.003-0.004=-0.001
min0.056-0.056=0.000
max0.066-0.069=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.712-1756.712=-0.000
σ0.371-0.369=0.002
min1756.137-1756.138=-0.001
max1757.306-1757.315=-0.009
mean1649.950-1642.750=7.200
σ615.641-640.116=-24.476
min642.000-640.000=2.000
max2482.000-2837.000=-355.000
mean2.339-2.439=-0.101
σ0.075-0.082=-0.006
min2.209-2.356=-0.147
max2.512-2.632=-0.119

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.881-277.880=0.001
σ0.006-0.007=-0.001
min277.874-277.870=0.004
max277.891-277.889=0.002
mean2482.000-2837.000=-355.000
σ0.000
min2482.000-2837.000=-355.000
max2482.000-2837.000=-355.000
mean0.406-0.404=0.002
σ0.007-0.007=-0.000
min0.399-0.397=0.002
max0.414-0.414=0.001
iters=5
new-facts=1
prior-facts=6402
mean2176.830-2176.833=-0.003
σ0.012-0.014=-0.002
min2176.812-2176.813=-0.001
max2176.841-2176.849=-0.008
mean2482.000-2837.000=-355.000
σ0.000
min2482.000-2837.000=-355.000
max2482.000-2837.000=-355.000
mean3.401-3.492=-0.091
σ0.112-0.088=0.024
min3.276-3.393=-0.118
max3.577-3.620=-0.042
iters=5
new-facts=6402
prior-facts=1
mean5054.712-5054.715=-0.003
σ0.931-0.925=0.006
min5054.158-5054.147=0.011
max5056.371-5056.359=0.012
mean2482.000-2837.000=-355.000
σ0.000
min2482.000-2837.000=-355.000
max2482.000-2837.000=-355.000
mean8.786-8.845=-0.059
σ0.543-0.491=0.052
min8.055-8.212=-0.157
max9.317-9.425=-0.107
iters=5
new-facts=6402
prior-facts=6402
mean5192.124-5192.061=0.063
σ0.093-0.122=-0.030
min5192.049-5191.880=0.169
max5192.226-5192.224=0.002
mean3253.200-3300.000=-46.800
σ419.751-364.442=55.309
min2675.000-2837.000=-162.000
max3645.000-3657.000=-12.000
mean8.799-9.058=-0.258
σ0.132-0.381=-0.250
min8.585-8.664=-0.079
max8.944-9.689=-0.745

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.608-1.030=0.578
σ0.296-0.066=0.230
min1.110-0.945=0.165
max1.841-1.083=0.759

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.028-464.039=-0.011
σ573.074-573.084=-0.009
min177.488-177.485=0.003
max1323.640-1323.664=-0.024
mean77.750
σ7.500
min74.000
max89.000
mean2482.000-2837.000=-355.000
σ0.000
min2482.000-2837.000=-355.000
max2482.000-2837.000=-355.000
mean0.544-0.428=0.116
σ0.542-0.286=0.255
min0.264-0.284=-0.020
max1.357-0.858=0.499
policies=20
mean1775.160-1775.185=-0.025
σ0.348-0.333=0.015
min1774.934-1774.961=-0.027
max1775.676-1775.677=-0.002
mean740.000
σ0.000
min740.000
max740.000
mean2482.000-2837.000=-355.000
σ0.000
min2482.000-2837.000=-355.000
max2482.000-2837.000=-355.000
mean2.746-2.831=-0.084
σ0.014-0.013=0.001
min2.733-2.817=-0.085
max2.763-2.845=-0.083
policies=200
mean17758.206-17758.176=0.030
σ0.410-0.433=-0.023
min17757.959-17757.769=0.190
max17758.820-17758.780=0.040
mean7400.000
σ0.000
min7400.000
max7400.000
mean2482.000-2837.000=-355.000
σ0.000
min2482.000-2837.000=-355.000
max2482.000-2837.000=-355.000
mean27.787-28.205=-0.418
σ0.152-0.561=-0.409
min27.626-27.663=-0.038
max27.966-28.819=-0.853