Compare commits

Home / Compare 267ba946 .. 6c934119

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.696-70.695=0.001
σ0.048-0.046=0.003
min70.668-70.668=0.000
max70.832-70.823=0.009
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.160-0.159=0.001
σ0.003-0.004=-0.001
min0.157-0.151=0.006
max0.168-0.165=0.003
cache=y
dps=1
iters=10
policies=100
mean21.421-21.419=0.001
σ0.004-0.003=0.001
min21.413-21.413=-0.001
max21.425-21.422=0.002
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.063-0.064=-0.001
σ0.003-0.003=-0.000
min0.061-0.060=0.001
max0.071-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.458-1754.457=0.001
σ0.360-0.358=0.002
min1753.889-1753.885=0.005
max1755.023-1755.033=-0.010
mean1646.900-1642.850=4.050
σ628.521-628.709=-0.188
min627.000-624.000=3.000
max2863.000-2854.000=9.000
mean2.809-2.828=-0.018
σ0.148-0.142=0.006
min2.490-2.546=-0.056
max3.073-3.125=-0.053

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.505-273.505=-0.000
σ0.008-0.005=0.003
min273.491-273.500=-0.009
max273.513-273.512=0.001
mean2863.000-2854.000=9.000
σ0.000
min2863.000-2854.000=9.000
max2863.000-2854.000=9.000
mean0.385-0.388=-0.003
σ0.004-0.007=-0.003
min0.383-0.381=0.002
max0.393-0.399=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1933.896-1933.893=0.003
σ0.009-0.013=-0.004
min1933.887-1933.879=0.008
max1933.909-1933.906=0.004
mean2863.000-2854.000=9.000
σ0.000
min2863.000-2854.000=9.000
max2863.000-2854.000=9.000
mean2.976-2.988=-0.012
σ0.147-0.144=0.004
min2.757-2.738=0.019
max3.152-3.092=0.060
iters=5
new-facts=6402
prior-facts=1
mean4754.704-4754.739=-0.035
σ0.868-0.807=0.061
min4754.185-4754.302=-0.118
max4756.251-4756.181=0.070
mean2863.000-2854.000=9.000
σ0.000
min2863.000-2854.000=9.000
max2863.000-2854.000=9.000
mean8.485-7.918=0.568
σ0.369-0.373=-0.004
min7.978-7.652=0.325
max9.010-8.567=0.443
iters=5
new-facts=6402
prior-facts=6402
mean4945.048-4765.021=180.027
σ0.167-402.692=-402.525
min4944.749-4044.663=900.086
max4945.135-4945.127=0.008
mean3048.800-3037.600=11.200
σ193.278-267.201=-73.923
min2863.000-2854.000=9.000
max3324.000-3466.000=-142.000
mean8.591-8.327=0.264
σ0.179-0.641=-0.462
min8.404-7.278=1.125
max8.832-8.936=-0.104

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.009-1.065=-0.055
σ0.148-0.175=-0.026
min0.937-0.928=0.010
max1.274-1.355=-0.081

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.080-473.076=0.004
σ575.909-575.912=-0.003
min185.119-185.111=0.008
max1336.943-1336.944=-0.001
mean88.250
σ8.500
min84.000
max101.000
mean2863.000-2854.000=9.000
σ0.000
min2863.000-2854.000=9.000
max2863.000-2854.000=9.000
mean0.491-0.478=0.013
σ0.377-0.363=0.013
min0.301-0.292=0.008
max1.056-1.023=0.033
policies=20
mean1851.442-1851.444=-0.001
σ0.372-0.381=-0.009
min1851.166-1851.150=0.016
max1851.983-1851.995=-0.012
mean840.000
σ0.000
min840.000
max840.000
mean2863.000-2854.000=9.000
σ0.000
min2863.000-2854.000=9.000
max2863.000-2854.000=9.000
mean2.958-2.950=0.007
σ0.010-0.007=0.003
min2.951-2.944=0.007
max2.973-2.956=0.016
policies=200
mean18519.792-18519.904=-0.112
σ0.804-0.734=0.070
min18519.121-18519.314=-0.194
max18520.848-18520.853=-0.005
mean8400.000
σ0.000
min8400.000
max8400.000
mean2863.000-2854.000=9.000
σ0.000
min2863.000-2854.000=9.000
max2863.000-2854.000=9.000
mean29.153-29.136=0.017
σ0.452-0.405=0.047
min28.740-28.727=0.012
max29.787-29.692=0.095