Compare commits

Home / Compare c700e33c .. e5793685

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.567-70.563=0.004
σ0.045-0.047=-0.002
min70.538-70.541=-0.003
max70.691-70.694=-0.004
mean417.600-413.000=4.600
σ0.843-0.000=0.843
min416.000-413.000=3.000
max418.000-413.000=5.000
mean0.161-0.160=0.001
σ0.005-0.003=0.002
min0.150-0.157=-0.007
max0.168-0.164=0.004
cache=y
dps=1
iters=10
policies=100
mean21.287-21.291=-0.004
σ0.003-0.011=-0.008
min21.283-21.282=0.000
max21.292-21.322=-0.031
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.065-0.063=0.002
σ0.003-0.004=-0.001
min0.063-0.059=0.004
max0.073-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.373-1753.373=0.000
σ0.361-0.358=0.003
min1752.811-1752.805=0.005
max1753.974-1753.938=0.037
mean1664.100-1652.350=11.750
σ637.203-645.985=-8.782
min620.000-632.000=-12.000
max2813.000-2885.000=-72.000
mean2.796-2.821=-0.025
σ0.200-0.134=0.065
min2.281-2.549=-0.268
max3.098-3.029=0.068

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.110-272.095=0.015
σ0.004-0.015=-0.011
min272.103-272.079=0.024
max272.114-272.120=-0.006
mean2813.000-2885.000=-72.000
σ0.000
min2813.000-2885.000=-72.000
max2813.000-2885.000=-72.000
mean0.391-0.387=0.004
σ0.009-0.010=-0.002
min0.380-0.379=0.002
max0.399-0.403=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1932.534-1932.536=-0.001
σ0.014-0.005=0.010
min1932.520-1932.530=-0.011
max1932.554-1932.542=0.012
mean2813.000-2885.000=-72.000
σ0.000
min2813.000-2885.000=-72.000
max2813.000-2885.000=-72.000
mean2.958-2.948=0.010
σ0.176-0.203=-0.027
min2.674-2.630=0.044
max3.141-3.196=-0.055
iters=5
new-facts=6402
prior-facts=1
mean4753.194-4753.296=-0.102
σ0.993-0.822=0.171
min4752.371-4752.882=-0.511
max4754.914-4754.762=0.152
mean2813.000-2885.000=-72.000
σ0.000
min2813.000-2885.000=-72.000
max2813.000-2885.000=-72.000
mean8.393-8.350=0.042
σ0.420-0.310=0.110
min8.011-7.798=0.212
max9.057-8.531=0.526
iters=5
new-facts=6402
prior-facts=6402
mean4943.737-4943.661=0.076
σ0.018-0.166=-0.148
min4943.715-4943.366=0.349
max4943.757-4943.753=0.004
mean3026.600-3074.600=-48.000
σ276.905-188.516=88.389
min2813.000-2885.000=-72.000
max3450.000-3323.000=127.000
mean8.523-8.606=-0.083
σ0.153-0.208=-0.054
min8.378-8.447=-0.070
max8.752-8.960=-0.208

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.085-1.065=0.020
σ0.207-0.283=-0.076
min0.932-0.936=-0.004
max1.437-1.572=-0.135

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.863-467.861=0.003
σ575.933-575.923=0.009
min179.888-179.892=-0.003
max1331.763-1331.746=0.017
mean86.250
σ8.500
min82.000
max99.000
mean2813.000-2885.000=-72.000
σ0.000
min2813.000-2885.000=-72.000
max2813.000-2885.000=-72.000
mean0.480-0.449=0.032
σ0.394-0.309=0.085
min0.280-0.293=-0.013
max1.071-0.912=0.160
policies=20
mean1799.176-1799.174=0.002
σ0.365-0.370=-0.005
min1798.888-1798.914=-0.026
max1799.711-1799.719=-0.008
mean820.000
σ0.000
min820.000
max820.000
mean2813.000-2885.000=-72.000
σ0.000
min2813.000-2885.000=-72.000
max2813.000-2885.000=-72.000
mean2.814-2.887=-0.073
σ0.007-0.010=-0.003
min2.804-2.880=-0.076
max2.820-2.902=-0.081
policies=200
mean17998.112-17998.541=-0.429
σ0.800-0.513=0.287
min17997.333-17998.228=-0.894
max17999.144-17999.305=-0.161
mean8200.000
σ0.000
min8200.000
max8200.000
mean2813.000-2885.000=-72.000
σ0.000
min2813.000-2885.000=-72.000
max2813.000-2885.000=-72.000
mean28.262-28.554=-0.292
σ0.078-0.480=-0.402
min28.187-28.096=0.091
max28.362-29.076=-0.714