Compare commits

Home / Compare 216cc304 .. 5d06193f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.703-70.703=0.000
σ0.046-0.046=0.000
min70.677-70.674=0.002
max70.832-70.829=0.003
mean417.500-415.000=2.500
σ0.527-0.000=0.527
min417.000-415.000=2.000
max418.000-415.000=3.000
mean0.160-0.162=-0.002
σ0.004-0.010=-0.006
min0.151-0.150=0.001
max0.167-0.181=-0.013
cache=y
dps=1
iters=10
policies=100
mean21.409-21.408=0.000
σ0.002-0.003=-0.000
min21.404-21.403=0.001
max21.413-21.411=0.002
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.064-0.065=-0.001
σ0.003-0.002=0.001
min0.060-0.063=-0.004
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.899-1754.899=0.000
σ0.360-0.362=-0.002
min1754.326-1754.337=-0.011
max1755.469-1755.483=-0.013
mean1641.350-1632.150=9.200
σ619.063-608.059=11.004
min635.000-632.000=3.000
max2482.000-2447.000=35.000
mean2.784-2.882=-0.097
σ0.186-0.077=0.109
min2.344-2.745=-0.401
max2.994-3.020=-0.025

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.759-272.759=-0.000
σ0.006-0.002=0.004
min272.749-272.755=-0.006
max272.765-272.762=0.003
mean2482.000-2447.000=35.000
σ0.000
min2482.000-2447.000=35.000
max2482.000-2447.000=35.000
mean0.387-0.387=-0.001
σ0.007-0.005=0.002
min0.382-0.382=0.000
max0.399-0.394=0.005
iters=5
new-facts=1
prior-facts=6402
mean1933.126-1933.132=-0.007
σ0.008-0.015=-0.007
min1933.114-1933.114=-0.001
max1933.136-1933.154=-0.018
mean2482.000-2447.000=35.000
σ0.000
min2482.000-2447.000=35.000
max2482.000-2447.000=35.000
mean3.074-2.974=0.100
σ0.134-0.132=0.002
min2.901-2.753=0.148
max3.239-3.086=0.152
iters=5
new-facts=6402
prior-facts=1
mean4753.905-4753.751=0.154
σ0.969-1.024=-0.055
min4753.362-4752.845=0.517
max4755.625-4755.518=0.107
mean2482.000-2447.000=35.000
σ0.000
min2482.000-2447.000=35.000
max2482.000-2447.000=35.000
mean8.692-8.750=-0.058
σ0.635-0.281=0.354
min7.718-8.373=-0.655
max9.387-9.024=0.363
iters=5
new-facts=6402
prior-facts=6402
mean4944.227-4944.361=-0.135
σ0.191-0.014=0.177
min4944.011-4944.347=-0.336
max4944.383-4944.378=0.005
mean3006.800-2919.600=87.200
σ298.793-399.178=-100.385
min2613.000-2447.000=166.000
max3383.000-3474.000=-91.000
mean8.552-8.387=0.165
σ0.174-0.073=0.101
min8.349-8.311=0.038
max8.805-8.496=0.309

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.789-1.846=-0.057
σ0.098-0.076=0.022
min1.698-1.787=-0.089
max1.899-1.964=-0.065

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.999-468.997=0.003
σ575.612-575.613=-0.001
min181.185-181.187=-0.002
max1332.417-1332.416=0.002
mean88.250
σ8.500
min84.000
max101.000
mean2482.000-2447.000=35.000
σ0.000
min2482.000-2447.000=35.000
max2482.000-2447.000=35.000
mean0.557-0.569=-0.012
σ0.528-0.552=-0.023
min0.286-0.290=-0.004
max1.349-1.396=-0.047
policies=20
mean1812.192-1812.212=-0.020
σ0.384-0.392=-0.009
min1811.941-1811.951=-0.011
max1812.758-1812.790=-0.032
mean840.000
σ0.000
min840.000
max840.000
mean2482.000-2447.000=35.000
σ0.000
min2482.000-2447.000=35.000
max2482.000-2447.000=35.000
mean2.853-2.849=0.004
σ0.027-0.005=0.022
min2.820-2.844=-0.024
max2.884-2.854=0.030
policies=200
mean18129.257-18129.217=0.040
σ0.492-0.473=0.020
min18128.890-18128.926=-0.036
max18129.983-18129.921=0.062
mean8400.000
σ0.000
min8400.000
max8400.000
mean2482.000-2447.000=35.000
σ0.000
min2482.000-2447.000=35.000
max2482.000-2447.000=35.000
mean28.578-28.653=-0.074
σ0.088-0.124=-0.035
min28.454-28.544=-0.090
max28.659-28.829=-0.170