Compare commits

Home / Compare ca084f58 .. de6a04e7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.916-53.913=0.003
σ0.368-0.368=-0.001
min53.787-53.788=-0.001
max54.962-54.961=0.001
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.138-0.136=0.002
σ0.003-0.005=-0.002
min0.136-0.131=0.005
max0.145-0.144=0.000
cache=y
dps=1
iters=10
policies=100
mean43.140-43.140=0.000
σ0.004-0.007=-0.003
min43.133-43.130=0.003
max43.146-43.153=-0.007
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.120-0.121=-0.002
σ0.003-0.002=0.000
min0.117-0.119=-0.002
max0.127-0.126=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.081-992.076=0.005
σ1.222-1.257=-0.034
min991.497-991.522=-0.025
max997.209-997.366=-0.157
mean1062.850-1067.600=-4.750
σ312.815-319.468=-6.652
min605.000-572.000=33.000
max1598.000-1650.000=-52.000
mean1.541-1.543=-0.001
σ0.088-0.082=0.006
min1.439-1.408=0.031
max1.826-1.745=0.080

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.605-285.605=0.001
σ0.014-0.014=-0.000
min285.583-285.582=0.001
max285.617-285.619=-0.002
mean1598.000-1650.000=-52.000
σ0.000
min1598.000-1650.000=-52.000
max1598.000-1650.000=-52.000
mean0.376-0.378=-0.002
σ0.002-0.007=-0.005
min0.374-0.374=-0.000
max0.379-0.391=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1285.565-1285.565=0.001
σ0.136-0.129=0.007
min1285.500-1285.503=-0.003
max1285.808-1285.795=0.013
mean1598.000-1650.000=-52.000
σ0.000
min1598.000-1650.000=-52.000
max1598.000-1650.000=-52.000
mean1.875-1.853=0.022
σ0.090-0.081=0.010
min1.787-1.759=0.028
max2.025-1.979=0.046
iters=5
new-facts=6402
prior-facts=1
mean1807.886-1807.910=-0.024
σ7.039-7.019=0.020
min1804.508-1804.546=-0.037
max1820.465-1820.450=0.015
mean1598.000-1650.000=-52.000
σ0.000
min1598.000-1650.000=-52.000
max1598.000-1650.000=-52.000
mean4.111-4.223=-0.112
σ0.286-0.190=0.096
min3.752-3.970=-0.218
max4.512-4.499=0.013
iters=5
new-facts=6402
prior-facts=6402
mean2070.388-2070.391=-0.003
σ0.006-0.010=-0.004
min2070.378-2070.380=-0.002
max2070.392-2070.405=-0.013
mean1860.200-1872.600=-12.400
σ210.496-195.817=14.679
min1598.000-1650.000=-52.000
max2090.000-2099.000=-9.000
mean4.457-4.543=-0.086
σ0.022-0.065=-0.043
min4.429-4.475=-0.046
max4.487-4.623=-0.136

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.309-1.239=0.070
σ0.332-0.333=-0.001
min0.990-1.037=-0.047
max1.762-1.817=-0.056

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.381-437.380=0.001
σ572.368-572.363=0.006
min151.194-151.197=-0.003
max1295.933-1295.924=0.010
mean90.250
σ8.500
min86.000
max103.000
mean1598.000-1650.000=-52.000
σ0.000
min1598.000-1650.000=-52.000
max1598.000-1650.000=-52.000
mean0.526-0.542=-0.016
σ0.530-0.566=-0.036
min0.255-0.257=-0.002
max1.322-1.392=-0.070
policies=20
mean1512.187-1512.211=-0.025
σ0.246-0.254=-0.008
min1512.026-1512.048=-0.021
max1512.553-1512.590=-0.037
mean860.000
σ0.000
min860.000
max860.000
mean1598.000-1650.000=-52.000
σ0.000
min1598.000-1650.000=-52.000
max1598.000-1650.000=-52.000
mean2.522-2.532=-0.011
σ0.015-0.015=0.001
min2.506-2.511=-0.005
max2.542-2.542=-0.000
policies=200
mean15129.672-15129.628=0.044
σ0.136-0.055=0.081
min15129.479-15129.564=-0.086
max15129.784-15129.677=0.107
mean8600.000
σ0.000
min8600.000
max8600.000
mean1598.000-1650.000=-52.000
σ0.000
min1598.000-1650.000=-52.000
max1598.000-1650.000=-52.000
mean25.645-25.665=-0.019
σ0.110-0.115=-0.005
min25.554-25.502=0.053
max25.797-25.751=0.046