Compare commits

Home / Compare 9b1d47f5 .. b88a02f2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.913=0.001
σ0.368-0.365=0.003
min53.784-53.778=0.006
max54.962-54.953=0.009
mean415.800-418.200=-2.400
σ0.422-1.033=-0.611
min415.000-417.000=-2.000
max416.000-419.000=-3.000
mean0.136-0.136=-0.000
σ0.004-0.005=-0.000
min0.129-0.129=-0.000
max0.143-0.143=0.000
cache=y
dps=1
iters=10
policies=100
mean43.140-43.141=-0.002
σ0.006-0.007=-0.001
min43.132-43.132=0.000
max43.148-43.155=-0.007
mean416.000-419.000=-3.000
σ0.000
min416.000-419.000=-3.000
max416.000-419.000=-3.000
mean0.116-0.119=-0.003
σ0.002-0.004=-0.002
min0.113-0.113=0.001
max0.120-0.125=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.083-992.071=0.012
σ1.239-1.250=-0.011
min991.491-991.502=-0.011
max997.282-997.332=-0.050
mean1061.200-1067.950=-6.750
σ313.816-321.474=-7.658
min604.000-574.000=30.000
max1562.000-1646.000=-84.000
mean1.528-1.517=0.011
σ0.086-0.053=0.033
min1.413-1.450=-0.038
max1.818-1.626=0.192

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.671-285.677=-0.005
σ0.010-0.011=-0.001
min285.656-285.659=-0.003
max285.682-285.688=-0.006
mean1562.000-1646.000=-84.000
σ0.000
min1562.000-1646.000=-84.000
max1562.000-1646.000=-84.000
mean0.376-0.375=0.000
σ0.001-0.001=0.000
min0.374-0.374=0.000
max0.377-0.376=0.001
iters=5
new-facts=1
prior-facts=6402
mean1285.641-1285.642=-0.001
σ0.127-0.140=-0.013
min1285.578-1285.574=0.003
max1285.868-1285.892=-0.024
mean1562.000-1646.000=-84.000
σ0.000
min1562.000-1646.000=-84.000
max1562.000-1646.000=-84.000
mean2.022-1.865=0.157
σ0.092-0.061=0.030
min1.867-1.806=0.061
max2.094-1.968=0.125
iters=5
new-facts=6402
prior-facts=1
mean1807.978-1807.959=0.020
σ7.047-7.002=0.045
min1804.601-1804.595=0.006
max1820.569-1820.469=0.099
mean1562.000-1646.000=-84.000
σ0.000
min1562.000-1646.000=-84.000
max1562.000-1646.000=-84.000
mean4.250-4.128=0.123
σ0.332-0.147=0.185
min3.972-3.953=0.019
max4.825-4.319=0.506
iters=5
new-facts=6402
prior-facts=6402
mean2070.460-2070.465=-0.005
σ0.014-0.015=-0.001
min2070.446-2070.450=-0.004
max2070.481-2070.488=-0.007
mean1816.000-1844.200=-28.200
σ205.676-175.652=30.024
min1562.000-1646.000=-84.000
max2085.000-2079.000=6.000
mean4.441-4.480=-0.039
σ0.070-0.057=0.013
min4.329-4.422=-0.093
max4.504-4.572=-0.068

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.516-1.249=0.267
σ0.323-0.339=-0.016
min1.041-0.904=0.137
max1.861-1.784=0.077

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.371-437.379=-0.008
σ572.354-572.360=-0.006
min151.190-151.197=-0.006
max1295.902-1295.919=-0.017
mean90.250
σ8.500
min86.000
max103.000
mean1562.000-1646.000=-84.000
σ0.000
min1562.000-1646.000=-84.000
max1562.000-1646.000=-84.000
mean0.523-0.531=-0.008
σ0.541-0.550=-0.009
min0.250-0.252=-0.002
max1.336-1.357=-0.021
policies=20
mean1512.193-1512.213=-0.020
σ0.249-0.251=-0.002
min1512.033-1512.048=-0.016
max1512.564-1512.586=-0.022
mean860.000
σ0.000
min860.000
max860.000
mean1562.000-1646.000=-84.000
σ0.000
min1562.000-1646.000=-84.000
max1562.000-1646.000=-84.000
mean2.532-2.530=0.003
σ0.015-0.009=0.006
min2.518-2.521=-0.003
max2.551-2.540=0.011
policies=200
mean15129.596-15129.582=0.014
σ0.034-0.153=-0.119
min15129.547-15129.472=0.075
max15129.621-15129.800=-0.179
mean8600.000
σ0.000
min8600.000
max8600.000
mean1562.000-1646.000=-84.000
σ0.000
min1562.000-1646.000=-84.000
max1562.000-1646.000=-84.000
mean25.759-25.662=0.097
σ0.115-0.142=-0.027
min25.664-25.542=0.122
max25.902-25.867=0.035