Compare commits

Home / Compare 4e0ccc48 .. 07c6a108

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.648-53.915=-0.267
σ0.367-0.366=0.002
min53.520-53.784=-0.263
max54.693-54.956=-0.263
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.139-0.141=-0.002
σ0.004-0.003=0.001
min0.135-0.138=-0.003
max0.145-0.148=-0.002
cache=y
dps=1
iters=10
policies=100
mean42.941-43.142=-0.201
σ0.006-0.006=-0.001
min42.934-43.131=-0.197
max42.950-43.152=-0.202
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.119-0.121=-0.001
σ0.004-0.004=0.000
min0.114-0.117=-0.003
max0.125-0.128=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.802-991.805=-0.003
σ1.261-1.266=-0.004
min991.224-991.254=-0.030
max997.113-997.136=-0.024
mean1060.450-1065.800=-5.350
σ322.078-322.730=-0.652
min565.000-568.000=-3.000
max1629.000-1642.000=-13.000
mean1.523-1.550=-0.026
σ0.071-0.105=-0.034
min1.455-1.436=0.019
max1.755-1.882=-0.127

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.392-285.411=-0.019
σ0.014-0.012=0.003
min285.368-285.397=-0.029
max285.405-285.428=-0.023
mean1629.000-1642.000=-13.000
σ0.000
min1629.000-1642.000=-13.000
max1629.000-1642.000=-13.000
mean0.380-0.385=-0.005
σ0.008-0.010=-0.001
min0.374-0.374=-0.001
max0.395-0.394=0.000
iters=5
new-facts=1
prior-facts=6402
mean1285.355-1285.380=-0.025
σ0.127-0.137=-0.010
min1285.296-1285.314=-0.018
max1285.582-1285.625=-0.044
mean1629.000-1642.000=-13.000
σ0.000
min1629.000-1642.000=-13.000
max1629.000-1642.000=-13.000
mean2.024-1.926=0.097
σ0.247-0.165=0.081
min1.820-1.679=0.141
max2.406-2.138=0.268
iters=5
new-facts=6402
prior-facts=1
mean1807.708-1807.707=0.001
σ6.996-6.996=-0.000
min1804.336-1804.327=0.009
max1820.206-1820.204=0.002
mean1629.000-1642.000=-13.000
σ0.000
min1629.000-1642.000=-13.000
max1629.000-1642.000=-13.000
mean4.242-4.115=0.127
σ0.171-0.245=-0.074
min4.027-3.859=0.169
max4.464-4.460=0.004
iters=5
new-facts=6402
prior-facts=6402
mean2070.176-2070.194=-0.018
σ0.008-0.013=-0.005
min2070.167-2070.182=-0.015
max2070.182-2070.215=-0.033
mean1855.600-1848.800=6.800
σ200.450-186.557=13.893
min1629.000-1642.000=-13.000
max2084.000
mean4.481-4.507=-0.027
σ0.078-0.056=0.022
min4.390-4.464=-0.074
max4.566-4.602=-0.036

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.232-1.191=0.041
σ0.325-0.326=-0.001
min0.915-0.899=0.016
max1.766-1.704=0.062

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.777-436.787=-0.009
σ572.360-572.364=-0.004
min150.589-150.603=-0.014
max1295.318-1295.333=-0.016
mean90.250
σ8.500
min86.000
max103.000
mean1629.000-1642.000=-13.000
σ0.000
min1629.000-1642.000=-13.000
max1629.000-1642.000=-13.000
mean0.515-0.515=-0.000
σ0.527-0.533=-0.006
min0.250-0.248=0.002
max1.306-1.315=-0.009
policies=20
mean1506.156-1506.276=-0.120
σ0.229-0.230=-0.001
min1506.015-1506.140=-0.125
max1506.498-1506.620=-0.122
mean860.000
σ0.000
min860.000
max860.000
mean1629.000-1642.000=-13.000
σ0.000
min1629.000-1642.000=-13.000
max1629.000-1642.000=-13.000
mean2.514-2.515=-0.001
σ0.025-0.015=0.009
min2.491-2.494=-0.003
max2.547-2.527=0.020
policies=200
mean15069.366-15070.306=-0.939
σ0.059-0.065=-0.007
min15069.286-15070.236=-0.951
max15069.422-15070.369=-0.947
mean8600.000
σ0.000
min8600.000
max8600.000
mean1629.000-1642.000=-13.000
σ0.000
min1629.000-1642.000=-13.000
max1629.000-1642.000=-13.000
mean25.402-25.563=-0.161
σ0.166-0.090=0.076
min25.153-25.460=-0.307
max25.497-25.658=-0.161