Compare commits

Home / Compare b129bc52 .. 6f3643ee

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.646-53.914=-0.268
σ0.364-0.367=-0.003
min53.512-53.775=-0.263
max54.682-54.959=-0.277
mean416.000-416.800=-0.800
σ0.000-0.422=-0.422
min416.000
max416.000-417.000=-1.000
mean0.139-0.139=-0.000
σ0.004-0.003=0.001
min0.134-0.136=-0.002
max0.146-0.144=0.002
cache=y
dps=1
iters=10
policies=100
mean42.945-43.142=-0.197
σ0.011-0.007=0.004
min42.935-43.133=-0.198
max42.973-43.154=-0.181
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.121-0.122=-0.000
σ0.004-0.003=0.001
min0.115-0.117=-0.002
max0.127-0.126=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.800-991.812=-0.012
σ1.237-1.236=0.000
min991.225-991.227=-0.002
max997.003-997.009=-0.007
mean1071.400-1072.700=-1.300
σ315.807-318.168=-2.361
min616.000-617.000=-1.000
max1628.000-1636.000=-8.000
mean1.520-1.520=0.001
σ0.068-0.079=-0.011
min1.399-1.396=0.003
max1.715-1.747=-0.031

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.389-285.411=-0.022
σ0.012-0.011=0.002
min285.371-285.396=-0.026
max285.401-285.420=-0.019
mean1628.000-1636.000=-8.000
σ0.000
min1628.000-1636.000=-8.000
max1628.000-1636.000=-8.000
mean0.378-0.378=0.000
σ0.006-0.007=-0.001
min0.374-0.373=0.002
max0.390-0.391=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1285.354-1285.374=-0.020
σ0.132-0.138=-0.006
min1285.289-1285.308=-0.018
max1285.590-1285.621=-0.031
mean1628.000-1636.000=-8.000
σ0.000
min1628.000-1636.000=-8.000
max1628.000-1636.000=-8.000
mean1.916-1.888=0.028
σ0.169-0.067=0.102
min1.680-1.829=-0.150
max2.140-2.001=0.140
iters=5
new-facts=6402
prior-facts=1
mean1807.668-1807.674=-0.006
σ7.049-7.026=0.023
min1804.309-1804.326=-0.017
max1820.264-1820.228=0.036
mean1628.000-1636.000=-8.000
σ0.000
min1628.000-1636.000=-8.000
max1628.000-1636.000=-8.000
mean4.112-4.058=0.054
σ0.298-0.214=0.084
min3.855-3.900=-0.045
max4.595-4.427=0.168
iters=5
new-facts=6402
prior-facts=6402
mean2070.182-2070.193=-0.010
σ0.007-0.012=-0.005
min2070.176-2070.180=-0.004
max2070.193-2070.212=-0.018
mean1859.000-1838.400=20.600
σ201.648-187.142=14.506
min1628.000-1636.000=-8.000
max2088.000-2079.000=9.000
mean4.528-4.480=0.048
σ0.080-0.048=0.032
min4.444-4.444=0.000
max4.637-4.562=0.075

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.105-1.238=-0.133
σ0.244-0.369=-0.125
min0.889-0.909=-0.020
max1.470-1.839=-0.368

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.770-436.787=-0.016
σ572.347-572.357=-0.010
min150.594-150.600=-0.006
max1295.291-1295.323=-0.031
mean90.250
σ8.500
min86.000
max103.000
mean1628.000-1636.000=-8.000
σ0.000
min1628.000-1636.000=-8.000
max1628.000-1636.000=-8.000
mean0.530-0.532=-0.001
σ0.561-0.563=-0.002
min0.249-0.249=0.000
max1.372-1.377=-0.005
policies=20
mean1506.184-1506.260=-0.076
σ0.237-0.236=0.001
min1506.028-1506.112=-0.084
max1506.537-1506.612=-0.075
mean860.000
σ0.000
min860.000
max860.000
mean1628.000-1636.000=-8.000
σ0.000
min1628.000-1636.000=-8.000
max1628.000-1636.000=-8.000
mean2.516-2.514=0.003
σ0.015-0.016=-0.001
min2.503-2.495=0.008
max2.534-2.533=0.001
policies=200
mean15069.569-15070.420=-0.851
σ0.056-0.041=0.015
min15069.498-15070.359=-0.861
max15069.631-15070.446=-0.815
mean8600.000
σ0.000
min8600.000
max8600.000
mean1628.000-1636.000=-8.000
σ0.000
min1628.000-1636.000=-8.000
max1628.000-1636.000=-8.000
mean25.563-25.513=0.051
σ0.091-0.168=-0.077
min25.457-25.320=0.137
max25.654-25.720=-0.066