Compare commits

Home / Compare 8bc21584 .. 2b2cf35a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.654-53.654=0.001
σ0.366-0.370=-0.004
min53.517-53.517=0.001
max54.696-54.707=-0.012
mean415.000-419.000=-4.000
σ0.000
min415.000-419.000=-4.000
max415.000-419.000=-4.000
mean0.136-0.137=-0.001
σ0.005-0.004=0.001
min0.130-0.131=-0.001
max0.144-0.144=0.001
cache=y
dps=1
iters=10
policies=100
mean42.981-42.981=-0.001
σ0.006-0.007=-0.001
min42.970-42.973=-0.003
max42.991-42.993=-0.002
mean415.000-419.000=-4.000
σ0.000
min415.000-419.000=-4.000
max415.000-419.000=-4.000
mean0.121-0.120=0.001
σ0.003-0.003=-0.001
min0.118-0.117=0.002
max0.125-0.127=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.970-1013.967=0.003
σ1.205-1.211=-0.006
min1013.423-1013.426=-0.003
max1019.014-1019.039=-0.025
mean1055.200-1053.300=1.900
σ322.695-316.887=5.808
min546.000-589.000=-43.000
max1670.000-1655.000=15.000
mean1.660-1.630=0.030
σ0.103-0.085=0.018
min1.553-1.553=0.000
max1.905-1.855=0.051

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.162-299.004=0.159
σ0.226-0.181=0.046
min299.011-298.865=0.146
max299.784-299.480=0.304
mean2039.000-1945.000=94.000
σ0.000
min2039.000-1945.000=94.000
max2039.000-1945.000=94.000
mean0.601-0.556=0.045
σ0.031-0.023=0.008
min0.542-0.507=0.034
max0.650-0.598=0.052

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.673-294.677=-0.005
σ0.015-0.021=-0.006
min294.648-294.649=-0.000
max294.688-294.707=-0.020
mean1670.000-1655.000=15.000
σ0.000
min1670.000-1655.000=15.000
max1670.000-1655.000=15.000
mean0.384-0.387=-0.004
σ0.001-0.008=-0.007
min0.382-0.380=0.002
max0.385-0.397=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1316.962-1316.935=0.026
σ0.067-0.095=-0.027
min1316.850-1316.879=-0.030
max1317.025-1317.104=-0.079
mean1670.000-1655.000=15.000
σ0.000
min1670.000-1655.000=15.000
max1670.000-1655.000=15.000
mean2.043-1.977=0.066
σ0.194-0.081=0.112
min1.837-1.861=-0.024
max2.293-2.088=0.205
iters=5
new-facts=6402
prior-facts=1
mean1555.363-1555.291=0.072
σ6.853-6.893=-0.040
min1552.112-1551.947=0.165
max1567.618-1567.615=0.003
mean1670.000-1655.000=15.000
σ0.000
min1670.000-1655.000=15.000
max1670.000-1655.000=15.000
mean2.385-2.281=0.103
σ0.385-0.353=0.032
min1.861-1.942=-0.081
max2.831-2.878=-0.046
iters=5
new-facts=6402
prior-facts=6402
mean1884.772-1884.781=-0.009
σ0.032-0.044=-0.012
min1884.748-1884.758=-0.010
max1884.827-1884.860=-0.033
mean1787.000-1778.800=8.200
σ155.800-106.994=48.806
min1670.000-1655.000=15.000
max2039.000-1945.000=94.000
mean3.010-3.019=-0.009
σ0.177-0.163=0.014
min2.865-2.856=0.009
max3.248-3.254=-0.007

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.198-1.185=0.014
σ0.367-0.344=0.023
min0.916-0.912=0.004
max1.777-1.750=0.027

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.487-440.489=-0.001
σ573.034-573.034=0.000
min153.966-153.960=0.006
max1300.038-1300.039=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1670.000-1655.000=15.000
σ0.000
min1670.000-1655.000=15.000
max1670.000-1655.000=15.000
mean0.538-0.537=0.000
σ0.554-0.557=-0.004
min0.259-0.258=0.001
max1.368-1.373=-0.005
policies=20
mean1539.853-1539.860=-0.007
σ0.321-0.316=0.005
min1539.657-1539.678=-0.020
max1540.333-1540.333=-0.000
mean920.000
σ0.000
min920.000
max920.000
mean1670.000-1655.000=15.000
σ0.000
min1670.000-1655.000=15.000
max1670.000-1655.000=15.000
mean2.613-2.591=0.022
σ0.018-0.022=-0.004
min2.598-2.572=0.026
max2.638-2.611=0.027
policies=200
mean15406.502-15406.597=-0.096
σ0.145-0.081=0.064
min15406.299-15406.503=-0.204
max15406.617-15406.695=-0.078
mean9200.000
σ0.000
min9200.000
max9200.000
mean1670.000-1655.000=15.000
σ0.000
min1670.000-1655.000=15.000
max1670.000-1655.000=15.000
mean26.393-26.225=0.169
σ0.161-0.138=0.023
min26.236-26.090=0.145
max26.562-26.388=0.174