Compare commits

Home / Compare 8f21fc97 .. 6b81fadb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.654-53.653=0.001
σ0.367-0.366=0.001
min53.515-53.508=0.007
max54.698-54.695=0.004
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.138-0.137=0.001
σ0.004-0.005=-0.001
min0.132-0.130=0.001
max0.145-0.145=-0.001
cache=y
dps=1
iters=10
policies=100
mean42.981-42.980=0.000
σ0.006-0.005=0.001
min42.973-42.975=-0.002
max42.989-42.988=0.001
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.119-0.119=-0.001
σ0.005-0.003=0.002
min0.113-0.117=-0.004
max0.126-0.128=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.977-1013.976=0.001
σ1.159-1.173=-0.014
min1013.432-1013.434=-0.002
max1018.823-1018.882=-0.060
mean1050.150-1051.800=-1.650
σ316.754-316.755=-0.000
min597.000-587.000=10.000
max1655.000
mean1.611-1.630=-0.019
σ0.080-0.099=-0.019
min1.519-1.493=0.026
max1.849-1.886=-0.037

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.305-299.321=-0.016
σ0.188-0.184=0.004
min299.174-299.154=0.020
max299.825-299.794=0.031
mean1974.000-1967.000=7.000
σ0.000
min1974.000-1967.000=7.000
max1974.000-1967.000=7.000
mean0.586-0.577=0.009
σ0.028-0.028=-0.001
min0.544-0.540=0.004
max0.611-0.618=-0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.682-294.681=0.001
σ0.021-0.011=0.009
min294.665-294.668=-0.004
max294.715-294.696=0.019
mean1655.000
σ0.000
min1655.000
max1655.000
mean0.392-0.387=0.006
σ0.014-0.007=0.006
min0.382-0.381=0.000
max0.412-0.399=0.013
iters=5
new-facts=1
prior-facts=6402
mean1316.933-1316.980=-0.047
σ0.103-0.087=0.016
min1316.881-1316.903=-0.022
max1317.118-1317.101=0.017
mean1655.000
σ0.000
min1655.000
max1655.000
mean1.895-1.986=-0.091
σ0.103-0.099=0.004
min1.753-1.864=-0.111
max2.010-2.116=-0.106
iters=5
new-facts=6402
prior-facts=1
mean1555.316-1555.293=0.023
σ6.872-6.891=-0.020
min1552.000-1551.980=0.020
max1567.603-1567.615=-0.013
mean1655.000
σ0.000
min1655.000
max1655.000
mean2.353-2.306=0.047
σ0.214-0.281=-0.066
min2.157-2.144=0.013
max2.657-2.801=-0.145
iters=5
new-facts=6402
prior-facts=6402
mean1884.785-1884.780=0.005
σ0.036-0.021=0.015
min1884.761-1884.765=-0.003
max1884.848-1884.816=0.032
mean1750.200-1777.000=-26.800
σ140.249-129.736=10.512
min1655.000
max1974.000-1967.000=7.000
mean3.001-2.954=0.047
σ0.139-0.078=0.061
min2.895-2.870=0.025
max3.199-3.051=0.148

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.188-1.097=0.091
σ0.350-0.168=0.182
min0.908-0.910=-0.002
max1.778-1.316=0.461

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.681-440.676=0.005
σ573.412-573.398=0.014
min153.969-153.973=-0.004
max1300.800-1300.774=0.026
mean96.250
σ8.500
min92.000
max109.000
mean1655.000
σ0.000
min1655.000
max1655.000
mean0.551-0.546=0.005
σ0.561-0.548=0.014
min0.268-0.256=0.012
max1.393-1.367=0.026
policies=20
mean1539.894-1539.921=-0.027
σ0.302-0.315=-0.013
min1539.724-1539.737=-0.014
max1540.347-1540.392=-0.045
mean920.000
σ0.000
min920.000
max920.000
mean1655.000
σ0.000
min1655.000
max1655.000
mean2.583-2.596=-0.014
σ0.014-0.025=-0.012
min2.569-2.576=-0.007
max2.594-2.633=-0.038
policies=200
mean15406.980-15407.035=-0.055
σ0.039-0.031=0.008
min15406.942-15406.996=-0.054
max15407.019-15407.072=-0.053
mean9200.000
σ0.000
min9200.000
max9200.000
mean1655.000
σ0.000
min1655.000
max1655.000
mean26.391-26.238=0.152
σ0.100-0.092=0.007
min26.273-26.106=0.167
max26.502-26.308=0.194