Compare commits

Home / Compare 836d2d73 .. e62ee4ea

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.709-53.710=-0.001
σ0.363-0.362=0.001
min53.574-53.575=-0.001
max54.741-54.738=0.002
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.138-0.139=-0.001
σ0.004-0.004=0.000
min0.134-0.135=-0.001
max0.145-0.145=0.000
cache=y
dps=1
iters=10
policies=100
mean42.978-42.979=-0.001
σ0.005-0.004=0.001
min42.969-42.973=-0.004
max42.987-42.986=0.001
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.118-0.119=-0.001
σ0.004-0.004=-0.000
min0.113-0.112=0.001
max0.125-0.125=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean995.219-995.223=-0.004
σ1.206-1.184=0.022
min994.689-994.685=0.004
max1000.283-1000.194=0.089
mean1066.500-1064.000=2.500
σ318.658-317.909=0.749
min607.000-611.000=-4.000
max1630.000-1628.000=2.000
mean1.482-1.480=0.002
σ0.075-0.088=-0.012
min1.372-1.393=-0.020
max1.645-1.653=-0.008

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.322-297.321=0.001
σ0.007-0.010=-0.003
min297.313-297.314=-0.001
max297.332-297.340=-0.007
mean1630.000-1628.000=2.000
σ0.000
min1630.000-1628.000=2.000
max1630.000-1628.000=2.000
mean0.396-0.386=0.010
σ0.007-0.002=0.006
min0.388-0.383=0.004
max0.404-0.388=0.017
iters=5
new-facts=1
prior-facts=6402
mean1299.025-1299.002=0.023
σ0.052-0.090=-0.037
min1298.934-1298.847=0.087
max1299.068-1299.064=0.004
mean1630.000-1628.000=2.000
σ0.000
min1630.000-1628.000=2.000
max1630.000-1628.000=2.000
mean1.995-1.888=0.107
σ0.228-0.045=0.183
min1.844-1.841=0.004
max2.378-1.951=0.427
iters=5
new-facts=6402
prior-facts=1
mean1719.186-1719.170=0.016
σ6.888-6.932=-0.044
min1715.994-1715.967=0.027
max1731.505-1731.567=-0.063
mean1630.000-1628.000=2.000
σ0.000
min1630.000-1628.000=2.000
max1630.000-1628.000=2.000
mean2.863-3.087=-0.224
σ0.244-0.487=-0.243
min2.554-2.701=-0.147
max3.233-3.912=-0.678
iters=5
new-facts=6402
prior-facts=6402
mean1981.921-1981.955=-0.034
σ0.040-0.011=0.029
min1981.852-1981.943=-0.092
max1981.948-1981.969=-0.021
mean1821.000-1825.200=-4.200
σ211.185-207.361=3.823
min1630.000-1628.000=2.000
max2134.000-2100.000=34.000
mean3.347-3.255=0.092
σ0.399-0.111=0.288
min3.089-3.101=-0.012
max4.056-3.384=0.672

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.206-1.248=-0.042
σ0.366-0.286=0.080
min0.908-1.030=-0.122
max1.805-1.703=0.102

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.464-440.455=0.009
σ573.037-573.031=0.007
min153.936-153.936=0.000
max1300.020-1300.001=0.019
mean94.250
σ8.500
min90.000
max107.000
mean1630.000-1628.000=2.000
σ0.000
min1630.000-1628.000=2.000
max1630.000-1628.000=2.000
mean0.557-0.551=0.007
σ0.603-0.583=0.020
min0.255-0.257=-0.002
max1.462-1.425=0.037
policies=20
mean1539.610-1539.587=0.023
σ0.301-0.297=0.004
min1539.416-1539.392=0.024
max1540.058-1540.028=0.030
mean900.000
σ0.000
min900.000
max900.000
mean1630.000-1628.000=2.000
σ0.000
min1630.000-1628.000=2.000
max1630.000-1628.000=2.000
mean2.566-2.557=0.010
σ0.027-0.013=0.015
min2.528-2.544=-0.016
max2.592-2.570=0.021
policies=200
mean15404.127-15404.084=0.043
σ0.069-0.078=-0.010
min15404.073-15403.993=0.079
max15404.228-15404.177=0.050
mean9000.000
σ0.000
min9000.000
max9000.000
mean1630.000-1628.000=2.000
σ0.000
min1630.000-1628.000=2.000
max1630.000-1628.000=2.000
mean26.008-25.946=0.062
σ0.159-0.171=-0.012
min25.862-25.759=0.103
max26.219-26.126=0.093