Compare commits

Home / Compare 1f969a64 .. 5079728a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.709-53.707=0.002
σ0.366-0.363=0.003
min53.572-53.574=-0.002
max54.749-54.738=0.011
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.137-0.135=0.002
σ0.003-0.004=-0.001
min0.134-0.129=0.005
max0.143-0.141=0.001
cache=y
dps=1
iters=10
policies=100
mean42.979-42.978=0.001
σ0.006-0.005=0.001
min42.964-42.971=-0.006
max42.986-42.989=-0.002
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.120-0.118=0.002
σ0.003-0.004=-0.001
min0.116-0.112=0.003
max0.125-0.124=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean995.222-995.217=0.004
σ1.230-1.189=0.041
min994.684-994.688=-0.004
max1000.387-1000.209=0.178
mean1058.800-1055.800=3.000
σ315.568-311.801=3.767
min592.000-593.000=-1.000
max1563.000-1513.000=50.000
mean1.507-1.489=0.018
σ0.129-0.136=-0.007
min1.388-1.384=0.005
max1.949-2.007=-0.057

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.307-297.306=0.002
σ0.017-0.019=-0.002
min297.277-297.273=0.004
max297.321-297.324=-0.002
mean1563.000-1513.000=50.000
σ0.000
min1563.000-1513.000=50.000
max1563.000-1513.000=50.000
mean0.392-0.390=0.003
σ0.010-0.001=0.009
min0.386-0.388=-0.001
max0.409-0.391=0.019
iters=5
new-facts=1
prior-facts=6402
mean1299.000-1299.011=-0.011
σ0.092-0.093=-0.001
min1298.840-1298.844=-0.004
max1299.070-1299.064=0.006
mean1563.000-1513.000=50.000
σ0.000
min1563.000-1513.000=50.000
max1563.000-1513.000=50.000
mean1.883-1.870=0.012
σ0.074-0.055=0.018
min1.772-1.844=-0.072
max1.939-1.969=-0.030
iters=5
new-facts=6402
prior-facts=1
mean1719.187-1719.180=0.007
σ6.895-6.925=-0.030
min1715.994-1715.989=0.005
max1731.519-1731.566=-0.047
mean1563.000-1513.000=50.000
σ0.000
min1563.000-1513.000=50.000
max1563.000-1513.000=50.000
mean3.045-2.906=0.139
σ0.220-0.417=-0.197
min2.854-2.599=0.254
max3.352-3.624=-0.272
iters=5
new-facts=6402
prior-facts=6402
mean1981.935-1981.920=0.014
σ0.046-0.033=0.014
min1981.868-1981.863=0.005
max1981.996-1981.943=0.053
mean1848.000-1793.800=54.200
σ245.423-234.260=11.163
min1563.000-1522.000=41.000
max2144.000-2121.000=23.000
mean3.271-3.343=-0.072
σ0.262-0.363=-0.102
min3.078-3.105=-0.027
max3.716-3.988=-0.272

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.379-1.533=-0.154
σ0.347-0.303=0.044
min0.906-1.179=-0.273
max1.687-1.761=-0.073

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.449-440.450=-0.001
σ573.033-573.029=0.004
min153.929-153.929=-0.000
max1299.999-1299.993=0.006
mean94.250
σ8.500
min90.000
max107.000
mean1563.000-1513.000=50.000
σ0.000
min1563.000-1513.000=50.000
max1563.000-1513.000=50.000
mean0.560-0.523=0.037
σ0.597-0.529=0.068
min0.257-0.258=-0.001
max1.456-1.317=0.139
policies=20
mean1539.563-1539.559=0.004
σ0.311-0.322=-0.010
min1539.358-1539.351=0.008
max1540.026-1540.037=-0.011
mean900.000
σ0.000
min900.000
max900.000
mean1563.000-1513.000=50.000
σ0.000
min1563.000-1513.000=50.000
max1563.000-1513.000=50.000
mean2.573-2.591=-0.018
σ0.023-0.027=-0.004
min2.557-2.555=0.002
max2.606-2.615=-0.009
policies=200
mean15403.761-15403.715=0.046
σ0.065-0.075=-0.009
min15403.698-15403.641=0.057
max15403.843-15403.787=0.055
mean9000.000
σ0.000
min9000.000
max9000.000
mean1563.000-1513.000=50.000
σ0.000
min1563.000-1513.000=50.000
max1563.000-1513.000=50.000
mean25.992-26.136=-0.145
σ0.151-0.205=-0.054
min25.798-25.896=-0.098
max26.116-26.384=-0.268