Compare commits

Home / Compare 7b518fbf .. 68cd1ac2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.822-53.654=0.168
σ0.367-0.368=-0.001
min53.679-53.516=0.162
max54.867-54.701=0.166
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.138-0.138=-0.000
σ0.003-0.004=-0.001
min0.134-0.134=0.000
max0.143-0.145=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.209-42.980=0.228
σ0.007-0.006=0.001
min43.199-42.973=0.226
max43.221-42.994=0.227
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.121-0.119=0.002
σ0.003-0.005=-0.001
min0.119-0.114=0.004
max0.130-0.127=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.177-1013.973=2.204
σ1.177-1.195=-0.018
min1015.630-1013.428=2.202
max1021.108-1018.970=2.139
mean1052.550-1069.000=-16.450
σ311.919-313.043=-1.125
min589.000-560.000=29.000
max1672.000-1638.000=34.000
mean1.588-1.632=-0.044
σ0.093-0.083=0.010
min1.504-1.554=-0.050
max1.808-1.890=-0.082

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.246-298.979=2.267
σ0.216-0.216=0.001
min301.003-298.846=2.157
max301.772-299.568=2.205
mean1958.000-2067.000=-109.000
σ0.000
min1958.000-2067.000=-109.000
max1958.000-2067.000=-109.000
mean0.551-0.573=-0.022
σ0.043-0.019=0.023
min0.502-0.548=-0.045
max0.604-0.598=0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.697-294.678=6.019
σ0.027-0.014=0.013
min300.665-294.660=6.005
max300.734-294.698=6.036
mean1672.000-1638.000=34.000
σ0.000
min1672.000-1638.000=34.000
max1672.000-1638.000=34.000
mean0.395-0.384=0.011
σ0.007-0.001=0.007
min0.389-0.383=0.006
max0.406-0.385=0.021
iters=5
new-facts=1
prior-facts=6402
mean1322.866-1316.946=5.920
σ0.099-0.099=0.001
min1322.809-1316.895=5.914
max1323.043-1317.122=5.921
mean1672.000-1638.000=34.000
σ0.000
min1672.000-1638.000=34.000
max1672.000-1638.000=34.000
mean1.944-1.952=-0.008
σ0.088-0.058=0.030
min1.813-1.884=-0.071
max2.031-2.009=0.022
iters=5
new-facts=6402
prior-facts=1
mean1561.311-1555.289=6.022
σ6.877-6.881=-0.004
min1557.972-1551.949=6.023
max1573.605-1567.590=6.015
mean1672.000-1638.000=34.000
σ0.000
min1672.000-1638.000=34.000
max1672.000-1638.000=34.000
mean2.361-2.325=0.036
σ0.270-0.299=-0.029
min2.075-2.065=0.010
max2.687-2.733=-0.046
iters=5
new-facts=6402
prior-facts=6402
mean1890.806-1884.779=6.026
σ0.032-0.047=-0.014
min1890.788-1884.741=6.047
max1890.863-1884.861=6.002
mean1793.800-1807.600=-13.800
σ108.258-187.092=-78.834
min1672.000-1638.000=34.000
max1958.000-2067.000=-109.000
mean3.028-3.084=-0.057
σ0.170-0.123=0.047
min2.900-2.923=-0.022
max3.312-3.243=0.068

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.045-1.228=-0.184
σ0.147-0.339=-0.192
min0.903-1.035=-0.132
max1.235-1.821=-0.586

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.051-440.679=2.372
σ573.403-573.411=-0.007
min156.339-153.965=2.374
max1303.156-1300.795=2.361
mean96.250
σ8.500
min92.000
max109.000
mean1672.000-1638.000=34.000
σ0.000
min1672.000-1638.000=34.000
max1672.000-1638.000=34.000
mean0.524-0.534=-0.011
σ0.532-0.566=-0.034
min0.242-0.237=0.006
max1.321-1.383=-0.062
policies=20
mean1563.653-1539.889=23.764
σ0.349-0.317=0.031
min1563.457-1539.696=23.761
max1564.176-1540.364=23.812
mean920.000
σ0.000
min920.000
max920.000
mean1672.000-1638.000=34.000
σ0.000
min1672.000-1638.000=34.000
max1672.000-1638.000=34.000
mean2.666-2.600=0.066
σ0.059-0.022=0.037
min2.630-2.578=0.051
max2.755-2.620=0.135
policies=200
mean15644.114-15406.972=237.142
σ0.025-0.046=-0.021
min15644.089-15406.905=237.184
max15644.145-15407.006=237.139
mean9200.000
σ0.000
min9200.000
max9200.000
mean1672.000-1638.000=34.000
σ0.000
min1672.000-1638.000=34.000
max1672.000-1638.000=34.000
mean26.641-26.344=0.298
σ0.219-0.106=0.113
min26.382-26.253=0.129
max26.871-26.489=0.382