Compare commits

Home / Compare 240334d6 .. dd800543

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.839-53.838=0.000
σ0.367-0.366=0.001
min53.694-53.697=-0.003
max54.882-54.880=0.003
mean418.700-414.000=4.700
σ0.483-0.000=0.483
min418.000-414.000=4.000
max419.000-414.000=5.000
mean0.139-0.137=0.001
σ0.003-0.004=-0.000
min0.135-0.130=0.005
max0.144-0.142=0.002
cache=y
dps=1
iters=10
policies=100
mean43.208-43.207=0.001
σ0.006-0.005=0.001
min43.197-43.200=-0.003
max43.221-43.217=0.004
mean419.000-414.000=5.000
σ0.000
min419.000-414.000=5.000
max419.000-414.000=5.000
mean0.121-0.120=0.001
σ0.004-0.004=-0.000
min0.115-0.115=0.000
max0.126-0.127=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.204-1016.208=-0.004
σ1.161-1.161=-0.001
min1015.628-1015.631=-0.003
max1021.062-1021.063=-0.001
mean1045.650-1048.250=-2.600
σ300.292-311.542=-11.250
min567.000-556.000=11.000
max1463.000-1513.000=-50.000
mean1.553-1.548=0.005
σ0.075-0.061=0.014
min1.482-1.494=-0.012
max1.772-1.678=0.095

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.208-301.358=-0.150
σ0.231-0.215=0.016
min301.002-301.199=-0.197
max301.831-301.949=-0.117
mean2036.000-2003.000=33.000
σ0.000
min2036.000-2003.000=33.000
max2036.000-2003.000=33.000
mean0.545-0.558=-0.013
σ0.034-0.027=0.008
min0.502-0.503=-0.001
max0.576-0.582=-0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.481-301.473=0.009
σ0.047-0.054=-0.008
min301.416-301.389=0.027
max301.533-301.526=0.007
mean1463.000-1513.000=-50.000
σ0.000
min1463.000-1513.000=-50.000
max1463.000-1513.000=-50.000
mean0.390-0.388=0.001
σ0.006-0.001=0.005
min0.386-0.387=-0.002
max0.401-0.390=0.011
iters=5
new-facts=1
prior-facts=6402
mean1324.061-1324.057=0.004
σ0.104-0.108=-0.004
min1323.932-1323.921=0.011
max1324.189-1324.191=-0.002
mean1463.000-1513.000=-50.000
σ0.000
min1463.000-1513.000=-50.000
max1463.000-1513.000=-50.000
mean1.871-1.881=-0.010
σ0.062-0.058=0.004
min1.815-1.825=-0.010
max1.967-1.969=-0.002
iters=5
new-facts=6402
prior-facts=1
mean1562.084-1562.095=-0.010
σ6.891-6.909=-0.018
min1558.814-1558.806=0.007
max1574.407-1574.449=-0.043
mean1463.000-1513.000=-50.000
σ0.000
min1463.000-1513.000=-50.000
max1463.000-1513.000=-50.000
mean2.321-2.386=-0.065
σ0.302-0.325=-0.023
min2.043-2.060=-0.018
max2.727-2.743=-0.016
iters=5
new-facts=6402
prior-facts=6402
mean1891.955-1891.969=-0.014
σ0.078-0.066=0.012
min1891.856-1891.852=0.004
max1892.035-1892.006=0.029
mean1739.600-1718.800=20.800
σ230.383-207.010=23.373
min1463.000-1513.000=-50.000
max2036.000-2003.000=33.000
mean2.973-3.011=-0.038
σ0.139-0.304=-0.165
min2.859-2.847=0.012
max3.138-3.554=-0.416

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.743-1.473=0.271
σ0.153-0.253=-0.100
min1.496-1.207=0.289
max1.897-1.801=0.096

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.059-444.066=-0.007
σ575.392-575.403=-0.011
min156.360-156.362=-0.002
max1307.147-1307.170=-0.024
mean96.250
σ8.500
min92.000
max109.000
mean1463.000-1513.000=-50.000
σ0.000
min1463.000-1513.000=-50.000
max1463.000-1513.000=-50.000
mean0.541-0.535=0.007
σ0.563-0.549=0.014
min0.258-0.252=0.006
max1.385-1.358=0.028
policies=20
mean1563.902-1563.906=-0.004
σ0.361-0.335=0.026
min1563.673-1563.688=-0.015
max1564.441-1564.405=0.035
mean920.000
σ0.000
min920.000
max920.000
mean1463.000-1513.000=-50.000
σ0.000
min1463.000-1513.000=-50.000
max1463.000-1513.000=-50.000
mean2.651-2.617=0.034
σ0.067-0.022=0.045
min2.600-2.597=0.003
max2.750-2.649=0.101
policies=200
mean15646.935-15647.001=-0.066
σ0.076-0.087=-0.011
min15646.864-15646.934=-0.070
max15647.028-15647.127=-0.099
mean9200.000
σ0.000
min9200.000
max9200.000
mean1463.000-1513.000=-50.000
σ0.000
min1463.000-1513.000=-50.000
max1463.000-1513.000=-50.000
mean26.290-26.495=-0.205
σ0.104-0.087=0.017
min26.196-26.389=-0.192
max26.438-26.568=-0.130