Compare commits

Home / Compare be798cf6 .. a8203ac3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.822-53.823=-0.000
σ0.369-0.368=0.000
min53.676-53.684=-0.008
max54.871-54.871=0.000
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.140-0.137=0.003
σ0.004-0.003=0.001
min0.136-0.130=0.006
max0.148-0.140=0.007
cache=y
dps=1
iters=10
policies=100
mean43.208-43.208=0.000
σ0.006-0.007=-0.001
min43.198-43.194=0.004
max43.218-43.220=-0.002
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.121-0.122=-0.001
σ0.002-0.002=0.000
min0.119-0.120=-0.001
max0.127-0.128=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.178-1016.174=0.004
σ1.173-1.190=-0.017
min1015.636-1015.623=0.013
max1021.089-1021.158=-0.070
mean1044.550-1048.150=-3.600
σ311.383-312.396=-1.012
min590.000-555.000=35.000
max1637.000-1515.000=122.000
mean1.585-1.562=0.022
σ0.098-0.065=0.033
min1.500-1.441=0.060
max1.866-1.689=0.176

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.316-301.366=-0.050
σ0.236-0.214=0.022
min301.169-301.183=-0.014
max301.969-301.916=0.053
mean1964.000-1955.000=9.000
σ0.000
min1964.000-1955.000=9.000
max1964.000-1955.000=9.000
mean0.538-0.541=-0.003
σ0.035-0.036=-0.002
min0.508-0.499=0.009
max0.586-0.578=0.008

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.694-300.704=-0.011
σ0.031-0.017=0.014
min300.646-300.682=-0.036
max300.728-300.728=0.000
mean1637.000-1515.000=122.000
σ0.000
min1637.000-1515.000=122.000
max1637.000-1515.000=122.000
mean0.399-0.393=0.006
σ0.006-0.009=-0.003
min0.392-0.386=0.006
max0.405-0.406=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1322.872-1322.861=0.011
σ0.094-0.109=-0.015
min1322.811-1322.808=0.003
max1323.033-1323.055=-0.022
mean1637.000-1515.000=122.000
σ0.000
min1637.000-1515.000=122.000
max1637.000-1515.000=122.000
mean1.934-1.963=-0.029
σ0.063-0.123=-0.060
min1.852-1.836=0.016
max2.004-2.162=-0.159
iters=5
new-facts=6402
prior-facts=1
mean1561.307-1561.307=-0.001
σ6.877-6.878=-0.001
min1557.942-1557.988=-0.047
max1573.601-1573.604=-0.003
mean1637.000-1515.000=122.000
σ0.000
min1637.000-1515.000=122.000
max1637.000-1515.000=122.000
mean2.313-2.351=-0.038
σ0.283-0.333=-0.050
min2.049-1.985=0.064
max2.623-2.798=-0.175
iters=5
new-facts=6402
prior-facts=6402
mean1890.803-1890.810=-0.007
σ0.031-0.028=0.002
min1890.780-1890.788=-0.008
max1890.857-1890.858=-0.002
mean1793.200-1764.000=29.200
σ121.370-155.016=-33.646
min1637.000-1530.000=107.000
max1964.000-1955.000=9.000
mean3.031-2.984=0.047
σ0.153-0.228=-0.075
min2.899-2.695=0.204
max3.267-3.314=-0.046

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.136-1.519=-0.383
σ0.311-0.302=0.009
min0.889-1.163=-0.273
max1.635-1.805=-0.171

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.042-443.039=0.003
σ573.416-573.406=0.010
min156.332-156.332=-0.000
max1303.166-1303.148=0.018
mean96.250
σ8.500
min92.000
max109.000
mean1637.000-1515.000=122.000
σ0.000
min1637.000-1515.000=122.000
max1637.000-1515.000=122.000
mean0.546-0.552=-0.006
σ0.560-0.583=-0.023
min0.260-0.259=0.001
max1.385-1.426=-0.041
policies=20
mean1563.605-1563.614=-0.008
σ0.328-0.330=-0.001
min1563.420-1563.403=0.017
max1564.097-1564.106=-0.009
mean920.000
σ0.000
min920.000
max920.000
mean1637.000-1515.000=122.000
σ0.000
min1637.000-1515.000=122.000
max1637.000-1515.000=122.000
mean2.621-2.614=0.007
σ0.013-0.015=-0.002
min2.610-2.599=0.011
max2.640-2.631=0.008
policies=200
mean15643.942-15644.119=-0.178
σ0.103-0.040=0.063
min15643.845-15644.073=-0.228
max15644.079-15644.168=-0.090
mean9200.000
σ0.000
min9200.000
max9200.000
mean1637.000-1515.000=122.000
σ0.000
min1637.000-1515.000=122.000
max1637.000-1515.000=122.000
mean26.666-26.514=0.152
σ0.237-0.129=0.108
min26.444-26.405=0.039
max26.988-26.698=0.290