Compare commits

Home / Compare d15d13e3 .. 69c163a3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.821-53.822=-0.002
σ0.368-0.370=-0.002
min53.684-53.677=0.007
max54.867-54.874=-0.008
mean419.000-418.000=1.000
σ0.000
min419.000-418.000=1.000
max419.000-418.000=1.000
mean0.136-0.139=-0.002
σ0.005-0.003=0.002
min0.130-0.136=-0.006
max0.145-0.145=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.208-43.207=0.000
σ0.007-0.006=0.001
min43.199-43.200=-0.000
max43.225-43.219=0.007
mean419.000-418.000=1.000
σ0.000
min419.000-418.000=1.000
max419.000-418.000=1.000
mean0.120-0.120=-0.000
σ0.001-0.004=-0.003
min0.118-0.114=0.004
max0.121-0.129=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.181-1016.178=0.003
σ1.151-1.163=-0.012
min1015.602-1015.610=-0.008
max1020.992-1021.047=-0.055
mean1042.350-1043.100=-0.750
σ311.507-311.788=-0.281
min588.000
max1633.000-1635.000=-2.000
mean1.561-1.561=0.000
σ0.101-0.089=0.012
min1.478-1.478=-0.000
max1.826-1.830=-0.004

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.269-301.141=0.128
σ0.186-0.222=-0.036
min301.156-300.931=0.225
max301.778-301.697=0.081
mean2036.000
σ0.000
min2036.000
max2036.000
mean0.573-0.562=0.011
σ0.025-0.025=0.000
min0.505-0.499=0.006
max0.596-0.578=0.018

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.693-300.690=0.003
σ0.034-0.041=-0.006
min300.636-300.622=0.014
max300.722-300.727=-0.005
mean1633.000-1635.000=-2.000
σ0.000
min1633.000-1635.000=-2.000
max1633.000-1635.000=-2.000
mean0.397-0.397=0.001
σ0.006-0.007=-0.000
min0.390-0.391=-0.001
max0.404-0.404=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1322.869-1322.861=0.008
σ0.081-0.098=-0.017
min1322.817-1322.812=0.005
max1323.007-1323.037=-0.031
mean1633.000-1635.000=-2.000
σ0.000
min1633.000-1635.000=-2.000
max1633.000-1635.000=-2.000
mean1.882-1.909=-0.028
σ0.056-0.108=-0.052
min1.826-1.811=0.015
max1.963-2.074=-0.111
iters=5
new-facts=6402
prior-facts=1
mean1561.347-1561.322=0.025
σ6.878-6.886=-0.008
min1558.095-1558.023=0.072
max1573.647-1573.635=0.012
mean1633.000-1635.000=-2.000
σ0.000
min1633.000-1635.000=-2.000
max1633.000-1635.000=-2.000
mean2.407-2.339=0.069
σ0.399-0.306=0.093
min2.061-2.037=0.024
max2.926-2.692=0.233
iters=5
new-facts=6402
prior-facts=6402
mean1890.798-1890.794=0.004
σ0.024-0.024=0.001
min1890.768-1890.767=0.001
max1890.829-1890.827=0.002
mean1772.800-1773.600=-0.800
σ170.613-169.982=0.631
min1633.000-1635.000=-2.000
max2036.000
mean2.931-2.941=-0.010
σ0.114-0.116=-0.002
min2.858-2.861=-0.003
max3.133-3.145=-0.012

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.182-1.173=0.009
σ0.368-0.291=0.077
min0.917-0.912=0.005
max1.798-1.651=0.148

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.044-443.042=0.002
σ573.416-573.417=-0.001
min156.332-156.330=0.002
max1303.168-1303.167=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1633.000-1635.000=-2.000
σ0.000
min1633.000-1635.000=-2.000
max1633.000-1635.000=-2.000
mean0.544-0.526=0.018
σ0.565-0.531=0.034
min0.261-0.261=0.000
max1.392-1.323=0.069
policies=20
mean1563.617-1563.617=0.001
σ0.318-0.322=-0.003
min1563.442-1563.439=0.003
max1564.094-1564.099=-0.005
mean920.000
σ0.000
min920.000
max920.000
mean1633.000-1635.000=-2.000
σ0.000
min1633.000-1635.000=-2.000
max1633.000-1635.000=-2.000
mean2.608-2.612=-0.004
σ0.017-0.021=-0.004
min2.582-2.583=-0.000
max2.618-2.632=-0.015
policies=200
mean15644.198-15644.111=0.087
σ0.087-0.156=-0.070
min15644.150-15643.974=0.176
max15644.327-15644.292=0.036
mean9200.000
σ0.000
min9200.000
max9200.000
mean1633.000-1635.000=-2.000
σ0.000
min1633.000-1635.000=-2.000
max1633.000-1635.000=-2.000
mean26.603-26.501=0.102
σ0.080-0.166=-0.086
min26.531-26.322=0.209
max26.687-26.668=0.020