Compare commits

Home / Compare 37e0202b .. edcbb145

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.822-53.823=-0.001
σ0.369-0.370=-0.001
min53.679-53.684=-0.005
max54.872-54.875=-0.003
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.138-0.142=-0.004
σ0.004-0.009=-0.005
min0.131-0.136=-0.005
max0.144-0.165=-0.021
cache=y
dps=1
iters=10
policies=100
mean43.207-43.210=-0.003
σ0.008-0.007=0.002
min43.193-43.200=-0.007
max43.221-43.222=-0.002
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.120-0.129=-0.009
σ0.003-0.013=-0.010
min0.115-0.114=0.001
max0.124-0.145=-0.021

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.173-1016.176=-0.003
σ1.220-1.178=0.041
min1015.635-1015.602=0.033
max1021.290-1021.110=0.180
mean1054.550-1048.500=6.050
σ313.144-312.271=0.873
min590.000-556.000=34.000
max1670.000-1515.000=155.000
mean1.573-1.520=0.054
σ0.141-0.054=0.087
min1.477-1.456=0.022
max2.065-1.628=0.437

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.288-301.317=-0.029
σ0.216-0.188=0.027
min301.088-301.081=0.007
max301.845-301.770=0.075
mean1940.000-1946.000=-6.000
σ0.000
min1940.000-1946.000=-6.000
max1940.000-1946.000=-6.000
mean0.562-0.554=0.008
σ0.027-0.034=-0.007
min0.508-0.506=0.002
max0.581-0.588=-0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.702-300.707=-0.005
σ0.028-0.014=0.013
min300.671-300.689=-0.018
max300.739-300.724=0.015
mean1670.000-1515.000=155.000
σ0.000
min1670.000-1515.000=155.000
max1670.000-1515.000=155.000
mean0.396-0.393=0.003
σ0.005-0.007=-0.002
min0.390-0.386=0.003
max0.401-0.404=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1322.857-1322.872=-0.015
σ0.099-0.099=0.000
min1322.806-1322.812=-0.007
max1323.034-1323.044=-0.010
mean1670.000-1515.000=155.000
σ0.000
min1670.000-1515.000=155.000
max1670.000-1515.000=155.000
mean1.938-1.881=0.057
σ0.087-0.032=0.054
min1.834-1.826=0.008
max2.065-1.909=0.156
iters=5
new-facts=6402
prior-facts=1
mean1561.304-1561.300=0.004
σ6.884-6.841=0.043
min1557.951-1557.958=-0.007
max1573.612-1573.530=0.082
mean1670.000-1515.000=155.000
σ0.000
min1670.000-1515.000=155.000
max1670.000-1515.000=155.000
mean2.344-2.271=0.073
σ0.275-0.231=0.044
min2.125-2.097=0.028
max2.684-2.639=0.046
iters=5
new-facts=6402
prior-facts=6402
mean1890.797-1890.803=-0.006
σ0.019-0.025=-0.006
min1890.786-1890.784=0.002
max1890.831-1890.845=-0.014
mean1782.400-1756.000=26.400
σ101.874-153.271=-51.397
min1670.000-1524.000=146.000
max1940.000-1946.000=-6.000
mean3.028-3.014=0.014
σ0.092-0.159=-0.067
min2.916-2.865=0.051
max3.108-3.253=-0.145

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.058-1.534=-0.476
σ0.230-0.348=-0.118
min0.893-1.092=-0.198
max1.415-1.810=-0.395

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.326-443.319=0.008
σ573.960-573.961=-0.002
min156.338-156.333=0.005
max1304.266-1304.261=0.005
mean96.250
σ8.500
min92.000
max109.000
mean1670.000-1515.000=155.000
σ0.000
min1670.000-1515.000=155.000
max1670.000-1515.000=155.000
mean0.536-0.536=0.000
σ0.548-0.552=-0.004
min0.260-0.257=0.002
max1.357-1.364=-0.006
policies=20
mean1563.635-1563.593=0.042
σ0.323-0.311=0.012
min1563.457-1563.401=0.056
max1564.119-1564.058=0.061
mean920.000
σ0.000
min920.000
max920.000
mean1670.000-1515.000=155.000
σ0.000
min1670.000-1515.000=155.000
max1670.000-1515.000=155.000
mean2.616-2.594=0.022
σ0.015-0.010=0.005
min2.598-2.586=0.012
max2.633-2.609=0.023
policies=200
mean15644.111-15644.059=0.053
σ0.041-0.172=-0.130
min15644.051-15643.899=0.152
max15644.139-15644.274=-0.136
mean9200.000
σ0.000
min9200.000
max9200.000
mean1670.000-1515.000=155.000
σ0.000
min1670.000-1515.000=155.000
max1670.000-1515.000=155.000
mean26.455-26.504=-0.049
σ0.085-0.142=-0.057
min26.360-26.358=0.002
max26.528-26.693=-0.164