Compare commits

Home / Compare 33105ecc .. f62422b7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.822-53.824=-0.002
σ0.367-0.368=-0.002
min53.679-53.682=-0.003
max54.864-54.871=-0.006
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.138-0.138=-0.001
σ0.005-0.004=0.001
min0.132-0.132=-0.000
max0.145-0.146=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.208-43.209=-0.001
σ0.006-0.007=-0.001
min43.200-43.199=0.001
max43.218-43.222=-0.004
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.118-0.122=-0.004
σ0.004-0.003=0.001
min0.114-0.120=-0.006
max0.124-0.128=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.174-1016.177=-0.003
σ1.173-1.167=0.006
min1015.603-1015.612=-0.010
max1021.092-1021.062=0.030
mean1044.400-1047.650=-3.250
σ306.324-309.617=-3.293
min583.000-589.000=-6.000
max1659.000-1668.000=-9.000
mean1.549-1.577=-0.028
σ0.118-0.088=0.030
min1.407-1.507=-0.100
max1.945-1.813=0.132

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.242-301.144=0.098
σ0.247-0.199=0.048
min301.028-300.898=0.131
max301.888-301.634=0.254
mean1934.000-2035.000=-101.000
σ0.000
min1934.000-2035.000=-101.000
max1934.000-2035.000=-101.000
mean0.585-0.563=0.022
σ0.020-0.039=-0.019
min0.552-0.500=0.052
max0.610-0.610=-0.000

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.687-300.686=0.000
σ0.037-0.041=-0.004
min300.623-300.615=0.008
max300.710-300.714=-0.004
mean1659.000-1668.000=-9.000
σ0.000
min1659.000-1668.000=-9.000
max1659.000-1668.000=-9.000
mean0.395-0.396=-0.000
σ0.005-0.008=-0.003
min0.388-0.389=-0.001
max0.401-0.406=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1322.859-1322.864=-0.005
σ0.108-0.093=0.015
min1322.787-1322.817=-0.030
max1323.050-1323.030=0.020
mean1659.000-1668.000=-9.000
σ0.000
min1659.000-1668.000=-9.000
max1659.000-1668.000=-9.000
mean1.923-1.898=0.026
σ0.022-0.066=-0.044
min1.896-1.830=0.067
max1.952-1.973=-0.021
iters=5
new-facts=6402
prior-facts=1
mean1561.324-1561.339=-0.015
σ6.838-6.882=-0.044
min1558.044-1558.006=0.038
max1573.552-1573.644=-0.092
mean1659.000-1668.000=-9.000
σ0.000
min1659.000-1668.000=-9.000
max1659.000-1668.000=-9.000
mean2.324-2.411=-0.086
σ0.169-0.318=-0.149
min2.109-2.044=0.065
max2.543-2.741=-0.199
iters=5
new-facts=6402
prior-facts=6402
mean1890.803-1890.796=0.007
σ0.031-0.017=0.013
min1890.781-1890.779=0.002
max1890.856-1890.820=0.036
mean1776.800-1784.200=-7.400
σ101.964-155.945=-53.980
min1659.000-1668.000=-9.000
max1934.000-2035.000=-101.000
mean3.009-2.867=0.142
σ0.170-0.098=0.072
min2.814-2.711=0.103
max3.271-2.983=0.288

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.056-1.093=-0.037
σ0.153-0.248=-0.095
min0.910-0.913=-0.003
max1.225-1.524=-0.299

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.323-443.052=0.271
σ573.960-573.411=0.549
min156.331-156.333=-0.002
max1304.263-1303.168=1.095
mean96.250
σ8.500
min92.000
max109.000
mean1659.000-1668.000=-9.000
σ0.000
min1659.000-1668.000=-9.000
max1659.000-1668.000=-9.000
mean0.544-0.548=-0.004
σ0.568-0.569=-0.002
min0.258-0.261=-0.004
max1.395-1.402=-0.007
policies=20
mean1563.623-1563.633=-0.010
σ0.325-0.340=-0.014
min1563.444-1563.449=-0.005
max1564.111-1564.142=-0.031
mean920.000
σ0.000
min920.000
max920.000
mean1659.000-1668.000=-9.000
σ0.000
min1659.000-1668.000=-9.000
max1659.000-1668.000=-9.000
mean2.612-2.628=-0.016
σ0.022-0.019=0.003
min2.583-2.600=-0.017
max2.631-2.646=-0.015
policies=200
mean15644.116-15644.148=-0.032
σ0.107-0.068=0.040
min15644.001-15644.072=-0.071
max15644.248-15644.235=0.012
mean9200.000
σ0.000
min9200.000
max9200.000
mean1659.000-1668.000=-9.000
σ0.000
min1659.000-1668.000=-9.000
max1659.000-1668.000=-9.000
mean26.387-26.502=-0.115
σ0.125-0.201=-0.076
min26.241-26.267=-0.026
max26.500-26.678=-0.178