Compare commits

Home / Compare 2126ae04 .. 6fab71d7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.658-53.654=0.005
σ0.369-0.366=0.003
min53.522-53.517=0.005
max54.708-54.696=0.012
mean417.000
σ0.000
min417.000
max417.000
mean0.148-0.138=0.011
σ0.011-0.005=0.005
min0.136-0.129=0.007
max0.162-0.145=0.018
cache=y
dps=1
iters=10
policies=100
mean42.980-42.980=-0.000
σ0.006-0.006=-0.001
min42.972-42.972=-0.000
max42.992-42.994=-0.002
mean417.000
σ0.000
min417.000
max417.000
mean0.121-0.121=-0.000
σ0.003-0.004=-0.001
min0.117-0.118=-0.001
max0.128-0.129=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.974-1013.971=0.003
σ1.171-1.167=0.005
min1013.427-1013.424=0.003
max1018.878-1018.857=0.021
mean1051.100-1051.550=-0.450
σ316.915-317.551=-0.636
min585.000
max1655.000-1656.000=-1.000
mean1.642-1.640=0.002
σ0.085-0.090=-0.005
min1.542-1.515=0.027
max1.866-1.889=-0.023

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.183-299.112=0.071
σ0.225-0.208=0.016
min299.048-298.920=0.129
max299.803-299.654=0.149
mean2050.000-2048.000=2.000
σ0.000
min2050.000-2048.000=2.000
max2050.000-2048.000=2.000
mean0.580-0.592=-0.012
σ0.023-0.028=-0.005
min0.542-0.554=-0.012
max0.617-0.624=-0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.674-294.676=-0.002
σ0.016-0.014=0.003
min294.659-294.658=0.001
max294.697-294.695=0.002
mean1655.000-1656.000=-1.000
σ0.000
min1655.000-1656.000=-1.000
max1655.000-1656.000=-1.000
mean0.383-0.384=-0.001
σ0.001-0.001=-0.000
min0.382-0.382=-0.001
max0.384-0.385=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1316.933-1316.944=-0.011
σ0.101-0.104=-0.003
min1316.871-1316.869=0.002
max1317.111-1317.123=-0.012
mean1655.000-1656.000=-1.000
σ0.000
min1655.000-1656.000=-1.000
max1655.000-1656.000=-1.000
mean1.941-1.976=-0.035
σ0.101-0.134=-0.032
min1.845-1.858=-0.013
max2.098-2.190=-0.092
iters=5
new-facts=6402
prior-facts=1
mean1555.281-1555.299=-0.018
σ6.868-6.880=-0.012
min1551.955-1551.941=0.014
max1567.561-1567.599=-0.038
mean1655.000-1656.000=-1.000
σ0.000
min1655.000-1656.000=-1.000
max1655.000-1656.000=-1.000
mean2.259-2.359=-0.100
σ0.197-0.293=-0.096
min2.102-2.139=-0.037
max2.595-2.768=-0.173
iters=5
new-facts=6402
prior-facts=6402
mean1884.767-1884.772=-0.005
σ0.019-0.036=-0.017
min1884.746-1884.748=-0.002
max1884.796-1884.835=-0.040
mean1795.000-1789.400=5.600
σ171.390-170.865=0.525
min1655.000-1656.000=-1.000
max2050.000-2048.000=2.000
mean2.995-2.926=0.069
σ0.189-0.110=0.079
min2.849-2.840=0.009
max3.310-3.119=0.191

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.146-1.193=-0.047
σ0.343-0.359=-0.015
min0.901-0.903=-0.002
max1.712-1.800=-0.087

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.565-440.570=-0.006
σ573.036-573.036=0.000
min154.042-154.042=0.000
max1300.119-1300.124=-0.005
mean96.250
σ8.500
min92.000
max109.000
mean1655.000-1656.000=-1.000
σ0.000
min1655.000-1656.000=-1.000
max1655.000-1656.000=-1.000
mean0.552-0.551=0.001
σ0.557-0.557=0.000
min0.270-0.271=-0.001
max1.388-1.386=0.002
policies=20
mean1540.663-1540.680=-0.017
σ0.255-0.327=-0.072
min1540.524-1540.483=0.041
max1541.046-1541.170=-0.124
mean920.000
σ0.000
min920.000
max920.000
mean1655.000-1656.000=-1.000
σ0.000
min1655.000-1656.000=-1.000
max1655.000-1656.000=-1.000
mean2.597-2.614=-0.017
σ0.017-0.028=-0.012
min2.577-2.596=-0.020
max2.615-2.656=-0.041
policies=200
mean15414.618-15414.827=-0.210
σ0.533-0.095=0.438
min15413.829-15414.709=-0.880
max15415.001-15414.939=0.061
mean9200.000
σ0.000
min9200.000
max9200.000
mean1655.000-1656.000=-1.000
σ0.000
min1655.000-1656.000=-1.000
max1655.000-1656.000=-1.000
mean26.358-26.428=-0.070
σ0.103-0.151=-0.048
min26.247-26.248=-0.001
max26.461-26.607=-0.146