Compare commits

Home / Compare 3379dd81 .. 9b9daae7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.654-53.655=-0.001
σ0.367-0.366=0.001
min53.518-53.517=0.001
max54.698-54.696=0.003
mean416.000
σ0.000
min416.000
max416.000
mean0.138-0.136=0.002
σ0.004-0.004=0.000
min0.132-0.130=0.002
max0.144-0.141=0.003
cache=y
dps=1
iters=10
policies=100
mean42.980-42.981=-0.000
σ0.006-0.007=-0.001
min42.973-42.971=0.002
max42.988-42.990=-0.003
mean416.000
σ0.000
min416.000
max416.000
mean0.119-0.120=-0.000
σ0.004-0.004=-0.000
min0.113-0.113=-0.000
max0.124-0.127=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.971-1013.971=0.000
σ1.179-1.174=0.006
min1013.426-1013.429=-0.003
max1018.904-1018.885=0.018
mean1052.250-1052.700=-0.450
σ317.052-317.768=-0.717
min586.000-585.000=1.000
max1655.000-1657.000=-2.000
mean1.639-1.626=0.013
σ0.097-0.076=0.021
min1.548-1.561=-0.014
max1.904-1.865=0.039

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.112-299.152=-0.040
σ0.242-0.259=-0.017
min298.939-298.911=0.028
max299.779-299.814=-0.035
mean1951.000-1967.000=-16.000
σ0.000
min1951.000-1967.000=-16.000
max1951.000-1967.000=-16.000
mean0.564-0.569=-0.006
σ0.019-0.033=-0.014
min0.536-0.510=0.026
max0.598-0.613=-0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.675-294.677=-0.002
σ0.009-0.018=-0.008
min294.664-294.658=0.006
max294.689-294.705=-0.016
mean1655.000-1657.000=-2.000
σ0.000
min1655.000-1657.000=-2.000
max1655.000-1657.000=-2.000
mean0.385-0.387=-0.002
σ0.004-0.005=-0.000
min0.381-0.381=0.000
max0.392-0.392=0.000
iters=5
new-facts=1
prior-facts=6402
mean1316.962-1316.930=0.032
σ0.090-0.064=0.026
min1316.896-1316.882=0.013
max1317.103-1317.031=0.072
mean1655.000-1657.000=-2.000
σ0.000
min1655.000-1657.000=-2.000
max1655.000-1657.000=-2.000
mean1.906-1.914=-0.007
σ0.081-0.077=0.004
min1.824-1.852=-0.028
max2.011-2.012=-0.001
iters=5
new-facts=6402
prior-facts=1
mean1555.284-1555.280=0.005
σ6.886-6.854=0.032
min1551.955-1551.990=-0.035
max1567.597-1567.535=0.061
mean1655.000-1657.000=-2.000
σ0.000
min1655.000-1657.000=-2.000
max1655.000-1657.000=-2.000
mean2.272-2.318=-0.046
σ0.286-0.246=0.041
min2.084-2.105=-0.021
max2.778-2.719=0.058
iters=5
new-facts=6402
prior-facts=6402
mean1884.775-1884.777=-0.001
σ0.027-0.037=-0.010
min1884.757-1884.751=0.007
max1884.822-1884.842=-0.019
mean1741.600-1772.200=-30.600
σ130.715-127.596=3.119
min1655.000-1657.000=-2.000
max1951.000-1967.000=-16.000
mean3.005-2.976=0.028
σ0.194-0.145=0.049
min2.860-2.861=-0.001
max3.310-3.224=0.086

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.322-1.163=0.159
σ0.360-0.236=0.124
min0.906-0.902=0.003
max1.767-1.524=0.243

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.567-440.569=-0.002
σ573.031-573.038=-0.007
min154.044-154.049=-0.005
max1300.114-1300.126=-0.012
mean96.250
σ8.500
min92.000
max109.000
mean1655.000-1657.000=-2.000
σ0.000
min1655.000-1657.000=-2.000
max1655.000-1657.000=-2.000
mean0.540-0.550=-0.009
σ0.539-0.583=-0.044
min0.268-0.257=0.011
max1.349-1.424=-0.076
policies=20
mean1540.677-1540.689=-0.013
σ0.324-0.303=0.020
min1540.475-1540.517=-0.042
max1541.161-1541.144=0.017
mean920.000
σ0.000
min920.000
max920.000
mean1655.000-1657.000=-2.000
σ0.000
min1655.000-1657.000=-2.000
max1655.000-1657.000=-2.000
mean2.596-2.585=0.011
σ0.015-0.025=-0.010
min2.583-2.561=0.022
max2.617-2.618=-0.000
policies=200
mean15414.842-15414.783=0.059
σ0.079-0.032=0.047
min15414.750-15414.753=-0.003
max15414.938-15414.828=0.110
mean9200.000
σ0.000
min9200.000
max9200.000
mean1655.000-1657.000=-2.000
σ0.000
min1655.000-1657.000=-2.000
max1655.000-1657.000=-2.000
mean26.197-26.274=-0.077
σ0.134-0.096=0.038
min26.030-26.160=-0.130
max26.320-26.355=-0.035