Compare commits

Home / Compare bdd8948d .. 8c25e91e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.986-33.985=0.001
σ0.054-0.054=-0.001
min33.956-33.954=0.003
max34.138-34.138=-0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.086-0.085=0.001
σ0.004-0.004=-0.000
min0.083-0.081=0.001
max0.093-0.093=0.001
cache=y
dps=1
iters=10
policies=100
mean23.324-23.324=-0.000
σ0.004-0.004=0.000
min23.320-23.320=-0.001
max23.331-23.333=-0.002
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.066-0.065=0.001
σ0.003-0.003=-0.000
min0.065-0.063=0.002
max0.074-0.071=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.726-1756.728=-0.002
σ0.364-0.366=-0.002
min1756.169-1756.151=0.018
max1757.300-1757.325=-0.025
mean1645.900-1650.450=-4.550
σ623.770-643.452=-19.682
min627.000-652.000=-25.000
max2691.000-2839.000=-148.000
mean2.439-2.383=0.055
σ0.254-0.108=0.146
min2.215-2.280=-0.065
max3.298-2.646=0.652

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean325.315-325.320=-0.005
σ0.052-0.047=0.005
min325.222-325.236=-0.014
max325.341-325.350=-0.008
mean2691.000-2839.000=-148.000
σ0.000
min2691.000-2839.000=-148.000
max2691.000-2839.000=-148.000
mean0.431-0.425=0.006
σ0.006-0.002=0.004
min0.426-0.424=0.002
max0.440-0.429=0.012
iters=5
new-facts=1
prior-facts=6402
mean1985.877-1985.861=0.015
σ0.009-0.013=-0.004
min1985.863-1985.838=0.024
max1985.888-1985.871=0.017
mean2691.000-2839.000=-148.000
σ0.000
min2691.000-2839.000=-148.000
max2691.000-2839.000=-148.000
mean2.724-2.719=0.005
σ0.082-0.106=-0.024
min2.673-2.642=0.031
max2.869-2.892=-0.023
iters=5
new-facts=6402
prior-facts=1
mean4809.420-4809.648=-0.228
σ7.488-7.680=-0.192
min4805.561-4806.160=-0.599
max4822.804-4823.386=-0.582
mean2691.000-2839.000=-148.000
σ0.000
min2691.000-2839.000=-148.000
max2691.000-2839.000=-148.000
mean8.465-8.922=-0.456
σ0.580-0.201=0.380
min7.706-8.731=-1.026
max9.163-9.261=-0.098
iters=5
new-facts=6402
prior-facts=6402
mean4997.091-4997.113=-0.022
σ0.131-0.174=-0.042
min4996.861-4996.804=0.057
max4997.175-4997.210=-0.035
mean3006.200-3045.200=-39.000
σ362.472-285.715=76.756
min2691.000-2839.000=-148.000
max3535.000-3496.000=39.000
mean8.531-8.587=-0.056
σ0.108-0.089=0.019
min8.399-8.485=-0.085
max8.694-8.701=-0.006

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.039-1.068=-0.029
σ0.163-0.255=-0.091
min0.916-0.917=-0.001
max1.236-1.512=-0.277

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.375-463.378=-0.003
σ574.777-574.773=0.003
min175.979-175.985=-0.006
max1325.540-1325.538=0.002
mean86.250
σ8.500
min82.000
max99.000
mean2691.000-2839.000=-148.000
σ0.000
min2691.000-2839.000=-148.000
max2691.000-2839.000=-148.000
mean0.556-0.467=0.088
σ0.556-0.368=0.189
min0.277-0.278=-0.001
max1.390-1.019=0.371
policies=20
mean1760.102-1760.114=-0.012
σ0.336-0.343=-0.007
min1759.883-1759.893=-0.011
max1760.601-1760.624=-0.023
mean820.000
σ0.000
min820.000
max820.000
mean2691.000-2839.000=-148.000
σ0.000
min2691.000-2839.000=-148.000
max2691.000-2839.000=-148.000
mean2.741-2.787=-0.047
σ0.024-0.007=0.017
min2.715-2.779=-0.064
max2.771-2.794=-0.023
policies=200
mean17608.400-17608.366=0.034
σ0.524-0.568=-0.044
min17608.035-17608.044=-0.008
max17609.176-17609.216=-0.040
mean8200.000
σ0.000
min8200.000
max8200.000
mean2691.000-2839.000=-148.000
σ0.000
min2691.000-2839.000=-148.000
max2691.000-2839.000=-148.000
mean27.579-27.907=-0.328
σ0.117-0.345=-0.228
min27.424-27.556=-0.132
max27.688-28.308=-0.620