Compare commits

Home / Compare e4ba0c26 .. 02238982

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.987-33.985=0.002
σ0.054-0.053=0.001
min33.956-33.957=-0.001
max34.140-34.135=0.005
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.086-0.083=0.003
σ0.004-0.004=0.000
min0.083-0.077=0.005
max0.094-0.090=0.004
cache=y
dps=1
iters=10
policies=100
mean23.326-23.324=0.002
σ0.003-0.003=0.001
min23.321-23.320=0.001
max23.332-23.330=0.002
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.066-0.063=0.003
σ0.003-0.003=0.000
min0.065-0.059=0.005
max0.074-0.069=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.725-1756.725=0.000
σ0.364-0.364=-0.001
min1756.150-1756.153=-0.002
max1757.310-1757.315=-0.005
mean1649.300-1673.850=-24.550
σ632.304-640.776=-8.472
min618.000-680.000=-62.000
max2731.000-2698.000=33.000
mean2.394-2.374=0.019
σ0.125-0.080=0.045
min2.267-2.260=0.007
max2.819-2.560=0.259

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean325.323-325.316=0.007
σ0.045-0.053=-0.008
min325.243-325.221=0.021
max325.350-325.344=0.005
mean2731.000-2698.000=33.000
σ0.000
min2731.000-2698.000=33.000
max2731.000-2698.000=33.000
mean0.431-0.426=0.005
σ0.007-0.001=0.006
min0.424-0.425=-0.001
max0.440-0.427=0.013
iters=5
new-facts=1
prior-facts=6402
mean1985.878-1985.871=0.007
σ0.009-0.017=-0.008
min1985.863-1985.841=0.022
max1985.886-1985.883=0.003
mean2731.000-2698.000=33.000
σ0.000
min2731.000-2698.000=33.000
max2731.000-2698.000=33.000
mean2.682-2.707=-0.025
σ0.052-0.058=-0.006
min2.613-2.657=-0.044
max2.735-2.775=-0.040
iters=5
new-facts=6402
prior-facts=1
mean4809.524-4809.540=-0.016
σ7.746-7.759=-0.013
min4805.668-4805.578=0.090
max4823.374-4823.410=-0.036
mean2731.000-2698.000=33.000
σ0.000
min2731.000-2698.000=33.000
max2731.000-2698.000=33.000
mean8.839-8.779=0.059
σ0.169-0.307=-0.139
min8.637-8.257=0.380
max8.966-9.071=-0.106
iters=5
new-facts=6402
prior-facts=6402
mean4997.182-4997.185=-0.004
σ0.021-0.022=-0.002
min4997.159-4997.159=-0.000
max4997.210-4997.208=0.002
mean3025.800-2971.600=54.200
σ267.057-322.283=-55.226
min2731.000-2698.000=33.000
max3389.000-3445.000=-56.000
mean8.650-8.507=0.142
σ0.212-0.090=0.121
min8.474-8.371=0.103
max9.001-8.615=0.386

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.979-1.073=-0.094
σ0.065-0.347=-0.282
min0.922-0.903=0.019
max1.054-1.694=-0.640

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.377-463.373=0.004
σ574.769-574.779=-0.011
min175.984-175.981=0.003
max1325.530-1325.542=-0.012
mean86.250
σ8.500
min82.000
max99.000
mean2731.000-2698.000=33.000
σ0.000
min2731.000-2698.000=33.000
max2731.000-2698.000=33.000
mean0.539-0.547=-0.008
σ0.533-0.548=-0.015
min0.270-0.271=-0.001
max1.339-1.370=-0.031
policies=20
mean1760.142-1760.138=0.003
σ0.352-0.361=-0.009
min1759.924-1759.905=0.019
max1760.667-1760.675=-0.007
mean820.000
σ0.000
min820.000
max820.000
mean2731.000-2698.000=33.000
σ0.000
min2731.000-2698.000=33.000
max2731.000-2698.000=33.000
mean2.731-2.732=-0.001
σ0.014-0.016=-0.001
min2.714-2.714=0.001
max2.749-2.752=-0.003
policies=200
mean17608.393-17608.388=0.005
σ0.511-0.485=0.026
min17608.084-17608.127=-0.043
max17609.156-17609.115=0.041
mean8200.000
σ0.000
min8200.000
max8200.000
mean2731.000-2698.000=33.000
σ0.000
min2731.000-2698.000=33.000
max2731.000-2698.000=33.000
mean27.588-27.511=0.077
σ0.130-0.174=-0.044
min27.452-27.330=0.123
max27.757-27.743=0.014