Compare commits

Home / Compare 0a48e6bf .. e4ba0c26

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.985-33.987=-0.002
σ0.053-0.055=-0.002
min33.957-33.960=-0.003
max34.135-34.142=-0.006
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.083-0.084=-0.000
σ0.004-0.005=-0.001
min0.077-0.077=0.000
max0.090-0.090=0.001
cache=y
dps=1
iters=10
policies=100
mean23.324-23.324=-0.000
σ0.003-0.003=-0.000
min23.320-23.320=0.000
max23.330-23.331=-0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.063-0.066=-0.003
σ0.003-0.003=0.000
min0.059-0.064=-0.005
max0.069-0.074=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.725-1756.725=-0.001
σ0.364-0.363=0.001
min1756.153-1756.151=0.002
max1757.315-1757.312=0.003
mean1673.850-1646.150=27.700
σ640.776-625.770=15.006
min680.000-645.000=35.000
max2698.000-2835.000=-137.000
mean2.374-2.374=0.000
σ0.080-0.125=-0.045
min2.260-2.272=-0.012
max2.560-2.839=-0.278

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean325.316-325.315=0.001
σ0.053-0.055=-0.002
min325.221-325.216=0.005
max325.344-325.343=0.002
mean2698.000-2835.000=-137.000
σ0.000
min2698.000-2835.000=-137.000
max2698.000-2835.000=-137.000
mean0.426-0.431=-0.004
σ0.001-0.004=-0.004
min0.425-0.428=-0.002
max0.427-0.438=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1985.871-1985.877=-0.005
σ0.017-0.011=0.007
min1985.841-1985.867=-0.026
max1985.883-1985.894=-0.011
mean2698.000-2835.000=-137.000
σ0.000
min2698.000-2835.000=-137.000
max2698.000-2835.000=-137.000
mean2.707-2.777=-0.069
σ0.058-0.126=-0.068
min2.657-2.637=0.020
max2.775-2.964=-0.189
iters=5
new-facts=6402
prior-facts=1
mean4809.540-4809.646=-0.106
σ7.759-7.738=0.022
min4805.578-4806.164=-0.586
max4823.410-4823.488=-0.078
mean2698.000-2835.000=-137.000
σ0.000
min2698.000-2835.000=-137.000
max2698.000-2835.000=-137.000
mean8.779-8.953=-0.174
σ0.307-0.339=-0.032
min8.257-8.399=-0.142
max9.071-9.259=-0.188
iters=5
new-facts=6402
prior-facts=6402
mean4997.185-4997.117=0.068
σ0.022-0.170=-0.148
min4997.159-4996.814=0.345
max4997.208-4997.218=-0.009
mean2971.600-3086.200=-114.600
σ322.283-265.547=56.736
min2698.000-2835.000=-137.000
max3445.000-3363.000=82.000
mean8.507-8.997=-0.490
σ0.090-0.411=-0.320
min8.371-8.606=-0.235
max8.615-9.664=-1.048

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.073-1.002=0.071
σ0.347-0.133=0.214
min0.903-0.914=-0.010
max1.694-1.221=0.473

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.373-463.373=0.001
σ574.779-574.772=0.008
min175.981-175.982=-0.001
max1325.542-1325.530=0.012
mean86.250
σ8.500
min82.000
max99.000
mean2698.000-2835.000=-137.000
σ0.000
min2698.000-2835.000=-137.000
max2698.000-2835.000=-137.000
mean0.547-0.473=0.074
σ0.548-0.377=0.171
min0.271-0.281=-0.009
max1.370-1.039=0.331
policies=20
mean1760.138-1760.155=-0.017
σ0.361-0.351=0.010
min1759.905-1759.916=-0.011
max1760.675-1760.674=0.001
mean820.000
σ0.000
min820.000
max820.000
mean2698.000-2835.000=-137.000
σ0.000
min2698.000-2835.000=-137.000
max2698.000-2835.000=-137.000
mean2.732-2.794=-0.062
σ0.016-0.012=0.004
min2.714-2.782=-0.068
max2.752-2.810=-0.058
policies=200
mean17608.388-17608.452=-0.064
σ0.485-0.444=0.041
min17608.127-17608.102=0.025
max17609.115-17609.102=0.013
mean8200.000
σ0.000
min8200.000
max8200.000
mean2698.000-2835.000=-137.000
σ0.000
min2698.000-2835.000=-137.000
max2698.000-2835.000=-137.000
mean27.511-28.002=-0.492
σ0.174-0.390=-0.216
min27.330-27.658=-0.329
max27.743-28.401=-0.658