Compare commits

Home / Compare c796548c .. 7c207838

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.246-73.045=-37.800
σ0.054-0.046=0.008
min35.221-73.019=-37.799
max35.397-73.174=-37.777
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.086-0.162=-0.075
σ0.005-0.004=0.001
min0.082-0.158=-0.076
max0.096-0.168=-0.072
cache=y
dps=1
iters=10
policies=100
mean23.769-23.741=0.028
σ0.004-0.003=0.002
min23.760-23.738=0.022
max23.775-23.745=0.030
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.066-0.066=0.001
σ0.004-0.002=0.002
min0.061-0.064=-0.003
max0.074-0.072=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1718.415-1758.788=-40.373
σ169.612-0.363=169.249
min997.815-1758.218=-760.403
max1756.946-1759.373=-2.427
mean1633.350-1659.050=-25.700
σ612.477-630.170=-17.693
min626.000-628.000=-2.000
max2461.000-2524.000=-63.000
mean2.288-2.795=-0.507
σ0.182-0.163=0.019
min1.590-2.329=-0.738
max2.568-2.996=-0.429

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.583-324.011=0.572
σ0.054-0.058=-0.003
min324.487-323.908=0.578
max324.610-324.039=0.571
mean2461.000-2524.000=-63.000
σ0.000
min2461.000-2524.000=-63.000
max2461.000-2524.000=-63.000
mean0.428-0.431=-0.003
σ0.007-0.010=-0.003
min0.423-0.425=-0.002
max0.440-0.449=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1985.146-1984.598=0.548
σ0.008-0.009=-0.000
min1985.135-1984.585=0.549
max1985.153-1984.606=0.546
mean2461.000-2524.000=-63.000
σ0.000
min2461.000-2524.000=-63.000
max2461.000-2524.000=-63.000
mean2.592-2.605=-0.014
σ0.102-0.149=-0.047
min2.456-2.462=-0.006
max2.721-2.813=-0.092
iters=5
new-facts=6402
prior-facts=1
mean4808.748-4808.240=0.508
σ7.725-7.812=-0.087
min4805.264-4804.688=0.576
max4822.566-4822.214=0.352
mean2461.000-2524.000=-63.000
σ0.000
min2461.000-2524.000=-63.000
max2461.000-2524.000=-63.000
mean8.965-8.836=0.128
σ0.339-0.220=0.119
min8.456-8.585=-0.129
max9.374-9.056=0.319
iters=5
new-facts=6402
prior-facts=6402
mean4996.347-4995.808=0.539
σ0.021-0.018=0.003
min4996.326-4995.785=0.541
max4996.371-4995.829=0.541
mean3003.200-3020.800=-17.600
σ271.020-290.837=-19.817
min2609.000
max3336.000-3389.000=-53.000
mean8.664-8.834=-0.170
σ0.141-0.297=-0.156
min8.472-8.472=0.000
max8.794-9.237=-0.443

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.601-1.411=0.190
σ0.163-0.222=-0.059
min1.378-1.136=0.242
max1.799-1.690=0.109

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.947-468.322=-5.375
σ574.249-574.230=0.019
min175.818-181.201=-5.383
max1324.320-1329.666=-5.346
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2461.000-2524.000=-63.000
σ0.000
min2461.000-2524.000=-63.000
max2461.000-2524.000=-63.000
mean0.567-0.567=-0.001
σ0.585-0.566=0.019
min0.272-0.284=-0.012
max1.444-1.416=0.028
policies=20
mean1758.493-1812.410=-53.917
σ0.338-0.392=-0.054
min1758.254-1812.141=-53.887
max1758.992-1812.990=-53.998
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2461.000-2524.000=-63.000
σ0.000
min2461.000-2524.000=-63.000
max2461.000-2524.000=-63.000
mean2.695-2.815=-0.120
σ0.010-0.009=0.001
min2.686-2.803=-0.117
max2.705-2.824=-0.119
policies=200
mean17592.362-18131.577=-539.215
σ0.362-0.474=-0.112
min17592.123-18131.195=-539.072
max17592.900-18132.256=-539.357
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2461.000-2524.000=-63.000
σ0.000
min2461.000-2524.000=-63.000
max2461.000-2524.000=-63.000
mean27.377-28.297=-0.920
σ0.124-0.061=0.063
min27.205-28.208=-1.003
max27.491-28.346=-0.854