Compare commits

Home / Compare 31ed1776 .. b099f414

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.561-70.566=-0.005
σ0.045-0.045=-0.000
min70.536-70.535=0.001
max70.689-70.690=-0.001
mean415.800-415.000=0.800
σ0.632-0.000=0.632
min414.000-415.000=-1.000
max416.000-415.000=1.000
mean0.155-0.160=-0.005
σ0.010-0.004=0.006
min0.131-0.157=-0.025
max0.166-0.168=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=0.001
σ0.002-0.003=-0.001
min21.285-21.282=0.002
max21.292-21.291=0.001
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.065-0.065=0.000
σ0.002-0.003=-0.000
min0.063-0.063=0.001
max0.072-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.568-1753.567=0.001
σ0.365-0.361=0.004
min1752.997-1752.996=0.001
max1754.173-1754.151=0.022
mean1665.700-1649.050=16.650
σ622.981-615.151=7.830
min689.000-688.000=1.000
max2762.000-2760.000=2.000
mean2.724-2.817=-0.093
σ0.202-0.156=0.045
min2.238-2.498=-0.261
max2.980-3.010=-0.030

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.996-272.019=-0.024
σ0.011-0.008=0.003
min271.983-272.006=-0.023
max272.013-272.028=-0.015
mean2762.000-2760.000=2.000
σ0.000
min2762.000-2760.000=2.000
max2762.000-2760.000=2.000
mean0.384-0.401=-0.017
σ0.011-0.010=0.001
min0.370-0.391=-0.021
max0.401-0.414=-0.013
iters=5
new-facts=1
prior-facts=6402
mean1932.443-1932.431=0.012
σ0.016-0.008=0.008
min1932.423-1932.423=0.001
max1932.464-1932.441=0.023
mean2762.000-2760.000=2.000
σ0.000
min2762.000-2760.000=2.000
max2762.000-2760.000=2.000
mean2.850-3.073=-0.223
σ0.248-0.179=0.069
min2.456-2.916=-0.460
max3.061-3.370=-0.308
iters=5
new-facts=6402
prior-facts=1
mean4753.047-4753.064=-0.018
σ0.946-0.940=0.007
min4752.094-4752.281=-0.187
max4754.636-4754.700=-0.063
mean2762.000-2760.000=2.000
σ0.000
min2762.000-2760.000=2.000
max2762.000-2760.000=2.000
mean8.499-8.502=-0.003
σ0.485-0.193=0.292
min7.700-8.200=-0.500
max8.988-8.670=0.318
iters=5
new-facts=6402
prior-facts=6402
mean4943.631-4943.492=0.140
σ0.015-0.189=-0.174
min4943.613-4943.272=0.341
max4943.647-4943.646=0.001
mean3052.600-3037.600=15.000
σ236.635-235.161=1.474
min2762.000-2760.000=2.000
max3382.000-3322.000=60.000
mean8.616-8.616=0.000
σ0.169-0.128=0.041
min8.436-8.416=0.020
max8.839-8.761=0.079

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.016-1.090=-0.073
σ0.140-0.232=-0.092
min0.925-0.925=-0.000
max1.246-1.428=-0.182

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.082-473.092=-0.010
σ575.932-575.945=-0.013
min185.110-185.115=-0.005
max1336.980-1337.010=-0.030
mean88.250
σ8.500
min84.000
max101.000
mean2762.000-2760.000=2.000
σ0.000
min2762.000-2760.000=2.000
max2762.000-2760.000=2.000
mean0.522-0.567=-0.045
σ0.447-0.562=-0.115
min0.295-0.284=0.011
max1.193-1.410=-0.217
policies=20
mean1851.451-1851.438=0.013
σ0.372-0.373=-0.001
min1851.229-1851.180=0.049
max1852.005-1851.989=0.016
mean840.000
σ0.000
min840.000
max840.000
mean2762.000-2760.000=2.000
σ0.000
min2762.000-2760.000=2.000
max2762.000-2760.000=2.000
mean2.861-2.865=-0.005
σ0.012-0.026=-0.014
min2.853-2.837=0.015
max2.878-2.896=-0.018
policies=200
mean18521.114-18521.168=-0.054
σ0.518-0.485=0.034
min18520.838-18520.898=-0.060
max18521.890-18521.893=-0.003
mean8400.000
σ0.000
min8400.000
max8400.000
mean2762.000-2760.000=2.000
σ0.000
min2762.000-2760.000=2.000
max2762.000-2760.000=2.000
mean28.891-28.786=0.105
σ0.151-0.092=0.059
min28.745-28.671=0.075
max29.093-28.894=0.198