Compare commits

Home / Compare e9e5f525 .. d70172b2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.783=-0.002
σ0.048-0.048=0.000
min70.753-70.754=-0.001
max70.914-70.916=-0.001
mean415.000-411.600=3.400
σ0.000-0.516=-0.516
min415.000-411.000=4.000
max415.000-412.000=3.000
mean0.158-0.160=-0.002
σ0.005-0.006=-0.001
min0.150-0.153=-0.003
max0.168-0.171=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.493-21.494=-0.001
σ0.003-0.004=-0.000
min21.490-21.490=-0.000
max21.500-21.501=-0.001
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.066-0.066=0.001
σ0.003-0.002=0.001
min0.064-0.064=0.000
max0.072-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.092-1754.093=-0.000
σ0.358-0.362=-0.004
min1753.523-1753.526=-0.003
max1754.676-1754.662=0.013
mean1650.000-1642.050=7.950
σ627.251-623.049=4.202
min630.000-626.000=4.000
max2707.000-2691.000=16.000
mean2.711-2.761=-0.050
σ0.220-0.294=-0.074
min2.128-2.143=-0.015
max2.999-3.147=-0.148

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.940-271.599=0.341
σ0.016-0.004=0.012
min271.919-271.595=0.325
max271.956-271.604=0.352
mean2707.000-2691.000=16.000
σ0.000
min2707.000-2691.000=16.000
max2707.000-2691.000=16.000
mean0.383-0.381=0.002
σ0.008-0.005=0.003
min0.378-0.378=0.000
max0.397-0.389=0.008
iters=5
new-facts=1
prior-facts=6402
mean1932.324-1932.003=0.321
σ0.009-0.010=-0.001
min1932.309-1931.986=0.323
max1932.332-1932.011=0.321
mean2707.000-2691.000=16.000
σ0.000
min2707.000-2691.000=16.000
max2707.000-2691.000=16.000
mean3.029-2.512=0.517
σ0.025-0.047=-0.022
min3.002-2.460=0.542
max3.067-2.576=0.491
iters=5
new-facts=6402
prior-facts=1
mean4753.061-4752.717=0.344
σ0.926-0.926=-0.000
min4752.571-4752.236=0.334
max4754.711-4754.366=0.345
mean2707.000-2691.000=16.000
σ0.000
min2707.000-2691.000=16.000
max2707.000-2691.000=16.000
mean8.634-8.770=-0.137
σ0.486-0.287=0.199
min7.889-8.282=-0.393
max9.056-8.987=0.069
iters=5
new-facts=6402
prior-facts=6402
mean4943.556-4943.150=0.406
σ0.014-0.141=-0.127
min4943.539-4942.899=0.641
max4943.574-4943.222=0.352
mean2976.600-3014.000=-37.400
σ227.674-274.095=-46.421
min2707.000-2691.000=16.000
max3294.000-3380.000=-86.000
mean8.533-8.485=0.048
σ0.123-0.188=-0.065
min8.390-8.314=0.076
max8.708-8.802=-0.094

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.115-1.099=0.016
σ0.136-0.121=0.014
min0.935-0.935=-0.000
max1.252-1.248=0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.662-468.665=-0.003
σ574.935-574.939=-0.004
min181.189-181.184=0.005
max1331.064-1331.073=-0.009
mean88.250
σ8.500
min84.000
max101.000
mean2707.000-2691.000=16.000
σ0.000
min2707.000-2691.000=16.000
max2707.000-2691.000=16.000
mean0.567-0.554=0.013
σ0.571-0.536=0.035
min0.271-0.277=-0.006
max1.423-1.358=0.065
policies=20
mean1812.207-1812.181=0.026
σ0.387-0.388=-0.001
min1811.949-1811.920=0.029
max1812.778-1812.755=0.023
mean840.000
σ0.000
min840.000
max840.000
mean2707.000-2691.000=16.000
σ0.000
min2707.000-2691.000=16.000
max2707.000-2691.000=16.000
mean2.842-2.833=0.010
σ0.006-0.014=-0.008
min2.835-2.822=0.013
max2.847-2.853=-0.005
policies=200
mean18129.165-18129.219=-0.054
σ0.347-0.489=-0.141
min18128.907-18128.949=-0.042
max18129.677-18129.952=-0.275
mean8400.000
σ0.000
min8400.000
max8400.000
mean2707.000-2691.000=16.000
σ0.000
min2707.000-2691.000=16.000
max2707.000-2691.000=16.000
mean28.542-28.527=0.016
σ0.140-0.115=0.025
min28.430-28.451=-0.021
max28.747-28.697=0.050