Compare commits

Home / Compare 31daf1af .. 05c30bc2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.562-70.562=-0.001
σ0.049-0.045=0.004
min70.538-70.539=-0.001
max70.701-70.690=0.011
mean412.000-417.000=-5.000
σ0.000
min412.000-417.000=-5.000
max412.000-417.000=-5.000
mean0.162-0.157=0.005
σ0.012-0.004=0.008
min0.149-0.151=-0.002
max0.186-0.164=0.022
cache=y
dps=1
iters=10
policies=100
mean21.287-21.287=-0.000
σ0.002-0.003=-0.001
min21.284-21.282=0.002
max21.290-21.291=-0.001
mean412.000-417.000=-5.000
σ0.000
min412.000-417.000=-5.000
max412.000-417.000=-5.000
mean0.062-0.062=0.001
σ0.003-0.003=0.000
min0.059-0.059=-0.000
max0.069-0.067=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.568-1753.567=0.001
σ0.362-0.360=0.002
min1752.994-1752.996=-0.002
max1754.158-1754.160=-0.003
mean1647.650-1655.750=-8.100
σ639.627-638.143=1.485
min626.000-648.000=-22.000
max2876.000-2846.000=30.000
mean2.822-2.762=0.060
σ0.142-0.157=-0.015
min2.415-2.304=0.111
max3.035-2.926=0.109

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.019-272.019=0.000
σ0.007-0.007=0.001
min272.009-272.015=-0.006
max272.027-272.030=-0.003
mean2876.000-2846.000=30.000
σ0.000
min2876.000-2846.000=30.000
max2876.000-2846.000=30.000
mean0.397-0.392=0.006
σ0.016-0.006=0.010
min0.382-0.381=0.000
max0.419-0.395=0.024
iters=5
new-facts=1
prior-facts=6402
mean1932.434-1932.439=-0.005
σ0.011-0.005=0.006
min1932.421-1932.432=-0.011
max1932.443-1932.444=-0.001
mean2876.000-2846.000=30.000
σ0.000
min2876.000-2846.000=30.000
max2876.000-2846.000=30.000
mean2.941-3.064=-0.122
σ0.136-0.143=-0.007
min2.747-2.952=-0.205
max3.120-3.307=-0.187
iters=5
new-facts=6402
prior-facts=1
mean4753.174-4753.083=0.091
σ0.900-0.963=-0.063
min4752.713-4752.317=0.396
max4754.777-4754.757=0.021
mean2876.000-2846.000=30.000
σ0.000
min2876.000-2846.000=30.000
max2876.000-2846.000=30.000
mean8.468-8.430=0.038
σ0.554-0.542=0.012
min7.579-7.945=-0.366
max8.914-9.098=-0.184
iters=5
new-facts=6402
prior-facts=6402
mean4943.625-4943.627=-0.002
σ0.028-0.015=0.013
min4943.591-4943.606=-0.014
max4943.659-4943.645=0.014
mean3033.200-3084.800=-51.600
σ180.951-313.063=-132.113
min2876.000-2846.000=30.000
max3318.000-3569.000=-251.000
mean8.529-8.432=0.097
σ0.080-0.126=-0.046
min8.391-8.355=0.036
max8.586-8.651=-0.065

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.034-1.055=-0.021
σ0.140-0.132=0.009
min0.938-0.933=0.005
max1.264-1.256=0.008

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.105-473.103=0.003
σ575.917-575.915=0.002
min185.139-185.143=-0.003
max1336.980-1336.975=0.005
mean88.250
σ8.500
min84.000
max101.000
mean2876.000-2846.000=30.000
σ0.000
min2876.000-2846.000=30.000
max2876.000-2846.000=30.000
mean0.447-0.448=-0.000
σ0.308-0.304=0.004
min0.281-0.293=-0.012
max0.909-0.904=0.005
policies=20
mean1851.681-1851.683=-0.002
σ0.298-0.367=-0.069
min1851.449-1851.401=0.049
max1852.109-1852.213=-0.104
mean840.000
σ0.000
min840.000
max840.000
mean2876.000-2846.000=30.000
σ0.000
min2876.000-2846.000=30.000
max2876.000-2846.000=30.000
mean2.962-2.948=0.014
σ0.018-0.005=0.013
min2.936-2.943=-0.008
max2.973-2.954=0.020
policies=200
mean18523.477-18523.599=-0.122
σ0.626-0.500=0.126
min18522.848-18523.334=-0.485
max18524.344-18524.348=-0.004
mean8400.000
σ0.000
min8400.000
max8400.000
mean2876.000-2846.000=30.000
σ0.000
min2876.000-2846.000=30.000
max2876.000-2846.000=30.000
mean29.336-29.149=0.187
σ0.490-0.452=0.037
min28.932-28.687=0.245
max29.995-29.654=0.340