Compare commits

Home / Compare abd4a7b8 .. aaa35101

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean56.289-56.290=-0.001
σ0.051-0.053=-0.002
min56.256-56.255=0.001
max56.428-56.435=-0.007
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.138-0.140=-0.002
σ0.005-0.004=0.001
min0.131-0.136=-0.005
max0.145-0.145=-0.000
cache=y
dps=1
iters=10
policies=100
mean44.805-44.804=0.001
σ0.006-0.005=0.000
min44.795-44.797=-0.002
max44.813-44.811=0.002
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.122-0.121=0.001
σ0.005-0.004=0.001
min0.118-0.116=0.002
max0.129-0.129=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1766.168-1766.169=-0.001
σ0.366-0.365=0.001
min1765.591-1765.594=-0.003
max1766.760-1766.752=0.008
mean1615.450-1629.300=-13.850
σ590.612-600.101=-9.490
min636.000-631.000=5.000
max2405.000-2428.000=-23.000
mean2.341-2.361=-0.020
σ0.073-0.125=-0.052
min2.214-2.200=0.014
max2.477-2.759=-0.281

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean348.776-348.776=-0.001
σ0.062-0.061=0.001
min348.665-348.668=-0.003
max348.812-348.808=0.004
mean2405.000-2428.000=-23.000
σ0.000
min2405.000-2428.000=-23.000
max2405.000-2428.000=-23.000
mean0.460-0.456=0.004
σ0.008-0.002=0.007
min0.453-0.454=-0.001
max0.471-0.458=0.014
iters=5
new-facts=1
prior-facts=6402
mean2009.246-2009.245=0.001
σ0.005-0.006=-0.001
min2009.240-2009.237=0.003
max2009.252-2009.252=-0.000
mean2405.000-2428.000=-23.000
σ0.000
min2405.000-2428.000=-23.000
max2405.000-2428.000=-23.000
mean2.795-2.643=0.152
σ0.130-0.107=0.023
min2.683-2.529=0.154
max3.016-2.797=0.219
iters=5
new-facts=6402
prior-facts=1
mean4833.017-4832.848=0.169
σ7.767-7.783=-0.017
min4829.432-4829.056=0.377
max4846.909-4846.767=0.142
mean2405.000-2428.000=-23.000
σ0.000
min2405.000-2428.000=-23.000
max2405.000-2428.000=-23.000
mean8.799-8.629=0.170
σ0.603-0.461=0.143
min7.762-7.976=-0.214
max9.323-9.167=0.157
iters=5
new-facts=6402
prior-facts=6402
mean5020.564-5020.415=0.150
σ0.024-0.328=-0.304
min5020.538-5019.829=0.709
max5020.594-5020.572=0.021
mean2950.200-3007.800=-57.600
σ413.730-334.755=78.975
min2422.000-2569.000=-147.000
max3494.000-3323.000=171.000
mean8.836-8.800=0.036
σ0.303-0.447=-0.143
min8.501-8.519=-0.018
max9.277-9.583=-0.306

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.741-1.671=0.070
σ0.075-0.186=-0.111
min1.630-1.353=0.277
max1.840-1.837=0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.528-467.530=-0.002
σ574.245-574.246=-0.001
min180.405-180.405=0.000
max1328.896-1328.900=-0.003
mean88.250
σ8.500
min84.000
max101.000
mean2405.000-2428.000=-23.000
σ0.000
min2405.000-2428.000=-23.000
max2405.000-2428.000=-23.000
mean0.539-0.538=0.001
σ0.525-0.516=0.009
min0.272-0.277=-0.005
max1.326-1.312=0.015
policies=20
mean1804.356-1804.355=0.000
σ0.404-0.397=0.007
min1804.123-1804.125=-0.003
max1804.958-1804.947=0.012
mean840.000
σ0.000
min840.000
max840.000
mean2405.000-2428.000=-23.000
σ0.000
min2405.000-2428.000=-23.000
max2405.000-2428.000=-23.000
mean2.780-2.766=0.014
σ0.007-0.014=-0.008
min2.773-2.754=0.019
max2.790-2.786=0.004
policies=200
mean18050.610-18050.710=-0.100
σ0.543-0.386=0.158
min18050.237-18050.479=-0.242
max18051.408-18051.287=0.121
mean8400.000
σ0.000
min8400.000
max8400.000
mean2405.000-2428.000=-23.000
σ0.000
min2405.000-2428.000=-23.000
max2405.000-2428.000=-23.000
mean28.106-28.065=0.041
σ0.140-0.026=0.114
min28.015-28.039=-0.025
max28.313-28.099=0.214