Compare commits

Home / Compare 0b3f77b4 .. a6be27d8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.915=-0.002
σ0.366-0.366=0.000
min53.787-53.781=0.006
max54.955-54.956=-0.001
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.139-0.137=0.002
σ0.004-0.006=-0.002
min0.135-0.129=0.006
max0.146-0.148=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.141-43.141=-0.000
σ0.007-0.007=0.000
min43.129-43.133=-0.004
max43.151-43.156=-0.005
mean416.000
σ0.000
min416.000
max416.000
mean0.121-0.122=-0.001
σ0.003-0.007=-0.004
min0.117-0.118=-0.001
max0.128-0.141=-0.013

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.081-992.078=0.004
σ1.232-1.243=-0.011
min991.493-991.498=-0.005
max997.252-997.306=-0.054
mean1062.700-1061.350=1.350
σ312.070-311.910=0.160
min605.000
max1598.000
mean1.539-1.555=-0.016
σ0.096-0.118=-0.022
min1.409-1.470=-0.061
max1.816-1.962=-0.146

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.665-285.675=-0.010
σ0.021-0.015=0.006
min285.632-285.651=-0.019
max285.685-285.690=-0.005
mean1598.000
σ0.000
min1598.000
max1598.000
mean0.375-0.375=0.000
σ0.001-0.000=0.001
min0.374-0.375=-0.001
max0.376-0.376=0.000
iters=5
new-facts=1
prior-facts=6402
mean1285.633-1285.641=-0.008
σ0.123-0.135=-0.012
min1285.575-1285.573=0.002
max1285.853-1285.882=-0.028
mean1598.000
σ0.000
min1598.000
max1598.000
mean1.882-1.880=0.002
σ0.059-0.019=0.040
min1.808-1.863=-0.055
max1.956-1.909=0.047
iters=5
new-facts=6402
prior-facts=1
mean1807.994-1807.983=0.011
σ6.998-7.016=-0.017
min1804.649-1804.616=0.034
max1820.499-1820.517=-0.018
mean1598.000
σ0.000
min1598.000
max1598.000
mean4.269-4.218=0.051
σ0.171-0.176=-0.005
min4.078-4.000=0.078
max4.481-4.472=0.009
iters=5
new-facts=6402
prior-facts=6402
mean2070.467-2070.462=0.005
σ0.011-0.010=0.001
min2070.459-2070.448=0.010
max2070.485-2070.477=0.008
mean1851.800-1844.000=7.800
σ209.992-217.430=-7.438
min1598.000
max2087.000-2086.000=1.000
mean4.541-4.453=0.087
σ0.107-0.028=0.079
min4.416-4.412=0.004
max4.687-4.488=0.198

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.318-1.247=0.071
σ0.303-0.314=-0.010
min0.985-0.903=0.082
max1.677-1.594=0.083

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.378-437.386=-0.007
σ572.364-572.364=0.000
min151.194-151.194=0.001
max1295.924-1295.931=-0.007
mean90.250
σ8.500
min86.000
max103.000
mean1598.000
σ0.000
min1598.000
max1598.000
mean0.520-0.561=-0.040
σ0.533-0.612=-0.078
min0.250-0.253=-0.003
max1.320-1.478=-0.158
policies=20
mean1512.173-1512.195=-0.021
σ0.200-0.245=-0.046
min1512.026-1512.032=-0.006
max1512.468-1512.560=-0.092
mean860.000
σ0.000
min860.000
max860.000
mean1598.000
σ0.000
min1598.000
max1598.000
mean2.519-2.520=-0.001
σ0.023-0.014=0.009
min2.494-2.505=-0.011
max2.539-2.539=0.000
policies=200
mean15129.511-15129.570=-0.059
σ0.414-0.083=0.332
min15128.898-15129.465=-0.567
max15129.788-15129.653=0.135
mean8600.000
σ0.000
min8600.000
max8600.000
mean1598.000
σ0.000
min1598.000
max1598.000
mean25.592-25.622=-0.029
σ0.116-0.110=0.006
min25.474-25.500=-0.025
max25.740-25.747=-0.006