Compare commits

Home / Compare a32f2fac .. bf3df1d4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.566-70.563=0.003
σ0.045-0.046=-0.001
min70.535-70.541=-0.005
max70.687-70.692=-0.004
mean416.000-415.400=0.600
σ0.000-0.516=-0.516
min416.000-415.000=1.000
max416.000
mean0.160-0.160=-0.000
σ0.004-0.003=0.000
min0.154-0.156=-0.001
max0.164-0.167=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.286-21.291=-0.005
σ0.004-0.012=-0.009
min21.281-21.280=0.001
max21.291-21.325=-0.034
mean416.000
σ0.000
min416.000
max416.000
mean0.065-0.065=-0.000
σ0.003-0.003=0.000
min0.062-0.063=-0.001
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.375-1753.374=0.001
σ0.360-0.359=0.001
min1752.806-1752.805=0.001
max1753.952-1753.960=-0.008
mean1652.150-1663.150=-11.000
σ642.420-630.297=12.123
min637.000-681.000=-44.000
max2882.000-2663.000=219.000
mean2.837-2.808=0.030
σ0.168-0.168=0.000
min2.431-2.400=0.031
max3.033-2.991=0.041

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.756-271.754=0.003
σ0.007-0.003=0.003
min271.747-271.751=-0.004
max271.765-271.759=0.006
mean2882.000-2663.000=219.000
σ0.000
min2882.000-2663.000=219.000
max2882.000-2663.000=219.000
mean0.382-0.380=0.002
σ0.003-0.007=-0.004
min0.380-0.369=0.011
max0.388-0.388=0.000
iters=5
new-facts=1
prior-facts=6402
mean1932.174-1932.178=-0.003
σ0.017-0.006=0.011
min1932.152-1932.171=-0.019
max1932.192-1932.187=0.005
mean2882.000-2663.000=219.000
σ0.000
min2882.000-2663.000=219.000
max2882.000-2663.000=219.000
mean2.950-3.006=-0.056
σ0.132-0.046=0.086
min2.733-2.962=-0.229
max3.070-3.083=-0.013
iters=5
new-facts=6402
prior-facts=1
mean4752.870-4752.839=0.031
σ0.909-0.927=-0.017
min4752.438-4751.986=0.452
max4754.496-4754.408=0.088
mean2882.000-2663.000=219.000
σ0.000
min2882.000-2663.000=219.000
max2882.000-2663.000=219.000
mean8.800-8.187=0.613
σ0.148-0.606=-0.459
min8.582-7.700=0.883
max8.927-9.138=-0.211
iters=5
new-facts=6402
prior-facts=6402
mean4943.232-4943.302=-0.070
σ0.188-0.176=0.012
min4943.017-4942.989=0.028
max4943.388-4943.398=-0.010
mean3036.200-2975.600=60.600
σ243.847-334.579=-90.732
min2882.000-2663.000=219.000
max3440.000-3429.000=11.000
mean8.497-8.411=0.087
σ0.083-0.126=-0.043
min8.385-8.344=0.041
max8.613-8.636=-0.024

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.103-1.131=-0.027
σ0.083-0.168=-0.086
min1.048-0.927=0.121
max1.249-1.351=-0.102

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.868-467.862=0.006
σ575.936-575.947=-0.011
min179.887-179.884=0.003
max1331.772-1331.783=-0.011
mean86.250
σ8.500
min82.000
max99.000
mean2882.000-2663.000=219.000
σ0.000
min2882.000-2663.000=219.000
max2882.000-2663.000=219.000
mean0.442-0.560=-0.118
σ0.303-0.557=-0.254
min0.287-0.280=0.007
max0.897-1.396=-0.499
policies=20
mean1799.191-1799.128=0.064
σ0.385-0.371=0.014
min1798.917-1798.896=0.021
max1799.756-1799.681=0.076
mean820.000
σ0.000
min820.000
max820.000
mean2882.000-2663.000=219.000
σ0.000
min2882.000-2663.000=219.000
max2882.000-2663.000=219.000
mean2.875-2.797=0.078
σ0.008-0.026=-0.018
min2.863-2.770=0.093
max2.881-2.833=0.048
policies=200
mean17998.502-17998.506=-0.004
σ0.362-0.493=-0.132
min17998.238-17998.208=0.030
max17999.029-17999.243=-0.214
mean8200.000
σ0.000
min8200.000
max8200.000
mean2882.000-2663.000=219.000
σ0.000
min2882.000-2663.000=219.000
max2882.000-2663.000=219.000
mean28.519-28.085=0.433
σ0.437-0.117=0.319
min28.152-27.962=0.190
max29.037-28.244=0.793