Compare commits

Home / Compare 71996f0e .. f63ad479

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.046-70.701=2.345
σ0.047-0.046=0.001
min73.018-70.668=2.350
max73.178-70.829=2.349
mean413.000
σ0.000
min413.000
max413.000
mean0.162-0.161=0.002
σ0.004-0.004=0.001
min0.158-0.156=0.002
max0.169-0.167=0.002
cache=y
dps=1
iters=10
policies=100
mean23.739-21.409=2.330
σ0.003-0.003=0.000
min23.734-21.404=2.329
max23.743-21.412=2.331
mean413.000
σ0.000
min413.000
max413.000
mean0.066-0.064=0.003
σ0.003-0.004=-0.001
min0.065-0.060=0.005
max0.074-0.073=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.787-1754.930=3.857
σ0.360-0.359=0.001
min1758.222-1754.357=3.865
max1759.367-1755.498=3.870
mean1619.750-1636.850=-17.100
σ595.781-608.613=-12.832
min636.000-643.000=-7.000
max2411.000-2439.000=-28.000
mean2.814-2.795=0.019
σ0.222-0.174=0.048
min2.165-2.477=-0.313
max3.174-3.078=0.096

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.025-272.754=51.271
σ0.026-0.005=0.021
min323.980-272.748=51.232
max324.040-272.759=51.280
mean2411.000-2439.000=-28.000
σ0.000
min2411.000-2439.000=-28.000
max2411.000-2439.000=-28.000
mean0.427-0.379=0.048
σ0.005-0.001=0.004
min0.423-0.379=0.045
max0.435-0.380=0.055
iters=5
new-facts=1
prior-facts=6402
mean1984.577-1933.167=51.410
σ0.022-0.022=0.000
min1984.555-1933.131=51.425
max1984.601-1933.186=51.415
mean2411.000-2439.000=-28.000
σ0.000
min2411.000-2439.000=-28.000
max2411.000-2439.000=-28.000
mean2.641-2.988=-0.347
σ0.132-0.162=-0.029
min2.551-2.804=-0.254
max2.873-3.147=-0.274
iters=5
new-facts=6402
prior-facts=1
mean4808.252-4756.919=51.333
σ7.726-7.581=0.145
min4804.676-4753.470=51.206
max4822.071-4770.480=51.592
mean2411.000-2439.000=-28.000
σ0.000
min2411.000-2439.000=-28.000
max2411.000-2439.000=-28.000
mean8.861-8.577=0.284
σ0.369-0.258=0.111
min8.431-8.317=0.114
max9.251-8.958=0.292
iters=5
new-facts=6402
prior-facts=6402
mean4995.808-4944.322=51.486
σ0.021-0.165=-0.144
min4995.783-4944.028=51.754
max4995.830-4944.410=51.420
mean2949.200-2906.800=42.400
σ266.441-389.707=-123.266
min2584.000-2439.000=145.000
max3288.000-3432.000=-144.000
mean8.709-8.394=0.316
σ0.151-0.040=0.112
min8.500-8.354=0.146
max8.874-8.452=0.422

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.700-1.671=0.029
σ0.094-0.110=-0.016
min1.623-1.564=0.058
max1.863-1.823=0.040

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.327-468.322=0.005
σ574.229-574.256=-0.027
min181.208-181.188=0.019
max1329.671-1329.706=-0.035
mean88.250
σ8.500
min84.000
max101.000
mean2411.000-2439.000=-28.000
σ0.000
min2411.000-2439.000=-28.000
max2411.000-2439.000=-28.000
mean0.555-0.558=-0.003
σ0.541-0.549=-0.009
min0.283-0.281=0.002
max1.366-1.383=-0.016
policies=20
mean1812.423-1812.180=0.244
σ0.396-0.387=0.009
min1812.152-1811.933=0.219
max1813.009-1812.755=0.254
mean840.000
σ0.000
min840.000
max840.000
mean2411.000-2439.000=-28.000
σ0.000
min2411.000-2439.000=-28.000
max2411.000-2439.000=-28.000
mean2.807-2.804=0.002
σ0.008-0.017=-0.009
min2.797-2.786=0.011
max2.814-2.825=-0.011
policies=200
mean18131.602-18129.072=2.530
σ0.469-0.471=-0.001
min18131.324-18128.788=2.535
max18132.303-18129.773=2.530
mean8400.000
σ0.000
min8400.000
max8400.000
mean2411.000-2439.000=-28.000
σ0.000
min2411.000-2439.000=-28.000
max2411.000-2439.000=-28.000
mean28.247-28.352=-0.105
σ0.094-0.036=0.058
min28.156-28.318=-0.162
max28.348-28.389=-0.041