Compare commits

Home / Compare 485bed35 .. 27f297d5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.702-70.697=0.004
σ0.048-0.047=0.001
min70.664-70.668=-0.004
max70.833-70.827=0.006
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.161-0.159=0.002
σ0.003-0.005=-0.001
min0.156-0.151=0.005
max0.167-0.167=0.000
cache=y
dps=1
iters=10
policies=100
mean21.408-21.409=-0.001
σ0.003-0.003=-0.000
min21.403-21.404=-0.001
max21.413-21.413=0.000
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.064-0.065=-0.001
σ0.004-0.003=0.002
min0.060-0.063=-0.003
max0.074-0.072=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.895-1754.897=-0.002
σ0.365-0.362=0.004
min1754.332-1754.329=0.003
max1755.481-1755.496=-0.015
mean1636.900-1662.200=-25.300
σ607.245-642.223=-34.977
min631.000-675.000=-44.000
max2438.000-2699.000=-261.000
mean2.800-2.791=0.009
σ0.175-0.161=0.013
min2.365-2.458=-0.093
max3.032-3.054=-0.022

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.760-272.761=-0.001
σ0.006-0.005=0.001
min272.752-272.753=-0.001
max272.765-272.765=0.001
mean2438.000-2699.000=-261.000
σ0.000
min2438.000-2699.000=-261.000
max2438.000-2699.000=-261.000
mean0.387-0.385=0.002
σ0.007-0.005=0.002
min0.383-0.381=0.002
max0.399-0.393=0.006
iters=5
new-facts=1
prior-facts=6402
mean1933.128-1933.133=-0.005
σ0.007-0.013=-0.005
min1933.122-1933.114=0.008
max1933.137-1933.149=-0.012
mean2438.000-2699.000=-261.000
σ0.000
min2438.000-2699.000=-261.000
max2438.000-2699.000=-261.000
mean3.059-2.975=0.084
σ0.069-0.332=-0.263
min3.004-2.417=0.586
max3.171-3.278=-0.106
iters=5
new-facts=6402
prior-facts=1
mean4753.795-4753.657=0.138
σ1.021-0.786=0.235
min4752.816-4752.842=-0.027
max4755.526-4754.957=0.569
mean2438.000-2699.000=-261.000
σ0.000
min2438.000-2699.000=-261.000
max2438.000-2699.000=-261.000
mean8.551-8.654=-0.103
σ0.560-0.487=0.073
min7.605-7.887=-0.281
max9.062-9.072=-0.010
iters=5
new-facts=6402
prior-facts=6402
mean4944.295-4944.361=-0.066
σ0.163-0.013=0.149
min4944.004-4944.345=-0.341
max4944.378-4944.374=0.004
mean2967.000-3011.200=-44.200
σ268.898-258.153=10.744
min2625.000-2699.000=-74.000
max3330.000-3346.000=-16.000
mean8.454-8.540=-0.086
σ0.035-0.292=-0.257
min8.420-8.375=0.046
max8.501-9.057=-0.556

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.795-1.075=0.720
σ0.093-0.143=-0.049
min1.666-0.934=0.732
max1.891-1.244=0.647

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.997-468.645=0.352
σ575.613-574.892=0.720
min181.189-181.191=-0.002
max1332.417-1330.984=1.433
mean88.250
σ8.500
min84.000
max101.000
mean2438.000-2699.000=-261.000
σ0.000
min2438.000-2699.000=-261.000
max2438.000-2699.000=-261.000
mean0.568-0.586=-0.019
σ0.551-0.585=-0.034
min0.291-0.287=0.004
max1.395-1.464=-0.069
policies=20
mean1812.211-1812.208=0.003
σ0.393-0.383=0.009
min1811.949-1811.951=-0.002
max1812.788-1812.775=0.014
mean840.000
σ0.000
min840.000
max840.000
mean2438.000-2699.000=-261.000
σ0.000
min2438.000-2699.000=-261.000
max2438.000-2699.000=-261.000
mean2.849-2.837=0.012
σ0.016-0.015=0.001
min2.834-2.816=0.018
max2.870-2.852=0.017
policies=200
mean18129.235-18129.252=-0.017
σ0.432-0.503=-0.071
min18128.899-18128.984=-0.085
max18129.868-18130.006=-0.138
mean8400.000
σ0.000
min8400.000
max8400.000
mean2438.000-2699.000=-261.000
σ0.000
min2438.000-2699.000=-261.000
max2438.000-2699.000=-261.000
mean28.649-28.674=-0.024
σ0.095-0.078=0.017
min28.563-28.572=-0.009
max28.764-28.750=0.014