Compare commits

Home / Compare d667ae07 .. 44bf884c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.648-53.647=0.001
σ0.368-0.369=-0.000
min53.517-53.518=-0.002
max54.696-54.696=-0.000
mean414.000-414.300=-0.300
σ0.000-0.483=-0.483
min414.000
max414.000-415.000=-1.000
mean0.139-0.138=0.000
σ0.003-0.003=0.001
min0.135-0.135=-0.000
max0.144-0.143=0.001
cache=y
dps=1
iters=10
policies=100
mean42.943-42.941=0.002
σ0.006-0.005=0.001
min42.933-42.933=0.000
max42.952-42.949=0.003
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.120-0.120=0.000
σ0.002-0.004=-0.002
min0.119-0.115=0.004
max0.125-0.126=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.868-991.857=0.011
σ1.219-1.214=0.005
min991.284-991.266=0.017
max996.952-996.938=0.014
mean1066.100-1055.450=10.650
σ323.037-311.661=11.376
min576.000-585.000=-9.000
max1633.000-1524.000=109.000
mean1.519-1.520=-0.001
σ0.122-0.073=0.049
min1.327-1.458=-0.132
max1.903-1.763=0.140

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.438-285.436=0.003
σ0.009-0.013=-0.004
min285.425-285.415=0.010
max285.448-285.448=-0.001
mean1633.000-1524.000=109.000
σ0.000
min1633.000-1524.000=109.000
max1633.000-1524.000=109.000
mean0.376-0.378=-0.001
σ0.006-0.007=-0.001
min0.373-0.374=-0.001
max0.387-0.390=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1285.489-1285.501=-0.012
σ0.081-0.087=-0.005
min1285.353-1285.353=0.000
max1285.548-1285.568=-0.019
mean1633.000-1524.000=109.000
σ0.000
min1633.000-1524.000=109.000
max1633.000-1524.000=109.000
mean1.920-1.888=0.032
σ0.159-0.066=0.093
min1.803-1.801=0.002
max2.192-1.978=0.214
iters=5
new-facts=6402
prior-facts=1
mean1705.833-1705.829=0.004
σ6.829-6.858=-0.028
min1702.652-1702.652=-0.000
max1718.046-1718.093=-0.047
mean1633.000-1524.000=109.000
σ0.000
min1633.000-1524.000=109.000
max1633.000-1524.000=109.000
mean3.026-2.963=0.063
σ0.169-0.224=-0.056
min2.827-2.802=0.025
max3.230-3.309=-0.079
iters=5
new-facts=6402
prior-facts=6402
mean1968.444-1968.411=0.033
σ0.022-0.034=-0.012
min1968.427-1968.355=0.072
max1968.475-1968.444=0.031
mean1904.400-1787.200=117.200
σ225.186-196.233=28.954
min1633.000-1530.000=103.000
max2183.000-2030.000=153.000
mean3.250-3.216=0.034
σ0.102-0.336=-0.234
min3.166-3.014=0.153
max3.367-3.814=-0.447

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.209-1.546=-0.337
σ0.335-0.264=0.070
min0.916-1.202=-0.287
max1.775-1.782=-0.008

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.780-436.771=0.009
σ572.362-572.353=0.009
min150.590-150.589=0.001
max1295.323-1295.301=0.022
mean90.250
σ8.500
min86.000
max103.000
mean1633.000-1524.000=109.000
σ0.000
min1633.000-1524.000=109.000
max1633.000-1524.000=109.000
mean0.529-0.528=0.001
σ0.557-0.556=0.001
min0.248-0.247=0.002
max1.365-1.363=0.003
policies=20
mean1506.183-1506.174=0.009
σ0.237-0.238=-0.000
min1506.031-1506.010=0.021
max1506.537-1506.526=0.010
mean860.000
σ0.000
min860.000
max860.000
mean1633.000-1524.000=109.000
σ0.000
min1633.000-1524.000=109.000
max1633.000-1524.000=109.000
mean2.518-2.511=0.008
σ0.019-0.025=-0.005
min2.492-2.477=0.015
max2.535-2.531=0.004
policies=200
mean15069.438-15069.415=0.023
σ0.120-0.101=0.019
min15069.284-15069.322=-0.037
max15069.572-15069.553=0.019
mean8600.000
σ0.000
min8600.000
max8600.000
mean1633.000-1524.000=109.000
σ0.000
min1633.000-1524.000=109.000
max1633.000-1524.000=109.000
mean25.409-25.443=-0.034
σ0.095-0.136=-0.041
min25.301-25.317=-0.016
max25.519-25.622=-0.103