Compare commits

Home / Compare 89971fa2 .. d584b5e5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.392-70.393=-0.001
σ0.045-0.048=-0.003
min70.370-70.367=0.003
max70.516-70.527=-0.010
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.159-0.159=0.000
σ0.006-0.002=0.004
min0.149-0.156=-0.007
max0.169-0.165=0.004
cache=y
dps=1
iters=10
policies=100
mean21.147-21.148=-0.000
σ0.013-0.011=0.001
min21.138-21.140=-0.002
max21.181-21.179=0.002
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.061-0.064=-0.003
σ0.003-0.003=0.001
min0.057-0.062=-0.005
max0.066-0.072=-0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.395-1752.395=0.000
σ0.358-0.361=-0.003
min1751.826-1751.825=0.001
max1752.957-1752.987=-0.030
mean1641.650-1657.900=-16.250
σ616.934-629.422=-12.489
min634.000-618.000=16.000
max2479.000-2774.000=-295.000
mean2.843-2.849=-0.006
σ0.091-0.101=-0.009
min2.648-2.633=0.015
max3.045-3.021=0.024

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.241-270.239=0.002
σ0.010-0.008=0.001
min270.229-270.230=-0.001
max270.254-270.252=0.002
mean2479.000-2774.000=-295.000
σ0.000
min2479.000-2774.000=-295.000
max2479.000-2774.000=-295.000
mean0.384-0.385=-0.002
σ0.011-0.010=0.000
min0.371-0.380=-0.009
max0.397-0.403=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1930.705-1930.698=0.007
σ0.005-0.018=-0.013
min1930.699-1930.668=0.031
max1930.712-1930.714=-0.002
mean2479.000-2774.000=-295.000
σ0.000
min2479.000-2774.000=-295.000
max2479.000-2774.000=-295.000
mean2.532-2.638=-0.105
σ0.052-0.154=-0.102
min2.479-2.478=0.002
max2.604-2.837=-0.232
iters=5
new-facts=6402
prior-facts=1
mean4751.229-4751.327=-0.099
σ0.977-0.924=0.053
min4750.464-4750.595=-0.131
max4752.875-4752.936=-0.061
mean2479.000-2774.000=-295.000
σ0.000
min2479.000-2774.000=-295.000
max2479.000-2774.000=-295.000
mean8.239-8.226=0.013
σ0.239-0.473=-0.234
min7.863-7.809=0.053
max8.514-8.911=-0.397
iters=5
new-facts=6402
prior-facts=6402
mean4941.729-4941.798=-0.069
σ0.199-0.164=0.035
min4941.500-4941.506=-0.006
max4941.898-4941.892=0.006
mean2978.400-3054.800=-76.400
σ265.903-343.795=-77.892
min2643.000-2774.000=-131.000
max3335.000-3566.000=-231.000
mean8.559-8.520=0.039
σ0.088-0.131=-0.043
min8.437-8.317=0.120
max8.654-8.640=0.013

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.829-1.069=0.760
σ0.064-0.100=-0.037
min1.741-0.939=0.803
max1.906-1.221=0.685

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.748-466.751=-0.003
σ575.931-575.941=-0.010
min178.781-178.777=0.004
max1330.645-1330.662=-0.018
mean86.250
σ8.500
min82.000
max99.000
mean2479.000-2774.000=-295.000
σ0.000
min2479.000-2774.000=-295.000
max2479.000-2774.000=-295.000
mean0.568-0.431=0.137
σ0.572-0.279=0.293
min0.281-0.288=-0.007
max1.426-0.849=0.577
policies=20
mean1788.106-1788.138=-0.031
σ0.371-0.386=-0.014
min1787.875-1787.890=-0.015
max1788.660-1788.709=-0.049
mean820.000
σ0.000
min820.000
max820.000
mean2479.000-2774.000=-295.000
σ0.000
min2479.000-2774.000=-295.000
max2479.000-2774.000=-295.000
mean2.797-2.854=-0.057
σ0.021-0.092=-0.071
min2.774-2.784=-0.011
max2.825-2.980=-0.155
policies=200
mean17888.048-17888.187=-0.140
σ0.583-0.507=0.076
min17887.723-17887.878=-0.155
max17888.922-17888.945=-0.023
mean8200.000
σ0.000
min8200.000
max8200.000
mean2479.000-2774.000=-295.000
σ0.000
min2479.000-2774.000=-295.000
max2479.000-2774.000=-295.000
mean28.118-28.116=0.002
σ0.041-0.104=-0.063
min28.058-28.014=0.044
max28.152-28.256=-0.105