Compare commits

Home / Compare a262d139 .. 582a7e17

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.567=-0.004
σ0.045-0.044=0.000
min70.543-70.543=0.000
max70.690-70.689=0.001
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.156-0.159=-0.002
σ0.004-0.003=0.001
min0.150-0.155=-0.005
max0.161-0.163=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.292-21.288=0.003
σ0.010-0.003=0.008
min21.284-21.284=0.000
max21.319-21.292=0.028
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.064-0.062=0.002
σ0.002-0.003=-0.001
min0.063-0.058=0.005
max0.070-0.068=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.568-1753.570=-0.002
σ0.359-0.359=0.000
min1752.994-1753.000=-0.005
max1754.154-1754.152=0.002
mean1644.600-1645.100=-0.500
σ627.798-634.841=-7.043
min686.000-627.000=59.000
max2701.000-2854.000=-153.000
mean2.780-2.820=-0.040
σ0.177-0.154=0.024
min2.475-2.364=0.111
max3.188-3.083=0.106

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.016-272.020=-0.004
σ0.009-0.007=0.002
min272.002-272.014=-0.012
max272.024-272.032=-0.008
mean2701.000-2854.000=-153.000
σ0.000
min2701.000-2854.000=-153.000
max2701.000-2854.000=-153.000
mean0.390-0.391=-0.001
σ0.010-0.011=-0.001
min0.379-0.379=0.000
max0.403-0.405=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1932.435-1932.438=-0.003
σ0.017-0.007=0.011
min1932.409-1932.428=-0.019
max1932.449-1932.446=0.003
mean2701.000-2854.000=-153.000
σ0.000
min2701.000-2854.000=-153.000
max2701.000-2854.000=-153.000
mean2.971-2.995=-0.024
σ0.148-0.110=0.038
min2.738-2.817=-0.079
max3.102-3.121=-0.019
iters=5
new-facts=6402
prior-facts=1
mean4753.121-4753.194=-0.073
σ0.863-0.830=0.033
min4752.637-4752.787=-0.150
max4754.657-4754.678=-0.020
mean2701.000-2854.000=-153.000
σ0.000
min2701.000-2854.000=-153.000
max2701.000-2854.000=-153.000
mean8.747-8.410=0.337
σ0.306-0.199=0.107
min8.410-8.177=0.234
max9.096-8.621=0.474
iters=5
new-facts=6402
prior-facts=6402
mean4943.557-4943.631=-0.074
σ0.160-0.022=0.138
min4943.273-4943.601=-0.329
max4943.650-4943.655=-0.004
mean2973.600-3052.200=-78.600
σ228.514-252.024=-23.510
min2701.000-2854.000=-153.000
max3291.000-3428.000=-137.000
mean8.508-8.610=-0.102
σ0.060-0.342=-0.282
min8.414-8.376=0.038
max8.562-9.205=-0.644

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.025-1.071=-0.046
σ0.139-0.108=0.031
min0.927-0.934=-0.007
max1.250-1.236=0.013

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.080-473.081=-0.002
σ575.925-575.915=0.009
min185.111-185.112=-0.001
max1336.967-1336.954=0.012
mean88.250
σ8.500
min84.000
max101.000
mean2701.000-2854.000=-153.000
σ0.000
min2701.000-2854.000=-153.000
max2701.000-2854.000=-153.000
mean0.548-0.452=0.097
σ0.516-0.304=0.212
min0.289-0.297=-0.008
max1.323-0.908=0.414
policies=20
mean1851.389-1851.465=-0.076
σ0.301-0.378=-0.077
min1851.173-1851.181=-0.008
max1851.832-1852.014=-0.182
mean840.000
σ0.000
min840.000
max840.000
mean2701.000-2854.000=-153.000
σ0.000
min2701.000-2854.000=-153.000
max2701.000-2854.000=-153.000
mean2.875-2.945=-0.070
σ0.018-0.001=0.017
min2.853-2.944=-0.091
max2.896-2.947=-0.051
policies=200
mean18520.844-18521.127=-0.283
σ0.936-0.530=0.406
min18519.619-18520.586=-0.967
max18521.900-18521.854=0.046
mean8400.000
σ0.000
min8400.000
max8400.000
mean2701.000-2854.000=-153.000
σ0.000
min2701.000-2854.000=-153.000
max2701.000-2854.000=-153.000
mean28.827-29.104=-0.277
σ0.060-0.450=-0.390
min28.750-28.747=0.003
max28.880-29.733=-0.853