Compare commits

Home / Compare 4ac2da06 .. 04a888e8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.732-70.729=0.003
σ0.051-0.053=-0.002
min70.705-70.699=0.006
max70.875-70.875=0.000
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.162-0.158=0.004
σ0.004-0.006=-0.002
min0.157-0.149=0.008
max0.168-0.167=0.001
cache=y
dps=1
iters=10
policies=100
mean21.444-21.447=-0.003
σ0.003-0.003=0.001
min21.442-21.444=-0.002
max21.451-21.451=-0.001
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.066-0.066=0.001
σ0.003-0.003=-0.000
min0.064-0.063=0.001
max0.073-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.285-1754.526=0.758
σ0.359-0.363=-0.004
min1754.730-1753.948=0.782
max1755.875-1755.113=0.762
mean1662.700-1664.100=-1.400
σ618.520-631.220=-12.701
min639.000-621.000=18.000
max2491.000-2679.000=-188.000
mean2.811-2.820=-0.009
σ0.174-0.134=0.040
min2.440-2.391=0.049
max3.162-3.034=0.128

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.772-273.586=-0.814
σ0.006-0.009=-0.003
min272.764-273.572=-0.809
max272.781-273.595=-0.814
mean2491.000-2679.000=-188.000
σ0.000
min2491.000-2679.000=-188.000
max2491.000-2679.000=-188.000
mean0.383-0.388=-0.005
σ0.008-0.006=0.002
min0.372-0.384=-0.012
max0.393-0.398=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1933.150-1934.002=-0.851
σ0.016-0.010=0.006
min1933.125-1933.987=-0.862
max1933.164-1934.015=-0.852
mean2491.000-2679.000=-188.000
σ0.000
min2491.000-2679.000=-188.000
max2491.000-2679.000=-188.000
mean2.991-3.083=-0.092
σ0.106-0.085=0.021
min2.820-3.013=-0.193
max3.085-3.212=-0.127
iters=5
new-facts=6402
prior-facts=1
mean4753.911-4754.844=-0.934
σ0.854-0.825=0.030
min4753.357-4754.388=-1.031
max4755.424-4756.316=-0.893
mean2491.000-2679.000=-188.000
σ0.000
min2491.000-2679.000=-188.000
max2491.000-2679.000=-188.000
mean8.599-7.984=0.615
σ0.519-0.356=0.162
min7.926-7.784=0.142
max9.363-8.615=0.748
iters=5
new-facts=6402
prior-facts=6402
mean4944.316-4945.217=-0.901
σ0.141-0.007=0.134
min4944.064-4945.209=-1.145
max4944.399-4945.225=-0.826
mean2896.000-2995.200=-99.200
σ358.837-361.763=-2.926
min2491.000-2679.000=-188.000
max3402.000-3523.000=-121.000
mean8.625-8.482=0.143
σ0.341-0.124=0.217
min8.368-8.373=-0.005
max9.171-8.646=0.525

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.704-1.218=0.486
σ0.170-0.324=-0.154
min1.462-0.937=0.525
max1.877-1.574=0.303

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean469.472-469.476=-0.004
σ574.928-574.938=-0.010
min182.002-182.005=-0.003
max1331.864-1331.883=-0.019
mean88.250
σ8.500
min84.000
max101.000
mean2491.000-2679.000=-188.000
σ0.000
min2491.000-2679.000=-188.000
max2491.000-2679.000=-188.000
mean0.578-0.555=0.023
σ0.569-0.532=0.036
min0.287-0.284=0.003
max1.431-1.353=0.078
policies=20
mean1820.343-1820.344=-0.000
σ0.377-0.383=-0.006
min1820.096-1820.088=0.008
max1820.902-1820.912=-0.010
mean840.000
σ0.000
min840.000
max840.000
mean2491.000-2679.000=-188.000
σ0.000
min2491.000-2679.000=-188.000
max2491.000-2679.000=-188.000
mean2.831-2.831=-0.000
σ0.017-0.009=0.008
min2.813-2.820=-0.007
max2.847-2.843=0.005
policies=200
mean18210.473-18210.407=0.066
σ0.357-0.567=-0.210
min18210.230-18210.066=0.164
max18211.003-18211.253=-0.250
mean8400.000
σ0.000
min8400.000
max8400.000
mean2491.000-2679.000=-188.000
σ0.000
min2491.000-2679.000=-188.000
max2491.000-2679.000=-188.000
mean28.587-28.549=0.038
σ0.119-0.043=0.076
min28.475-28.505=-0.030
max28.694-28.595=0.099