Compare commits

Home / Compare feb74a4d .. 680ea81f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.708-70.568=0.140
σ0.045-0.046=-0.001
min70.677-70.543=0.134
max70.833-70.694=0.139
mean414.000-419.000=-5.000
σ0.000
min414.000-419.000=-5.000
max414.000-419.000=-5.000
mean0.159-0.160=-0.001
σ0.005-0.004=0.001
min0.153-0.156=-0.003
max0.167-0.165=0.002
cache=y
dps=1
iters=10
policies=100
mean21.411-21.289=0.123
σ0.003-0.003=-0.001
min21.408-21.282=0.126
max21.415-21.293=0.122
mean414.000-419.000=-5.000
σ0.000
min414.000-419.000=-5.000
max414.000-419.000=-5.000
mean0.062-0.065=-0.003
σ0.003-0.003=-0.000
min0.059-0.063=-0.004
max0.067-0.071=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.932-1753.174=1.758
σ0.363-0.362=0.001
min1754.363-1752.603=1.759
max1755.523-1753.756=1.767
mean1666.100-1650.450=15.650
σ644.080-630.541=13.539
min677.000-636.000=41.000
max2712.000-2763.000=-51.000
mean2.794-2.817=-0.024
σ0.168-0.172=-0.004
min2.366-2.450=-0.084
max3.014-2.991=0.022

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.794-271.621=1.173
σ0.007-0.007=-0.000
min272.787-271.610=1.177
max272.802-271.627=1.174
mean2712.000-2763.000=-51.000
σ0.000
min2712.000-2763.000=-51.000
max2712.000-2763.000=-51.000
mean0.377-0.382=-0.005
σ0.001-0.007=-0.006
min0.375-0.378=-0.003
max0.379-0.395=-0.016
iters=5
new-facts=1
prior-facts=6402
mean1933.218-1932.050=1.168
σ0.017-0.007=0.010
min1933.198-1932.040=1.159
max1933.244-1932.058=1.186
mean2712.000-2763.000=-51.000
σ0.000
min2712.000-2763.000=-51.000
max2712.000-2763.000=-51.000
mean3.107-3.021=0.086
σ0.158-0.062=0.097
min2.951-2.944=0.007
max3.363-3.081=0.281
iters=5
new-facts=6402
prior-facts=1
mean4756.916-4752.820=4.096
σ7.578-0.809=6.769
min4753.415-4752.245=1.170
max4770.471-4754.243=16.228
mean2712.000-2763.000=-51.000
σ0.000
min2712.000-2763.000=-51.000
max2712.000-2763.000=-51.000
mean8.660-8.185=0.474
σ0.438-0.729=-0.291
min8.030-7.703=0.327
max9.108-9.407=-0.299
iters=5
new-facts=6402
prior-facts=6402
mean4944.449-4943.164=1.285
σ0.014-0.163=-0.149
min4944.433-4942.872=1.561
max4944.467-4943.243=1.224
mean3008.800-3006.800=2.000
σ336.166-301.193=34.973
min2712.000-2763.000=-51.000
max3505.000-3457.000=48.000
mean8.538-8.409=0.129
σ0.241-0.040=0.201
min8.344-8.362=-0.017
max8.947-8.454=0.493

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.043-1.076=-0.033
σ0.130-0.116=0.014
min0.927-0.933=-0.006
max1.245-1.257=-0.012

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.313-472.292=-3.978
σ574.243-575.930=-1.688
min181.191-184.324=-3.133
max1329.677-1336.187=-6.510
mean88.250
σ8.500
min84.000
max101.000
mean2712.000-2763.000=-51.000
σ0.000
min2712.000-2763.000=-51.000
max2712.000-2763.000=-51.000
mean0.569-0.450=0.119
σ0.571-0.308=0.262
min0.280-0.292=-0.012
max1.424-0.913=0.512
policies=20
mean1812.198-1843.580=-31.383
σ0.381-0.363=0.018
min1811.949-1843.307=-31.358
max1812.764-1844.108=-31.344
mean840.000
σ0.000
min840.000
max840.000
mean2712.000-2763.000=-51.000
σ0.000
min2712.000-2763.000=-51.000
max2712.000-2763.000=-51.000
mean2.815-2.950=-0.135
σ0.020-0.105=-0.085
min2.797-2.866=-0.069
max2.838-3.097=-0.259
policies=200
mean18128.987-18442.230=-313.243
σ0.623-0.542=0.081
min18128.595-18441.928=-313.333
max18129.916-18443.041=-313.125
mean8400.000
σ0.000
min8400.000
max8400.000
mean2712.000-2763.000=-51.000
σ0.000
min2712.000-2763.000=-51.000
max2712.000-2763.000=-51.000
mean28.304-28.983=-0.679
σ0.089-0.130=-0.041
min28.191-28.905=-0.714
max28.406-29.178=-0.772