Compare commits

Home / Compare ec76fd0b .. 09088916

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.729-70.732=-0.003
σ0.046-0.043=0.003
min70.701-70.706=-0.005
max70.857-70.852=0.006
mean415.000
σ0.000
min415.000
max415.000
mean0.159-0.159=0.001
σ0.005-0.005=-0.000
min0.154-0.152=0.002
max0.167-0.167=0.001
cache=y
dps=1
iters=10
policies=100
mean21.446-21.446=-0.001
σ0.003-0.004=-0.000
min21.440-21.443=-0.002
max21.449-21.453=-0.004
mean415.000
σ0.000
min415.000
max415.000
mean0.064-0.066=-0.002
σ0.004-0.003=0.001
min0.060-0.064=-0.004
max0.072-0.074=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.525-1754.527=-0.002
σ0.359-0.360=-0.001
min1753.959-1753.954=0.005
max1755.093-1755.108=-0.014
mean1639.000-1661.550=-22.550
σ628.194-631.362=-3.168
min640.000-623.000=17.000
max2852.000-2667.000=185.000
mean2.815-2.831=-0.016
σ0.220-0.110=0.110
min2.360-2.639=-0.279
max3.191-3.080=0.111

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.608-273.609=-0.001
σ0.006-0.007=-0.000
min273.598-273.599=-0.000
max273.614-273.615=-0.001
mean2852.000-2667.000=185.000
σ0.000
min2852.000-2667.000=185.000
max2852.000-2667.000=185.000
mean0.383-0.388=-0.005
σ0.004-0.011=-0.007
min0.381-0.380=0.001
max0.390-0.403=-0.013
iters=5
new-facts=1
prior-facts=6402
mean1933.999-1933.995=0.004
σ0.007-0.003=0.005
min1933.991-1933.990=0.000
max1934.011-1933.997=0.014
mean2852.000-2667.000=185.000
σ0.000
min2852.000-2667.000=185.000
max2852.000-2667.000=185.000
mean2.949-3.101=-0.152
σ0.163-0.108=0.055
min2.676-2.999=-0.323
max3.092-3.232=-0.139
iters=5
new-facts=6402
prior-facts=1
mean4754.770-4754.614=0.156
σ0.849-0.651=0.198
min4754.287-4754.245=0.042
max4756.284-4755.776=0.508
mean2852.000-2667.000=185.000
σ0.000
min2852.000-2667.000=185.000
max2852.000-2667.000=185.000
mean8.472-8.859=-0.387
σ0.484-0.196=0.289
min7.654-8.604=-0.950
max8.925-9.134=-0.209
iters=5
new-facts=6402
prior-facts=6402
mean4945.150-4945.230=-0.080
σ0.160-0.018=0.142
min4944.865-4945.208=-0.342
max4945.240-4945.256=-0.016
mean3011.600-3007.400=4.200
σ180.500-257.967=-77.467
min2852.000-2667.000=185.000
max3292.000-3307.000=-15.000
mean8.557-8.636=-0.078
σ0.132-0.159=-0.027
min8.387-8.464=-0.077
max8.756-8.894=-0.138

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.050-1.081=-0.032
σ0.124-0.147=-0.022
min0.938-0.940=-0.002
max1.241-1.244=-0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.843-472.846=-0.002
σ574.926-574.934=-0.008
min185.371-185.369=0.002
max1335.232-1335.247=-0.014
mean88.250
σ8.500
min84.000
max101.000
mean2852.000-2667.000=185.000
σ0.000
min2852.000-2667.000=185.000
max2852.000-2667.000=185.000
mean0.451-0.560=-0.109
σ0.305-0.532=-0.228
min0.295-0.290=0.005
max0.908-1.359=-0.451
policies=20
mean1854.003-1853.983=0.020
σ0.370-0.378=-0.008
min1853.729-1853.720=0.009
max1854.542-1854.540=0.002
mean840.000
σ0.000
min840.000
max840.000
mean2852.000-2667.000=185.000
σ0.000
min2852.000-2667.000=185.000
max2852.000-2667.000=185.000
mean2.951-2.872=0.079
σ0.018-0.031=-0.013
min2.929-2.844=0.085
max2.972-2.903=0.069
policies=200
mean18546.618-18546.719=-0.102
σ0.425-0.458=-0.033
min18546.249-18546.453=-0.205
max18547.228-18547.405=-0.176
mean8400.000
σ0.000
min8400.000
max8400.000
mean2852.000-2667.000=185.000
σ0.000
min2852.000-2667.000=185.000
max2852.000-2667.000=185.000
mean29.094-28.819=0.275
σ0.453-0.075=0.378
min28.805-28.708=0.097
max29.762-28.874=0.888