Compare commits

Home / Compare 4ce7243c .. 94b4cae0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.390-30.769=39.621
σ0.047-0.047=0.001
min70.361-30.730=39.631
max70.523-30.897=39.627
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.157-0.075=0.082
σ0.003-0.004=-0.002
min0.154-0.069=0.085
max0.163-0.084=0.079
cache=y
dps=1
iters=10
policies=100
mean21.145-21.061=0.084
σ0.004-0.002=0.002
min21.139-21.058=0.082
max21.150-21.063=0.087
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.065-0.062=0.002
σ0.003-0.003=-0.000
min0.062-0.058=0.004
max0.072-0.067=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean20814.796-20813.754=1.042
σ0.355-0.353=0.002
min20814.278-20813.233=1.046
max20815.383-20814.336=1.047
mean2632.050-2588.950=43.100
σ768.343-730.037=38.306
min1521.000-1418.000=103.000
max3893.000-3899.000=-6.000
mean17.078-17.095=-0.017
σ1.142-0.773=0.369
min15.216-16.059=-0.843
max19.065-19.034=0.031

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean295.146-300.736=-5.589
σ0.005-0.018=-0.013
min295.141-300.705=-5.564
max295.154-300.751=-5.596
mean3893.000-3899.000=-6.000
σ0.000
min3893.000-3899.000=-6.000
max3893.000-3899.000=-6.000
mean0.415-0.429=-0.014
σ0.006-0.012=-0.006
min0.407-0.418=-0.011
max0.421-0.445=-0.024
iters=5
new-facts=1
prior-facts=6402
mean2981.968-3219.670=-237.701
σ0.015-0.076=-0.061
min2981.954-3219.551=-237.596
max2981.988-3219.734=-237.747
mean3893.000-3899.000=-6.000
σ0.000
min3893.000-3899.000=-6.000
max3893.000-3899.000=-6.000
mean3.936-3.712=0.224
σ0.088-0.105=-0.017
min3.837-3.619=0.218
max4.042-3.865=0.177
iters=5
new-facts=6402
prior-facts=1
mean5802.744-6099.594=-296.850
σ1.040-1.116=-0.076
min5802.171-6098.473=-296.303
max5804.600-6101.466=-296.866
mean3893.000-3899.000=-6.000
σ0.000
min3893.000-3899.000=-6.000
max3893.000-3899.000=-6.000
mean9.486-10.033=-0.547
σ0.476-0.831=-0.356
min8.712-8.885=-0.173
max9.984-10.882=-0.899
iters=5
new-facts=6402
prior-facts=6402
mean6011.247-6248.762=-237.515
σ0.065-0.137=-0.072
min6011.156-6248.581=-237.425
max6011.306-6248.963=-237.658
mean3893.000-3913.800=-20.800
σ0.000-33.094=-33.094
min3893.000-3899.000=-6.000
max3893.000-3973.000=-80.000
mean9.212-9.914=-0.702
σ0.181-0.476=-0.296
min9.030-9.505=-0.475
max9.421-10.738=-1.316

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.429-1.092=0.337
σ0.366-0.145=0.221
min0.964-0.960=0.004
max1.843-1.330=0.513

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean532.765-529.949=2.816
σ575.925-572.661=3.264
min244.800-243.618=1.182
max1396.653-1388.941=7.712
mean84.000-79.750=4.250
σ8.000-7.500=0.500
min80.000-76.000=4.000
max96.000-91.000=5.000
mean3893.000-3899.000=-6.000
σ0.000
min3893.000-3899.000=-6.000
max3893.000-3899.000=-6.000
mean0.665-0.660=0.005
σ0.561-0.572=-0.010
min0.368-0.367=0.001
max1.507-1.517=-0.011
policies=20
mean2448.329-2436.594=11.735
σ0.408-0.384=0.023
min2447.952-2436.251=11.701
max2448.786-2437.023=11.762
mean800.000-760.000=40.000
σ0.000
min800.000-760.000=40.000
max800.000-760.000=40.000
mean3893.000-3899.000=-6.000
σ0.000
min3893.000-3899.000=-6.000
max3893.000-3899.000=-6.000
mean3.659-3.662=-0.002
σ0.017-0.020=-0.004
min3.648-3.639=0.009
max3.684-3.688=-0.004
policies=200
mean24488.521-24371.034=117.487
σ0.379-0.486=-0.107
min24488.272-24370.712=117.559
max24489.085-24371.758=117.328
mean8000.000-7600.000=400.000
σ0.000
min8000.000-7600.000=400.000
max8000.000-7600.000=400.000
mean3893.000-3899.000=-6.000
σ0.000
min3893.000-3899.000=-6.000
max3893.000-3899.000=-6.000
mean36.845-36.821=0.023
σ0.183-0.134=0.049
min36.605-36.648=-0.043
max37.050-36.928=0.122