Compare commits

Home / Compare 97747a44 .. fc4ae16f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.567-70.568=-0.001
σ0.045-0.045=0.000
min70.541-70.544=-0.003
max70.690-70.691=-0.001
mean415.000-418.600=-3.600
σ0.000-0.516=-0.516
min415.000-418.000=-3.000
max415.000-419.000=-4.000
mean0.160-0.159=0.001
σ0.003-0.003=0.000
min0.154-0.154=-0.000
max0.165-0.164=0.001
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=0.000
σ0.003-0.003=-0.001
min21.285-21.282=0.003
max21.292-21.292=0.000
mean415.000-419.000=-4.000
σ0.000
min415.000-419.000=-4.000
max415.000-419.000=-4.000
mean0.065-0.064=0.001
σ0.002-0.002=0.001
min0.063-0.063=0.001
max0.072-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.568-1753.372=0.196
σ0.361-0.359=0.002
min1752.997-1752.809=0.189
max1754.152-1753.939=0.213
mean1658.550-1655.100=3.450
σ647.667-634.377=13.290
min627.000-638.000=-11.000
max2908.000-2854.000=54.000
mean2.759-2.795=-0.036
σ0.166-0.111=0.055
min2.371-2.518=-0.147
max3.009-3.011=-0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.018-271.754=0.264
σ0.005-0.002=0.002
min272.013-271.752=0.261
max272.025-271.758=0.267
mean2908.000-2854.000=54.000
σ0.000
min2908.000-2854.000=54.000
max2908.000-2854.000=54.000
mean0.388-0.383=0.005
σ0.010-0.007=0.003
min0.378-0.376=0.002
max0.400-0.394=0.006
iters=5
new-facts=1
prior-facts=6402
mean1932.437-1932.182=0.254
σ0.010-0.007=0.002
min1932.421-1932.175=0.246
max1932.446-1932.191=0.255
mean2908.000-2854.000=54.000
σ0.000
min2908.000-2854.000=54.000
max2908.000-2854.000=54.000
mean3.000-2.942=0.058
σ0.078-0.152=-0.074
min2.938-2.786=0.152
max3.135-3.147=-0.012
iters=5
new-facts=6402
prior-facts=1
mean4753.054-4752.875=0.179
σ0.955-0.890=0.065
min4752.087-4752.107=-0.020
max4754.653-4754.415=0.238
mean2908.000-2854.000=54.000
σ0.000
min2908.000-2854.000=54.000
max2908.000-2854.000=54.000
mean8.499-7.935=0.564
σ0.587-0.310=0.277
min7.607-7.710=-0.103
max9.121-8.481=0.640
iters=5
new-facts=6402
prior-facts=6402
mean4943.417-4943.157=0.260
σ0.309-0.324=-0.014
min4942.938-4942.638=0.301
max4943.662-4943.390=0.272
mean3099.600-3073.000=26.600
σ212.359-295.946=-83.587
min2908.000-2854.000=54.000
max3424.000-3532.000=-108.000
mean8.617-8.426=0.192
σ0.223-0.087=0.136
min8.394-8.345=0.049
max8.951-8.565=0.386

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.085-0.997=0.088
σ0.178-0.123=0.056
min0.912-0.937=-0.025
max1.288-1.216=0.072

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.085-472.854=0.231
σ575.921-575.912=0.008
min185.115-184.892=0.224
max1336.966-1336.723=0.244
mean88.250
σ8.500
min84.000
max101.000
mean2908.000-2854.000=54.000
σ0.000
min2908.000-2854.000=54.000
max2908.000-2854.000=54.000
mean0.451-0.450=0.001
σ0.303-0.308=-0.005
min0.298-0.293=0.005
max0.906-0.912=-0.006
policies=20
mean1851.468-1849.190=2.278
σ0.378-0.371=0.008
min1851.190-1848.916=2.274
max1852.019-1849.729=2.290
mean840.000
σ0.000
min840.000
max840.000
mean2908.000-2854.000=54.000
σ0.000
min2908.000-2854.000=54.000
max2908.000-2854.000=54.000
mean2.943-2.951=-0.008
σ0.002-0.015=-0.013
min2.941-2.938=0.003
max2.945-2.969=-0.023
policies=200
mean18521.128-18498.629=22.499
σ0.521-0.512=0.009
min18520.716-18498.326=22.391
max18521.891-18499.394=22.497
mean8400.000
σ0.000
min8400.000
max8400.000
mean2908.000-2854.000=54.000
σ0.000
min2908.000-2854.000=54.000
max2908.000-2854.000=54.000
mean29.231-29.241=-0.011
σ0.510-0.618=-0.108
min28.759-28.692=0.067
max29.749-29.868=-0.119