Compare commits

Home / Compare a887904a .. 1eb6ccb9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.564-70.388=0.176
σ0.045-0.045=0.001
min70.534-70.360=0.173
max70.691-70.512=0.179
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.165-0.156=0.009
σ0.014-0.005=0.009
min0.147-0.149=-0.002
max0.189-0.162=0.027
cache=y
dps=1
iters=10
policies=100
mean21.291-21.144=0.147
σ0.010-0.003=0.007
min21.285-21.139=0.146
max21.319-21.149=0.170
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.065-0.064=0.002
σ0.002-0.003=-0.001
min0.064-0.058=0.005
max0.072-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.653-1752.395=1.258
σ0.361-0.361=0.000
min1753.084-1751.823=1.261
max1754.232-1752.979=1.254
mean1645.750-1655.700=-9.950
σ628.955-646.723=-17.768
min634.000-618.000=16.000
max2768.000-2778.000=-10.000
mean2.822-2.828=-0.006
σ0.165-0.107=0.058
min2.359-2.555=-0.197
max3.156-3.013=0.143

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.097-270.140=1.957
σ0.008-0.009=-0.001
min272.082-270.131=1.952
max272.103-270.150=1.953
mean2768.000-2778.000=-10.000
σ0.000
min2768.000-2778.000=-10.000
max2768.000-2778.000=-10.000
mean0.393-0.377=0.016
σ0.011-0.005=0.006
min0.376-0.370=0.007
max0.406-0.383=0.023
iters=5
new-facts=1
prior-facts=6402
mean1932.525-1930.597=1.928
σ0.011-0.020=-0.009
min1932.512-1930.565=1.947
max1932.539-1930.613=1.925
mean2768.000-2778.000=-10.000
σ0.000
min2768.000-2778.000=-10.000
max2768.000-2778.000=-10.000
mean3.040-2.563=0.476
σ0.128-0.132=-0.004
min2.915-2.474=0.441
max3.188-2.783=0.404
iters=5
new-facts=6402
prior-facts=1
mean4753.272-4751.314=1.958
σ0.802-0.960=-0.158
min4752.816-4750.782=2.035
max4754.701-4753.021=1.680
mean2768.000-2778.000=-10.000
σ0.000
min2768.000-2778.000=-10.000
max2768.000-2778.000=-10.000
mean8.390-8.621=-0.231
σ0.450-0.656=-0.206
min7.702-7.625=0.077
max8.808-9.344=-0.536
iters=5
new-facts=6402
prior-facts=6402
mean4943.640-4941.769=1.871
σ0.174-0.011=0.163
min4943.330-4941.754=1.576
max4943.737-4941.778=1.959
mean3054.600-2989.400=65.200
σ253.425-218.298=35.128
min2768.000-2778.000=-10.000
max3411.000-3306.000=105.000
mean8.534-8.472=0.062
σ0.081-0.083=-0.002
min8.412-8.405=0.007
max8.608-8.615=-0.007

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.096-1.022=0.074
σ0.231-0.139=0.092
min0.920-0.928=-0.008
max1.381-1.248=0.133

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.295-466.378=5.917
σ575.929-575.927=0.002
min184.321-178.407=5.913
max1336.189-1330.269=5.920
mean88.250-84.250=4.000
σ8.500
min84.000-80.000=4.000
max101.000-97.000=4.000
mean2768.000-2778.000=-10.000
σ0.000
min2768.000-2778.000=-10.000
max2768.000-2778.000=-10.000
mean0.472-0.443=0.029
σ0.373-0.303=0.069
min0.283-0.287=-0.004
max1.031-0.898=0.133
policies=20
mean1843.551-1784.369=59.182
σ0.375-0.333=0.042
min1843.322-1784.125=59.197
max1844.108-1784.851=59.257
mean840.000-800.000=40.000
σ0.000
min840.000-800.000=40.000
max840.000-800.000=40.000
mean2768.000-2778.000=-10.000
σ0.000
min2768.000-2778.000=-10.000
max2768.000-2778.000=-10.000
mean2.880-2.865=0.015
σ0.015-0.082=-0.067
min2.861-2.762=0.099
max2.896-2.960=-0.064
policies=200
mean18442.203-17849.641=592.561
σ0.469-0.516=-0.047
min18441.877-17849.346=592.531
max18442.898-17850.415=592.484
mean8400.000-8000.000=400.000
σ0.000
min8400.000-8000.000=400.000
max8400.000-8000.000=400.000
mean2768.000-2778.000=-10.000
σ0.000
min2768.000-2778.000=-10.000
max2768.000-2778.000=-10.000
mean28.984-27.966=1.018
σ0.132-0.122=0.010
min28.867-27.825=1.042
max29.172-28.077=1.096