Compare commits

Home / Compare b6fe30c8 .. b017af50

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.567-70.564=0.003
σ0.045-0.049=-0.004
min70.541-70.536=0.005
max70.690-70.702=-0.012
mean415.000
σ0.000
min415.000
max415.000
mean0.160-0.159=0.001
σ0.003-0.005=-0.001
min0.154-0.153=0.001
max0.165-0.165=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.288-21.287=0.002
σ0.003-0.002=0.000
min21.285-21.284=0.001
max21.292-21.291=0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.065-0.061=0.004
σ0.002-0.003=-0.000
min0.063-0.059=0.004
max0.072-0.067=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.568-1753.570=-0.002
σ0.361-0.361=0.000
min1752.997-1752.999=-0.002
max1754.152-1754.169=-0.017
mean1658.550-1652.800=5.750
σ647.667-639.847=7.820
min627.000-632.000=-5.000
max2908.000-2857.000=51.000
mean2.759-2.820=-0.061
σ0.166-0.188=-0.022
min2.371-2.175=0.197
max3.009-2.999=0.010

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.018-272.019=-0.001
σ0.005-0.009=-0.004
min272.013-272.011=0.002
max272.025-272.033=-0.008
mean2908.000-2857.000=51.000
σ0.000
min2908.000-2857.000=51.000
max2908.000-2857.000=51.000
mean0.388-0.395=-0.007
σ0.010-0.018=-0.009
min0.378-0.378=-0.000
max0.400-0.421=-0.021
iters=5
new-facts=1
prior-facts=6402
mean1932.437-1932.432=0.005
σ0.010-0.005=0.005
min1932.421-1932.428=-0.007
max1932.446-1932.438=0.007
mean2908.000-2857.000=51.000
σ0.000
min2908.000-2857.000=51.000
max2908.000-2857.000=51.000
mean3.000-3.021=-0.021
σ0.078-0.088=-0.010
min2.938-2.936=0.002
max3.135-3.137=-0.002
iters=5
new-facts=6402
prior-facts=1
mean4753.054-4753.174=-0.120
σ0.955-0.852=0.103
min4752.087-4752.707=-0.621
max4754.653-4754.690=-0.038
mean2908.000-2857.000=51.000
σ0.000
min2908.000-2857.000=51.000
max2908.000-2857.000=51.000
mean8.499-8.487=0.011
σ0.587-0.509=0.078
min7.607-7.669=-0.062
max9.121-8.953=0.168
iters=5
new-facts=6402
prior-facts=6402
mean4943.417-4943.562=-0.145
σ0.309-0.151=0.158
min4942.938-4943.293=-0.355
max4943.662-4943.652=0.010
mean3099.600-3059.200=40.400
σ212.359-197.779=14.579
min2908.000-2857.000=51.000
max3424.000-3310.000=114.000
mean8.617-8.591=0.026
σ0.223-0.145=0.078
min8.394-8.432=-0.037
max8.951-8.742=0.209

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.085-1.071=0.015
σ0.178-0.241=-0.063
min0.912-0.927=-0.015
max1.288-1.489=-0.202

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.085-473.081=0.004
σ575.921-575.916=0.005
min185.115-185.116=-0.001
max1336.966-1336.955=0.011
mean88.250
σ8.500
min84.000
max101.000
mean2908.000-2857.000=51.000
σ0.000
min2908.000-2857.000=51.000
max2908.000-2857.000=51.000
mean0.451-0.486=-0.035
σ0.303-0.375=-0.072
min0.298-0.296=0.003
max0.906-1.049=-0.143
policies=20
mean1851.468-1851.474=-0.006
σ0.378-0.378=0.000
min1851.190-1851.183=0.007
max1852.019-1852.022=-0.003
mean840.000
σ0.000
min840.000
max840.000
mean2908.000-2857.000=51.000
σ0.000
min2908.000-2857.000=51.000
max2908.000-2857.000=51.000
mean2.943-2.954=-0.012
σ0.002-0.018=-0.016
min2.941-2.938=0.002
max2.945-2.980=-0.035
policies=200
mean18521.128-18521.064=0.064
σ0.521-0.390=0.132
min18520.716-18520.765=-0.049
max18521.891-18521.629=0.262
mean8400.000
σ0.000
min8400.000
max8400.000
mean2908.000-2857.000=51.000
σ0.000
min2908.000-2857.000=51.000
max2908.000-2857.000=51.000
mean29.231-29.065=0.166
σ0.510-0.492=0.018
min28.759-28.687=0.072
max29.749-29.761=-0.011