Compare commits

Home / Compare a5b1d197 .. bd2006f9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.741-70.742=-0.002
σ0.048-0.047=0.001
min70.717-70.708=0.008
max70.876-70.872=0.004
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.161-0.156=0.005
σ0.004-0.005=-0.001
min0.158-0.151=0.007
max0.169-0.162=0.007
cache=y
dps=1
iters=10
policies=100
mean21.465-21.465=0.000
σ0.003-0.003=0.000
min21.461-21.461=0.001
max21.470-21.468=0.002
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.065-0.063=0.002
σ0.002-0.004=-0.001
min0.064-0.059=0.004
max0.071-0.071=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.457-1754.458=-0.001
σ0.360-0.360=0.001
min1753.885-1753.884=0.001
max1755.028-1755.043=-0.015
mean1663.500-1647.900=15.600
σ627.210-620.260=6.949
min674.000-621.000=53.000
max2606.000-2650.000=-44.000
mean2.772-2.834=-0.062
σ0.167-0.152=0.015
min2.513-2.411=0.102
max3.069-3.098=-0.030

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.505-273.503=0.002
σ0.004-0.007=-0.003
min273.499-273.494=0.005
max273.509-273.510=-0.001
mean2606.000-2650.000=-44.000
σ0.000
min2606.000-2650.000=-44.000
max2606.000-2650.000=-44.000
mean0.385-0.384=0.001
σ0.004-0.004=0.000
min0.382-0.381=0.001
max0.392-0.391=0.002
iters=5
new-facts=1
prior-facts=6402
mean1933.905-1933.900=0.005
σ0.011-0.007=0.005
min1933.893-1933.895=-0.002
max1933.923-1933.910=0.013
mean2606.000-2650.000=-44.000
σ0.000
min2606.000-2650.000=-44.000
max2606.000-2650.000=-44.000
mean3.001-2.930=0.070
σ0.333-0.133=0.199
min2.456-2.694=-0.238
max3.311-3.012=0.299
iters=5
new-facts=6402
prior-facts=1
mean4754.504-4754.391=0.113
σ1.064-0.752=0.312
min4753.273-4753.629=-0.355
max4756.211-4755.654=0.557
mean2606.000-2650.000=-44.000
σ0.000
min2606.000-2650.000=-44.000
max2606.000-2650.000=-44.000
mean8.004-8.786=-0.781
σ0.484-0.192=0.291
min7.751-8.454=-0.703
max8.868-8.935=-0.068
iters=5
new-facts=6402
prior-facts=6402
mean4945.047-4945.118=-0.071
σ0.165-0.012=0.153
min4944.754-4945.103=-0.348
max4945.150-4945.133=0.017
mean2962.000-2990.000=-28.000
σ362.278-254.731=107.547
min2606.000-2650.000=-44.000
max3437.000-3292.000=145.000
mean8.565-8.512=0.054
σ0.277-0.139=0.138
min8.365-8.397=-0.033
max9.019-8.744=0.275

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.339-1.180=0.159
σ0.381-0.333=0.048
min0.940-0.925=0.015
max1.813-1.729=0.084

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.057-473.064=-0.008
σ575.922-575.930=-0.007
min185.090-185.094=-0.004
max1336.940-1336.959=-0.019
mean88.250
σ8.500
min84.000
max101.000
mean2606.000-2650.000=-44.000
σ0.000
min2606.000-2650.000=-44.000
max2606.000-2650.000=-44.000
mean0.562-0.592=-0.030
σ0.549-0.600=-0.051
min0.284-0.288=-0.004
max1.386-1.491=-0.106
policies=20
mean1851.235-1851.260=-0.025
σ0.379-0.377=0.002
min1850.984-1851.004=-0.020
max1851.794-1851.817=-0.023
mean840.000
σ0.000
min840.000
max840.000
mean2606.000-2650.000=-44.000
σ0.000
min2606.000-2650.000=-44.000
max2606.000-2650.000=-44.000
mean2.885-2.871=0.014
σ0.016-0.003=0.013
min2.867-2.868=-0.001
max2.900-2.873=0.027
policies=200
mean18519.392-18519.486=-0.095
σ0.524-0.488=0.035
min18519.026-18519.193=-0.167
max18520.169-18520.217=-0.048
mean8400.000
σ0.000
min8400.000
max8400.000
mean2606.000-2650.000=-44.000
σ0.000
min2606.000-2650.000=-44.000
max2606.000-2650.000=-44.000
mean28.948-28.990=-0.042
σ0.099-0.156=-0.057
min28.831-28.873=-0.042
max29.058-29.219=-0.161