Compare commits

Home / Compare b880769f .. 88098af6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.732-70.732=0.001
σ0.047-0.049=-0.002
min70.700-70.698=0.002
max70.863-70.868=-0.006
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.158-0.162=-0.004
σ0.004-0.004=0.001
min0.151-0.157=-0.007
max0.164-0.168=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.446-21.446=-0.000
σ0.003-0.002=0.001
min21.440-21.442=-0.002
max21.451-21.449=0.002
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.063-0.066=-0.002
σ0.003-0.003=-0.001
min0.058-0.063=-0.005
max0.066-0.072=-0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.527-1754.527=0.000
σ0.361-0.361=-0.000
min1753.956-1753.952=0.004
max1755.106-1755.096=0.010
mean1663.650-1658.350=5.300
σ646.506-638.335=8.172
min638.000-639.000=-1.000
max2833.000-2836.000=-3.000
mean2.822-2.741=0.082
σ0.181-0.191=-0.010
min2.306-2.296=0.011
max3.157-2.915=0.242

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.607-273.610=-0.003
σ0.008-0.002=0.006
min273.595-273.608=-0.014
max273.613-273.612=0.001
mean2833.000-2836.000=-3.000
σ0.000
min2833.000-2836.000=-3.000
max2833.000-2836.000=-3.000
mean0.384-0.383=0.002
σ0.002-0.002=0.000
min0.381-0.380=0.001
max0.386-0.385=0.001
iters=5
new-facts=1
prior-facts=6402
mean1934.002-1934.007=-0.005
σ0.005-0.014=-0.009
min1933.994-1934.000=-0.006
max1934.008-1934.032=-0.024
mean2833.000-2836.000=-3.000
σ0.000
min2833.000-2836.000=-3.000
max2833.000-2836.000=-3.000
mean3.067-3.057=0.010
σ0.122-0.184=-0.061
min2.966-2.843=0.123
max3.205-3.312=-0.108
iters=5
new-facts=6402
prior-facts=1
mean4754.773-4754.779=-0.006
σ0.830-0.827=0.003
min4754.318-4754.209=0.109
max4756.250-4756.234=0.016
mean2833.000-2836.000=-3.000
σ0.000
min2833.000-2836.000=-3.000
max2833.000-2836.000=-3.000
mean8.433-8.544=-0.110
σ0.521-0.691=-0.171
min7.574-7.620=-0.047
max8.892-9.494=-0.602
iters=5
new-facts=6402
prior-facts=6402
mean4945.225-4945.156=0.070
σ0.018-0.144=-0.126
min4945.204-4944.900=0.304
max4945.247-4945.249=-0.003
mean3039.200-3073.400=-34.200
σ209.810-240.070=-30.260
min2833.000-2836.000=-3.000
max3328.000-3316.000=12.000
mean8.632-8.787=-0.155
σ0.222-0.194=0.027
min8.366-8.512=-0.146
max8.927-8.980=-0.053

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.110-1.019=0.091
σ0.255-0.140=0.115
min0.935-0.920=0.015
max1.552-1.245=0.307

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.850-472.841=0.009
σ574.937-574.937=0.000
min185.374-185.369=0.005
max1335.255-1335.246=0.009
mean88.250
σ8.500
min84.000
max101.000
mean2833.000-2836.000=-3.000
σ0.000
min2833.000-2836.000=-3.000
max2833.000-2836.000=-3.000
mean0.491-0.449=0.042
σ0.381-0.301=0.080
min0.299-0.294=0.005
max1.062-0.900=0.163
policies=20
mean1854.019-1853.994=0.026
σ0.372-0.364=0.008
min1853.745-1853.721=0.024
max1854.561-1854.521=0.041
mean840.000
σ0.000
min840.000
max840.000
mean2833.000-2836.000=-3.000
σ0.000
min2833.000-2836.000=-3.000
max2833.000-2836.000=-3.000
mean2.960-2.956=0.003
σ0.011-0.009=0.002
min2.944-2.947=-0.002
max2.968-2.964=0.004
policies=200
mean18546.749-18546.642=0.107
σ0.479-0.430=0.049
min18546.465-18546.363=0.102
max18547.465-18547.272=0.193
mean8400.000
σ0.000
min8400.000
max8400.000
mean2833.000-2836.000=-3.000
σ0.000
min2833.000-2836.000=-3.000
max2833.000-2836.000=-3.000
mean29.111-29.308=-0.197
σ0.434-0.462=-0.028
min28.868-28.854=0.013
max29.760-29.795=-0.035