Compare commits

Home / Compare 1d9b14e8 .. b83ae114

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.380-70.374=0.006
σ0.048-0.058=-0.011
min70.351-70.333=0.018
max70.514-70.536=-0.023
mean413.000
σ0.000
min413.000
max413.000
mean0.157-0.157=-0.000
σ0.005-0.005=0.000
min0.149-0.150=-0.001
max0.165-0.166=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.144-21.143=0.001
σ0.002-0.002=0.000
min21.142-21.139=0.002
max21.149-21.147=0.003
mean413.000
σ0.000
min413.000
max413.000
mean0.064-0.064=0.000
σ0.002-0.002=0.000
min0.063-0.062=0.000
max0.071-0.069=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.388-1752.200=0.188
σ0.360-0.362=-0.002
min1751.820-1751.626=0.194
max1752.973-1752.788=0.185
mean1633.150-1654.900=-21.750
σ597.141-629.817=-32.675
min624.000-688.000=-64.000
max2412.000-2769.000=-357.000
mean2.811-2.793=0.019
σ0.191-0.233=-0.042
min2.193-2.245=-0.052
max3.031-3.121=-0.090

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.130-269.929=0.201
σ0.007-0.007=0.001
min270.122-269.923=0.199
max270.139-269.940=0.199
mean2412.000-2769.000=-357.000
σ0.000
min2412.000-2769.000=-357.000
max2412.000-2769.000=-357.000
mean0.379-0.374=0.005
σ0.001-0.005=-0.003
min0.377-0.371=0.007
max0.381-0.380=0.001
iters=5
new-facts=1
prior-facts=6402
mean1930.590-1930.393=0.197
σ0.016-0.013=0.003
min1930.562-1930.379=0.183
max1930.603-1930.414=0.189
mean2412.000-2769.000=-357.000
σ0.000
min2412.000-2769.000=-357.000
max2412.000-2769.000=-357.000
mean2.509-2.669=-0.160
σ0.066-0.130=-0.064
min2.439-2.500=-0.061
max2.608-2.850=-0.241
iters=5
new-facts=6402
prior-facts=1
mean4751.095-4750.764=0.331
σ0.858-0.660=0.198
min4750.643-4750.298=0.345
max4752.626-4751.927=0.699
mean2412.000-2769.000=-357.000
σ0.000
min2412.000-2769.000=-357.000
max2412.000-2769.000=-357.000
mean8.282-8.647=-0.365
σ0.682-0.579=0.104
min7.673-7.850=-0.178
max9.080-9.345=-0.265
iters=5
new-facts=6402
prior-facts=6402
mean4941.523-4941.196=0.327
σ0.079-0.270=-0.191
min4941.458-4940.729=0.729
max4941.611-4941.433=0.178
mean2939.800-3040.400=-100.600
σ424.374-308.791=115.584
min2468.000-2769.000=-301.000
max3511.000-3487.000=24.000
mean8.415-8.633=-0.218
σ0.143-0.114=0.029
min8.252-8.507=-0.255
max8.646-8.820=-0.174

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.861-1.091=0.770
σ0.146-0.275=-0.129
min1.647-0.938=0.709
max2.004-1.572=0.432

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.352-465.917=0.435
σ575.917-575.769=0.148
min178.392-178.025=0.367
max1330.228-1329.570=0.657
mean84.000-81.750=2.250
σ8.000-7.500=0.500
min80.000-78.000=2.000
max96.000-93.000=3.000
mean2412.000-2769.000=-357.000
σ0.000
min2412.000-2769.000=-357.000
max2412.000-2769.000=-357.000
mean0.560-0.443=0.118
σ0.560-0.309=0.252
min0.277-0.285=-0.007
max1.401-0.906=0.495
policies=20
mean1784.222-1780.497=3.725
σ0.356-0.340=0.016
min1783.998-1780.261=3.737
max1784.752-1780.987=3.764
mean800.000-780.000=20.000
σ0.000
min800.000-780.000=20.000
max800.000-780.000=20.000
mean2412.000-2769.000=-357.000
σ0.000
min2412.000-2769.000=-357.000
max2412.000-2769.000=-357.000
mean2.779-2.830=-0.052
σ0.014-0.123=-0.109
min2.769-2.755=0.014
max2.799-3.014=-0.214
policies=200
mean17848.884-17811.414=37.471
σ0.497-0.446=0.050
min17848.575-17811.020=37.555
max17849.626-17812.053=37.573
mean8000.000-7800.000=200.000
σ0.000
min8000.000-7800.000=200.000
max8000.000-7800.000=200.000
mean2412.000-2769.000=-357.000
σ0.000
min2412.000-2769.000=-357.000
max2412.000-2769.000=-357.000
mean27.845-27.853=-0.008
σ0.038-0.127=-0.089
min27.807-27.774=0.033
max27.897-28.043=-0.146