Compare commits

Home / Compare 13887c21 .. 203ced3e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.380-70.374=0.006
σ0.045-0.059=-0.015
min70.352-70.335=0.017
max70.503-70.539=-0.036
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.160-0.159=0.001
σ0.003-0.005=-0.002
min0.157-0.152=0.005
max0.165-0.165=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=0.000
σ0.002-0.002=0.000
min21.139-21.140=-0.001
max21.146-21.146=0.000
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.065-0.064=0.001
σ0.002-0.002=0.000
min0.064-0.063=0.001
max0.071-0.069=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.387-1714.284=38.103
σ0.362-169.563=-169.201
min1751.823-993.894=757.929
max1752.969-1752.785=0.185
mean1661.300-1642.050=19.250
σ624.151-592.233=31.918
min636.000-683.000=-47.000
max2513.000-2739.000=-226.000
mean2.822-2.663=0.159
σ0.119-0.362=-0.243
min2.395-1.450=0.945
max2.980-3.034=-0.055

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.128-269.930=0.198
σ0.008-0.008=0.000
min270.117-269.922=0.195
max270.138-269.940=0.198
mean2513.000-2739.000=-226.000
σ0.000
min2513.000-2739.000=-226.000
max2513.000-2739.000=-226.000
mean0.377-0.375=0.003
σ0.005-0.009=-0.004
min0.370-0.369=0.001
max0.382-0.388=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1930.588-1930.392=0.195
σ0.022-0.012=0.010
min1930.550-1930.375=0.175
max1930.604-1930.408=0.196
mean2513.000-2739.000=-226.000
σ0.000
min2513.000-2739.000=-226.000
max2513.000-2739.000=-226.000
mean2.476-2.517=-0.041
σ0.125-0.141=-0.016
min2.283-2.362=-0.079
max2.597-2.737=-0.140
iters=5
new-facts=6402
prior-facts=1
mean4751.041-4750.627=0.413
σ0.892-1.103=-0.211
min4750.522-4749.347=1.175
max4752.622-4752.391=0.230
mean2513.000-2739.000=-226.000
σ0.000
min2513.000-2739.000=-226.000
max2513.000-2739.000=-226.000
mean8.726-8.513=0.212
σ0.258-0.600=-0.342
min8.376-7.612=0.764
max8.967-8.974=-0.007
iters=5
new-facts=6402
prior-facts=6402
mean4941.526-4941.331=0.194
σ0.096-0.092=0.004
min4941.440-4941.254=0.186
max4941.630-4941.433=0.197
mean2979.200-3032.600=-53.400
σ282.128-218.620=63.508
min2595.000-2739.000=-144.000
max3315.000-3317.000=-2.000
mean8.486-8.505=-0.019
σ0.110-0.141=-0.031
min8.372-8.374=-0.002
max8.666-8.719=-0.053

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.794-1.040=0.754
σ0.115-0.183=-0.068
min1.642-0.926=0.716
max1.932-1.352=0.581

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.354-465.920=0.434
σ575.916-575.794=0.122
min178.394-178.017=0.376
max1330.228-1329.611=0.616
mean84.000-81.750=2.250
σ8.000-7.500=0.500
min80.000-78.000=2.000
max96.000-93.000=3.000
mean2513.000-2739.000=-226.000
σ0.000
min2513.000-2739.000=-226.000
max2513.000-2739.000=-226.000
mean0.560-0.493=0.067
σ0.546-0.426=0.120
min0.279-0.276=0.003
max1.379-1.133=0.246
policies=20
mean1784.218-1780.447=3.770
σ0.352-0.367=-0.015
min1783.988-1780.194=3.794
max1784.742-1780.992=3.750
mean800.000-780.000=20.000
σ0.000
min800.000-780.000=20.000
max800.000-780.000=20.000
mean2513.000-2739.000=-226.000
σ0.000
min2513.000-2739.000=-226.000
max2513.000-2739.000=-226.000
mean2.766-2.767=-0.001
σ0.021-0.008=0.012
min2.737-2.757=-0.020
max2.781-2.777=0.004
policies=200
mean17848.760-17811.265=37.496
σ0.566-0.528=0.038
min17848.432-17810.852=37.580
max17849.604-17812.039=37.565
mean8000.000-7800.000=200.000
σ0.000
min8000.000-7800.000=200.000
max8000.000-7800.000=200.000
mean2513.000-2739.000=-226.000
σ0.000
min2513.000-2739.000=-226.000
max2513.000-2739.000=-226.000
mean27.918-27.849=0.068
σ0.048-0.114=-0.067
min27.865-27.732=0.134
max27.978-27.976=0.002