Compare commits

Home / Compare 7a4eaee7 .. 4442b129

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.381-70.380=0.001
σ0.047-0.047=-0.001
min70.352-70.355=-0.003
max70.509-70.512=-0.002
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.159-0.159=-0.000
σ0.009-0.003=0.006
min0.150-0.157=-0.006
max0.181-0.164=0.016
cache=y
dps=1
iters=10
policies=100
mean21.144-21.145=-0.000
σ0.002-0.002=-0.000
min21.141-21.142=-0.000
max21.148-21.148=-0.001
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.064-0.063=0.001
σ0.002-0.003=-0.001
min0.062-0.059=0.003
max0.069-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.387-1752.387=0.001
σ0.361-0.361=0.001
min1751.820-1751.815=0.004
max1752.973-1752.966=0.008
mean1651.400-1661.050=-9.650
σ642.373-622.128=20.245
min631.000-637.000=-6.000
max2847.000-2507.000=340.000
mean2.775-2.759=0.016
σ0.145-0.239=-0.094
min2.495-2.164=0.331
max3.013-3.082=-0.069

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.114-270.126=-0.013
σ0.013-0.005=0.007
min270.096-270.118=-0.022
max270.133-270.133=0.000
mean2847.000-2507.000=340.000
σ0.000
min2847.000-2507.000=340.000
max2847.000-2507.000=340.000
mean0.375-0.373=0.002
σ0.004-0.004=0.000
min0.371-0.369=0.002
max0.381-0.379=0.002
iters=5
new-facts=1
prior-facts=6402
mean1930.589-1930.596=-0.007
σ0.017-0.016=0.001
min1930.564-1930.572=-0.008
max1930.604-1930.612=-0.008
mean2847.000-2507.000=340.000
σ0.000
min2847.000-2507.000=340.000
max2847.000-2507.000=340.000
mean2.579-2.581=-0.002
σ0.115-0.155=-0.040
min2.430-2.444=-0.013
max2.722-2.810=-0.088
iters=5
new-facts=6402
prior-facts=1
mean4751.127-4750.887=0.240
σ0.813-0.315=0.498
min4750.667-4750.684=-0.016
max4752.572-4751.445=1.127
mean2847.000-2507.000=340.000
σ0.000
min2847.000-2507.000=340.000
max2847.000-2507.000=340.000
mean8.124-8.346=-0.223
σ0.510-0.525=-0.015
min7.780-7.786=-0.006
max9.016-8.955=0.060
iters=5
new-facts=6402
prior-facts=6402
mean4941.524-4941.453=0.071
σ0.074-0.215=-0.141
min4941.459-4941.097=0.362
max4941.604-4941.636=-0.032
mean3081.600-2931.200=150.400
σ309.385-384.586=-75.202
min2847.000-2507.000=340.000
max3561.000-3430.000=131.000
mean8.382-8.461=-0.079
σ0.141-0.354=-0.213
min8.254-8.241=0.013
max8.621-9.090=-0.469

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.073-1.714=-0.640
σ0.108-0.128=-0.020
min0.938-1.577=-0.639
max1.240-1.862=-0.622

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.363-466.356=0.007
σ575.919-575.918=0.001
min178.394-178.392=0.002
max1330.242-1330.233=0.009
mean84.000
σ8.000
min80.000
max96.000
mean2847.000-2507.000=340.000
σ0.000
min2847.000-2507.000=340.000
max2847.000-2507.000=340.000
mean0.441-0.565=-0.124
σ0.305-0.563=-0.258
min0.286-0.278=0.008
max0.899-1.409=-0.510
policies=20
mean1784.276-1784.221=0.055
σ0.362-0.351=0.010
min1784.030-1783.995=0.035
max1784.810-1784.744=0.066
mean800.000
σ0.000
min800.000
max800.000
mean2847.000-2507.000=340.000
σ0.000
min2847.000-2507.000=340.000
max2847.000-2507.000=340.000
mean2.856-2.773=0.084
σ0.009-0.024=-0.015
min2.845-2.746=0.099
max2.863-2.794=0.069
policies=200
mean17848.886-17848.920=-0.034
σ0.372-0.467=-0.095
min17848.605-17848.617=-0.011
max17849.433-17849.617=-0.184
mean8000.000
σ0.000
min8000.000
max8000.000
mean2847.000-2507.000=340.000
σ0.000
min2847.000-2507.000=340.000
max2847.000-2507.000=340.000
mean28.381-27.854=0.527
σ0.504-0.131=0.373
min27.862-27.746=0.115
max28.862-28.045=0.817