Compare commits

Home / Compare 214dee9e .. 278f61bd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.378-70.380=-0.001
σ0.045-0.048=-0.003
min70.350-70.347=0.003
max70.504-70.511=-0.007
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.156-0.160=-0.004
σ0.005-0.003=0.002
min0.151-0.157=-0.005
max0.165-0.166=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.143-21.144=-0.001
σ0.003-0.003=0.000
min21.139-21.141=-0.001
max21.149-21.148=0.001
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.060-0.065=-0.006
σ0.002-0.003=-0.000
min0.058-0.063=-0.005
max0.066-0.073=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.385-1752.387=-0.001
σ0.363-0.360=0.002
min1751.826-1751.823=0.004
max1752.956-1752.978=-0.021
mean1640.300-1643.250=-2.950
σ617.921-625.468=-7.547
min631.000-669.000=-38.000
max2480.000-2509.000=-29.000
mean2.790-2.767=0.023
σ0.188-0.206=-0.018
min2.266-2.177=0.089
max2.988-3.124=-0.135

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.128-270.125=0.003
σ0.007-0.006=0.001
min270.117-270.117=0.000
max270.135-270.131=0.005
mean2480.000-2509.000=-29.000
σ0.000
min2480.000-2509.000=-29.000
max2480.000-2509.000=-29.000
mean0.379-0.373=0.006
σ0.006-0.006=-0.000
min0.370-0.369=0.001
max0.387-0.384=0.003
iters=5
new-facts=1
prior-facts=6402
mean1930.591-1930.588=0.003
σ0.011-0.020=-0.010
min1930.577-1930.564=0.013
max1930.603-1930.610=-0.007
mean2480.000-2509.000=-29.000
σ0.000
min2480.000-2509.000=-29.000
max2480.000-2509.000=-29.000
mean2.495-2.549=-0.054
σ0.034-0.134=-0.100
min2.465-2.442=0.024
max2.550-2.742=-0.192
iters=5
new-facts=6402
prior-facts=1
mean4751.081-4751.026=0.055
σ0.827-0.523=0.304
min4750.499-4750.699=-0.200
max4752.543-4751.949=0.593
mean2480.000-2509.000=-29.000
σ0.000
min2480.000-2509.000=-29.000
max2480.000-2509.000=-29.000
mean8.529-8.206=0.324
σ0.573-0.264=0.310
min7.597-7.850=-0.253
max9.093-8.473=0.620
iters=5
new-facts=6402
prior-facts=6402
mean4941.463-4941.516=-0.053
σ0.211-0.087=0.124
min4941.118-4941.437=-0.319
max4941.636-4941.614=0.022
mean2985.200-2962.400=22.800
σ284.083-431.882=-147.799
min2596.000-2509.000=87.000
max3321.000-3551.000=-230.000
mean8.550-8.448=0.102
σ0.211-0.083=0.128
min8.392-8.345=0.047
max8.820-8.531=0.289

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.809-1.652=0.157
σ0.175-0.174=0.000
min1.608-1.400=0.208
max1.976-1.876=0.100

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.363-466.365=-0.002
σ575.931-575.935=-0.004
min178.394-178.392=0.002
max1330.259-1330.267=-0.009
mean84.000
σ8.000
min80.000
max96.000
mean2480.000-2509.000=-29.000
σ0.000
min2480.000-2509.000=-29.000
max2480.000-2509.000=-29.000
mean0.566-0.548=0.018
σ0.566-0.536=0.031
min0.279-0.278=0.001
max1.415-1.352=0.064
policies=20
mean1784.219-1784.227=-0.008
σ0.345-0.362=-0.016
min1783.998-1783.994=0.005
max1784.733-1784.765=-0.032
mean800.000
σ0.000
min800.000
max800.000
mean2480.000-2509.000=-29.000
σ0.000
min2480.000-2509.000=-29.000
max2480.000-2509.000=-29.000
mean2.777-2.780=-0.003
σ0.019-0.013=0.007
min2.752-2.763=-0.011
max2.799-2.793=0.006
policies=200
mean17848.893-17848.931=-0.038
σ0.495-0.494=0.000
min17848.618-17848.654=-0.036
max17849.634-17849.671=-0.036
mean8000.000
σ0.000
min8000.000
max8000.000
mean2480.000-2509.000=-29.000
σ0.000
min2480.000-2509.000=-29.000
max2480.000-2509.000=-29.000
mean27.952-27.976=-0.024
σ0.106-0.186=-0.081
min27.815-27.775=0.041
max28.051-28.224=-0.172