Compare commits

Home / Compare d9f6947c .. 79a63f2b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-35.245=-0.001
σ0.051-0.053=-0.002
min35.218-35.221=-0.003
max35.390-35.396=-0.006
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.083-0.085=-0.003
σ0.005-0.004=0.001
min0.077-0.083=-0.006
max0.091-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.771-23.771=-0.000
σ0.003-0.003=-0.000
min23.766-23.766=-0.000
max23.777-23.776=0.000
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.069-0.069=0.000
σ0.003-0.003=0.000
min0.066-0.066=-0.000
max0.076-0.075=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.364-1756.364=0.000
σ0.366-0.366=-0.000
min1755.786-1755.789=-0.002
max1756.950-1756.957=-0.007
mean1640.950-1666.150=-25.200
σ624.124-615.397=8.727
min641.000-677.000=-36.000
max2834.000-2503.000=331.000
mean2.340-2.334=0.006
σ0.076-0.074=0.002
min2.266-2.176=0.090
max2.566-2.437=0.129

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.586-324.588=-0.002
σ0.048-0.044=0.004
min324.501-324.510=-0.010
max324.614-324.612=0.002
mean2834.000-2503.000=331.000
σ0.000
min2834.000-2503.000=331.000
max2834.000-2503.000=331.000
mean0.427-0.424=0.004
σ0.008-0.002=0.006
min0.423-0.421=0.002
max0.442-0.427=0.015
iters=5
new-facts=1
prior-facts=6402
mean1985.144-1985.136=0.008
σ0.013-0.020=-0.007
min1985.128-1985.109=0.018
max1985.161-1985.154=0.007
mean2834.000-2503.000=331.000
σ0.000
min2834.000-2503.000=331.000
max2834.000-2503.000=331.000
mean2.642-2.724=-0.082
σ0.122-0.286=-0.165
min2.558-2.499=0.060
max2.848-3.195=-0.347
iters=5
new-facts=6402
prior-facts=1
mean4808.798-4808.739=0.059
σ7.643-7.661=-0.018
min4805.256-4805.280=-0.024
max4822.468-4822.443=0.025
mean2834.000-2503.000=331.000
σ0.000
min2834.000-2503.000=331.000
max2834.000-2503.000=331.000
mean8.497-8.963=-0.466
σ0.592-0.121=0.472
min7.703-8.839=-1.136
max9.080-9.131=-0.051
iters=5
new-facts=6402
prior-facts=6402
mean4996.279-4996.134=0.145
σ0.160-0.179=-0.019
min4995.996-4996.002=-0.005
max4996.378-4996.335=0.043
mean3087.000-2991.600=95.400
σ248.252-308.096=-59.844
min2834.000-2586.000=248.000
max3330.000-3389.000=-59.000
mean8.884-8.588=0.296
σ0.420-0.082=0.338
min8.522-8.491=0.030
max9.580-8.705=0.875

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.942-1.568=-0.627
σ0.062-0.289=-0.227
min0.895-1.084=-0.189
max1.050-1.805=-0.755

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.965-462.949=0.016
σ574.249-574.250=-0.001
min175.836-175.818=0.018
max1324.339-1324.324=0.015
mean86.250
σ8.500
min82.000
max99.000
mean2834.000-2503.000=331.000
σ0.000
min2834.000-2503.000=331.000
max2834.000-2503.000=331.000
mean0.436-0.546=-0.110
σ0.298-0.541=-0.244
min0.286-0.273=0.013
max0.882-1.358=-0.476
policies=20
mean1758.714-1758.520=0.195
σ0.339-0.344=-0.005
min1758.496-1758.278=0.217
max1759.218-1759.028=0.190
mean820.000
σ0.000
min820.000
max820.000
mean2834.000-2503.000=331.000
σ0.000
min2834.000-2503.000=331.000
max2834.000-2503.000=331.000
mean2.784-2.714=0.070
σ0.008-0.017=-0.009
min2.773-2.700=0.073
max2.792-2.737=0.055
policies=200
mean17593.360-17592.310=1.050
σ0.593-0.580=0.013
min17592.572-17591.952=0.621
max17593.889-17593.170=0.718
mean8200.000
σ0.000
min8200.000
max8200.000
mean2834.000-2503.000=331.000
σ0.000
min2834.000-2503.000=331.000
max2834.000-2503.000=331.000
mean27.789-27.442=0.347
σ0.365-0.128=0.237
min27.405-27.308=0.098
max28.258-27.559=0.699