Compare commits

Home / Compare 80f0e7d2 .. 9d219e46

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.262=0.001
σ0.054-0.053=0.002
min35.230-35.231=-0.000
max35.416-35.409=0.006
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.084-0.082=0.003
σ0.003-0.004=-0.001
min0.082-0.076=0.006
max0.092-0.089=0.003
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.001
σ0.004-0.003=0.001
min23.764-23.764=0.001
max23.776-23.773=0.003
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.069-0.067=0.002
σ0.003-0.005=-0.001
min0.066-0.061=0.005
max0.075-0.074=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.486-1756.486=-0.001
σ0.365-0.367=-0.002
min1755.909-1755.909=0.000
max1757.072-1757.077=-0.005
mean1647.900-1647.300=0.600
σ642.307-639.265=3.042
min623.000-626.000=-3.000
max2840.000-2824.000=16.000
mean2.345-2.314=0.031
σ0.098-0.103=-0.005
min2.245-2.100=0.145
max2.583-2.552=0.031

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.683-324.709=-0.026
σ0.041-0.048=-0.007
min324.611-324.624=-0.012
max324.708-324.739=-0.031
mean2840.000-2824.000=16.000
σ0.000
min2840.000-2824.000=16.000
max2840.000-2824.000=16.000
mean0.430-0.423=0.006
σ0.007-0.001=0.007
min0.423-0.423=0.001
max0.440-0.424=0.016
iters=5
new-facts=1
prior-facts=6402
mean1985.261-1985.262=-0.001
σ0.015-0.015=-0.000
min1985.244-1985.238=0.006
max1985.273-1985.278=-0.005
mean2840.000-2824.000=16.000
σ0.000
min2840.000-2824.000=16.000
max2840.000-2824.000=16.000
mean2.659-2.677=-0.019
σ0.146-0.113=0.033
min2.520-2.550=-0.030
max2.855-2.792=0.064
iters=5
new-facts=6402
prior-facts=1
mean4808.898-4808.861=0.037
σ7.688-7.669=0.019
min4805.396-4805.404=-0.008
max4822.651-4822.580=0.071
mean2840.000-2824.000=16.000
σ0.000
min2840.000-2824.000=16.000
max2840.000-2824.000=16.000
mean9.109-8.799=0.310
σ0.292-0.141=0.151
min8.673-8.614=0.059
max9.362-8.931=0.431
iters=5
new-facts=6402
prior-facts=6402
mean4996.469-4996.466=0.002
σ0.009-0.021=-0.012
min4996.458-4996.431=0.027
max4996.480-4996.482=-0.003
mean3041.800-3059.000=-17.200
σ203.884-306.841=-102.957
min2840.000-2824.000=16.000
max3319.000-3533.000=-214.000
mean8.806-8.561=0.246
σ0.247-0.296=-0.049
min8.501-8.406=0.095
max9.144-9.089=0.055

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.998-1.047=-0.048
σ0.062-0.159=-0.097
min0.920-0.895=0.025
max1.048-1.305=-0.257

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.978-462.978=0.000
σ574.252-574.250=0.002
min175.838-175.842=-0.004
max1324.356-1324.353=0.003
mean86.250
σ8.500
min82.000
max99.000
mean2840.000-2824.000=16.000
σ0.000
min2840.000-2824.000=16.000
max2840.000-2824.000=16.000
mean0.431-0.430=0.001
σ0.299-0.296=0.004
min0.276-0.278=-0.003
max0.880-0.874=0.006
policies=20
mean1758.707-1758.716=-0.009
σ0.347-0.349=-0.002
min1758.470-1758.478=-0.008
max1759.220-1759.233=-0.013
mean820.000
σ0.000
min820.000
max820.000
mean2840.000-2824.000=16.000
σ0.000
min2840.000-2824.000=16.000
max2840.000-2824.000=16.000
mean2.803-2.783=0.020
σ0.007-0.008=-0.001
min2.797-2.773=0.024
max2.814-2.792=0.022
policies=200
mean17593.288-17593.349=-0.061
σ0.676-0.741=-0.065
min17592.420-17592.336=0.085
max17593.861-17593.928=-0.067
mean8200.000
σ0.000
min8200.000
max8200.000
mean2840.000-2824.000=16.000
σ0.000
min2840.000-2824.000=16.000
max2840.000-2824.000=16.000
mean27.931-27.828=0.103
σ0.374-0.413=-0.039
min27.475-27.433=0.042
max28.362-28.294=0.068