Compare commits

Home / Compare 0a9685e1 .. 34eb6360

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.043-73.046=-0.003
σ0.045-0.049=-0.005
min73.023-73.018=0.005
max73.170-73.185=-0.015
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.159-0.157=0.002
σ0.005-0.005=-0.000
min0.152-0.149=0.003
max0.166-0.164=0.002
cache=y
dps=1
iters=10
policies=100
mean23.740-23.741=-0.001
σ0.003-0.002=0.001
min23.735-23.737=-0.002
max23.744-23.745=-0.001
mean413.000-415.500=-2.500
σ0.000-0.527=-0.527
min413.000-415.000=-2.000
max413.000-416.000=-3.000
mean0.061-0.065=-0.004
σ0.002-0.000=0.002
min0.059-0.065=-0.005
max0.067-0.066=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.788-1758.787=0.001
σ0.360-0.360=0.000
min1758.210-1758.218=-0.008
max1759.368-1759.381=-0.013
mean1667.850-1646.150=21.700
σ639.149-624.771=14.378
min678.000-623.000=55.000
max2758.000-2775.000=-17.000
mean2.796-2.809=-0.013
σ0.195-0.194=0.001
min2.248-2.267=-0.019
max3.015-3.104=-0.089

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.011-324.012=-0.001
σ0.060-0.058=0.002
min323.905-323.910=-0.005
max324.043-324.042=0.002
mean2758.000-2775.000=-17.000
σ0.000
min2758.000-2775.000=-17.000
max2758.000-2775.000=-17.000
mean0.428-0.428=0.000
σ0.004-0.004=0.000
min0.426-0.423=0.002
max0.435-0.433=0.003
iters=5
new-facts=1
prior-facts=6402
mean1984.588-1984.586=0.001
σ0.021-0.024=-0.003
min1984.555-1984.547=0.008
max1984.607-1984.605=0.002
mean2758.000-2775.000=-17.000
σ0.000
min2758.000-2775.000=-17.000
max2758.000-2775.000=-17.000
mean2.643-2.709=-0.066
σ0.148-0.267=-0.119
min2.500-2.517=-0.016
max2.865-3.168=-0.303
iters=5
new-facts=6402
prior-facts=1
mean4808.054-4808.231=-0.178
σ7.563-7.758=-0.195
min4804.099-4804.702=-0.603
max4821.570-4822.108=-0.539
mean2758.000-2775.000=-17.000
σ0.000
min2758.000-2775.000=-17.000
max2758.000-2775.000=-17.000
mean8.640-8.848=-0.207
σ0.519-0.189=0.330
min7.871-8.553=-0.682
max9.236-9.046=0.191
iters=5
new-facts=6402
prior-facts=6402
mean4995.731-4995.809=-0.078
σ0.155-0.017=0.138
min4995.458-4995.784=-0.326
max4995.836-4995.828=0.008
mean3035.000-3035.600=-0.600
σ219.256-233.793=-14.538
min2758.000-2775.000=-17.000
max3326.000-3334.000=-8.000
mean8.649-8.687=-0.038
σ0.154-0.150=0.004
min8.509-8.527=-0.018
max8.851-8.933=-0.082

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.007-1.030=-0.024
σ0.142-0.242=-0.100
min0.912-0.916=-0.004
max1.237-1.463=-0.226

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.350-468.355=-0.005
σ574.270-574.229=0.041
min181.210-181.230=-0.020
max1329.755-1329.698=0.057
mean88.250
σ8.500
min84.000
max101.000
mean2758.000-2775.000=-17.000
σ0.000
min2758.000-2775.000=-17.000
max2758.000-2775.000=-17.000
mean0.560-0.446=0.114
σ0.549-0.304=0.245
min0.285-0.287=-0.002
max1.384-0.902=0.482
policies=20
mean1812.446-1812.646=-0.201
σ0.399-0.391=0.008
min1812.165-1812.363=-0.197
max1813.032-1813.214=-0.181
mean840.000
σ0.000
min840.000
max840.000
mean2758.000-2775.000=-17.000
σ0.000
min2758.000-2775.000=-17.000
max2758.000-2775.000=-17.000
mean2.841-2.946=-0.104
σ0.071-0.047=0.024
min2.785-2.912=-0.128
max2.945-3.013=-0.068
policies=200
mean18131.249-18131.632=-0.383
σ0.800-0.457=0.343
min18130.303-18131.267=-0.965
max18132.237-18132.301=-0.064
mean8400.000
σ0.000
min8400.000
max8400.000
mean2758.000-2775.000=-17.000
σ0.000
min2758.000-2775.000=-17.000
max2758.000-2775.000=-17.000
mean28.361-28.427=-0.066
σ0.076-0.189=-0.113
min28.275-28.250=0.025
max28.460-28.664=-0.203