Compare commits

Home / Compare bfa1b356 .. 209781bd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.784-70.565=0.219
σ0.047-0.045=0.002
min70.748-70.539=0.209
max70.914-70.687=0.227
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.158-0.155=0.003
σ0.005-0.005=0.001
min0.150-0.148=0.003
max0.165-0.162=0.002
cache=y
dps=1
iters=10
policies=100
mean21.493-21.287=0.206
σ0.002-0.003=-0.001
min21.490-21.283=0.207
max21.496-21.291=0.205
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.065-0.062=0.004
σ0.002-0.004=-0.001
min0.064-0.058=0.005
max0.072-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.895-1753.569=1.327
σ0.360-0.361=-0.001
min1754.322-1752.999=1.323
max1755.486-1754.145=1.340
mean1665.700-1646.600=19.100
σ642.651-634.825=7.826
min678.000-628.000=50.000
max2704.000-2860.000=-156.000
mean2.798-2.799=-0.000
σ0.254-0.149=0.106
min2.150-2.368=-0.217
max3.503-2.954=0.549

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.759-272.017=0.741
σ0.006-0.010=-0.004
min272.754-272.009=0.745
max272.767-272.034=0.733
mean2704.000-2860.000=-156.000
σ0.000
min2704.000-2860.000=-156.000
max2704.000-2860.000=-156.000
mean0.383-0.387=-0.004
σ0.004-0.007=-0.003
min0.379-0.377=0.002
max0.390-0.396=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1933.130-1932.434=0.696
σ0.011-0.010=0.000
min1933.121-1932.423=0.698
max1933.146-1932.450=0.695
mean2704.000-2860.000=-156.000
σ0.000
min2704.000-2860.000=-156.000
max2704.000-2860.000=-156.000
mean3.103-3.021=0.082
σ0.094-0.070=0.025
min2.990-2.963=0.027
max3.189-3.134=0.055
iters=5
new-facts=6402
prior-facts=1
mean4753.838-4753.161=0.676
σ0.938-0.840=0.098
min4753.128-4752.655=0.473
max4755.479-4754.654=0.824
mean2704.000-2860.000=-156.000
σ0.000
min2704.000-2860.000=-156.000
max2704.000-2860.000=-156.000
mean8.480-8.456=0.024
σ0.498-0.608=-0.110
min7.962-7.617=0.345
max9.063-9.188=-0.125
iters=5
new-facts=6402
prior-facts=6402
mean4944.357-4943.629=0.728
σ0.018-0.019=-0.000
min4944.332-4943.610=0.722
max4944.375-4943.654=0.721
mean2996.000-3080.800=-84.800
σ328.917-233.967=94.950
min2704.000-2860.000=-156.000
max3465.000-3422.000=43.000
mean8.433-8.573=-0.140
σ0.095-0.176=-0.081
min8.327-8.427=-0.100
max8.564-8.855=-0.291

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.104-1.070=0.034
σ0.142-0.111=0.031
min0.930-0.929=0.001
max1.257-1.241=0.016

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.644-473.087=-4.443
σ574.894-575.924=-1.030
min181.186-185.113=-3.927
max1330.985-1336.973=-5.988
mean88.250
σ8.500
min84.000
max101.000
mean2704.000-2860.000=-156.000
σ0.000
min2704.000-2860.000=-156.000
max2704.000-2860.000=-156.000
mean0.583-0.487=0.096
σ0.594-0.375=0.220
min0.284-0.298=-0.014
max1.475-1.049=0.426
policies=20
mean1812.172-1851.465=-39.294
σ0.379-0.370=0.010
min1811.926-1851.192=-39.266
max1812.733-1852.003=-39.270
mean840.000
σ0.000
min840.000
max840.000
mean2704.000-2860.000=-156.000
σ0.000
min2704.000-2860.000=-156.000
max2704.000-2860.000=-156.000
mean2.833-2.945=-0.111
σ0.022-0.010=0.012
min2.804-2.930=-0.125
max2.856-2.950=-0.094
policies=200
mean18129.190-18521.192=-392.002
σ0.528-0.475=0.053
min18128.806-18520.910=-392.105
max18129.970-18521.902=-391.932
mean8400.000
σ0.000
min8400.000
max8400.000
mean2704.000-2860.000=-156.000
σ0.000
min2704.000-2860.000=-156.000
max2704.000-2860.000=-156.000
mean28.500-29.039=-0.538
σ0.071-0.430=-0.359
min28.413-28.723=-0.310
max28.563-29.664=-1.101