Compare commits

Home / Compare 178a65a9 .. 6ddde149

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.262-35.263=-0.001
σ0.052-0.055=-0.002
min35.238-35.233=0.005
max35.411-35.417=-0.007
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.085-0.086=-0.001
σ0.003-0.004=-0.001
min0.082-0.082=0.000
max0.091-0.092=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=-0.000
σ0.003-0.003=0.000
min23.765-23.766=-0.001
max23.773-23.774=-0.001
mean414.000-415.700=-1.700
σ0.000-0.483=-0.483
min414.000-415.000=-1.000
max414.000-416.000=-2.000
mean0.067-0.068=-0.002
σ0.005-0.003=0.002
min0.061-0.066=-0.004
max0.075-0.075=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.487-1756.484=0.002
σ0.366-0.365=0.001
min1755.911-1755.907=0.004
max1757.078-1757.069=0.009
mean1661.350-1652.300=9.050
σ616.750-639.625=-22.875
min629.000
max2494.000-2839.000=-345.000
mean2.348-2.381=-0.033
σ0.110-0.130=-0.019
min2.223-2.265=-0.042
max2.728-2.745=-0.017

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.706-324.707=-0.001
σ0.054-0.045=0.009
min324.609-324.627=-0.018
max324.736-324.733=0.003
mean2494.000-2839.000=-345.000
σ0.000
min2494.000-2839.000=-345.000
max2494.000-2839.000=-345.000
mean0.429-0.426=0.003
σ0.003-0.002=0.001
min0.427-0.424=0.003
max0.435-0.429=0.006
iters=5
new-facts=1
prior-facts=6402
mean1985.268-1985.261=0.007
σ0.011-0.011=-0.000
min1985.250-1985.247=0.003
max1985.277-1985.274=0.003
mean2494.000-2839.000=-345.000
σ0.000
min2494.000-2839.000=-345.000
max2494.000-2839.000=-345.000
mean2.569-2.712=-0.143
σ0.080-0.081=-0.002
min2.461-2.567=-0.106
max2.686-2.757=-0.071
iters=5
new-facts=6402
prior-facts=1
mean4809.028-4809.018=0.010
σ7.678-7.708=-0.030
min4805.588-4805.538=0.051
max4822.763-4822.805=-0.042
mean2494.000-2839.000=-345.000
σ0.000
min2494.000-2839.000=-345.000
max2494.000-2839.000=-345.000
mean8.904-8.925=-0.021
σ0.049-0.208=-0.158
min8.865-8.645=0.219
max8.975-9.180=-0.205
iters=5
new-facts=6402
prior-facts=6402
mean4996.573-4996.569=0.003
σ0.021-0.027=-0.006
min4996.548-4996.533=0.016
max4996.592-4996.605=-0.013
mean3021.000-3086.800=-65.800
σ329.133-256.656=72.477
min2556.000-2839.000=-283.000
max3313.000-3351.000=-38.000
mean8.922-8.809=0.113
σ0.387-0.246=0.141
min8.498-8.512=-0.014
max9.467-9.108=0.358

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.663-0.938=0.725
σ0.113-0.013=0.100
min1.541-0.929=0.611
max1.825-0.961=0.864

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.205-463.213=-0.009
σ574.762-574.764=-0.002
min175.820-175.823=-0.003
max1325.348-1325.359=-0.011
mean86.250
σ8.500
min82.000
max99.000
mean2494.000-2839.000=-345.000
σ0.000
min2494.000-2839.000=-345.000
max2494.000-2839.000=-345.000
mean0.538-0.412=0.126
σ0.525-0.265=0.260
min0.269-0.269=-0.000
max1.325-0.809=0.517
policies=20
mean1758.531-1758.593=-0.062
σ0.358-0.369=-0.011
min1758.278-1758.362=-0.084
max1759.061-1759.143=-0.082
mean820.000
σ0.000
min820.000
max820.000
mean2494.000-2839.000=-345.000
σ0.000
min2494.000-2839.000=-345.000
max2494.000-2839.000=-345.000
mean2.735-2.824=-0.090
σ0.018-0.019=-0.001
min2.717-2.811=-0.095
max2.760-2.852=-0.092
policies=200
mean17592.482-17592.517=-0.034
σ0.471-0.566=-0.095
min17592.134-17592.177=-0.043
max17593.172-17593.361=-0.188
mean8200.000
σ0.000
min8200.000
max8200.000
mean2494.000-2839.000=-345.000
σ0.000
min2494.000-2839.000=-345.000
max2494.000-2839.000=-345.000
mean27.552-28.056=-0.504
σ0.130-0.364=-0.234
min27.400-27.639=-0.239
max27.688-28.483=-0.795