Compare commits

Home / Compare c8d143d2 .. 86b1ba6b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-35.617=-0.001
σ0.055-0.054=0.001
min35.587-35.591=-0.004
max35.771-35.770=0.001
mean411.500-418.000=-6.500
σ0.527-0.000=0.527
min411.000-418.000=-7.000
max412.000-418.000=-6.000
mean0.083-0.082=0.001
σ0.006-0.005=0.000
min0.077-0.076=0.000
max0.093-0.094=-0.000
cache=y
dps=1
iters=10
policies=100
mean24.046-24.047=-0.001
σ0.002-0.005=-0.002
min24.041-24.041=-0.000
max24.049-24.055=-0.006
mean412.000-418.000=-6.000
σ0.000
min412.000-418.000=-6.000
max412.000-418.000=-6.000
mean0.066-0.067=-0.001
σ0.004-0.005=-0.001
min0.061-0.062=-0.001
max0.073-0.075=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.488-1756.492=-0.004
σ0.366-0.366=-0.000
min1755.917-1755.915=0.002
max1757.079-1757.082=-0.003
mean1642.400-1643.000=-0.600
σ646.000-624.725=21.275
min619.000-653.000=-34.000
max2724.000-2830.000=-106.000
mean2.372-2.348=0.025
σ0.124-0.110=0.013
min2.182-2.134=0.048
max2.629-2.624=0.005

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.761-324.749=0.012
σ0.049-0.029=0.020
min324.673-324.701=-0.027
max324.787-324.780=0.007
mean2724.000-2830.000=-106.000
σ0.000
min2724.000-2830.000=-106.000
max2724.000-2830.000=-106.000
mean0.424-0.417=0.007
σ0.001-0.002=-0.001
min0.423-0.415=0.009
max0.425-0.419=0.007
iters=5
new-facts=1
prior-facts=6402
mean1985.322-1985.310=0.012
σ0.014-0.013=0.001
min1985.299-1985.303=-0.004
max1985.337-1985.333=0.004
mean2724.000-2830.000=-106.000
σ0.000
min2724.000-2830.000=-106.000
max2724.000-2830.000=-106.000
mean2.633-2.640=-0.007
σ0.067-0.081=-0.014
min2.568-2.549=0.019
max2.739-2.737=0.002
iters=5
new-facts=6402
prior-facts=1
mean4808.971-4809.016=-0.045
σ7.799-7.779=0.021
min4805.119-4805.013=0.106
max4822.917-4822.920=-0.002
mean2724.000-2830.000=-106.000
σ0.000
min2724.000-2830.000=-106.000
max2724.000-2830.000=-106.000
mean8.800-8.656=0.144
σ0.506-0.567=-0.061
min8.034-7.836=0.198
max9.328-9.173=0.155
iters=5
new-facts=6402
prior-facts=6402
mean4996.620-4996.628=-0.008
σ0.021-0.025=-0.004
min4996.599-4996.600=-0.001
max4996.652-4996.657=-0.005
mean3022.000-3060.800=-38.800
σ351.019-301.024=49.996
min2724.000-2830.000=-106.000
max3541.000-3522.000=19.000
mean8.494-8.467=0.027
σ0.130-0.101=0.029
min8.384-8.393=-0.009
max8.716-8.645=0.071

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.954-0.975=-0.022
σ0.060-0.066=-0.007
min0.923-0.913=0.010
max1.060-1.049=0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.219-463.216=0.002
σ574.797-574.772=0.025
min175.808-175.820=-0.012
max1325.415-1325.375=0.040
mean86.250
σ8.500
min82.000
max99.000
mean2724.000-2830.000=-106.000
σ0.000
min2724.000-2830.000=-106.000
max2724.000-2830.000=-106.000
mean0.547-0.430=0.117
σ0.546-0.294=0.251
min0.273-0.280=-0.007
max1.366-0.872=0.494
policies=20
mean1758.488-1758.518=-0.030
σ0.336-0.343=-0.007
min1758.277-1758.295=-0.018
max1758.988-1759.027=-0.040
mean820.000
σ0.000
min820.000
max820.000
mean2724.000-2830.000=-106.000
σ0.000
min2724.000-2830.000=-106.000
max2724.000-2830.000=-106.000
mean2.706-2.794=-0.089
σ0.009-0.002=0.007
min2.697-2.792=-0.095
max2.717-2.796=-0.079
policies=200
mean17592.146-17592.213=-0.067
σ0.475-0.466=0.009
min17591.865-17591.896=-0.031
max17592.855-17592.905=-0.050
mean8200.000
σ0.000
min8200.000
max8200.000
mean2724.000-2830.000=-106.000
σ0.000
min2724.000-2830.000=-106.000
max2724.000-2830.000=-106.000
mean27.489-27.839=-0.349
σ0.113-0.365=-0.252
min27.376-27.466=-0.090
max27.599-28.247=-0.648