Compare commits

Home / Compare c32b02d7 .. 260cce4f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.245-35.245=-0.000
σ0.055-0.053=0.002
min35.209-35.212=-0.003
max35.400-35.394=0.005
mean416.000
σ0.000
min416.000
max416.000
mean0.085-0.084=0.001
σ0.003-0.003=0.001
min0.083-0.082=0.001
max0.091-0.091=0.000
cache=y
dps=1
iters=10
policies=100
mean23.768-23.769=-0.001
σ0.004-0.003=0.001
min23.764-23.763=0.001
max23.776-23.773=0.004
mean416.000
σ0.000
min416.000
max416.000
mean0.064-0.067=-0.003
σ0.004-0.004=0.001
min0.061-0.062=-0.001
max0.074-0.073=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.351-1756.363=-0.013
σ0.365-0.366=-0.001
min1755.772-1755.790=-0.017
max1756.932-1756.958=-0.025
mean1654.700-1659.300=-4.600
σ645.128-621.593=23.534
min627.000-667.000=-40.000
max2847.000-2643.000=204.000
mean2.315-2.328=-0.013
σ0.072-0.113=-0.041
min2.241-2.178=0.064
max2.515-2.561=-0.046

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.574-316.677=7.896
σ0.040-17.686=-17.646
min324.505-285.040=39.465
max324.604-324.608=-0.004
mean2847.000-2643.000=204.000
σ0.000
min2847.000-2643.000=204.000
max2847.000-2643.000=204.000
mean0.423-0.411=0.012
σ0.001-0.027=-0.025
min0.421-0.363=0.058
max0.425-0.424=0.001
iters=5
new-facts=1
prior-facts=6402
mean1985.130-1985.147=-0.017
σ0.008-0.007=0.001
min1985.119-1985.137=-0.018
max1985.140-1985.156=-0.016
mean2847.000-2643.000=204.000
σ0.000
min2847.000-2643.000=204.000
max2847.000-2643.000=204.000
mean2.606-2.620=-0.015
σ0.058-0.095=-0.038
min2.545-2.520=0.025
max2.696-2.730=-0.034
iters=5
new-facts=6402
prior-facts=1
mean4808.736-4808.749=-0.013
σ7.715-7.674=0.041
min4805.223-4805.267=-0.045
max4822.537-4822.477=0.059
mean2847.000-2643.000=204.000
σ0.000
min2847.000-2643.000=204.000
max2847.000-2643.000=204.000
mean8.893-8.979=-0.086
σ0.358-0.227=0.131
min8.336-8.812=-0.476
max9.240-9.376=-0.136
iters=5
new-facts=6402
prior-facts=6402
mean4996.258-4996.276=-0.018
σ0.166-0.145=0.021
min4995.963-4996.017=-0.054
max4996.349-4996.349=0.000
mean3044.800-2986.200=58.600
σ181.661-273.258=-91.598
min2847.000-2643.000=204.000
max3306.000-3328.000=-22.000
mean8.787-8.622=0.164
σ0.389-0.138=0.252
min8.433-8.465=-0.032
max9.306-8.829=0.477

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.002-1.126=-0.124
σ0.139-0.294=-0.156
min0.911-0.931=-0.020
max1.229-1.641=-0.412

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.953-462.957=-0.004
σ574.252-574.261=-0.009
min175.812-175.820=-0.008
max1324.332-1324.349=-0.018
mean86.250
σ8.500
min82.000
max99.000
mean2847.000-2643.000=204.000
σ0.000
min2847.000-2643.000=204.000
max2847.000-2643.000=204.000
mean0.432-0.546=-0.114
σ0.300-0.545=-0.245
min0.279-0.272=0.008
max0.882-1.363=-0.481
policies=20
mean1758.474-1758.509=-0.035
σ0.350-0.351=-0.002
min1758.243-1758.264=-0.021
max1758.993-1759.029=-0.036
mean820.000
σ0.000
min820.000
max820.000
mean2847.000-2643.000=204.000
σ0.000
min2847.000-2643.000=204.000
max2847.000-2643.000=204.000
mean2.778-2.701=0.078
σ0.009-0.006=0.002
min2.772-2.694=0.078
max2.791-2.709=0.082
policies=200
mean17591.140-17592.160=-1.020
σ0.560-0.473=0.087
min17590.423-17591.812=-1.389
max17591.616-17592.850=-1.234
mean8200.000
σ0.000
min8200.000
max8200.000
mean2847.000-2643.000=204.000
σ0.000
min2847.000-2643.000=204.000
max2847.000-2643.000=204.000
mean27.888-27.338=0.551
σ0.403-0.125=0.278
min27.443-27.224=0.219
max28.384-27.459=0.924