Compare commits

Home / Compare ede3d974 .. e3a3a7ad

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.264-35.263=0.000
σ0.054-0.053=0.001
min35.234-35.229=0.005
max35.416-35.413=0.003
mean414.000
σ0.000
min414.000
max414.000
mean0.085-0.084=0.001
σ0.003-0.004=-0.000
min0.082-0.078=0.005
max0.092-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=0.000
σ0.003-0.003=-0.000
min23.766-23.765=0.000
max23.774-23.777=-0.003
mean414.000
σ0.000
min414.000
max414.000
mean0.068-0.068=0.000
σ0.003-0.003=0.000
min0.066-0.065=0.001
max0.075-0.074=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.484-1756.485=-0.001
σ0.366-0.364=0.002
min1755.908-1755.913=-0.005
max1757.073-1757.076=-0.002
mean1648.850-1660.500=-11.650
σ642.122-646.886=-4.764
min624.000-628.000=-4.000
max2837.000-2810.000=27.000
mean2.352-2.363=-0.011
σ0.081-0.117=-0.036
min2.255-2.238=0.017
max2.532-2.721=-0.189

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.708-324.686=0.022
σ0.052-0.034=0.017
min324.616-324.625=-0.009
max324.738-324.706=0.032
mean2837.000-2810.000=27.000
σ0.000
min2837.000-2810.000=27.000
max2837.000-2810.000=27.000
mean0.423-0.427=-0.005
σ0.001-0.006=-0.005
min0.421-0.424=-0.003
max0.424-0.439=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1985.264-1985.247=0.017
σ0.018-0.018=0.000
min1985.232-1985.222=0.010
max1985.277-1985.269=0.007
mean2837.000-2810.000=27.000
σ0.000
min2837.000-2810.000=27.000
max2837.000-2810.000=27.000
mean2.630-2.630=0.000
σ0.063-0.085=-0.022
min2.570-2.562=0.008
max2.703-2.761=-0.058
iters=5
new-facts=6402
prior-facts=1
mean4808.890-4808.746=0.143
σ7.655-7.386=0.269
min4805.354-4805.381=-0.027
max4822.582-4821.958=0.623
mean2837.000-2810.000=27.000
σ0.000
min2837.000-2810.000=27.000
max2837.000-2810.000=27.000
mean8.809-8.936=-0.127
σ0.449-0.168=0.281
min8.059-8.681=-0.622
max9.220-9.117=0.104
iters=5
new-facts=6402
prior-facts=6402
mean4996.468-4996.390=0.079
σ0.015-0.154=-0.139
min4996.455-4996.116=0.339
max4996.489-4996.475=0.014
mean3041.400-3059.600=-18.200
σ210.397-316.687=-106.290
min2837.000-2810.000=27.000
max3356.000-3540.000=-184.000
mean8.742-8.475=0.267
σ0.242-0.129=0.114
min8.485-8.307=0.177
max9.021-8.664=0.357

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.943-0.967=-0.023
σ0.068-0.066=0.002
min0.888-0.909=-0.021
max1.061-1.039=0.022

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.970-462.966=0.004
σ574.246-574.252=-0.005
min175.839-175.837=0.002
max1324.339-1324.344=-0.005
mean86.250
σ8.500
min82.000
max99.000
mean2837.000-2810.000=27.000
σ0.000
min2837.000-2810.000=27.000
max2837.000-2810.000=27.000
mean0.425-0.430=-0.005
σ0.286-0.300=-0.014
min0.278-0.278=-0.001
max0.853-0.879=-0.026
policies=20
mean1758.723-1758.718=0.005
σ0.351-0.343=0.008
min1758.509-1758.494=0.015
max1759.246-1759.228=0.018
mean820.000
σ0.000
min820.000
max820.000
mean2837.000-2810.000=27.000
σ0.000
min2837.000-2810.000=27.000
max2837.000-2810.000=27.000
mean2.788-2.785=0.003
σ0.018-0.022=-0.003
min2.773-2.757=0.016
max2.814-2.811=0.004
policies=200
mean17593.387-17592.547=0.840
σ0.622-0.363=0.260
min17592.545-17592.254=0.291
max17593.881-17593.052=0.829
mean8200.000
σ0.000
min8200.000
max8200.000
mean2837.000-2810.000=27.000
σ0.000
min2837.000-2810.000=27.000
max2837.000-2810.000=27.000
mean27.846-27.367=0.478
σ0.352-0.159=0.193
min27.449-27.197=0.252
max28.232-27.574=0.658