Compare commits

Home / Compare 7735ae94 .. 6b8111bf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-35.245=-0.002
σ0.053-0.053=-0.000
min35.217-35.212=0.005
max35.393-35.394=-0.002
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.082-0.084=-0.003
σ0.005-0.003=0.002
min0.076-0.082=-0.006
max0.090-0.091=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=0.000
σ0.002-0.003=-0.001
min23.766-23.763=0.003
max23.772-23.773=-0.000
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.065-0.067=-0.001
σ0.004-0.004=0.000
min0.061-0.062=-0.001
max0.074-0.073=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.365-1756.363=0.001
σ0.365-0.366=-0.000
min1755.787-1755.790=-0.003
max1756.951-1756.958=-0.007
mean1654.700-1659.300=-4.600
σ644.841-621.593=23.248
min626.000-667.000=-41.000
max2847.000-2643.000=204.000
mean2.318-2.328=-0.010
σ0.079-0.113=-0.034
min2.237-2.178=0.060
max2.513-2.561=-0.048

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.585-316.677=7.907
σ0.054-17.686=-17.632
min324.489-285.040=39.449
max324.621-324.608=0.013
mean2847.000-2643.000=204.000
σ0.000
min2847.000-2643.000=204.000
max2847.000-2643.000=204.000
mean0.431-0.411=0.020
σ0.011-0.027=-0.016
min0.423-0.363=0.059
max0.446-0.424=0.022
iters=5
new-facts=1
prior-facts=6402
mean1985.141-1985.147=-0.005
σ0.015-0.007=0.008
min1985.125-1985.137=-0.012
max1985.156-1985.156=-0.000
mean2847.000-2643.000=204.000
σ0.000
min2847.000-2643.000=204.000
max2847.000-2643.000=204.000
mean2.616-2.620=-0.004
σ0.151-0.095=0.056
min2.441-2.520=-0.078
max2.847-2.730=0.116
iters=5
new-facts=6402
prior-facts=1
mean4808.668-4808.749=-0.081
σ7.772-7.674=0.098
min4804.678-4805.267=-0.589
max4822.561-4822.477=0.084
mean2847.000-2643.000=204.000
σ0.000
min2847.000-2643.000=204.000
max2847.000-2643.000=204.000
mean9.132-8.979=0.153
σ0.206-0.227=-0.021
min8.802-8.812=-0.009
max9.330-9.376=-0.046
iters=5
new-facts=6402
prior-facts=6402
mean4996.344-4996.276=0.068
σ0.024-0.145=-0.121
min4996.316-4996.017=0.299
max4996.370-4996.349=0.021
mean3041.000-2986.200=54.800
σ212.123-273.258=-61.136
min2847.000-2643.000=204.000
max3361.000-3328.000=33.000
mean8.772-8.622=0.150
σ0.180-0.138=0.043
min8.549-8.465=0.084
max9.037-8.829=0.208

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.010-1.126=-0.117
σ0.136-0.294=-0.158
min0.918-0.931=-0.013
max1.228-1.641=-0.413

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.976-462.957=0.019
σ574.253-574.261=-0.008
min175.838-175.820=0.018
max1324.356-1324.349=0.007
mean86.250
σ8.500
min82.000
max99.000
mean2847.000-2643.000=204.000
σ0.000
min2847.000-2643.000=204.000
max2847.000-2643.000=204.000
mean0.428-0.546=-0.118
σ0.297-0.545=-0.247
min0.278-0.272=0.006
max0.874-1.363=-0.488
policies=20
mean1758.712-1758.509=0.204
σ0.347-0.351=-0.004
min1758.476-1758.264=0.213
max1759.227-1759.029=0.198
mean820.000
σ0.000
min820.000
max820.000
mean2847.000-2643.000=204.000
σ0.000
min2847.000-2643.000=204.000
max2847.000-2643.000=204.000
mean2.779-2.701=0.078
σ0.012-0.006=0.005
min2.770-2.694=0.076
max2.795-2.709=0.086
policies=200
mean17593.393-17592.160=1.233
σ0.497-0.473=0.025
min17592.763-17591.812=0.950
max17593.818-17592.850=0.968
mean8200.000
σ0.000
min8200.000
max8200.000
mean2847.000-2643.000=204.000
σ0.000
min2847.000-2643.000=204.000
max2847.000-2643.000=204.000
mean27.859-27.338=0.522
σ0.359-0.125=0.234
min27.479-27.224=0.255
max28.300-27.459=0.841