Compare commits

Home / Compare 80bd2fab .. eaaf333b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.243-35.244=-0.000
σ0.054-0.052=0.003
min35.212-35.216=-0.003
max35.397-35.389=0.008
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.083-0.085=-0.001
σ0.005-0.003=0.001
min0.078-0.082=-0.004
max0.092-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.768-23.770=-0.002
σ0.003-0.003=-0.000
min23.766-23.767=-0.001
max23.774-23.774=0.000
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.062-0.069=-0.007
σ0.002-0.004=-0.001
min0.061-0.066=-0.006
max0.069-0.076=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.486=-0.001
σ0.365-0.365=-0.001
min1755.910-1755.912=-0.002
max1757.072-1757.072=-0.000
mean1650.500-1656.600=-6.100
σ639.634-638.599=1.035
min628.000-629.000=-1.000
max2826.000-2752.000=74.000
mean2.339-2.321=0.017
σ0.056-0.133=-0.077
min2.271-2.105=0.166
max2.445-2.778=-0.333

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.704-324.709=-0.006
σ0.064-0.040=0.024
min324.590-324.639=-0.050
max324.742-324.736=0.006
mean2826.000-2752.000=74.000
σ0.000
min2826.000-2752.000=74.000
max2826.000-2752.000=74.000
mean0.433-0.425=0.008
σ0.010-0.002=0.008
min0.424-0.423=0.002
max0.445-0.428=0.017
iters=5
new-facts=1
prior-facts=6402
mean1985.265-1985.256=0.009
σ0.004-0.016=-0.012
min1985.260-1985.239=0.020
max1985.271-1985.273=-0.002
mean2826.000-2752.000=74.000
σ0.000
min2826.000-2752.000=74.000
max2826.000-2752.000=74.000
mean2.624-2.671=-0.048
σ0.081-0.098=-0.017
min2.560-2.575=-0.015
max2.739-2.799=-0.060
iters=5
new-facts=6402
prior-facts=1
mean4808.864-4808.876=-0.013
σ7.718-7.654=0.064
min4805.336-4805.381=-0.045
max4822.670-4822.569=0.101
mean2826.000-2752.000=74.000
σ0.000
min2826.000-2752.000=74.000
max2826.000-2752.000=74.000
mean8.928-8.992=-0.064
σ0.296-0.163=0.133
min8.570-8.747=-0.177
max9.267-9.189=0.078
iters=5
new-facts=6402
prior-facts=6402
mean4996.464-4996.462=0.002
σ0.012-0.014=-0.002
min4996.449-4996.447=0.002
max4996.481-4996.476=0.005
mean3020.000-3038.200=-18.200
σ269.384-341.750=-72.366
min2826.000-2752.000=74.000
max3440.000-3544.000=-104.000
mean8.487-8.688=-0.200
σ0.038-0.336=-0.298
min8.452-8.446=0.006
max8.548-9.257=-0.709

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.940-0.941=-0.001
σ0.049-0.058=-0.009
min0.909-0.909=-0.000
max1.026-1.044=-0.017

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.964-462.967=-0.003
σ574.249-574.246=0.003
min175.833-175.840=-0.007
max1324.337-1324.336=0.002
mean86.250
σ8.500
min82.000
max99.000
mean2826.000-2752.000=74.000
σ0.000
min2826.000-2752.000=74.000
max2826.000-2752.000=74.000
mean0.431-0.440=-0.009
σ0.297-0.302=-0.005
min0.280-0.285=-0.004
max0.877-0.894=-0.017
policies=20
mean1758.700-1758.686=0.014
σ0.357-0.302=0.055
min1758.468-1758.490=-0.022
max1759.230-1759.133=0.097
mean820.000
σ0.000
min820.000
max820.000
mean2826.000-2752.000=74.000
σ0.000
min2826.000-2752.000=74.000
max2826.000-2752.000=74.000
mean2.802-2.847=-0.046
σ0.021-0.058=-0.037
min2.790-2.806=-0.016
max2.833-2.934=-0.100
policies=200
mean17593.229-17592.412=0.818
σ0.674-0.561=0.113
min17592.310-17591.914=0.395
max17593.804-17593.211=0.593
mean8200.000
σ0.000
min8200.000
max8200.000
mean2826.000-2752.000=74.000
σ0.000
min2826.000-2752.000=74.000
max2826.000-2752.000=74.000
mean27.933-27.573=0.360
σ0.434-0.224=0.210
min27.509-27.366=0.143
max28.409-27.874=0.535