Compare commits

Home / Compare e9d1d1c7 .. 6566a06b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-35.246=-0.001
σ0.055-0.054=0.001
min35.219-35.221=-0.001
max35.399-35.397=0.002
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.082-0.086=-0.004
σ0.006-0.005=0.001
min0.077-0.082=-0.006
max0.096-0.096=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=0.000
σ0.003-0.004=-0.001
min23.764-23.760=0.004
max23.775-23.775=-0.000
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.067-0.066=0.001
σ0.002-0.004=-0.002
min0.065-0.061=0.004
max0.074-0.074=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.362-1718.415=37.946
σ0.366-169.612=-169.247
min1755.788-997.815=757.973
max1756.951-1756.946=0.005
mean1642.850-1633.350=9.500
σ632.987-612.477=20.510
min625.000-626.000=-1.000
max2838.000-2461.000=377.000
mean2.373-2.288=0.086
σ0.080-0.182=-0.101
min2.247-1.590=0.657
max2.605-2.568=0.038

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.571-324.583=-0.012
σ0.037-0.054=-0.018
min324.509-324.487=0.022
max324.598-324.610=-0.011
mean2838.000-2461.000=377.000
σ0.000
min2838.000-2461.000=377.000
max2838.000-2461.000=377.000
mean0.431-0.428=0.004
σ0.006-0.007=-0.001
min0.422-0.423=-0.001
max0.439-0.440=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1985.139-1985.146=-0.007
σ0.014-0.008=0.006
min1985.114-1985.135=-0.021
max1985.150-1985.153=-0.003
mean2838.000-2461.000=377.000
σ0.000
min2838.000-2461.000=377.000
max2838.000-2461.000=377.000
mean2.638-2.592=0.046
σ0.089-0.102=-0.013
min2.572-2.456=0.116
max2.741-2.721=0.020
iters=5
new-facts=6402
prior-facts=1
mean4808.787-4808.748=0.040
σ7.625-7.725=-0.100
min4805.233-4805.264=-0.030
max4822.425-4822.566=-0.141
mean2838.000-2461.000=377.000
σ0.000
min2838.000-2461.000=377.000
max2838.000-2461.000=377.000
mean8.720-8.965=-0.245
σ0.591-0.339=0.252
min7.748-8.456=-0.708
max9.178-9.374=-0.197
iters=5
new-facts=6402
prior-facts=6402
mean4996.343-4996.347=-0.004
σ0.016-0.021=-0.005
min4996.324-4996.326=-0.002
max4996.361-4996.371=-0.009
mean3061.400-3003.200=58.200
σ297.721-271.020=26.701
min2838.000-2609.000=229.000
max3524.000-3336.000=188.000
mean8.518-8.664=-0.146
σ0.145-0.141=0.004
min8.416-8.472=-0.056
max8.772-8.794=-0.022

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.944-1.601=-0.657
σ0.056-0.163=-0.107
min0.910-1.378=-0.467
max1.043-1.799=-0.755

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.966-462.947=0.019
σ574.248-574.249=-0.000
min175.838-175.818=0.020
max1324.338-1324.320=0.018
mean86.250
σ8.500
min82.000
max99.000
mean2838.000-2461.000=377.000
σ0.000
min2838.000-2461.000=377.000
max2838.000-2461.000=377.000
mean0.432-0.567=-0.134
σ0.298-0.585=-0.287
min0.279-0.272=0.007
max0.880-1.444=-0.565
policies=20
mean1758.701-1758.493=0.208
σ0.339-0.338=0.001
min1758.483-1758.254=0.229
max1759.204-1758.992=0.212
mean820.000
σ0.000
min820.000
max820.000
mean2838.000-2461.000=377.000
σ0.000
min2838.000-2461.000=377.000
max2838.000-2461.000=377.000
mean2.782-2.695=0.087
σ0.008-0.010=-0.002
min2.770-2.686=0.085
max2.790-2.705=0.085
policies=200
mean17593.207-17592.362=0.845
σ0.821-0.362=0.459
min17592.139-17592.123=0.016
max17593.909-17592.900=1.009
mean8200.000
σ0.000
min8200.000
max8200.000
mean2838.000-2461.000=377.000
σ0.000
min2838.000-2461.000=377.000
max2838.000-2461.000=377.000
mean27.919-27.377=0.542
σ0.371-0.124=0.247
min27.595-27.205=0.390
max28.289-27.491=0.798