Compare commits

Home / Compare 1e23ea37 .. e4af3cd8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.245=0.018
σ0.054-0.054=0.000
min35.233-35.217=0.016
max35.415-35.396=0.019
mean414.800-415.000=-0.200
σ0.422-0.000=0.422
min414.000-415.000=-1.000
max415.000
mean0.085-0.086=-0.001
σ0.004-0.005=-0.001
min0.082-0.082=-0.000
max0.093-0.096=-0.003
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.001
σ0.002-0.002=-0.000
min23.767-23.764=0.003
max23.774-23.772=0.003
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.069-0.068=0.001
σ0.004-0.003=0.001
min0.066-0.064=0.001
max0.075-0.075=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.483=0.002
σ0.364-0.365=-0.001
min1755.910-1755.910=-0.000
max1757.071-1757.077=-0.006
mean1652.350-1659.600=-7.250
σ639.953-646.857=-6.904
min627.000-628.000=-1.000
max2829.000-2811.000=18.000
mean2.380-2.360=0.020
σ0.145-0.105=0.040
min2.252-2.255=-0.003
max2.904-2.713=0.192

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.718-324.709=0.009
σ0.030-0.039=-0.009
min324.666-324.639=0.027
max324.742-324.732=0.010
mean2829.000-2811.000=18.000
σ0.000
min2829.000-2811.000=18.000
max2829.000-2811.000=18.000
mean0.424-0.422=0.002
σ0.003-0.001=0.002
min0.422-0.421=0.001
max0.429-0.423=0.006
iters=5
new-facts=1
prior-facts=6402
mean1985.253-1985.271=-0.018
σ0.016-0.007=0.009
min1985.231-1985.264=-0.032
max1985.271-1985.282=-0.011
mean2829.000-2811.000=18.000
σ0.000
min2829.000-2811.000=18.000
max2829.000-2811.000=18.000
mean2.641-2.615=0.026
σ0.119-0.074=0.045
min2.555-2.552=0.003
max2.830-2.702=0.128
iters=5
new-facts=6402
prior-facts=1
mean4808.858-4808.890=-0.033
σ7.671-7.653=0.018
min4805.385-4805.356=0.028
max4822.580-4822.579=0.001
mean2829.000-2811.000=18.000
σ0.000
min2829.000-2811.000=18.000
max2829.000-2811.000=18.000
mean8.828-8.705=0.123
σ0.122-0.572=-0.449
min8.650-7.712=0.938
max8.988-9.098=-0.109
iters=5
new-facts=6402
prior-facts=6402
mean4996.459-4996.467=-0.008
σ0.025-0.016=0.008
min4996.421-4996.450=-0.029
max4996.482-4996.485=-0.002
mean3063.400-3015.800=47.600
σ306.458-207.944=98.514
min2829.000-2811.000=18.000
max3537.000-3301.000=236.000
mean8.495-8.667=-0.172
σ0.126-0.104=0.022
min8.334-8.541=-0.207
max8.682-8.810=-0.128

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.003-0.949=0.054
σ0.137-0.054=0.082
min0.913-0.916=-0.002
max1.227-1.042=0.185

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.977-462.966=0.011
σ574.251-574.249=0.002
min175.841-175.838=0.003
max1324.353-1324.339=0.014
mean86.250
σ8.500
min82.000
max99.000
mean2829.000-2811.000=18.000
σ0.000
min2829.000-2811.000=18.000
max2829.000-2811.000=18.000
mean0.431-0.424=0.007
σ0.297-0.291=0.006
min0.281-0.275=0.005
max0.877-0.861=0.017
policies=20
mean1758.718-1758.716=0.002
σ0.348-0.345=0.003
min1758.481-1758.495=-0.014
max1759.232-1759.229=0.003
mean820.000
σ0.000
min820.000
max820.000
mean2829.000-2811.000=18.000
σ0.000
min2829.000-2811.000=18.000
max2829.000-2811.000=18.000
mean2.789-2.784=0.005
σ0.014-0.005=0.010
min2.776-2.779=-0.003
max2.809-2.789=0.020
policies=200
mean17593.218-17592.527=0.691
σ0.708-0.443=0.265
min17592.186-17592.170=0.017
max17593.692-17593.135=0.557
mean8200.000
σ0.000
min8200.000
max8200.000
mean2829.000-2811.000=18.000
σ0.000
min2829.000-2811.000=18.000
max2829.000-2811.000=18.000
mean27.846-27.502=0.345
σ0.396-0.206=0.190
min27.499-27.261=0.238
max28.281-27.764=0.517