Compare commits

Home / Compare 52f12be4 .. dd984946

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.264-35.264=-0.000
σ0.056-0.053=0.003
min35.232-35.238=-0.006
max35.422-35.415=0.008
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.086-0.086=0.000
σ0.005-0.003=0.002
min0.082-0.083=-0.001
max0.096-0.091=0.004
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.001
σ0.003-0.002=0.001
min23.768-23.765=0.002
max23.778-23.774=0.005
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.068-0.068=-0.001
σ0.002-0.003=-0.001
min0.066-0.066=-0.001
max0.074-0.076=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.486=-0.001
σ0.364-0.365=-0.000
min1755.910-1755.910=-0.000
max1757.070-1757.070=0.001
mean1651.350-1649.650=1.700
σ639.644-639.722=-0.078
min628.000-626.000=2.000
max2828.000-2826.000=2.000
mean2.340-2.344=-0.005
σ0.067-0.080=-0.013
min2.231-2.206=0.025
max2.466-2.565=-0.100

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.705-324.701=0.004
σ0.053-0.058=-0.005
min324.612-324.598=0.015
max324.747-324.734=0.013
mean2828.000-2826.000=2.000
σ0.000
min2828.000-2826.000=2.000
max2828.000-2826.000=2.000
mean0.424-0.425=-0.000
σ0.002-0.001=0.001
min0.423-0.424=-0.001
max0.428-0.426=0.002
iters=5
new-facts=1
prior-facts=6402
mean1985.271-1985.256=0.015
σ0.007-0.015=-0.008
min1985.263-1985.241=0.021
max1985.279-1985.276=0.003
mean2828.000-2826.000=2.000
σ0.000
min2828.000-2826.000=2.000
max2828.000-2826.000=2.000
mean2.611-2.622=-0.011
σ0.057-0.069=-0.012
min2.557-2.546=0.011
max2.688-2.711=-0.024
iters=5
new-facts=6402
prior-facts=1
mean4808.760-4808.867=-0.107
σ7.715-7.657=0.058
min4804.829-4805.394=-0.565
max4822.551-4822.564=-0.013
mean2828.000-2826.000=2.000
σ0.000
min2828.000-2826.000=2.000
max2828.000-2826.000=2.000
mean8.863-8.938=-0.075
σ0.367-0.162=0.204
min8.444-8.689=-0.245
max9.417-9.084=0.333
iters=5
new-facts=6402
prior-facts=6402
mean4996.328-4996.469=-0.141
σ0.332-0.017=0.315
min4995.735-4996.451=-0.717
max4996.493-4996.491=0.002
mean3046.600-3047.200=-0.600
σ190.197-199.608=-9.411
min2828.000-2826.000=2.000
max3318.000-3335.000=-17.000
mean8.678-8.720=-0.042
σ0.244-0.254=-0.010
min8.492-8.506=-0.014
max8.956-9.053=-0.097

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.059-1.025=0.035
σ0.261-0.129=0.132
min0.912-0.909=0.003
max1.517-1.224=0.293

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.972-462.968=0.004
σ574.254-574.253=0.002
min175.836-175.838=-0.002
max1324.353-1324.347=0.006
mean86.250
σ8.500
min82.000
max99.000
mean2828.000-2826.000=2.000
σ0.000
min2828.000-2826.000=2.000
max2828.000-2826.000=2.000
mean0.433-0.430=0.003
σ0.302-0.300=0.003
min0.279-0.276=0.003
max0.886-0.879=0.007
policies=20
mean1758.689-1758.717=-0.029
σ0.353-0.349=0.004
min1758.443-1758.478=-0.036
max1759.211-1759.234=-0.022
mean820.000
σ0.000
min820.000
max820.000
mean2828.000-2826.000=2.000
σ0.000
min2828.000-2826.000=2.000
max2828.000-2826.000=2.000
mean2.787-2.789=-0.002
σ0.007-0.023=-0.016
min2.777-2.772=0.006
max2.794-2.822=-0.028
policies=200
mean17593.307-17593.291=0.016
σ0.722-0.734=-0.011
min17592.299-17592.324=-0.026
max17593.926-17593.902=0.025
mean8200.000
σ0.000
min8200.000
max8200.000
mean2828.000-2826.000=2.000
σ0.000
min2828.000-2826.000=2.000
max2828.000-2826.000=2.000
mean27.923-27.873=0.050
σ0.408-0.416=-0.008
min27.569-27.530=0.039
max28.398-28.382=0.016