Compare commits

Home / Compare 4ab867ac .. 2c18266b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.265-35.264=0.001
σ0.053-0.053=0.000
min35.240-35.238=0.002
max35.413-35.412=0.001
mean412.000-418.000=-6.000
σ0.000
min412.000-418.000=-6.000
max412.000-418.000=-6.000
mean0.086-0.085=0.000
σ0.003-0.004=-0.001
min0.083-0.082=0.001
max0.093-0.092=0.000
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.001
σ0.003-0.003=0.001
min23.765-23.765=-0.000
max23.774-23.774=0.000
mean412.000-418.000=-6.000
σ0.000
min412.000-418.000=-6.000
max412.000-418.000=-6.000
mean0.066-0.069=-0.002
σ0.004-0.004=0.000
min0.062-0.066=-0.004
max0.075-0.076=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.486-1756.487=-0.001
σ0.365-0.365=-0.000
min1755.909-1755.910=-0.000
max1757.075-1757.078=-0.003
mean1650.350-1656.250=-5.900
σ628.967-642.871=-13.904
min618.000-630.000=-12.000
max2696.000-2839.000=-143.000
mean2.351-2.327=0.024
σ0.108-0.064=0.044
min2.252-2.231=0.021
max2.618-2.435=0.183

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.686-324.705=-0.019
σ0.031-0.056=-0.024
min324.631-324.606=0.025
max324.706-324.738=-0.032
mean2696.000-2839.000=-143.000
σ0.000
min2696.000-2839.000=-143.000
max2696.000-2839.000=-143.000
mean0.427-0.424=0.002
σ0.006-0.002=0.004
min0.421-0.421=0.000
max0.437-0.426=0.011
iters=5
new-facts=1
prior-facts=6402
mean1985.268-1985.258=0.010
σ0.011-0.020=-0.009
min1985.250-1985.231=0.019
max1985.277-1985.277=0.001
mean2696.000-2839.000=-143.000
σ0.000
min2696.000-2839.000=-143.000
max2696.000-2839.000=-143.000
mean2.646-2.625=0.021
σ0.239-0.091=0.148
min2.449-2.534=-0.085
max3.038-2.765=0.273
iters=5
new-facts=6402
prior-facts=1
mean4808.731-4808.864=-0.133
σ7.746-7.642=0.104
min4804.829-4805.371=-0.542
max4822.580-4822.534=0.046
mean2696.000-2839.000=-143.000
σ0.000
min2696.000-2839.000=-143.000
max2696.000-2839.000=-143.000
mean8.726-8.695=0.031
σ0.582-0.188=0.393
min7.722-8.494=-0.772
max9.189-8.894=0.294
iters=5
new-facts=6402
prior-facts=6402
mean4996.326-4996.458=-0.132
σ0.308-0.019=0.289
min4995.775-4996.429=-0.653
max4996.481-4996.481=0.000
mean3004.800-3070.200=-65.400
σ355.046-303.047=51.999
min2696.000-2839.000=-143.000
max3523.000-3535.000=-12.000
mean8.584-8.536=0.049
σ0.195-0.124=0.071
min8.392-8.427=-0.035
max8.877-8.672=0.206

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.994-0.995=-0.002
σ0.063-0.062=0.000
min0.913-0.911=0.002
max1.043-1.045=-0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.957-462.972=-0.015
σ574.253-574.254=-0.002
min175.822-175.835=-0.013
max1324.337-1324.354=-0.017
mean86.250
σ8.500
min82.000
max99.000
mean2696.000-2839.000=-143.000
σ0.000
min2696.000-2839.000=-143.000
max2696.000-2839.000=-143.000
mean0.541-0.433=0.107
σ0.529-0.301=0.227
min0.274-0.279=-0.005
max1.334-0.885=0.449
policies=20
mean1758.535-1758.691=-0.156
σ0.346-0.352=-0.006
min1758.307-1758.440=-0.133
max1759.051-1759.208=-0.157
mean820.000
σ0.000
min820.000
max820.000
mean2696.000-2839.000=-143.000
σ0.000
min2696.000-2839.000=-143.000
max2696.000-2839.000=-143.000
mean2.729-2.813=-0.083
σ0.008-0.027=-0.019
min2.719-2.790=-0.070
max2.738-2.849=-0.111
policies=200
mean17592.276-17593.290=-1.015
σ0.423-0.518=-0.095
min17591.993-17592.554=-0.561
max17592.902-17593.673=-0.770
mean8200.000
σ0.000
min8200.000
max8200.000
mean2696.000-2839.000=-143.000
σ0.000
min2696.000-2839.000=-143.000
max2696.000-2839.000=-143.000
mean27.443-27.872=-0.430
σ0.104-0.350=-0.246
min27.315-27.523=-0.208
max27.562-28.230=-0.668