Compare commits

Home / Compare 19c830d0 .. 275e2bb5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.619=-0.001
σ0.056-0.054=0.002
min35.587-35.584=0.002
max35.775-35.769=0.006
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.085-0.086=-0.000
σ0.003-0.003=0.000
min0.082-0.083=-0.001
max0.091-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean24.047-24.046=0.000
σ0.002-0.004=-0.002
min24.044-24.040=0.004
max24.049-24.054=-0.005
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.069-0.066=0.003
σ0.004-0.008=-0.004
min0.066-0.054=0.012
max0.075-0.077=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.489-1756.492=-0.003
σ0.364-0.366=-0.002
min1755.915-1755.915=-0.001
max1757.075-1757.077=-0.002
mean1655.850-1638.650=17.200
σ644.014-604.461=39.554
min635.000-658.000=-23.000
max2843.000-2450.000=393.000
mean2.332-2.324=0.008
σ0.063-0.135=-0.072
min2.254-2.057=0.197
max2.466-2.714=-0.247

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.738-324.760=-0.021
σ0.043-0.048=-0.006
min324.662-324.674=-0.011
max324.763-324.789=-0.027
mean2843.000-2450.000=393.000
σ0.000
min2843.000-2450.000=393.000
max2843.000-2450.000=393.000
mean0.426-0.426=-0.001
σ0.005-0.002=0.003
min0.423-0.424=-0.001
max0.434-0.429=0.005
iters=5
new-facts=1
prior-facts=6402
mean1985.322-1985.325=-0.003
σ0.014-0.008=0.005
min1985.300-1985.316=-0.017
max1985.335-1985.335=-0.001
mean2843.000-2450.000=393.000
σ0.000
min2843.000-2450.000=393.000
max2843.000-2450.000=393.000
mean2.672-2.606=0.066
σ0.132-0.109=0.022
min2.520-2.504=0.016
max2.872-2.739=0.133
iters=5
new-facts=6402
prior-facts=1
mean4809.089-4809.085=0.004
σ7.736-7.670=0.067
min4805.605-4805.542=0.063
max4822.928-4822.804=0.124
mean2843.000-2450.000=393.000
σ0.000
min2843.000-2450.000=393.000
max2843.000-2450.000=393.000
mean8.969-8.676=0.293
σ0.487-0.396=0.091
min8.245-8.169=0.076
max9.565-9.148=0.417
iters=5
new-facts=6402
prior-facts=6402
mean4996.566-4996.631=-0.065
σ0.181-0.020=0.161
min4996.247-4996.606=-0.360
max4996.674-4996.651=0.023
mean3086.000-3015.400=70.600
σ259.533-283.473=-23.940
min2843.000-2611.000=232.000
max3358.000-3372.000=-14.000
mean9.158-8.659=0.499
σ0.551-0.156=0.395
min8.528-8.472=0.056
max9.899-8.860=1.039

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.068-1.688=-0.620
σ0.264-0.265=-0.001
min0.916-1.218=-0.302
max1.529-1.860=-0.331

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.219-463.204=0.015
σ574.771-574.766=0.006
min175.821-175.818=0.003
max1325.376-1325.352=0.023
mean86.250
σ8.500
min82.000
max99.000
mean2843.000-2450.000=393.000
σ0.000
min2843.000-2450.000=393.000
max2843.000-2450.000=393.000
mean0.421-0.537=-0.117
σ0.284-0.525=-0.242
min0.273-0.273=0.001
max0.846-1.325=-0.479
policies=20
mean1758.533-1758.465=0.068
σ0.366-0.362=0.004
min1758.284-1758.239=0.045
max1759.075-1759.004=0.072
mean820.000
σ0.000
min820.000
max820.000
mean2843.000-2450.000=393.000
σ0.000
min2843.000-2450.000=393.000
max2843.000-2450.000=393.000
mean2.786-2.727=0.058
σ0.012-0.018=-0.006
min2.771-2.713=0.059
max2.798-2.752=0.045
policies=200
mean17592.089-17591.917=0.172
σ0.498-0.502=-0.005
min17591.686-17591.631=0.055
max17592.805-17592.670=0.135
mean8200.000
σ0.000
min8200.000
max8200.000
mean2843.000-2450.000=393.000
σ0.000
min2843.000-2450.000=393.000
max2843.000-2450.000=393.000
mean27.794-27.554=0.240
σ0.317-0.146=0.170
min27.446-27.407=0.038
max28.168-27.701=0.467