Compare commits

Home / Compare 2c8b1e98 .. c0446d91

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.618=-0.000
σ0.056-0.054=0.001
min35.587-35.588=-0.001
max35.775-35.772=0.003
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.085-0.085=-0.000
σ0.003-0.003=0.000
min0.082-0.082=0.000
max0.091-0.091=-0.000
cache=y
dps=1
iters=10
policies=100
mean24.047-24.048=-0.001
σ0.002-0.004=-0.002
min24.044-24.043=0.001
max24.049-24.053=-0.004
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.069-0.066=0.002
σ0.004-0.005=-0.001
min0.066-0.062=0.004
max0.075-0.075=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.489-1756.490=-0.001
σ0.364-0.364=0.000
min1755.915-1755.914=0.001
max1757.075-1757.076=-0.001
mean1655.850-1653.300=2.550
σ644.014-646.932=-2.918
min635.000-649.000=-14.000
max2843.000-2844.000=-1.000
mean2.332-2.353=-0.021
σ0.063-0.126=-0.063
min2.254-2.155=0.098
max2.466-2.714=-0.248

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.738-324.768=-0.030
σ0.043-0.047=-0.004
min324.662-324.685=-0.022
max324.763-324.801=-0.038
mean2843.000-2844.000=-1.000
σ0.000
min2843.000-2844.000=-1.000
max2843.000-2844.000=-1.000
mean0.426-0.423=0.002
σ0.005-0.000=0.004
min0.423-0.423=-0.000
max0.434-0.424=0.010
iters=5
new-facts=1
prior-facts=6402
mean1985.322-1985.313=0.009
σ0.014-0.015=-0.001
min1985.300-1985.302=-0.002
max1985.335-1985.331=0.004
mean2843.000-2844.000=-1.000
σ0.000
min2843.000-2844.000=-1.000
max2843.000-2844.000=-1.000
mean2.672-2.620=0.052
σ0.132-0.187=-0.055
min2.520-2.373=0.148
max2.872-2.835=0.036
iters=5
new-facts=6402
prior-facts=1
mean4809.089-4809.084=0.005
σ7.736-7.685=0.051
min4805.605-4805.629=-0.024
max4822.928-4822.832=0.096
mean2843.000-2844.000=-1.000
σ0.000
min2843.000-2844.000=-1.000
max2843.000-2844.000=-1.000
mean8.969-8.926=0.043
σ0.487-0.119=0.368
min8.245-8.727=-0.482
max9.565-9.019=0.546
iters=5
new-facts=6402
prior-facts=6402
mean4996.566-4996.616=-0.050
σ0.181-0.018=0.163
min4996.247-4996.595=-0.349
max4996.674-4996.643=0.030
mean3086.000-3071.800=14.200
σ259.533-302.521=-42.988
min2843.000-2844.000=-1.000
max3358.000-3541.000=-183.000
mean9.158-8.528=0.630
σ0.551-0.135=0.415
min8.528-8.410=0.118
max9.899-8.724=1.175

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.068-0.984=0.084
σ0.264-0.137=0.127
min0.916-0.917=-0.001
max1.529-1.229=0.300

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.219-463.211=0.008
σ574.771-574.775=-0.004
min175.821-175.817=0.004
max1325.376-1325.373=0.002
mean86.250
σ8.500
min82.000
max99.000
mean2843.000-2844.000=-1.000
σ0.000
min2843.000-2844.000=-1.000
max2843.000-2844.000=-1.000
mean0.421-0.428=-0.007
σ0.284-0.299=-0.016
min0.273-0.274=-0.000
max0.846-0.877=-0.031
policies=20
mean1758.533-1758.524=0.009
σ0.366-0.345=0.021
min1758.284-1758.287=-0.003
max1759.075-1759.035=0.040
mean820.000
σ0.000
min820.000
max820.000
mean2843.000-2844.000=-1.000
σ0.000
min2843.000-2844.000=-1.000
max2843.000-2844.000=-1.000
mean2.786-2.792=-0.007
σ0.012-0.005=0.007
min2.771-2.787=-0.016
max2.798-2.798=0.000
policies=200
mean17592.089-17592.145=-0.056
σ0.498-0.450=0.048
min17591.686-17591.899=-0.213
max17592.805-17592.820=-0.015
mean8200.000
σ0.000
min8200.000
max8200.000
mean2843.000-2844.000=-1.000
σ0.000
min2843.000-2844.000=-1.000
max2843.000-2844.000=-1.000
mean27.794-27.901=-0.107
σ0.317-0.424=-0.108
min27.446-27.436=0.010
max28.168-28.429=-0.261