Compare commits

Home / Compare 8945f5ef .. fad56d26

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-35.618=-0.000
σ0.055-0.055=-0.000
min35.590-35.584=0.005
max35.771-35.771=0.000
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.083-0.085=-0.002
σ0.005-0.005=0.000
min0.077-0.077=0.000
max0.095-0.093=0.002
cache=y
dps=1
iters=10
policies=100
mean24.047-24.046=0.001
σ0.003-0.004=-0.001
min24.042-24.042=0.000
max24.051-24.053=-0.002
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.066-0.067=-0.001
σ0.003-0.003=0.000
min0.060-0.063=-0.003
max0.070-0.074=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1756.489=0.000
σ0.364-0.365=-0.000
min1755.917-1755.915=0.002
max1757.078-1757.079=-0.001
mean1652.950-1652.250=0.700
σ627.140-627.390=-0.250
min622.000-621.000=1.000
max2684.000-2683.000=1.000
mean2.350-2.348=0.002
σ0.106-0.102=0.005
min2.236-2.234=0.001
max2.630-2.611=0.019

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.770-324.768=0.002
σ0.032-0.041=-0.008
min324.716-324.697=0.019
max324.802-324.797=0.006
mean2684.000-2683.000=1.000
σ0.000
min2684.000-2683.000=1.000
max2684.000-2683.000=1.000
mean0.418-0.427=-0.009
σ0.008-0.009=-0.001
min0.412-0.422=-0.010
max0.432-0.443=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1985.323-1985.320=0.003
σ0.013-0.023=-0.010
min1985.302-1985.284=0.017
max1985.336-1985.341=-0.005
mean2684.000-2683.000=1.000
σ0.000
min2684.000-2683.000=1.000
max2684.000-2683.000=1.000
mean2.620-2.639=-0.019
σ0.083-0.087=-0.004
min2.555-2.561=-0.007
max2.738-2.778=-0.040
iters=5
new-facts=6402
prior-facts=1
mean4809.089-4809.099=-0.010
σ7.725-7.714=0.011
min4805.571-4805.618=-0.047
max4822.908-4822.898=0.010
mean2684.000-2683.000=1.000
σ0.000
min2684.000-2683.000=1.000
max2684.000-2683.000=1.000
mean8.957-9.085=-0.128
σ0.258-0.320=-0.062
min8.667-8.670=-0.003
max9.285-9.528=-0.243
iters=5
new-facts=6402
prior-facts=6402
mean4996.559-4996.627=-0.068
σ0.155-0.028=0.127
min4996.284-4996.591=-0.307
max4996.658-4996.652=0.006
mean3041.800-3000.800=41.000
σ270.855-361.720=-90.864
min2684.000-2683.000=1.000
max3403.000-3521.000=-118.000
mean8.681-8.503=0.178
σ0.242-0.102=0.141
min8.361-8.364=-0.002
max8.977-8.648=0.329

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.947-0.952=-0.005
σ0.054-0.058=-0.005
min0.916-0.911=0.005
max1.041-1.054=-0.013

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.210-463.212=-0.002
σ574.774-574.768=0.006
min175.811-175.812=-0.000
max1325.371-1325.364=0.007
mean86.250
σ8.500
min82.000
max99.000
mean2684.000-2683.000=1.000
σ0.000
min2684.000-2683.000=1.000
max2684.000-2683.000=1.000
mean0.532-0.555=-0.023
σ0.518-0.567=-0.049
min0.271-0.270=0.001
max1.309-1.405=-0.096
policies=20
mean1758.485-1758.469=0.017
σ0.324-0.322=0.001
min1758.273-1758.268=0.005
max1758.966-1758.948=0.018
mean820.000
σ0.000
min820.000
max820.000
mean2684.000-2683.000=1.000
σ0.000
min2684.000-2683.000=1.000
max2684.000-2683.000=1.000
mean2.701-2.711=-0.010
σ0.018-0.020=-0.002
min2.682-2.691=-0.008
max2.724-2.738=-0.014
policies=200
mean17592.068-17591.989=0.080
σ0.481-0.446=0.035
min17591.804-17591.608=0.197
max17592.789-17592.633=0.156
mean8200.000
σ0.000
min8200.000
max8200.000
mean2684.000-2683.000=1.000
σ0.000
min2684.000-2683.000=1.000
max2684.000-2683.000=1.000
mean27.303-27.356=-0.053
σ0.173-0.143=0.031
min27.149-27.212=-0.063
max27.493-27.536=-0.043