Compare commits

Home / Compare bd877ebf .. 1aed7b18

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.245-35.243=0.002
σ0.054-0.053=0.001
min35.219-35.218=0.000
max35.399-35.393=0.006
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.085-0.085=-0.000
σ0.004-0.004=-0.000
min0.082-0.083=-0.001
max0.093-0.093=0.001
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.001
σ0.004-0.003=0.001
min23.762-23.765=-0.003
max23.774-23.774=0.001
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.069-0.066=0.003
σ0.003-0.004=-0.001
min0.067-0.061=0.006
max0.075-0.072=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1718.440-1756.363=-37.923
σ169.735-0.364=169.371
min997.318-1755.790=-758.471
max1756.950-1756.952=-0.002
mean1585.250-1642.750=-57.500
σ601.010-632.644=-31.634
min624.000-625.000=-1.000
max2408.000-2839.000=-431.000
mean2.272-2.348=-0.077
σ0.203-0.140=0.062
min1.443-2.193=-0.750
max2.410-2.859=-0.449

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.582-324.585=-0.003
σ0.053-0.046=0.007
min324.488-324.504=-0.016
max324.614-324.617=-0.003
mean2408.000-2839.000=-431.000
σ0.000
min2408.000-2839.000=-431.000
max2408.000-2839.000=-431.000
mean0.425-0.423=0.002
σ0.001-0.001=0.000
min0.423-0.422=0.001
max0.426-0.425=0.001
iters=5
new-facts=1
prior-facts=6402
mean1985.118-1985.149=-0.031
σ0.019-0.005=0.014
min1985.098-1985.141=-0.042
max1985.148-1985.152=-0.004
mean2408.000-2839.000=-431.000
σ0.000
min2408.000-2839.000=-431.000
max2408.000-2839.000=-431.000
mean2.664-2.609=0.055
σ0.113-0.058=0.055
min2.531-2.559=-0.028
max2.801-2.682=0.119
iters=5
new-facts=6402
prior-facts=1
mean4808.690-4808.734=-0.044
σ7.687-7.683=0.004
min4804.669-4805.270=-0.601
max4822.425-4822.477=-0.052
mean2408.000-2839.000=-431.000
σ0.000
min2408.000-2839.000=-431.000
max2408.000-2839.000=-431.000
mean8.792-8.835=-0.042
σ0.687-0.156=0.531
min7.700-8.618=-0.919
max9.513-9.046=0.466
iters=5
new-facts=6402
prior-facts=6402
mean4996.346-4996.203=0.143
σ0.012-0.306=-0.294
min4996.331-4995.658=0.673
max4996.359-4996.371=-0.012
mean2894.800-3046.600=-151.800
σ393.672-182.595=211.077
min2408.000-2839.000=-431.000
max3411.000-3306.000=105.000
mean8.460-8.674=-0.214
σ0.071-0.240=-0.169
min8.378-8.462=-0.084
max8.541-9.011=-0.470

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.453-0.972=0.481
σ0.209-0.069=0.141
min1.120-0.914=0.207
max1.663-1.052=0.611

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.948-462.974=-0.026
σ574.255-574.254=0.002
min175.819-175.835=-0.015
max1324.331-1324.355=-0.023
mean86.250
σ8.500
min82.000
max99.000
mean2408.000-2839.000=-431.000
σ0.000
min2408.000-2839.000=-431.000
max2408.000-2839.000=-431.000
mean0.551-0.472=0.080
σ0.557-0.376=0.181
min0.271-0.282=-0.011
max1.387-1.036=0.351
policies=20
mean1758.512-1758.689=-0.176
σ0.324-0.351=-0.027
min1758.270-1758.449=-0.179
max1758.988-1759.208=-0.219
mean820.000
σ0.000
min820.000
max820.000
mean2408.000-2839.000=-431.000
σ0.000
min2408.000-2839.000=-431.000
max2408.000-2839.000=-431.000
mean2.691-2.793=-0.102
σ0.017-0.010=0.007
min2.668-2.782=-0.114
max2.704-2.806=-0.102
policies=200
mean17592.478-17593.193=-0.716
σ0.473-0.808=-0.335
min17592.192-17592.122=0.070
max17593.185-17593.868=-0.683
mean8200.000
σ0.000
min8200.000
max8200.000
mean2408.000-2839.000=-431.000
σ0.000
min2408.000-2839.000=-431.000
max2408.000-2839.000=-431.000
mean27.451-27.880=-0.429
σ0.200-0.428=-0.228
min27.277-27.499=-0.222
max27.709-28.389=-0.680