Compare commits

Home / Compare d702da38 .. 5cc7ce3d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.264=-0.000
σ0.053-0.054=-0.001
min35.236-35.238=-0.001
max35.412-35.415=-0.003
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.084-0.086=-0.001
σ0.003-0.004=-0.001
min0.082-0.083=-0.001
max0.090-0.093=-0.003
cache=y
dps=1
iters=10
policies=100
mean23.770-23.771=-0.001
σ0.003-0.003=-0.001
min23.766-23.767=-0.001
max23.775-23.777=-0.002
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.069-0.067=0.002
σ0.004-0.005=-0.001
min0.066-0.061=0.005
max0.076-0.075=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.487-1756.485=0.001
σ0.365-0.365=0.000
min1755.910-1755.911=-0.001
max1757.079-1757.077=0.003
mean1656.050-1655.350=0.700
σ627.192-626.637=0.555
min631.000-629.000=2.000
max2760.000-2751.000=9.000
mean2.355-2.359=-0.004
σ0.082-0.123=-0.041
min2.266-2.251=0.014
max2.600-2.807=-0.207

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.710-324.717=-0.008
σ0.046-0.025=0.021
min324.628-324.674=-0.045
max324.738-324.732=0.007
mean2760.000-2751.000=9.000
σ0.000
min2760.000-2751.000=9.000
max2760.000-2751.000=9.000
mean0.426-0.424=0.003
σ0.006-0.001=0.005
min0.423-0.422=0.001
max0.437-0.425=0.012
iters=5
new-facts=1
prior-facts=6402
mean1985.265-1985.268=-0.004
σ0.009-0.006=0.003
min1985.251-1985.263=-0.012
max1985.276-1985.279=-0.003
mean2760.000-2751.000=9.000
σ0.000
min2760.000-2751.000=9.000
max2760.000-2751.000=9.000
mean2.604-2.600=0.004
σ0.106-0.061=0.044
min2.461-2.550=-0.089
max2.751-2.702=0.049
iters=5
new-facts=6402
prior-facts=1
mean4808.774-4808.896=-0.121
σ7.694-7.656=0.039
min4804.796-4805.419=-0.623
max4822.526-4822.590=-0.064
mean2760.000-2751.000=9.000
σ0.000
min2760.000-2751.000=9.000
max2760.000-2751.000=9.000
mean8.672-9.045=-0.373
σ0.537-0.204=0.334
min7.765-8.802=-1.037
max9.085-9.232=-0.147
iters=5
new-facts=6402
prior-facts=6402
mean4996.404-4996.399=0.005
σ0.175-0.161=0.014
min4996.092-4996.113=-0.022
max4996.493-4996.496=-0.003
mean3058.400-3006.200=52.200
σ268.997-250.417=18.580
min2760.000-2751.000=9.000
max3330.000-3357.000=-27.000
mean8.927-8.728=0.199
σ0.460-0.233=0.227
min8.527-8.494=0.033
max9.518-9.042=0.476

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.953-0.970=-0.017
σ0.056-0.066=-0.010
min0.919-0.911=0.008
max1.051-1.046=0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.966-462.976=-0.009
σ574.249-574.253=-0.004
min175.835-175.839=-0.004
max1324.340-1324.355=-0.015
mean86.250
σ8.500
min82.000
max99.000
mean2760.000-2751.000=9.000
σ0.000
min2760.000-2751.000=9.000
max2760.000-2751.000=9.000
mean0.432-0.431=0.002
σ0.305-0.299=0.006
min0.278-0.279=-0.001
max0.890-0.879=0.011
policies=20
mean1758.716-1758.665=0.051
σ0.327-0.311=0.016
min1758.502-1758.458=0.044
max1759.202-1759.126=0.076
mean820.000
σ0.000
min820.000
max820.000
mean2760.000-2751.000=9.000
σ0.000
min2760.000-2751.000=9.000
max2760.000-2751.000=9.000
mean2.842-2.833=0.009
σ0.083-0.071=0.012
min2.797-2.790=0.007
max2.967-2.938=0.029
policies=200
mean17592.341-17592.386=-0.045
σ0.609-0.601=0.008
min17592.007-17591.940=0.066
max17593.253-17593.267=-0.014
mean8200.000
σ0.000
min8200.000
max8200.000
mean2760.000-2751.000=9.000
σ0.000
min2760.000-2751.000=9.000
max2760.000-2751.000=9.000
mean27.392-27.373=0.020
σ0.100-0.114=-0.014
min27.300-27.273=0.027
max27.492-27.485=0.007