Compare commits

Home / Compare b7864dec .. d3685a86

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.264-35.263=0.000
σ0.054-0.055=-0.001
min35.239-35.234=0.005
max35.417-35.418=-0.001
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.085-0.086=-0.000
σ0.003-0.005=-0.001
min0.083-0.082=0.001
max0.093-0.092=0.000
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.001
σ0.003-0.003=-0.000
min23.765-23.764=0.001
max23.776-23.773=0.003
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.067-0.065=0.002
σ0.005-0.004=0.000
min0.063-0.061=0.002
max0.076-0.075=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.483-1756.485=-0.002
σ0.366-0.365=0.001
min1755.911-1755.914=-0.002
max1757.071-1757.078=-0.006
mean1659.450-1663.100=-3.650
σ640.723-646.544=-5.821
min624.000-631.000=-7.000
max2772.000-2813.000=-41.000
mean2.341-2.355=-0.013
σ0.116-0.103=0.013
min2.246-2.243=0.004
max2.715-2.635=0.081

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.722-324.709=0.013
σ0.019-0.042=-0.023
min324.692-324.635=0.058
max324.739-324.730=0.009
mean2772.000-2813.000=-41.000
σ0.000
min2772.000-2813.000=-41.000
max2772.000-2813.000=-41.000
mean0.424-0.425=-0.001
σ0.002-0.001=0.001
min0.421-0.424=-0.003
max0.426-0.426=0.000
iters=5
new-facts=1
prior-facts=6402
mean1985.258-1985.251=0.007
σ0.016-0.016=0.000
min1985.232-1985.231=0.001
max1985.272-1985.265=0.007
mean2772.000-2813.000=-41.000
σ0.000
min2772.000-2813.000=-41.000
max2772.000-2813.000=-41.000
mean2.632-2.605=0.027
σ0.103-0.086=0.017
min2.549-2.530=0.019
max2.767-2.750=0.018
iters=5
new-facts=6402
prior-facts=1
mean4808.774-4808.865=-0.091
σ7.747-7.692=0.055
min4804.816-4805.406=-0.590
max4822.622-4822.625=-0.003
mean2772.000-2813.000=-41.000
σ0.000
min2772.000-2813.000=-41.000
max2772.000-2813.000=-41.000
mean8.725-8.935=-0.210
σ0.401-0.126=0.275
min8.029-8.796=-0.768
max9.050-9.061=-0.011
iters=5
new-facts=6402
prior-facts=6402
mean4996.461-4996.394=0.067
σ0.017-0.152=-0.135
min4996.443-4996.122=0.321
max4996.480-4996.478=0.002
mean3034.600-3033.600=1.000
σ232.878-215.324=17.555
min2772.000-2813.000=-41.000
max3372.000-3354.000=18.000
mean8.779-8.743=0.036
σ0.154-0.171=-0.017
min8.568-8.491=0.078
max8.939-8.930=0.008

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.907-0.999=-0.092
σ0.010-0.064=-0.054
min0.890-0.918=-0.027
max0.916-1.048=-0.132

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.972-462.976=-0.004
σ574.258-574.250=0.008
min175.838-175.838=-0.000
max1324.359-1324.351=0.007
mean86.250
σ8.500
min82.000
max99.000
mean2772.000-2813.000=-41.000
σ0.000
min2772.000-2813.000=-41.000
max2772.000-2813.000=-41.000
mean0.429-0.424=0.006
σ0.290-0.283=0.007
min0.283-0.280=0.004
max0.865-0.849=0.016
policies=20
mean1758.720-1758.716=0.004
σ0.353-0.350=0.003
min1758.500-1758.481=0.019
max1759.247-1759.235=0.012
mean820.000
σ0.000
min820.000
max820.000
mean2772.000-2813.000=-41.000
σ0.000
min2772.000-2813.000=-41.000
max2772.000-2813.000=-41.000
mean2.779-2.787=-0.009
σ0.011-0.008=0.004
min2.762-2.780=-0.018
max2.787-2.797=-0.010
policies=200
mean17592.365-17592.453=-0.089
σ0.456-0.426=0.030
min17591.961-17592.001=-0.040
max17593.019-17593.014=0.004
mean8200.000
σ0.000
min8200.000
max8200.000
mean2772.000-2813.000=-41.000
σ0.000
min2772.000-2813.000=-41.000
max2772.000-2813.000=-41.000
mean27.537-27.513=0.025
σ0.294-0.182=0.112
min27.252-27.355=-0.104
max27.947-27.774=0.173