Compare commits

Home / Compare ef45a689 .. f38a1908

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.262-35.263=-0.001
σ0.054-0.055=-0.001
min35.237-35.234=0.004
max35.415-35.418=-0.003
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.081-0.086=-0.004
σ0.005-0.005=0.000
min0.076-0.082=-0.006
max0.089-0.092=-0.003
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.001
σ0.002-0.003=-0.001
min23.765-23.764=0.001
max23.774-23.773=0.000
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.069-0.065=0.004
σ0.003-0.004=-0.001
min0.067-0.061=0.006
max0.075-0.075=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.486-1756.485=0.001
σ0.365-0.365=0.000
min1755.912-1755.914=-0.002
max1757.077-1757.078=-0.000
mean1651.000-1663.100=-12.100
σ640.585-646.544=-5.958
min628.000-631.000=-3.000
max2840.000-2813.000=27.000
mean2.329-2.355=-0.026
σ0.059-0.103=-0.044
min2.256-2.243=0.013
max2.433-2.635=-0.202

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.706-324.709=-0.003
σ0.048-0.042=0.006
min324.621-324.635=-0.013
max324.740-324.730=0.010
mean2840.000-2813.000=27.000
σ0.000
min2840.000-2813.000=27.000
max2840.000-2813.000=27.000
mean0.426-0.425=0.001
σ0.006-0.001=0.005
min0.422-0.424=-0.002
max0.436-0.426=0.010
iters=5
new-facts=1
prior-facts=6402
mean1985.270-1985.251=0.019
σ0.007-0.016=-0.008
min1985.259-1985.231=0.028
max1985.277-1985.265=0.013
mean2840.000-2813.000=27.000
σ0.000
min2840.000-2813.000=27.000
max2840.000-2813.000=27.000
mean2.596-2.605=-0.009
σ0.058-0.086=-0.028
min2.543-2.530=0.013
max2.669-2.750=-0.080
iters=5
new-facts=6402
prior-facts=1
mean4808.911-4808.865=0.046
σ7.708-7.692=0.016
min4805.357-4805.406=-0.049
max4822.698-4822.625=0.074
mean2840.000-2813.000=27.000
σ0.000
min2840.000-2813.000=27.000
max2840.000-2813.000=27.000
mean8.833-8.935=-0.102
σ0.627-0.126=0.500
min7.771-8.796=-1.025
max9.353-9.061=0.291
iters=5
new-facts=6402
prior-facts=6402
mean4996.463-4996.394=0.069
σ0.021-0.152=-0.131
min4996.440-4996.122=0.318
max4996.482-4996.478=0.004
mean3054.600-3033.600=21.000
σ201.676-215.324=-13.647
min2840.000-2813.000=27.000
max3350.000-3354.000=-4.000
mean8.706-8.743=-0.037
σ0.237-0.171=0.066
min8.475-8.491=-0.015
max9.071-8.930=0.140

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.007-0.999=0.008
σ0.136-0.064=0.072
min0.916-0.918=-0.002
max1.228-1.048=0.180

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.969-462.976=-0.007
σ574.253-574.250=0.002
min175.836-175.838=-0.002
max1324.348-1324.351=-0.004
mean86.250
σ8.500
min82.000
max99.000
mean2840.000-2813.000=27.000
σ0.000
min2840.000-2813.000=27.000
max2840.000-2813.000=27.000
mean0.472-0.424=0.049
σ0.382-0.283=0.098
min0.279-0.280=-0.001
max1.045-0.849=0.196
policies=20
mean1758.707-1758.716=-0.009
σ0.343-0.350=-0.007
min1758.480-1758.481=-0.001
max1759.216-1759.235=-0.020
mean820.000
σ0.000
min820.000
max820.000
mean2840.000-2813.000=27.000
σ0.000
min2840.000-2813.000=27.000
max2840.000-2813.000=27.000
mean2.790-2.787=0.002
σ0.015-0.008=0.008
min2.779-2.780=-0.001
max2.812-2.797=0.016
policies=200
mean17593.384-17592.453=0.930
σ0.705-0.426=0.280
min17592.409-17592.001=0.408
max17593.926-17593.014=0.911
mean8200.000
σ0.000
min8200.000
max8200.000
mean2840.000-2813.000=27.000
σ0.000
min2840.000-2813.000=27.000
max2840.000-2813.000=27.000
mean27.903-27.513=0.390
σ0.365-0.182=0.183
min27.543-27.355=0.188
max28.348-27.774=0.574