Compare commits

Home / Compare 50e62de2 .. ea9d4a96

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.264-35.263=0.001
σ0.055-0.054=0.001
min35.233-35.235=-0.002
max35.418-35.415=0.003
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.083-0.083=-0.001
σ0.004-0.001=0.004
min0.077-0.083=-0.006
max0.090-0.085=0.006
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=-0.000
σ0.003-0.004=-0.001
min23.765-23.764=0.001
max23.775-23.778=-0.003
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.068-0.068=0.000
σ0.003-0.003=0.000
min0.066-0.066=-0.000
max0.076-0.074=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.483=0.001
σ0.366-0.365=0.001
min1755.913-1755.908=0.004
max1757.074-1757.069=0.005
mean1629.500-1657.300=-27.800
σ591.061-637.183=-46.123
min644.000-678.000=-34.000
max2425.000-2845.000=-420.000
mean2.342-2.362=-0.020
σ0.092-0.088=0.004
min2.199-2.274=-0.075
max2.622-2.602=0.020

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.703-324.705=-0.002
σ0.059-0.054=0.004
min324.600-324.609=-0.009
max324.743-324.737=0.006
mean2425.000-2845.000=-420.000
σ0.000
min2425.000-2845.000=-420.000
max2425.000-2845.000=-420.000
mean0.432-0.427=0.005
σ0.008-0.004=0.004
min0.426-0.424=0.001
max0.444-0.434=0.010
iters=5
new-facts=1
prior-facts=6402
mean1985.256-1985.273=-0.017
σ0.021-0.002=0.018
min1985.229-1985.270=-0.040
max1985.280-1985.275=0.004
mean2425.000-2845.000=-420.000
σ0.000
min2425.000-2845.000=-420.000
max2425.000-2845.000=-420.000
mean2.578-2.623=-0.045
σ0.069-0.079=-0.010
min2.486-2.566=-0.080
max2.668-2.752=-0.084
iters=5
new-facts=6402
prior-facts=1
mean4808.866-4808.669=0.197
σ7.702-7.824=-0.121
min4805.356-4804.274=1.082
max4822.644-4822.632=0.012
mean2425.000-2845.000=-420.000
σ0.000
min2425.000-2845.000=-420.000
max2425.000-2845.000=-420.000
mean8.933-8.717=0.217
σ0.128-0.465=-0.337
min8.816-8.165=0.651
max9.086-9.151=-0.065
iters=5
new-facts=6402
prior-facts=6402
mean4996.472-4996.464=0.008
σ0.017-0.011=0.006
min4996.451-4996.445=0.006
max4996.489-4996.472=0.017
mean3003.000-3064.000=-61.000
σ313.334-291.515=21.819
min2599.000-2845.000=-246.000
max3404.000-3513.000=-109.000
mean8.593-8.498=0.095
σ0.111-0.122=-0.011
min8.482-8.418=0.064
max8.713-8.714=-0.001

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.631-0.954=0.677
σ0.112-0.054=0.058
min1.466-0.916=0.550
max1.776-1.048=0.727

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.945-462.966=-0.021
σ574.246-574.249=-0.003
min175.817-175.834=-0.016
max1324.314-1324.340=-0.026
mean86.250
σ8.500
min82.000
max99.000
mean2425.000-2845.000=-420.000
σ0.000
min2425.000-2845.000=-420.000
max2425.000-2845.000=-420.000
mean0.545-0.428=0.117
σ0.534-0.296=0.239
min0.277-0.277=0.000
max1.347-0.872=0.475
policies=20
mean1758.505-1758.719=-0.214
σ0.352-0.351=0.001
min1758.252-1758.495=-0.242
max1759.024-1759.239=-0.216
mean820.000
σ0.000
min820.000
max820.000
mean2425.000-2845.000=-420.000
σ0.000
min2425.000-2845.000=-420.000
max2425.000-2845.000=-420.000
mean2.718-2.810=-0.092
σ0.010-0.027=-0.018
min2.712-2.782=-0.070
max2.732-2.844=-0.113
policies=200
mean17592.513-17593.417=-0.904
σ0.504-0.579=-0.075
min17592.231-17592.674=-0.443
max17593.266-17593.912=-0.646
mean8200.000
σ0.000
min8200.000
max8200.000
mean2425.000-2845.000=-420.000
σ0.000
min2425.000-2845.000=-420.000
max2425.000-2845.000=-420.000
mean27.532-27.905=-0.373
σ0.069-0.366=-0.297
min27.439-27.540=-0.101
max27.592-28.309=-0.717