Compare commits

Home / Compare 77fb6386 .. 6363452b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-35.245=-0.001
σ0.054-0.053=0.001
min35.214-35.220=-0.006
max35.396-35.395=0.001
mean415.000-414.900=0.100
σ0.000-0.316=-0.316
min415.000-414.000=1.000
max415.000
mean0.083-0.086=-0.003
σ0.006-0.003=0.002
min0.077-0.083=-0.006
max0.095-0.091=0.004
cache=y
dps=1
iters=10
policies=100
mean23.768-23.769=-0.001
σ0.003-0.003=-0.000
min23.763-23.765=-0.001
max23.773-23.774=-0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.064-0.069=-0.005
σ0.003-0.003=-0.000
min0.061-0.066=-0.005
max0.071-0.076=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.365-1756.362=0.003
σ0.365-0.366=-0.001
min1755.789-1755.787=0.002
max1756.953-1756.948=0.004
mean1653.750-1656.650=-2.900
σ631.544-631.956=-0.412
min622.000-670.000=-48.000
max2753.000-2792.000=-39.000
mean2.344-2.320=0.024
σ0.107-0.079=0.028
min2.222-2.223=-0.002
max2.617-2.559=0.057

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.580-324.586=-0.006
σ0.053-0.044=0.009
min324.487-324.508=-0.021
max324.611-324.611=0.000
mean2753.000-2792.000=-39.000
σ0.000
min2753.000-2792.000=-39.000
max2753.000-2792.000=-39.000
mean0.421-0.425=-0.004
σ0.002-0.001=0.000
min0.419-0.423=-0.004
max0.423-0.426=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1985.144-1985.138=0.006
σ0.015-0.019=-0.005
min1985.118-1985.105=0.013
max1985.155-1985.152=0.002
mean2753.000-2792.000=-39.000
σ0.000
min2753.000-2792.000=-39.000
max2753.000-2792.000=-39.000
mean2.682-2.564=0.118
σ0.161-0.050=0.111
min2.577-2.514=0.063
max2.947-2.644=0.303
iters=5
new-facts=6402
prior-facts=1
mean4808.745-4808.762=-0.017
σ7.653-7.631=0.023
min4805.224-4805.292=-0.068
max4822.435-4822.411=0.023
mean2753.000-2792.000=-39.000
σ0.000
min2753.000-2792.000=-39.000
max2753.000-2792.000=-39.000
mean8.918-8.690=0.228
σ0.290-0.298=-0.008
min8.746-8.329=0.418
max9.433-9.006=0.427
iters=5
new-facts=6402
prior-facts=6402
mean4996.317-4996.350=-0.033
σ0.045-0.015=0.030
min4996.241-4996.336=-0.095
max4996.356-4996.369=-0.013
mean3034.400-3044.400=-10.000
σ339.863-200.377=139.486
min2753.000-2792.000=-39.000
max3543.000-3315.000=228.000
mean8.500-8.589=-0.089
σ0.152-0.116=0.036
min8.421-8.428=-0.007
max8.771-8.726=0.045

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.951-0.966=-0.015
σ0.055-0.055=-0.001
min0.911-0.925=-0.014
max1.045-1.061=-0.016

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.970-462.964=0.006
σ574.257-574.250=0.006
min175.835-175.836=-0.000
max1324.355-1324.339=0.016
mean86.250
σ8.500
min82.000
max99.000
mean2753.000-2792.000=-39.000
σ0.000
min2753.000-2792.000=-39.000
max2753.000-2792.000=-39.000
mean0.429-0.431=-0.002
σ0.296-0.299=-0.003
min0.277-0.279=-0.002
max0.874-0.880=-0.006
policies=20
mean1758.719-1758.688=0.031
σ0.346-0.353=-0.007
min1758.487-1758.457=0.030
max1759.232-1759.213=0.019
mean820.000
σ0.000
min820.000
max820.000
mean2753.000-2792.000=-39.000
σ0.000
min2753.000-2792.000=-39.000
max2753.000-2792.000=-39.000
mean2.780-2.780=0.000
σ0.016-0.019=-0.003
min2.756-2.752=0.004
max2.790-2.794=-0.004
policies=200
mean17592.417-17592.391=0.026
σ0.357-0.404=-0.047
min17592.213-17591.969=0.244
max17592.951-17592.937=0.014
mean8200.000
σ0.000
min8200.000
max8200.000
mean2753.000-2792.000=-39.000
σ0.000
min2753.000-2792.000=-39.000
max2753.000-2792.000=-39.000
mean27.470-27.515=-0.045
σ0.153-0.071=0.082
min27.270-27.413=-0.143
max27.642-27.566=0.076