Compare commits

Home / Compare ece96d51 .. d9817c2a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-35.243=0.001
σ0.052-0.053=-0.001
min35.220-35.214=0.006
max35.391-35.393=-0.002
mean414.000-417.900=-3.900
σ0.000-0.316=-0.316
min414.000-417.000=-3.000
max414.000-418.000=-4.000
mean0.084-0.084=-0.000
σ0.005-0.005=-0.000
min0.077-0.077=0.000
max0.092-0.091=0.001
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=-0.001
σ0.004-0.002=0.001
min23.762-23.766=-0.004
max23.775-23.774=0.001
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.065-0.069=-0.004
σ0.004-0.003=0.000
min0.061-0.067=-0.006
max0.071-0.076=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.486-1756.486=-0.000
σ0.366-0.366=0.000
min1755.910-1755.910=-0.000
max1757.079-1757.072=0.007
mean1648.850-1630.250=18.600
σ642.152-594.103=48.049
min624.000-653.000=-29.000
max2837.000-2429.000=408.000
mean2.351-2.331=0.020
σ0.103-0.095=0.009
min2.195-2.156=0.038
max2.600-2.562=0.038

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.702-324.709=-0.007
σ0.055-0.039=0.016
min324.604-324.639=-0.035
max324.733-324.728=0.004
mean2837.000-2429.000=408.000
σ0.000
min2837.000-2429.000=408.000
max2837.000-2429.000=408.000
mean0.430-0.423=0.007
σ0.008-0.002=0.006
min0.422-0.421=0.001
max0.442-0.426=0.017
iters=5
new-facts=1
prior-facts=6402
mean1985.263-1985.265=-0.002
σ0.014-0.011=0.003
min1985.239-1985.246=-0.007
max1985.275-1985.272=0.003
mean2837.000-2429.000=408.000
σ0.000
min2837.000-2429.000=408.000
max2837.000-2429.000=408.000
mean2.613-2.593=0.020
σ0.114-0.096=0.017
min2.468-2.485=-0.017
max2.746-2.748=-0.002
iters=5
new-facts=6402
prior-facts=1
mean4808.918-4808.642=0.276
σ7.650-7.793=-0.144
min4805.393-4804.784=0.609
max4822.601-4822.569=0.032
mean2837.000-2429.000=408.000
σ0.000
min2837.000-2429.000=408.000
max2837.000-2429.000=408.000
mean8.531-8.479=0.052
σ0.525-0.470=0.056
min7.844-7.846=-0.002
max8.937-8.887=0.051
iters=5
new-facts=6402
prior-facts=6402
mean4996.458-4996.464=-0.006
σ0.019-0.014=0.005
min4996.431-4996.450=-0.019
max4996.478-4996.482=-0.004
mean3060.000-2895.600=164.400
σ295.058-397.286=-102.227
min2837.000-2429.000=408.000
max3514.000-3434.000=80.000
mean8.560-8.531=0.029
σ0.157-0.124=0.033
min8.468-8.449=0.019
max8.833-8.750=0.083

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.979-1.810=-0.831
σ0.067-0.059=0.007
min0.919-1.715=-0.795
max1.051-1.854=-0.802

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.953-462.942=0.012
σ574.256-574.244=0.013
min175.819-175.812=0.007
max1324.338-1324.307=0.031
mean86.250
σ8.500
min82.000
max99.000
mean2837.000-2429.000=408.000
σ0.000
min2837.000-2429.000=408.000
max2837.000-2429.000=408.000
mean0.428-0.549=-0.121
σ0.291-0.547=-0.256
min0.279-0.272=0.007
max0.864-1.369=-0.505
policies=20
mean1758.514-1758.523=-0.009
σ0.267-0.346=-0.079
min1758.317-1758.289=0.028
max1758.906-1759.036=-0.130
mean820.000
σ0.000
min820.000
max820.000
mean2837.000-2429.000=408.000
σ0.000
min2837.000-2429.000=408.000
max2837.000-2429.000=408.000
mean2.790-2.724=0.066
σ0.005-0.014=-0.008
min2.785-2.714=0.071
max2.795-2.744=0.051
policies=200
mean17592.442-17592.455=-0.013
σ0.577-0.461=0.116
min17591.966-17592.183=-0.217
max17593.270-17593.144=0.126
mean8200.000
σ0.000
min8200.000
max8200.000
mean2837.000-2429.000=408.000
σ0.000
min2837.000-2429.000=408.000
max2837.000-2429.000=408.000
mean27.908-27.528=0.379
σ0.331-0.091=0.240
min27.606-27.425=0.181
max28.284-27.628=0.657