Compare commits

Home / Compare 264cfc3d .. 6ba1f8de

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.262=0.002
σ0.054-0.053=0.000
min35.238-35.237=0.001
max35.415-35.412=0.002
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.085-0.083=0.003
σ0.003-0.005=-0.001
min0.083-0.076=0.007
max0.092-0.090=0.002
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=0.001
σ0.003-0.003=-0.000
min23.766-23.764=0.002
max23.775-23.774=0.000
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.069-0.066=0.002
σ0.003-0.004=-0.001
min0.066-0.061=0.006
max0.075-0.071=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.485=0.000
σ0.366-0.365=0.000
min1755.912-1755.908=0.004
max1757.076-1757.072=0.004
mean1643.100-1648.550=-5.450
σ626.347-627.826=-1.479
min628.000-676.000=-48.000
max2827.000-2826.000=1.000
mean2.370-2.368=0.001
σ0.085-0.077=0.008
min2.233-2.281=-0.048
max2.583-2.569=0.014

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.710-324.710=0.000
σ0.045-0.043=0.002
min324.631-324.633=-0.003
max324.738-324.734=0.004
mean2827.000-2826.000=1.000
σ0.000
min2827.000-2826.000=1.000
max2827.000-2826.000=1.000
mean0.421-0.423=-0.002
σ0.001-0.001=-0.000
min0.420-0.421=-0.001
max0.423-0.425=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1985.252-1985.266=-0.014
σ0.016-0.015=0.001
min1985.231-1985.242=-0.011
max1985.268-1985.278=-0.010
mean2827.000-2826.000=1.000
σ0.000
min2827.000-2826.000=1.000
max2827.000-2826.000=1.000
mean2.651-2.629=0.022
σ0.097-0.128=-0.031
min2.566-2.473=0.093
max2.775-2.749=0.025
iters=5
new-facts=6402
prior-facts=1
mean4808.896-4808.875=0.021
σ7.647-7.705=-0.058
min4805.418-4805.413=0.005
max4822.573-4822.658=-0.085
mean2827.000-2826.000=1.000
σ0.000
min2827.000-2826.000=1.000
max2827.000-2826.000=1.000
mean8.781-9.067=-0.286
σ0.425-0.147=0.278
min8.087-8.919=-0.832
max9.243-9.308=-0.065
iters=5
new-facts=6402
prior-facts=6402
mean4996.467-4996.466=0.002
σ0.015-0.012=0.003
min4996.445-4996.447=-0.001
max4996.482-4996.480=0.002
mean3057.000-3046.200=10.800
σ306.666-293.336=13.330
min2827.000-2826.000=1.000
max3531.000-3500.000=31.000
mean8.509-8.554=-0.045
σ0.121-0.161=-0.040
min8.391-8.433=-0.042
max8.708-8.790=-0.082

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.032-0.973=0.060
σ0.131-0.147=-0.016
min0.916-0.896=0.019
max1.237-1.234=0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.969-462.977=-0.008
σ574.254-574.254=0.000
min175.840-175.837=0.003
max1324.350-1324.358=-0.008
mean86.250
σ8.500
min82.000
max99.000
mean2827.000-2826.000=1.000
σ0.000
min2827.000-2826.000=1.000
max2827.000-2826.000=1.000
mean0.434-0.475=-0.040
σ0.299-0.378=-0.079
min0.284-0.281=0.003
max0.883-1.041=-0.158
policies=20
mean1758.711-1758.716=-0.005
σ0.343-0.347=-0.004
min1758.476-1758.474=0.002
max1759.219-1759.229=-0.010
mean820.000
σ0.000
min820.000
max820.000
mean2827.000-2826.000=1.000
σ0.000
min2827.000-2826.000=1.000
max2827.000-2826.000=1.000
mean2.765-2.782=-0.016
σ0.005-0.010=-0.005
min2.761-2.775=-0.014
max2.771-2.796=-0.025
policies=200
mean17593.171-17593.372=-0.201
σ0.716-0.660=0.057
min17592.189-17592.469=-0.280
max17593.833-17593.898=-0.065
mean8200.000
σ0.000
min8200.000
max8200.000
mean2827.000-2826.000=1.000
σ0.000
min2827.000-2826.000=1.000
max2827.000-2826.000=1.000
mean27.770-27.827=-0.057
σ0.335-0.352=-0.018
min27.448-27.456=-0.008
max28.147-28.220=-0.073