Compare commits

Home / Compare fccc0e44 .. e7ed1855

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-35.243=0.001
σ0.054-0.053=0.001
min35.218-35.216=0.003
max35.396-35.392=0.003
mean413.900-414.900=-1.000
σ0.316
min413.000-414.000=-1.000
max414.000-415.000=-1.000
mean0.085-0.085=0.000
σ0.003-0.004=-0.001
min0.083-0.080=0.003
max0.092-0.094=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.770-23.770=-0.000
σ0.004-0.004=0.000
min23.765-23.764=0.000
max23.775-23.775=0.001
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.068-0.067=0.001
σ0.004-0.005=-0.001
min0.062-0.062=0.000
max0.075-0.076=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.487-1756.485=0.002
σ0.365-0.366=-0.000
min1755.910-1755.911=-0.001
max1757.078-1757.074=0.005
mean1648.000-1655.550=-7.550
σ612.583-636.278=-23.696
min651.000-677.000=-26.000
max2473.000-2839.000=-366.000
mean2.311-2.352=-0.041
σ0.094-0.096=-0.002
min2.049-2.231=-0.182
max2.448-2.545=-0.097

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.682-324.703=-0.022
σ0.043-0.040=0.003
min324.605-324.633=-0.027
max324.711-324.730=-0.019
mean2473.000-2839.000=-366.000
σ0.000
min2473.000-2839.000=-366.000
max2473.000-2839.000=-366.000
mean0.428-0.421=0.007
σ0.007-0.000=0.007
min0.423-0.421=0.002
max0.441-0.422=0.019
iters=5
new-facts=1
prior-facts=6402
mean1985.262-1985.269=-0.007
σ0.018-0.007=0.012
min1985.240-1985.263=-0.023
max1985.278-1985.279=-0.001
mean2473.000-2839.000=-366.000
σ0.000
min2473.000-2839.000=-366.000
max2473.000-2839.000=-366.000
mean2.567-2.609=-0.042
σ0.113-0.057=0.056
min2.391-2.551=-0.160
max2.704-2.678=0.026
iters=5
new-facts=6402
prior-facts=1
mean4808.877-4808.744=0.133
σ7.706-7.746=-0.040
min4805.327-4804.826=0.501
max4822.662-4822.593=0.069
mean2473.000-2839.000=-366.000
σ0.000
min2473.000-2839.000=-366.000
max2473.000-2839.000=-366.000
mean9.092-8.901=0.191
σ0.277-0.129=0.147
min8.695-8.804=-0.109
max9.464-9.096=0.368
iters=5
new-facts=6402
prior-facts=6402
mean4996.472-4996.465=0.007
σ0.014-0.018=-0.004
min4996.455-4996.444=0.011
max4996.486-4996.489=-0.003
mean2978.200-3062.800=-84.600
σ288.881-225.053=63.828
min2584.000-2839.000=-255.000
max3327.000-3399.000=-72.000
mean8.773-8.716=0.057
σ0.389-0.182=0.207
min8.489-8.481=0.007
max9.423-8.967=0.456

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.678-0.947=0.731
σ0.221-0.052=0.170
min1.292-0.914=0.378
max1.832-1.037=0.795

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.947-462.967=-0.020
σ574.246-574.249=-0.003
min175.819-175.840=-0.021
max1324.316-1324.341=-0.025
mean86.250
σ8.500
min82.000
max99.000
mean2473.000-2839.000=-366.000
σ0.000
min2473.000-2839.000=-366.000
max2473.000-2839.000=-366.000
mean0.555-0.462=0.093
σ0.564-0.360=0.204
min0.271-0.281=-0.009
max1.401-1.003=0.398
policies=20
mean1758.523-1758.722=-0.198
σ0.339-0.340=-0.001
min1758.298-1758.496=-0.198
max1759.025-1759.226=-0.201
mean820.000
σ0.000
min820.000
max820.000
mean2473.000-2839.000=-366.000
σ0.000
min2473.000-2839.000=-366.000
max2473.000-2839.000=-366.000
mean2.714-2.789=-0.075
σ0.007-0.010=-0.003
min2.706-2.779=-0.073
max2.722-2.800=-0.078
policies=200
mean17592.439-17593.302=-0.864
σ0.504-0.670=-0.166
min17592.148-17592.449=-0.301
max17593.193-17593.869=-0.676
mean8200.000
σ0.000
min8200.000
max8200.000
mean2473.000-2839.000=-366.000
σ0.000
min2473.000-2839.000=-366.000
max2473.000-2839.000=-366.000
mean27.404-27.868=-0.464
σ0.134-0.284=-0.151
min27.249-27.569=-0.320
max27.519-28.184=-0.665