Compare commits

Home / Compare 64ee7c46 .. 09791b3e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.618=-0.001
σ0.055-0.054=0.001
min35.587-35.589=-0.003
max35.772-35.769=0.003
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.086-0.083=0.003
σ0.003-0.005=-0.002
min0.083-0.077=0.005
max0.092-0.091=0.001
cache=y
dps=1
iters=10
policies=100
mean24.046-24.047=-0.001
σ0.003-0.003=0.000
min24.041-24.042=-0.001
max24.054-24.053=0.002
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.062-0.067=-0.004
σ0.002-0.004=-0.002
min0.061-0.062=-0.001
max0.069-0.075=-0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1756.490=-0.000
σ0.364-0.365=-0.001
min1755.916-1755.917=-0.001
max1757.082-1757.077=0.005
mean1648.300-1649.950=-1.650
σ633.250-645.032=-11.782
min621.000-650.000=-29.000
max2832.000-2837.000=-5.000
mean2.333-2.363=-0.030
σ0.073-0.100=-0.027
min2.256-2.251=0.005
max2.511-2.667=-0.156

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.761-324.760=0.001
σ0.055-0.057=-0.001
min324.662-324.660=0.002
max324.791-324.797=-0.006
mean2832.000-2837.000=-5.000
σ0.000
min2832.000-2837.000=-5.000
max2832.000-2837.000=-5.000
mean0.426-0.426=-0.000
σ0.008-0.007=0.001
min0.421-0.422=-0.001
max0.440-0.439=0.001
iters=5
new-facts=1
prior-facts=6402
mean1985.289-1985.330=-0.041
σ0.078-0.007=0.071
min1985.152-1985.322=-0.170
max1985.338-1985.338=0.000
mean2832.000-2837.000=-5.000
σ0.000
min2832.000-2837.000=-5.000
max2832.000-2837.000=-5.000
mean2.565-2.559=0.006
σ0.096-0.111=-0.015
min2.441-2.428=0.012
max2.682-2.685=-0.002
iters=5
new-facts=6402
prior-facts=1
mean4809.085-4809.093=-0.009
σ7.717-7.713=0.004
min4805.613-4805.594=0.019
max4822.890-4822.890=-0.001
mean2832.000-2837.000=-5.000
σ0.000
min2832.000-2837.000=-5.000
max2832.000-2837.000=-5.000
mean9.008-9.051=-0.043
σ0.148-0.281=-0.133
min8.861-8.798=0.064
max9.249-9.477=-0.228
iters=5
new-facts=6402
prior-facts=6402
mean4996.629-4996.488=0.141
σ0.026-0.183=-0.158
min4996.601-4996.280=0.321
max4996.658-4996.643=0.014
mean3049.400-3062.200=-12.800
σ289.074-218.149=70.925
min2832.000-2837.000=-5.000
max3503.000-3385.000=118.000
mean8.511-8.681=-0.170
σ0.093-0.226=-0.133
min8.414-8.464=-0.050
max8.665-9.032=-0.367

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.075-0.915=0.160
σ0.227-0.014=0.213
min0.912-0.904=0.008
max1.464-0.938=0.527

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.209-463.213=-0.004
σ574.774-574.776=-0.003
min175.818-175.818=-0.000
max1325.370-1325.378=-0.008
mean86.250
σ8.500
min82.000
max99.000
mean2832.000-2837.000=-5.000
σ0.000
min2832.000-2837.000=-5.000
max2832.000-2837.000=-5.000
mean0.434-0.418=0.017
σ0.300-0.287=0.012
min0.279-0.264=0.015
max0.884-0.849=0.035
policies=20
mean1758.500-1758.545=-0.045
σ0.348-0.355=-0.007
min1758.263-1758.331=-0.068
max1759.016-1759.075=-0.059
mean820.000
σ0.000
min820.000
max820.000
mean2832.000-2837.000=-5.000
σ0.000
min2832.000-2837.000=-5.000
max2832.000-2837.000=-5.000
mean2.789-2.790=-0.001
σ0.012-0.013=-0.001
min2.779-2.773=0.006
max2.804-2.803=0.001
policies=200
mean17592.101-17592.203=-0.102
σ0.411-0.482=-0.071
min17591.727-17591.833=-0.106
max17592.674-17592.911=-0.236
mean8200.000
σ0.000
min8200.000
max8200.000
mean2832.000-2837.000=-5.000
σ0.000
min2832.000-2837.000=-5.000
max2832.000-2837.000=-5.000
mean27.860-27.911=-0.051
σ0.377-0.331=0.046
min27.487-27.627=-0.140
max28.291-28.299=-0.009