Compare commits

Home / Compare ed120f09 .. af52a44c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.701
σ0.664
min35.925
max37.523
mean3941.000
σ0.000
min3941.000
max3941.000
mean0.076
σ0.002
min0.074
max0.080
cache=y
dps=1
iters=10
policies=100
mean26.585
σ0.603
min26.206
max27.464
mean3941.000
σ0.000
min3941.000
max3941.000
mean0.057
σ0.001
min0.056
max0.058

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.357-1755.328=1.028
σ0.371-0.367=0.004
min1755.784-1754.753=1.031
max1756.948-1755.920=1.028
mean1667.050-1641.250=25.800
σ646.269-615.814=30.455
min629.000-616.000=13.000
max2858.000-2628.000=230.000
mean2.268-2.294=-0.026
σ0.151-0.199=-0.047
min2.083-2.156=-0.073
max2.817-3.048=-0.231

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.670-277.718=0.952
σ0.012-0.012=-0.000
min278.661-277.700=0.961
max278.690-277.732=0.958
mean2858.000-2628.000=230.000
σ0.000
min2858.000-2628.000=230.000
max2858.000-2628.000=230.000
mean0.417-0.410=0.008
σ0.001-0.001=0.000
min0.416-0.409=0.007
max0.418-0.410=0.008
iters=5
new-facts=1
prior-facts=6402
mean2268.847-2267.883=0.964
σ0.006-0.007=-0.001
min2268.841-2267.871=0.970
max2268.856-2267.889=0.967
mean2858.000-2628.000=230.000
σ0.000
min2858.000-2628.000=230.000
max2858.000-2628.000=230.000
mean3.005-2.964=0.042
σ0.119-0.141=-0.021
min2.911-2.775=0.137
max3.166-3.141=0.025
iters=5
new-facts=6402
prior-facts=1
mean4952.121-4954.963=-2.842
σ0.234-0.899=-0.665
min4951.960-4954.214=-2.255
max4952.531-4956.528=-3.997
mean2858.000-2628.000=230.000
σ0.000
min2858.000-2628.000=230.000
max2858.000-2628.000=230.000
mean7.737-7.857=-0.120
σ0.151-0.197=-0.046
min7.608-7.716=-0.108
max7.924-8.202=-0.278
iters=5
new-facts=6402
prior-facts=6402
mean5167.048-5169.648=-2.600
σ0.012-0.282=-0.270
min5167.030-5169.337=-2.307
max5167.063-5169.866=-2.803
mean3391.600-3413.200=-21.600
σ412.736-454.540=-41.804
min2858.000-2821.000=37.000
max3941.000-4049.000=-108.000
mean9.347-9.295=0.052
σ0.249-0.347=-0.098
min9.057-8.974=0.083
max9.671-9.870=-0.199

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.028-1.089=-0.061
σ0.140-0.239=-0.100
min0.935-0.950=-0.016
max1.255-1.503=-0.249

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.253-456.325=3.928
σ572.607-572.607=-0.000
min173.947-170.020=3.927
max1319.164-1315.236=3.928
mean79.500
σ7.000
min76.000
max90.000
mean437.000-432.500=4.500
σ0.000-0.577=-0.577
min437.000-432.000=5.000
max437.000-433.000=4.000
mean0.571-0.536=0.035
σ0.589-0.541=0.048
min0.273-0.258=0.015
max1.455-1.347=0.107
policies=20
mean1740.001-1700.729=39.272
σ0.322-0.305=0.017
min1739.768-1700.501=39.267
max1740.472-1701.173=39.299
mean760.000
σ0.000
min760.000
max760.000
mean447.000-442.000=5.000
σ9.381-10.392=-1.011
min437.000-433.000=4.000
max455.000-457.000=-2.000
mean2.660-2.621=0.039
σ0.012-0.027=-0.015
min2.645-2.588=0.057
max2.671-2.653=0.018
policies=200
mean17409.188-17016.734=392.455
σ0.054-0.070=-0.015
min17409.132-17016.632=392.500
max17409.259-17016.789=392.470
mean7600.000
σ0.000
min7600.000
max7600.000
mean491.250-491.750=-0.500
σ2.754-2.217=0.536
min488.000-489.000=-1.000
max494.000
mean26.786-26.522=0.264
σ0.109-0.098=0.011
min26.665-26.382=0.282
max26.918-26.603=0.315