Compare commits

Home / Compare a8baec13 .. 10fc80c4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.720-36.692=0.028
σ0.801-0.593=0.208
min35.919-35.929=-0.010
max38.437-37.212=1.225
mean3992.000-4136.000=-144.000
σ0.000
min3992.000-4136.000=-144.000
max3992.000-4136.000=-144.000
mean0.075-0.076=-0.000
σ0.001-0.001=0.000
min0.074-0.075=-0.001
max0.076-0.077=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.712-26.712=0.000
σ0.644-0.644=-0.000
min26.210-26.209=0.001
max27.463-27.464=-0.001
mean3992.000-4136.000=-144.000
σ0.000
min3992.000-4136.000=-144.000
max3992.000-4136.000=-144.000
mean0.060-0.060=0.000
σ0.001-0.001=-0.000
min0.060-0.059=0.000
max0.061-0.061=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.366-1756.366=0.000
σ0.374-0.373=0.002
min1755.797-1755.794=0.003
max1756.965-1756.966=-0.001
mean1656.750-1649.800=6.950
σ630.043-625.248=4.795
min680.000-613.000=67.000
max2611.000-2651.000=-40.000
mean2.282-2.339=-0.057
σ0.151-0.241=-0.089
min2.148-2.136=0.012
max2.788-3.050=-0.262

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.696-278.699=-0.003
σ0.014-0.012=0.003
min278.684-278.687=-0.003
max278.719-278.715=0.004
mean2611.000-2651.000=-40.000
σ0.000
min2611.000-2651.000=-40.000
max2611.000-2651.000=-40.000
mean0.426-0.416=0.010
σ0.013-0.002=0.011
min0.416-0.413=0.003
max0.442-0.419=0.023
iters=5
new-facts=1
prior-facts=6402
mean2268.873-2268.864=0.009
σ0.005-0.006=-0.001
min2268.868-2268.853=0.015
max2268.881-2268.869=0.012
mean2611.000-2651.000=-40.000
σ0.000
min2611.000-2651.000=-40.000
max2611.000-2651.000=-40.000
mean2.948-3.054=-0.106
σ0.117-0.151=-0.034
min2.864-2.868=-0.005
max3.151-3.214=-0.063
iters=5
new-facts=6402
prior-facts=1
mean4952.363-4952.357=0.006
σ0.992-0.789=0.204
min4951.723-4951.949=-0.226
max4954.125-4953.767=0.359
mean2611.000-2651.000=-40.000
σ0.000
min2611.000-2651.000=-40.000
max2611.000-2651.000=-40.000
mean8.342-7.896=0.446
σ0.677-0.193=0.485
min7.810-7.714=0.096
max9.527-8.163=1.364
iters=5
new-facts=6402
prior-facts=6402
mean5167.074-5166.999=0.076
σ0.014-0.165=-0.151
min5167.066-5166.706=0.360
max5167.099-5167.096=0.003
mean3422.800-3422.600=0.200
σ454.531-478.771=-24.239
min2809.000-2877.000=-68.000
max3992.000-4136.000=-144.000
mean9.234-9.350=-0.116
σ0.255-0.480=-0.225
min8.985-8.517=0.468
max9.615-9.725=-0.109

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.064-1.027=0.037
σ0.122-0.131=-0.009
min0.951-0.936=0.014
max1.252-1.241=0.010

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.258-460.259=-0.001
σ572.607-572.607=-0.000
min173.953-173.954=-0.001
max1319.169-1319.170=-0.002
mean79.500
σ7.000
min76.000
max90.000
mean435.000
σ0.000
min435.000
max435.000
mean0.552-0.559=-0.007
σ0.560-0.570=-0.010
min0.267-0.267=-0.000
max1.392-1.414=-0.022
policies=20
mean1740.033-1740.048=-0.015
σ0.331-0.335=-0.004
min1739.793-1739.810=-0.017
max1740.519-1740.541=-0.022
mean760.000
σ0.000
min760.000
max760.000
mean445.000-446.250=-1.250
σ9.381-10.308=-0.927
min435.000
max453.000-455.000=-2.000
mean2.664-2.673=-0.009
σ0.012-0.015=-0.003
min2.647-2.661=-0.014
max2.675-2.693=-0.018
policies=200
mean17409.816-17409.790=0.025
σ0.105-0.081=0.024
min17409.659-17409.686=-0.027
max17409.878-17409.879=-0.001
mean7600.000
σ0.000
min7600.000
max7600.000
mean489.750-492.750=-3.000
σ2.754
min487.000-490.000=-3.000
max493.000-496.000=-3.000
mean26.978-26.869=0.109
σ0.173-0.097=0.076
min26.776-26.776=-0.000
max27.198-27.005=0.193