Compare commits

Home / Compare 861d634d .. 38479f88

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.328-1753.252=2.076
σ0.368-0.365=0.003
min1754.758-1752.676=2.081
max1755.929-1753.842=2.087
mean1659.200-1658.700=0.500
σ623.139-621.902=1.237
min675.000-682.000=-7.000
max2742.000-2658.000=84.000
mean2.281-2.750=-0.469
σ0.103-0.092=0.011
min2.167-2.539=-0.371
max2.527-2.931=-0.404

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.725-274.420=3.305
σ0.023-0.011=0.012
min277.703-274.404=3.299
max277.764-274.430=3.334
mean2742.000-2658.000=84.000
σ0.000
min2742.000-2658.000=84.000
max2742.000-2658.000=84.000
mean0.411-0.405=0.005
σ0.001-0.001=0.000
min0.409-0.404=0.005
max0.413-0.407=0.006
iters=5
new-facts=1
prior-facts=6402
mean2267.876-2264.670=3.205
σ0.017-0.009=0.008
min2267.847-2264.661=3.186
max2267.889-2264.684=3.205
mean2742.000-2658.000=84.000
σ0.000
min2742.000-2658.000=84.000
max2742.000-2658.000=84.000
mean3.151-2.884=0.268
σ0.128-0.119=0.009
min2.944-2.706=0.238
max3.270-3.032=0.238
iters=5
new-facts=6402
prior-facts=1
mean4954.942-4951.629=3.313
σ0.817-0.846=-0.028
min4954.164-4950.935=3.229
max4956.326-4953.087=3.239
mean2742.000-2658.000=84.000
σ0.000
min2742.000-2658.000=84.000
max2742.000-2658.000=84.000
mean7.768-7.995=-0.227
σ0.199-0.299=-0.100
min7.548-7.748=-0.200
max8.053-8.415=-0.362
iters=5
new-facts=6402
prior-facts=6402
mean5169.682-5166.395=3.288
σ0.136-0.199=-0.063
min5169.473-5166.069=3.404
max5169.855-5166.558=3.297
mean3372.600-3393.200=-20.600
σ406.252-447.850=-41.597
min2973.000-2794.000=179.000
max3785.000-3976.000=-191.000
mean9.223-9.244=-0.020
σ0.460-0.264=0.197
min8.437-9.011=-0.573
max9.624-9.653=-0.029

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.640-1.100=0.539
σ0.273-0.122=0.152
min1.330-0.954=0.376
max1.857-1.293=0.565

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean456.315-454.912=1.403
σ572.592-572.577=0.016
min170.017-168.620=1.397
max1315.204-1313.777=1.427
mean79.500
σ7.000
min76.000
max90.000
mean434.000-430.750=3.250
σ0.000-0.500=-0.500
min434.000-430.000=4.000
max434.000-431.000=3.000
mean0.538-0.575=-0.036
σ0.539-0.613=-0.074
min0.264-0.266=-0.002
max1.346-1.494=-0.147
policies=20
mean1700.718-1686.713=14.005
σ0.313-0.299=0.014
min1700.488-1686.496=13.993
max1701.176-1687.150=14.026
mean760.000
σ0.000
min760.000
max760.000
mean444.500-443.500=1.000
σ11.000-8.660=2.340
min434.000-436.000=-2.000
max460.000-451.000=9.000
mean2.633-2.617=0.017
σ0.026-0.027=-0.000
min2.610-2.595=0.015
max2.668-2.652=0.016
policies=200
mean17016.395-16876.542=139.853
σ0.078-0.086=-0.007
min17016.317-16876.418=139.899
max17016.504-16876.616=139.888
mean7600.000
σ0.000
min7600.000
max7600.000
mean491.500-490.500=1.000
σ3.109-2.646=0.463
min488.000
max495.000-494.000=1.000
mean26.438-26.254=0.184
σ0.046-0.022=0.024
min26.399-26.232=0.166
max26.501-26.281=0.220