Compare commits

Home / Compare 9b0394f5 .. ba821809

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.792-35.792=-0.000
σ0.107-0.108=-0.001
min35.744-35.741=0.002
max36.095-36.098=-0.003
mean412.800-415.000=-2.200
σ0.632-0.000=0.632
min411.000-415.000=-4.000
max413.000-415.000=-2.000
mean0.076-0.075=0.001
σ0.003-0.005=-0.002
min0.074-0.070=0.004
max0.081-0.083=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.065-26.064=0.001
σ0.004-0.004=0.000
min26.058-26.058=0.000
max26.070-26.069=0.001
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.061-0.060=0.001
σ0.002-0.003=-0.001
min0.060-0.056=0.004
max0.066-0.067=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.886-1714.957=37.929
σ0.364-169.698=-169.334
min1752.317-993.993=758.323
max1753.481-1753.452=0.029
mean1663.200-1612.150=51.050
σ622.655-611.586=11.069
min666.000
max2650.000-2626.000=24.000
mean2.729-2.758=-0.029
σ0.204-0.352=-0.148
min2.285-1.454=0.831
max3.041-3.092=-0.052

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.194-277.194=-0.000
σ0.006-0.008=-0.002
min277.188-277.186=0.001
max277.201-277.205=-0.004
mean2650.000-2626.000=24.000
σ0.000
min2650.000-2626.000=24.000
max2650.000-2626.000=24.000
mean0.404-0.406=-0.002
σ0.001-0.010=-0.009
min0.403-0.399=0.004
max0.406-0.424=-0.018
iters=5
new-facts=1
prior-facts=6402
mean2169.675-2169.680=-0.005
σ0.043-0.029=0.015
min2169.598-2169.630=-0.032
max2169.702-2169.699=0.003
mean2650.000-2626.000=24.000
σ0.000
min2650.000-2626.000=24.000
max2650.000-2626.000=24.000
mean2.999-2.855=0.145
σ0.166-0.163=0.003
min2.781-2.769=0.012
max3.158-3.146=0.012
iters=5
new-facts=6402
prior-facts=1
mean5049.563-5049.446=0.117
σ1.010-1.109=-0.099
min5049.014-5048.437=0.577
max5051.362-5051.350=0.011
mean2650.000-2626.000=24.000
σ0.000
min2650.000-2626.000=24.000
max2650.000-2626.000=24.000
mean9.032-8.908=0.124
σ0.610-0.605=0.005
min8.135-7.988=0.148
max9.790-9.599=0.192
iters=5
new-facts=6402
prior-facts=6402
mean5180.595-5180.653=-0.058
σ0.120-0.088=0.032
min5180.417-5180.582=-0.165
max5180.754-5180.752=0.001
mean3272.600-3220.200=52.400
σ435.636-470.337=-34.701
min2669.000-2637.000=32.000
max3676.000-3819.000=-143.000
mean9.077-8.722=0.355
σ0.419-0.114=0.305
min8.813-8.559=0.254
max9.820-8.867=0.953

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.289-1.164=0.125
σ0.376-0.249=0.127
min0.947-0.942=0.005
max1.802-1.466=0.336

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.857-464.862=-0.005
σ572.654-572.669=-0.015
min178.528-178.523=0.004
max1323.839-1323.866=-0.028
mean79.500
σ7.000
min76.000
max90.000
mean2650.000-2626.000=24.000
σ0.000
min2650.000-2626.000=24.000
max2650.000-2626.000=24.000
mean0.525-0.561=-0.036
σ0.482-0.556=-0.074
min0.280-0.282=-0.002
max1.248-1.395=-0.147
policies=20
mean1785.477-1785.480=-0.003
σ0.341-0.345=-0.004
min1785.254-1785.254=-0.000
max1785.984-1785.994=-0.009
mean760.000
σ0.000
min760.000
max760.000
mean2650.000-2626.000=24.000
σ0.000
min2650.000-2626.000=24.000
max2650.000-2626.000=24.000
mean2.795-2.779=0.016
σ0.036-0.019=0.018
min2.757-2.754=0.002
max2.844-2.800=0.044
policies=200
mean17861.542-17861.504=0.038
σ0.489-0.423=0.066
min17861.293-17861.262=0.031
max17862.276-17862.137=0.139
mean7600.000
σ0.000
min7600.000
max7600.000
mean2650.000-2626.000=24.000
σ0.000
min2650.000-2626.000=24.000
max2650.000-2626.000=24.000
mean28.276-28.107=0.169
σ0.162-0.231=-0.068
min28.084-27.853=0.231
max28.419-28.336=0.083