Compare commits

Home / Compare 9008dfb4 .. b3ed4379

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.798-35.799=-0.001
σ0.107-0.106=0.001
min35.749-35.750=-0.001
max36.101-36.099=0.002
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.074-0.077=-0.003
σ0.005-0.004=0.001
min0.068-0.075=-0.006
max0.083-0.084=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.065-26.065=0.000
σ0.002-0.003=-0.002
min26.062-26.060=0.001
max26.067-26.069=-0.002
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.061-0.062=-0.001
σ0.002-0.002=0.000
min0.059-0.060=-0.001
max0.068-0.068=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.922-1755.923=-0.002
σ0.367-0.368=-0.001
min1755.352-1755.352=-0.000
max1756.516-1756.513=0.004
mean1669.550-1645.050=24.500
σ627.745-623.021=4.724
min677.000-611.000=66.000
max2667.000-2650.000=17.000
mean2.804-2.850=-0.046
σ0.128-0.182=-0.054
min2.535-2.303=0.233
max2.972-3.141=-0.169

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.194-277.195=-0.001
σ0.005-0.005=-0.001
min277.188-277.188=0.000
max277.199-277.202=-0.003
mean2667.000-2650.000=17.000
σ0.000
min2667.000-2650.000=17.000
max2667.000-2650.000=17.000
mean0.395-0.397=-0.002
σ0.004-0.008=-0.004
min0.392-0.392=-0.000
max0.402-0.411=-0.009
iters=5
new-facts=1
prior-facts=6402
mean2174.435-2174.430=0.005
σ0.021-0.005=0.015
min2174.406-2174.425=-0.018
max2174.464-2174.436=0.028
mean2667.000-2650.000=17.000
σ0.000
min2667.000-2650.000=17.000
max2667.000-2650.000=17.000
mean2.825-3.055=-0.230
σ0.137-0.146=-0.009
min2.746-2.809=-0.064
max3.068-3.199=-0.131
iters=5
new-facts=6402
prior-facts=1
mean5052.660-5052.638=0.022
σ1.025-0.962=0.064
min5051.998-5052.036=-0.038
max5054.478-5054.344=0.134
mean2667.000-2650.000=17.000
σ0.000
min2667.000-2650.000=17.000
max2667.000-2650.000=17.000
mean8.823-8.698=0.126
σ1.015-0.476=0.539
min8.029-8.257=-0.228
max10.468-9.409=1.059
iters=5
new-facts=6402
prior-facts=6402
mean5188.352-5188.420=-0.068
σ0.211-0.091=0.120
min5188.002-5188.349=-0.347
max5188.527-5188.521=0.006
mean3276.200-3233.000=43.200
σ482.314-385.841=96.473
min2667.000-2696.000=-29.000
max3858.000-3720.000=138.000
mean8.937-8.992=-0.055
σ0.429-0.407=0.022
min8.652-8.725=-0.074
max9.675-9.701=-0.026

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.243-1.204=0.039
σ0.372-0.294=0.078
min0.941-0.950=-0.009
max1.878-1.702=0.177

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.855-464.854=0.001
σ572.657-572.657=-0.000
min178.521-178.523=-0.002
max1323.841-1323.840=0.001
mean79.500
σ7.000
min76.000
max90.000
mean2667.000-2650.000=17.000
σ0.000
min2667.000-2650.000=17.000
max2667.000-2650.000=17.000
mean0.546-0.583=-0.037
σ0.514-0.587=-0.074
min0.279-0.283=-0.003
max1.316-1.464=-0.148
policies=20
mean1785.465-1785.488=-0.022
σ0.349-0.343=0.006
min1785.230-1785.260=-0.029
max1785.983-1785.997=-0.013
mean760.000
σ0.000
min760.000
max760.000
mean2667.000-2650.000=17.000
σ0.000
min2667.000-2650.000=17.000
max2667.000-2650.000=17.000
mean2.785-2.792=-0.007
σ0.022-0.012=0.010
min2.763-2.780=-0.017
max2.815-2.806=0.008
policies=200
mean17861.512-17861.546=-0.034
σ0.550-0.455=0.095
min17861.098-17861.268=-0.169
max17862.322-17862.224=0.097
mean7600.000
σ0.000
min7600.000
max7600.000
mean2667.000-2650.000=17.000
σ0.000
min2667.000-2650.000=17.000
max2667.000-2650.000=17.000
mean28.261-28.287=-0.026
σ0.102-0.149=-0.047
min28.127-28.127=0.000
max28.352-28.427=-0.075