Compare commits

Home / Compare f9a58277 .. 4f2f4c4d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.798-35.799=-0.001
σ0.107-0.106=0.001
min35.750-35.756=-0.006
max36.103-36.101=0.002
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.074-0.075=-0.001
σ0.004-0.003=0.001
min0.069-0.073=-0.004
max0.081-0.081=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.064-26.066=-0.002
σ0.004-0.003=0.001
min26.061-26.060=0.001
max26.073-26.071=0.003
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.060-0.061=-0.000
σ0.003-0.003=0.000
min0.056-0.059=-0.003
max0.068-0.069=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.923-1755.924=-0.000
σ0.367-0.366=0.001
min1755.350-1755.352=-0.002
max1756.513-1756.507=0.005
mean1663.200-1646.800=16.400
σ635.935-624.780=11.155
min672.000-610.000=62.000
max2709.000-2655.000=54.000
mean2.759-2.776=-0.018
σ0.166-0.265=-0.099
min2.316-2.275=0.041
max2.934-3.120=-0.185

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.197-277.195=0.002
σ0.004-0.006=-0.002
min277.192-277.187=0.005
max277.202-277.201=0.001
mean2709.000-2655.000=54.000
σ0.000
min2709.000-2655.000=54.000
max2709.000-2655.000=54.000
mean0.406-0.405=0.000
σ0.007-0.006=0.001
min0.402-0.401=0.001
max0.418-0.416=0.002
iters=5
new-facts=1
prior-facts=6402
mean2174.427-2174.425=0.002
σ0.021-0.015=0.006
min2174.391-2174.401=-0.010
max2174.446-2174.439=0.007
mean2709.000-2655.000=54.000
σ0.000
min2709.000-2655.000=54.000
max2709.000-2655.000=54.000
mean2.981-2.806=0.175
σ0.175-0.154=0.021
min2.776-2.719=0.057
max3.168-3.081=0.087
iters=5
new-facts=6402
prior-facts=1
mean5052.271-5052.531=-0.260
σ1.277-1.080=0.198
min5051.037-5051.633=-0.596
max5054.377-5054.395=-0.018
mean2709.000-2655.000=54.000
σ0.000
min2709.000-2655.000=54.000
max2709.000-2655.000=54.000
mean9.349-8.663=0.686
σ0.291-0.743=-0.452
min8.861-7.976=0.885
max9.598-9.684=-0.085
iters=5
new-facts=6402
prior-facts=6402
mean5188.213-5188.272=-0.059
σ0.382-0.378=0.003
min5187.643-5187.610=0.032
max5188.527-5188.524=0.003
mean3252.000-3217.400=34.600
σ345.453-489.429=-143.975
min2774.000-2655.000=119.000
max3650.000-3882.000=-232.000
mean9.022-8.820=0.201
σ0.414-0.246=0.168
min8.648-8.613=0.035
max9.611-9.147=0.464

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.237-1.162=0.076
σ0.347-0.342=0.005
min0.949-0.942=0.007
max1.828-1.728=0.099

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.856-464.860=-0.004
σ572.656-572.668=-0.012
min178.523-178.524=-0.001
max1323.841-1323.862=-0.021
mean79.500
σ7.000
min76.000
max90.000
mean2709.000-2655.000=54.000
σ0.000
min2709.000-2655.000=54.000
max2709.000-2655.000=54.000
mean0.560-0.574=-0.014
σ0.547-0.568=-0.021
min0.277-0.278=-0.000
max1.380-1.426=-0.046
policies=20
mean1785.485-1785.484=0.000
σ0.347-0.345=0.002
min1785.242-1785.259=-0.018
max1785.997
mean760.000
σ0.000
min760.000
max760.000
mean2709.000-2655.000=54.000
σ0.000
min2709.000-2655.000=54.000
max2709.000-2655.000=54.000
mean2.799-2.782=0.017
σ0.004-0.009=-0.005
min2.793-2.773=0.019
max2.803-2.795=0.008
policies=200
mean17861.557-17861.431=0.127
σ0.522-0.439=0.083
min17861.251-17861.075=0.176
max17862.339-17862.070=0.269
mean7600.000
σ0.000
min7600.000
max7600.000
mean2709.000-2655.000=54.000
σ0.000
min2709.000-2655.000=54.000
max2709.000-2655.000=54.000
mean28.169-28.117=0.051
σ0.157-0.120=0.038
min28.023-27.967=0.056
max28.340-28.247=0.093