Compare commits

Home / Compare 0aa75d9f .. 036a5b2e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.798-35.799=-0.001
σ0.107-0.107=-0.000
min35.753-35.751=0.002
max36.103-36.104=-0.001
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.076-0.076=0.000
σ0.003-0.004=-0.000
min0.073-0.074=-0.000
max0.084-0.084=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.065-26.064=0.001
σ0.004-0.002=0.003
min26.059-26.062=-0.002
max26.072-26.067=0.005
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.061-0.061=-0.000
σ0.002-0.003=-0.000
min0.059-0.059=0.000
max0.068-0.069=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.923-1755.923=0.000
σ0.367-0.368=-0.001
min1755.351-1755.351=-0.001
max1756.519-1756.514=0.005
mean1660.700-1669.750=-9.050
σ628.359-634.755=-6.396
min673.000-669.000=4.000
max2660.000-2632.000=28.000
mean2.784-2.823=-0.039
σ0.192-0.152=0.040
min2.286-2.446=-0.160
max3.079-3.074=0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.199-277.193=0.006
σ0.006-0.005=0.002
min277.192-277.189=0.003
max277.207-277.200=0.007
mean2660.000-2632.000=28.000
σ0.000
min2660.000-2632.000=28.000
max2660.000-2632.000=28.000
mean0.416-0.396=0.020
σ0.013-0.009=0.004
min0.402-0.391=0.011
max0.432-0.411=0.021
iters=5
new-facts=1
prior-facts=6402
mean2174.437-2174.445=-0.008
σ0.023-0.022=0.001
min2174.418-2174.421=-0.003
max2174.477-2174.471=0.005
mean2660.000-2632.000=28.000
σ0.000
min2660.000-2632.000=28.000
max2660.000-2632.000=28.000
mean2.950-2.931=0.019
σ0.143-0.125=0.018
min2.785-2.779=0.006
max3.093-3.105=-0.012
iters=5
new-facts=6402
prior-facts=1
mean5052.471-5052.479=-0.008
σ1.076-1.077=-0.001
min5051.681-5051.514=0.167
max5054.359-5054.334=0.024
mean2660.000-2632.000=28.000
σ0.000
min2660.000-2632.000=28.000
max2660.000-2632.000=28.000
mean9.029-8.802=0.226
σ0.606-0.557=0.048
min7.991-8.125=-0.134
max9.522-9.451=0.071
iters=5
new-facts=6402
prior-facts=6402
mean5188.431-5188.333=0.098
σ0.087-0.131=-0.044
min5188.353-5188.180=0.174
max5188.528-5188.516=0.012
mean3232.200-3293.000=-60.800
σ371.091-417.447=-46.356
min2709.000
max3687.000-3679.000=8.000
mean9.105-8.986=0.118
σ0.729-0.409=0.320
min8.693-8.676=0.017
max10.399-9.704=0.696

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.162-1.317=-0.156
σ0.195-0.393=-0.197
min0.948-0.947=0.001
max1.450-1.820=-0.370

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.857-464.855=0.002
σ572.663-572.660=0.003
min178.523-178.521=0.002
max1323.852-1323.845=0.006
mean79.500
σ7.000
min76.000
max90.000
mean2660.000-2632.000=28.000
σ0.000
min2660.000-2632.000=28.000
max2660.000-2632.000=28.000
mean0.567-0.557=0.010
σ0.556-0.543=0.013
min0.283-0.280=0.003
max1.401-1.371=0.029
policies=20
mean1785.465-1785.484=-0.020
σ0.345-0.352=-0.007
min1785.236-1785.257=-0.021
max1785.977-1786.008=-0.031
mean760.000
σ0.000
min760.000
max760.000
mean2660.000-2632.000=28.000
σ0.000
min2660.000-2632.000=28.000
max2660.000-2632.000=28.000
mean2.798-2.783=0.015
σ0.015-0.017=-0.001
min2.780-2.759=0.021
max2.811-2.794=0.016
policies=200
mean17861.530-17861.485=0.046
σ0.554-0.404=0.149
min17861.150-17861.245=-0.094
max17862.353-17862.090=0.263
mean7600.000
σ0.000
min7600.000
max7600.000
mean2660.000-2632.000=28.000
σ0.000
min2660.000-2632.000=28.000
max2660.000-2632.000=28.000
mean28.167-28.220=-0.054
σ0.071-0.137=-0.066
min28.076-28.095=-0.019
max28.236-28.352=-0.116