Compare commits

Home / Compare 99bbcc2f .. bc983278

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.993-35.990=0.002
σ0.102-0.100=0.002
min35.946-35.945=0.001
max36.283-36.274=0.009
mean3999.000-3790.000=209.000
σ0.000
min3999.000-3790.000=209.000
max3999.000-3790.000=209.000
mean0.076-0.076=0.001
σ0.001-0.002=-0.002
min0.075-0.074=0.001
max0.078-0.082=-0.004
cache=y
dps=1
iters=10
policies=100
mean26.215-26.212=0.003
σ0.002-0.004=-0.002
min26.212-26.205=0.007
max26.217-26.217=0.000
mean3999.000-3790.000=209.000
σ0.000
min3999.000-3790.000=209.000
max3999.000-3790.000=209.000
mean0.060-0.059=0.001
σ0.001-0.002=-0.002
min0.059-0.057=0.002
max0.062-0.065=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.367-1756.359=0.007
σ0.374-0.374=-0.001
min1755.791-1755.786=0.005
max1756.973-1756.953=0.021
mean1654.250-1656.500=-2.250
σ624.859-628.629=-3.770
min686.000-612.000=74.000
max2589.000-2672.000=-83.000
mean2.264-2.303=-0.039
σ0.122-0.147=-0.026
min2.102-2.157=-0.055
max2.523-2.744=-0.221

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.693-278.675=0.018
σ0.008-0.014=-0.006
min278.686-278.661=0.024
max278.706-278.697=0.009
mean2589.000-2672.000=-83.000
σ0.000
min2589.000-2672.000=-83.000
max2589.000-2672.000=-83.000
mean0.417-0.421=-0.004
σ0.001-0.001=0.000
min0.416-0.420=-0.004
max0.418-0.422=-0.004
iters=5
new-facts=1
prior-facts=6402
mean2268.861-2268.834=0.027
σ0.017-0.016=0.001
min2268.833-2268.815=0.018
max2268.877-2268.848=0.030
mean2589.000-2672.000=-83.000
σ0.000
min2589.000-2672.000=-83.000
max2589.000-2672.000=-83.000
mean2.980-3.187=-0.207
σ0.136-0.141=-0.006
min2.897-2.958=-0.060
max3.219-3.346=-0.127
iters=5
new-facts=6402
prior-facts=1
mean4952.062-4952.055=0.007
σ0.976-0.874=0.102
min4951.133-4951.263=-0.130
max4953.725-4953.554=0.171
mean2589.000-2672.000=-83.000
σ0.000
min2589.000-2672.000=-83.000
max2589.000-2672.000=-83.000
mean7.937-7.934=0.003
σ0.320-0.245=0.076
min7.674-7.676=-0.003
max8.427-8.296=0.132
iters=5
new-facts=6402
prior-facts=6402
mean5166.915-5166.894=0.021
σ0.013-0.012=0.001
min5166.903-5166.876=0.027
max5166.936-5166.908=0.028
mean3343.800-3360.400=-16.600
σ468.509-426.556=41.953
min2775.000-2937.000=-162.000
max3999.000-3790.000=209.000
mean9.453-9.065=0.388
σ0.251-0.350=-0.099
min9.208-8.656=0.552
max9.807-9.525=0.282

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.093-1.579=-0.486
σ0.110-0.287=-0.177
min0.956-1.246=-0.290
max1.263-1.811=-0.548

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.258-460.255=0.004
σ572.607-572.608=-0.001
min173.954-173.949=0.005
max1319.169-1319.167=0.002
mean79.500
σ7.000
min76.000
max90.000
mean437.000
σ0.000
min437.000
max437.000
mean0.562-0.566=-0.004
σ0.563-0.581=-0.018
min0.274-0.273=0.001
max1.407-1.437=-0.030
policies=20
mean1740.039-1740.016=0.023
σ0.329-0.336=-0.006
min1739.803-1739.774=0.029
max1740.522-1740.508=0.014
mean760.000
σ0.000
min760.000
max760.000
mean447.000-448.250=-1.250
σ9.381-10.308=-0.927
min437.000
max455.000-457.000=-2.000
mean2.662-2.676=-0.015
σ0.013-0.016=-0.004
min2.650-2.658=-0.009
max2.678-2.697=-0.019
policies=200
mean17409.808-17409.307=0.500
σ0.134-0.105=0.029
min17409.642-17409.186=0.457
max17409.968-17409.432=0.537
mean7600.000
σ0.000
min7600.000
max7600.000
mean491.750-491.250=0.500
σ2.754-1.708=1.046
min489.000
max495.000-493.000=2.000
mean26.844-26.995=-0.151
σ0.100-0.098=0.003
min26.751-26.885=-0.134
max26.951-27.114=-0.163