Compare commits

Home / Compare 690cc10a .. b777f8fc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.565-70.566=-0.001
σ0.046-0.044=0.002
min70.538-70.539=-0.001
max70.693-70.687=0.006
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.152-0.162=-0.010
σ0.017-0.004=0.013
min0.108-0.157=-0.049
max0.165-0.168=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.289-21.287=0.002
σ0.003-0.002=0.001
min21.284-21.283=0.000
max21.294-21.291=0.003
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.066-0.065=0.001
σ0.004-0.002=0.002
min0.063-0.063=-0.000
max0.073-0.070=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.373-1715.452=37.922
σ0.364-169.562=-169.198
min1752.801-995.065=757.736
max1753.981-1753.953=0.029
mean1663.250-1657.700=5.550
σ637.194-628.824=8.370
min620.000-680.000=-60.000
max2807.000-2705.000=102.000
mean2.804-2.724=0.079
σ0.136-0.317=-0.181
min2.535-1.612=0.923
max3.130-2.993=0.137

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.756-271.755=0.001
σ0.007-0.008=-0.001
min271.750-271.745=0.005
max271.766-271.766=-0.000
mean2807.000-2705.000=102.000
σ0.000
min2807.000-2705.000=102.000
max2807.000-2705.000=102.000
mean0.384-0.387=-0.003
σ0.009-0.013=-0.004
min0.377-0.375=0.002
max0.399-0.403=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1932.179-1932.174=0.005
σ0.006-0.016=-0.010
min1932.172-1932.146=0.026
max1932.189-1932.184=0.005
mean2807.000-2705.000=102.000
σ0.000
min2807.000-2705.000=102.000
max2807.000-2705.000=102.000
mean2.973-2.978=-0.005
σ0.185-0.142=0.044
min2.664-2.736=-0.072
max3.154-3.113=0.042
iters=5
new-facts=6402
prior-facts=1
mean4752.893-4752.775=0.118
σ0.984-1.030=-0.046
min4752.389-4751.846=0.543
max4754.652-4754.545=0.107
mean2807.000-2705.000=102.000
σ0.000
min2807.000-2705.000=102.000
max2807.000-2705.000=102.000
mean8.965-8.736=0.229
σ0.440-0.221=0.219
min8.432-8.517=-0.085
max9.522-9.008=0.514
iters=5
new-facts=6402
prior-facts=6402
mean4943.377-4943.377=0.000
σ0.016-0.015=0.001
min4943.359-4943.359=0.001
max4943.394-4943.390=0.005
mean3009.600-2980.200=29.400
σ272.242-232.111=40.131
min2807.000-2705.000=102.000
max3425.000-3308.000=117.000
mean8.530-8.489=0.041
σ0.287-0.067=0.220
min8.266-8.405=-0.138
max8.877-8.558=0.319

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.024-1.048=-0.024
σ0.137-0.124=0.013
min0.930-0.938=-0.008
max1.244-1.241=0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.859-467.864=-0.006
σ575.942-575.938=0.004
min179.885-179.886=-0.001
max1331.772-1331.771=0.001
mean86.250
σ8.500
min82.000
max99.000
mean2807.000-2705.000=102.000
σ0.000
min2807.000-2705.000=102.000
max2807.000-2705.000=102.000
mean0.481-0.568=-0.086
σ0.398-0.567=-0.169
min0.279-0.280=-0.001
max1.078-1.418=-0.340
policies=20
mean1799.165-1799.153=0.012
σ0.369-0.366=0.004
min1798.902-1798.920=-0.018
max1799.712-1799.698=0.014
mean820.000
σ0.000
min820.000
max820.000
mean2807.000-2705.000=102.000
σ0.000
min2807.000-2705.000=102.000
max2807.000-2705.000=102.000
mean2.795-2.800=-0.005
σ0.030-0.007=0.023
min2.751-2.790=-0.040
max2.815-2.807=0.008
policies=200
mean17998.398-17998.385=0.013
σ0.455-0.565=-0.110
min17998.104-17997.991=0.113
max17999.073-17999.211=-0.138
mean8200.000
σ0.000
min8200.000
max8200.000
mean2807.000-2705.000=102.000
σ0.000
min2807.000-2705.000=102.000
max2807.000-2705.000=102.000
mean28.162-28.179=-0.017
σ0.061-0.083=-0.022
min28.093-28.099=-0.006
max28.216-28.293=-0.077