Compare commits

Home / Compare 5f3ee152 .. 16d07eaa

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.565-70.567=-0.001
σ0.044-0.044=0.001
min70.537-70.537=-0.000
max70.687-70.686=0.002
mean414.000
σ0.000
min414.000
max414.000
mean0.157-0.157=-0.000
σ0.006-0.005=0.001
min0.150-0.149=0.001
max0.167-0.163=0.004
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=-0.001
σ0.003-0.003=-0.000
min21.282-21.284=-0.002
max21.291-21.292=-0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.062-0.064=-0.003
σ0.003-0.002=0.002
min0.059-0.063=-0.004
max0.070-0.069=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.174-1753.175=-0.001
σ0.361-0.360=0.001
min1752.605-1752.602=0.003
max1753.752-1753.754=-0.002
mean1658.500-1656.250=2.250
σ622.823-645.081=-22.258
min668.000-627.000=41.000
max2665.000-2897.000=-232.000
mean2.830-2.868=-0.038
σ0.147-0.094=0.053
min2.416-2.651=-0.234
max3.035-3.025=0.011

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.620-271.622=-0.002
σ0.004-0.008=-0.004
min271.615-271.609=0.005
max271.625-271.629=-0.005
mean2665.000-2897.000=-232.000
σ0.000
min2665.000-2897.000=-232.000
max2665.000-2897.000=-232.000
mean0.387-0.380=0.007
σ0.011-0.001=0.009
min0.377-0.378=-0.001
max0.401-0.382=0.020
iters=5
new-facts=1
prior-facts=6402
mean1932.050-1932.047=0.004
σ0.010-0.013=-0.003
min1932.042-1932.035=0.007
max1932.068-1932.069=-0.001
mean2665.000-2897.000=-232.000
σ0.000
min2665.000-2897.000=-232.000
max2665.000-2897.000=-232.000
mean2.950-3.029=-0.079
σ0.294-0.336=-0.042
min2.506-2.462=0.044
max3.334-3.316=0.018
iters=5
new-facts=6402
prior-facts=1
mean4752.850-4752.803=0.047
σ0.808-0.814=-0.006
min4752.412-4752.249=0.163
max4754.294-4754.243=0.051
mean2665.000-2897.000=-232.000
σ0.000
min2665.000-2897.000=-232.000
max2665.000-2897.000=-232.000
mean7.935-8.159=-0.223
σ0.368-0.708=-0.339
min7.602-7.649=-0.047
max8.550-9.266=-0.716
iters=5
new-facts=6402
prior-facts=6402
mean4943.224-4943.239=-0.015
σ0.019-0.011=0.008
min4943.201-4943.224=-0.023
max4943.243-4943.254=-0.011
mean3005.400-3132.000=-126.600
σ382.029-272.725=109.304
min2665.000-2897.000=-232.000
max3554.000-3516.000=38.000
mean8.465-8.622=-0.157
σ0.103-0.210=-0.107
min8.347-8.391=-0.044
max8.629-8.844=-0.215

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.177-1.025=0.152
σ0.272-0.142=0.130
min0.946-0.929=0.017
max1.559-1.254=0.305

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.286-472.289=-0.003
σ575.928-575.918=0.010
min184.317-184.318=-0.001
max1336.177-1336.165=0.012
mean88.250
σ8.500
min84.000
max101.000
mean2665.000-2897.000=-232.000
σ0.000
min2665.000-2897.000=-232.000
max2665.000-2897.000=-232.000
mean0.565-0.487=0.078
σ0.540-0.359=0.180
min0.288-0.304=-0.015
max1.375-1.026=0.348
policies=20
mean1843.519-1843.564=-0.045
σ0.388-0.375=0.013
min1843.258-1843.273=-0.015
max1844.091-1844.104=-0.013
mean840.000
σ0.000
min840.000
max840.000
mean2665.000-2897.000=-232.000
σ0.000
min2665.000-2897.000=-232.000
max2665.000-2897.000=-232.000
mean2.894-2.990=-0.095
σ0.028-0.050=-0.022
min2.870-2.958=-0.089
max2.926-3.064=-0.138
policies=200
mean18442.116-18442.125=-0.009
σ0.514-0.380=0.134
min18441.752-18441.904=-0.152
max18442.870-18442.691=0.179
mean8400.000
σ0.000
min8400.000
max8400.000
mean2665.000-2897.000=-232.000
σ0.000
min2665.000-2897.000=-232.000
max2665.000-2897.000=-232.000
mean29.034-29.304=-0.270
σ0.280-0.464=-0.184
min28.679-28.881=-0.202
max29.345-29.820=-0.475