Compare commits

Home / Compare c0de3d4e .. edf745c5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.562-70.564=-0.001
σ0.046-0.045=0.001
min70.539-70.543=-0.004
max70.691-70.692=-0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.156-0.160=-0.005
σ0.005-0.004=0.001
min0.149-0.157=-0.008
max0.162-0.167=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=0.000
σ0.002-0.003=-0.001
min21.284-21.281=0.002
max21.292-21.292=0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.063-0.065=-0.002
σ0.004-0.003=0.001
min0.059-0.062=-0.003
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.569-1753.570=-0.001
σ0.357-0.361=-0.004
min1753.000-1752.999=0.001
max1754.127-1754.169=-0.042
mean1663.250-1668.350=-5.100
σ633.850-650.766=-16.916
min688.000-632.000=56.000
max2750.000-2848.000=-98.000
mean2.798-2.827=-0.029
σ0.208-0.107=0.101
min2.411-2.561=-0.150
max3.356-2.984=0.372

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.014-272.016=-0.002
σ0.010-0.007=0.003
min271.997-272.005=-0.008
max272.021-272.024=-0.004
mean2750.000-2848.000=-98.000
σ0.000
min2750.000-2848.000=-98.000
max2750.000-2848.000=-98.000
mean0.391-0.389=0.001
σ0.013-0.010=0.003
min0.372-0.379=-0.007
max0.404-0.400=0.003
iters=5
new-facts=1
prior-facts=6402
mean1932.440-1932.434=0.006
σ0.009-0.014=-0.005
min1932.428-1932.418=0.010
max1932.453-1932.456=-0.004
mean2750.000-2848.000=-98.000
σ0.000
min2750.000-2848.000=-98.000
max2750.000-2848.000=-98.000
mean2.931-2.976=-0.045
σ0.156-0.061=0.095
min2.731-2.890=-0.159
max3.129-3.046=0.083
iters=5
new-facts=6402
prior-facts=1
mean4753.038-4752.954=0.084
σ0.971-0.313=0.657
min4752.044-4752.658=-0.615
max4754.657-4753.480=1.177
mean2750.000-2848.000=-98.000
σ0.000
min2750.000-2848.000=-98.000
max2750.000-2848.000=-98.000
mean8.752-8.468=0.283
σ0.397-0.356=0.041
min8.437-8.183=0.254
max9.398-9.057=0.341
iters=5
new-facts=6402
prior-facts=6402
mean4943.563-4943.634=-0.070
σ0.166-0.015=0.150
min4943.268-4943.621=-0.353
max4943.652-4943.651=0.001
mean3032.600-3050.800=-18.200
σ231.498-205.059=26.439
min2750.000-2848.000=-98.000
max3304.000-3330.000=-26.000
mean8.622-8.565=0.057
σ0.181-0.227=-0.047
min8.401-8.275=0.126
max8.894-8.818=0.076

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.025-1.024=0.000
σ0.145-0.137=0.009
min0.920-0.933=-0.013
max1.261-1.248=0.013

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.085-473.080=0.005
σ575.921-575.913=0.008
min185.116-185.118=-0.003
max1336.968-1336.950=0.017
mean88.250
σ8.500
min84.000
max101.000
mean2750.000-2848.000=-98.000
σ0.000
min2750.000-2848.000=-98.000
max2750.000-2848.000=-98.000
mean0.559-0.487=0.072
σ0.536-0.377=0.159
min0.290-0.296=-0.006
max1.363-1.052=0.311
policies=20
mean1851.439-1851.463=-0.024
σ0.374-0.379=-0.005
min1851.179-1851.183=-0.003
max1851.992-1852.012=-0.021
mean840.000
σ0.000
min840.000
max840.000
mean2750.000-2848.000=-98.000
σ0.000
min2750.000-2848.000=-98.000
max2750.000-2848.000=-98.000
mean2.879-2.945=-0.066
σ0.008-0.005=0.003
min2.871-2.940=-0.069
max2.890-2.951=-0.061
policies=200
mean18520.951-18520.848=0.103
σ0.436-0.724=-0.288
min18520.623-18520.027=0.595
max18521.581-18521.733=-0.151
mean8400.000
σ0.000
min8400.000
max8400.000
mean2750.000-2848.000=-98.000
σ0.000
min2750.000-2848.000=-98.000
max2750.000-2848.000=-98.000
mean28.964-29.110=-0.147
σ0.152-0.576=-0.424
min28.834-28.728=0.106
max29.154-29.961=-0.806