Compare commits

Home / Compare ce640087 .. 9abd6427

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.565-70.567=-0.002
σ0.045-0.047=-0.003
min70.534-70.542=-0.007
max70.689-70.699=-0.011
mean411.000-412.000=-1.000
σ0.000
min411.000-412.000=-1.000
max411.000-412.000=-1.000
mean0.156-0.162=-0.006
σ0.005-0.003=0.002
min0.149-0.159=-0.010
max0.163-0.168=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=0.001
σ0.003-0.004=-0.001
min21.284-21.283=0.001
max21.294-21.294=-0.000
mean411.000-412.000=-1.000
σ0.000
min411.000-412.000=-1.000
max411.000-412.000=-1.000
mean0.065-0.065=-0.000
σ0.003-0.003=-0.000
min0.063-0.062=0.001
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.570-1753.565=0.005
σ0.359-0.361=-0.002
min1753.000-1752.998=0.002
max1754.150-1754.148=0.002
mean1645.650-1652.800=-7.150
σ635.635-643.221=-7.587
min625.000-626.000=-1.000
max2859.000-2883.000=-24.000
mean2.836-2.770=0.065
σ0.113-0.166=-0.054
min2.562-2.312=0.250
max3.012-2.966=0.046

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.017-272.018=-0.001
σ0.007-0.008=-0.000
min272.007-272.009=-0.002
max272.026-272.028=-0.002
mean2859.000-2883.000=-24.000
σ0.000
min2859.000-2883.000=-24.000
max2859.000-2883.000=-24.000
mean0.379-0.391=-0.012
σ0.004-0.011=-0.007
min0.376-0.379=-0.002
max0.387-0.402=-0.015
iters=5
new-facts=1
prior-facts=6402
mean1932.433-1932.429=0.005
σ0.008-0.015=-0.007
min1932.422-1932.406=0.017
max1932.443-1932.444=-0.001
mean2859.000-2883.000=-24.000
σ0.000
min2859.000-2883.000=-24.000
max2859.000-2883.000=-24.000
mean3.016-3.036=-0.020
σ0.106-0.094=0.012
min2.910-2.941=-0.031
max3.194-3.148=0.045
iters=5
new-facts=6402
prior-facts=1
mean4753.046-4753.177=-0.132
σ0.585-0.828=-0.243
min4752.718-4752.726=-0.008
max4754.089-4754.651=-0.562
mean2859.000-2883.000=-24.000
σ0.000
min2859.000-2883.000=-24.000
max2859.000-2883.000=-24.000
mean8.603-8.427=0.175
σ0.149-0.465=-0.317
min8.489-7.734=0.755
max8.854-8.909=-0.055
iters=5
new-facts=6402
prior-facts=6402
mean4943.630-4943.631=-0.001
σ0.019-0.016=0.003
min4943.614-4943.617=-0.002
max4943.651-4943.655=-0.004
mean3070.000-3083.600=-13.600
σ222.332-220.531=1.801
min2859.000-2883.000=-24.000
max3392.000-3418.000=-26.000
mean8.584-8.588=-0.004
σ0.231-0.120=0.111
min8.396-8.451=-0.056
max8.972-8.701=0.271

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.023-0.996=0.026
σ0.136-0.145=-0.009
min0.932-0.928=0.003
max1.246-1.256=-0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.083-473.078=0.005
σ575.913-575.914=-0.001
min185.115-185.120=-0.004
max1336.953-1336.949=0.004
mean88.250
σ8.500
min84.000
max101.000
mean2859.000-2883.000=-24.000
σ0.000
min2859.000-2883.000=-24.000
max2859.000-2883.000=-24.000
mean0.453-0.451=0.002
σ0.302-0.301=0.001
min0.300-0.299=0.001
max0.906-0.903=0.003
policies=20
mean1851.476-1851.437=0.039
σ0.374-0.368=0.006
min1851.201-1851.171=0.030
max1852.021-1851.972=0.049
mean840.000
σ0.000
min840.000
max840.000
mean2859.000-2883.000=-24.000
σ0.000
min2859.000-2883.000=-24.000
max2859.000-2883.000=-24.000
mean2.954-2.949=0.005
σ0.014-0.004=0.010
min2.941-2.946=-0.005
max2.973-2.954=0.019
policies=200
mean18521.057-18521.134=-0.076
σ0.378-0.494=-0.115
min18520.761-18520.810=-0.048
max18521.612-18521.861=-0.249
mean8400.000
σ0.000
min8400.000
max8400.000
mean2859.000-2883.000=-24.000
σ0.000
min2859.000-2883.000=-24.000
max2859.000-2883.000=-24.000
mean29.149-29.285=-0.136
σ0.535-0.440=0.095
min28.659-28.906=-0.247
max29.723-29.756=-0.033