Compare commits

Home / Compare c6f187ce .. f79c387b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.697-70.562=0.135
σ0.046-0.045=0.001
min70.670-70.543=0.128
max70.825-70.689=0.136
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.161-0.158=0.003
σ0.004-0.005=-0.001
min0.157-0.150=0.006
max0.169-0.164=0.005
cache=y
dps=1
iters=10
policies=100
mean21.424-21.289=0.135
σ0.009-0.003=0.006
min21.417-21.283=0.134
max21.449-21.295=0.155
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.065-0.065=0.000
σ0.002-0.002=0.000
min0.063-0.063=0.000
max0.071-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.459-1753.570=0.889
σ0.360-0.359=0.001
min1753.892-1752.998=0.894
max1755.043-1754.159=0.884
mean1664.950-1655.100=9.850
σ642.583-645.290=-2.707
min644.000-628.000=16.000
max2843.000-2900.000=-57.000
mean2.830-2.814=0.017
σ0.163-0.147=0.017
min2.537-2.419=0.118
max3.182-2.988=0.194

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.999-277.475=1.524
σ0.005-0.005=0.000
min278.994-277.471=1.523
max279.007-277.482=1.525
mean2843.000-2900.000=-57.000
σ0.000
min2843.000-2900.000=-57.000
max2843.000-2900.000=-57.000
mean0.385-0.393=-0.007
σ0.006-0.005=0.001
min0.381-0.388=-0.008
max0.395-0.400=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1939.439-1937.902=1.537
σ0.006-0.011=-0.004
min1939.434-1937.884=1.550
max1939.449-1937.912=1.537
mean2843.000-2900.000=-57.000
σ0.000
min2843.000-2900.000=-57.000
max2843.000-2900.000=-57.000
mean2.564-2.969=-0.406
σ0.118-0.031=0.087
min2.460-2.926=-0.466
max2.730-2.999=-0.268
iters=5
new-facts=6402
prior-facts=1
mean4760.155-4758.610=1.544
σ0.887-0.918=-0.031
min4759.660-4758.167=1.494
max4761.732-4760.250=1.482
mean2843.000-2900.000=-57.000
σ0.000
min2843.000-2900.000=-57.000
max2843.000-2900.000=-57.000
mean8.573-8.703=-0.130
σ0.581-0.222=0.359
min7.604-8.394=-0.790
max9.061-8.966=0.095
iters=5
new-facts=6402
prior-facts=6402
mean4950.494-4949.109=1.385
σ0.306-0.024=0.282
min4949.948-4949.082=0.866
max4950.658-4949.137=1.521
mean3066.600-3041.000=25.600
σ191.486-169.462=22.023
min2843.000-2900.000=-57.000
max3333.000-3315.000=18.000
mean8.530-8.634=-0.104
σ0.149-0.122=0.027
min8.395-8.513=-0.118
max8.748-8.825=-0.077

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.048-1.017=0.030
σ0.133-0.117=0.016
min0.927-0.935=-0.009
max1.254-1.202=0.052

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.084-473.080=0.004
σ575.923-575.915=0.008
min185.114-185.120=-0.006
max1336.968-1336.952=0.017
mean88.250
σ8.500
min84.000
max101.000
mean2843.000-2900.000=-57.000
σ0.000
min2843.000-2900.000=-57.000
max2843.000-2900.000=-57.000
mean0.499-0.488=0.011
σ0.376-0.380=-0.004
min0.309-0.296=0.013
max1.062-1.058=0.004
policies=20
mean1851.454-1851.459=-0.005
σ0.384-0.378=0.006
min1851.172-1851.179=-0.007
max1852.013-1852.011=0.002
mean840.000
σ0.000
min840.000
max840.000
mean2843.000-2900.000=-57.000
σ0.000
min2843.000-2900.000=-57.000
max2843.000-2900.000=-57.000
mean2.967-2.927=0.040
σ0.029-0.018=0.011
min2.949-2.905=0.045
max3.010-2.947=0.063
policies=200
mean18520.062-18521.195=-1.133
σ0.647-0.414=0.233
min18519.225-18520.937=-1.712
max18520.802-18521.806=-1.004
mean8400.000
σ0.000
min8400.000
max8400.000
mean2843.000-2900.000=-57.000
σ0.000
min2843.000-2900.000=-57.000
max2843.000-2900.000=-57.000
mean29.223-29.087=0.136
σ0.474-0.423=0.051
min28.748-28.683=0.066
max29.814-29.550=0.264