Compare commits

Home / Compare 08e46379 .. 99e444a2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.730-70.696=0.034
σ0.053-0.047=0.006
min70.698-70.668=0.030
max70.877-70.828=0.049
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.161-0.160=0.001
σ0.004-0.004=0.000
min0.155-0.157=-0.002
max0.165-0.167=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.445-21.423=0.022
σ0.002-0.013=-0.010
min21.442-21.415=0.027
max21.449-21.459=-0.009
mean415.800-414.000=1.800
σ0.422-0.000=0.422
min415.000-414.000=1.000
max416.000-414.000=2.000
mean0.065-0.065=0.001
σ0.002-0.003=-0.000
min0.064-0.063=0.000
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.284-1754.457=0.826
σ0.359-0.361=-0.002
min1754.717-1753.884=0.833
max1755.868-1755.038=0.830
mean1654.550-1672.950=-18.400
σ634.022-650.528=-16.506
min622.000-625.000=-3.000
max2848.000-2869.000=-21.000
mean2.817-2.820=-0.002
σ0.157-0.189=-0.032
min2.458-2.285=0.173
max3.016-3.110=-0.094

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean274.364-273.503=0.861
σ0.006-0.008=-0.001
min274.360-273.491=0.868
max274.375-273.510=0.865
mean2848.000-2869.000=-21.000
σ0.000
min2848.000-2869.000=-21.000
max2848.000-2869.000=-21.000
mean0.382-0.382=-0.000
σ0.004-0.005=-0.001
min0.375-0.378=-0.003
max0.384-0.391=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1934.759-1933.900=0.859
σ0.007-0.013=-0.005
min1934.751-1933.890=0.860
max1934.770-1933.921=0.848
mean2848.000-2869.000=-21.000
σ0.000
min2848.000-2869.000=-21.000
max2848.000-2869.000=-21.000
mean3.091-2.905=0.187
σ0.304-0.119=0.185
min2.856-2.740=0.116
max3.622-3.062=0.560
iters=5
new-facts=6402
prior-facts=1
mean4755.472-4754.648=0.824
σ0.895-0.844=0.051
min4755.037-4754.103=0.935
max4757.073-4756.134=0.938
mean2848.000-2869.000=-21.000
σ0.000
min2848.000-2869.000=-21.000
max2848.000-2869.000=-21.000
mean8.626-8.821=-0.195
σ0.501-0.478=0.023
min7.740-8.438=-0.698
max8.956-9.629=-0.672
iters=5
new-facts=6402
prior-facts=6402
mean4945.983-4945.117=0.865
σ0.022-0.016=0.006
min4945.953-4945.097=0.856
max4946.007-4945.134=0.873
mean3069.600-3071.400=-1.800
σ232.960-216.625=16.335
min2848.000-2869.000=-21.000
max3406.000-3391.000=15.000
mean8.545-8.686=-0.140
σ0.135-0.191=-0.056
min8.410-8.456=-0.046
max8.724-8.976=-0.252

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.996-1.016=-0.020
σ0.139-0.137=0.002
min0.931-0.922=0.009
max1.246-1.240=0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.840-473.062=-0.222
σ574.924-575.908=-0.984
min185.368-185.100=0.268
max1335.226-1336.924=-1.698
mean88.250
σ8.500
min84.000
max101.000
mean2848.000-2869.000=-21.000
σ0.000
min2848.000-2869.000=-21.000
max2848.000-2869.000=-21.000
mean0.456-0.485=-0.029
σ0.304-0.378=-0.074
min0.303-0.292=0.011
max0.912-1.052=-0.140
policies=20
mean1853.993-1851.278=2.715
σ0.363-0.368=-0.005
min1853.724-1851.009=2.715
max1854.521-1851.817=2.704
mean840.000
σ0.000
min840.000
max840.000
mean2848.000-2869.000=-21.000
σ0.000
min2848.000-2869.000=-21.000
max2848.000-2869.000=-21.000
mean2.963-2.942=0.022
σ0.012-0.015=-0.003
min2.950-2.921=0.029
max2.977-2.954=0.023
policies=200
mean18546.518-18519.337=27.181
σ0.432-0.434=-0.002
min18546.129-18519.002=27.127
max18547.134-18519.973=27.161
mean8400.000
σ0.000
min8400.000
max8400.000
mean2848.000-2869.000=-21.000
σ0.000
min2848.000-2869.000=-21.000
max2848.000-2869.000=-21.000
mean29.306-29.150=0.156
σ0.502-0.428=0.074
min28.845-28.852=-0.007
max29.765-29.784=-0.019