Compare commits

Home / Compare fdb9ed5f .. a052f6af

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.980=-0.000
σ0.048-0.049=-0.002
min33.953-33.947=0.006
max34.111-34.115=-0.004
mean415.000-412.800=2.200
σ0.000-0.422=-0.422
min415.000-412.000=3.000
max415.000-413.000=2.000
mean0.084-0.085=-0.001
σ0.003-0.003=-0.000
min0.082-0.082=-0.000
max0.090-0.090=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.318-23.318=-0.000
σ0.003-0.003=0.000
min23.315-23.313=0.002
max23.325-23.323=0.002
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.065-0.066=-0.001
σ0.002-0.003=-0.000
min0.064-0.064=0.000
max0.072-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.428-1757.429=-0.002
σ0.365-0.366=-0.001
min1756.853-1756.853=0.000
max1758.016-1758.021=-0.004
mean1660.800-1647.200=13.600
σ621.225-626.172=-4.947
min669.000-634.000=35.000
max2589.000-2821.000=-232.000
mean2.372-2.362=0.010
σ0.109-0.092=0.017
min2.255-2.257=-0.002
max2.683-2.665=0.017

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.575-326.574=0.001
σ0.041-0.051=-0.010
min326.505-326.484=0.021
max326.615-326.609=0.006
mean2589.000-2821.000=-232.000
σ0.000
min2589.000-2821.000=-232.000
max2589.000-2821.000=-232.000
mean0.428-0.424=0.003
σ0.005-0.002=0.003
min0.423-0.422=0.002
max0.434-0.428=0.006
iters=5
new-facts=1
prior-facts=6402
mean1988.739-1988.733=0.006
σ0.012-0.017=-0.006
min1988.721-1988.710=0.011
max1988.751-1988.751=0.000
mean2589.000-2821.000=-232.000
σ0.000
min2589.000-2821.000=-232.000
max2589.000-2821.000=-232.000
mean2.739-2.660=0.079
σ0.130-0.079=0.050
min2.623-2.555=0.067
max2.955-2.779=0.176
iters=5
new-facts=6402
prior-facts=1
mean4813.457-4813.461=-0.003
σ7.795-7.472=0.324
min4809.536-4810.078=-0.543
max4827.394-4826.826=0.568
mean2589.000-2821.000=-232.000
σ0.000
min2589.000-2821.000=-232.000
max2589.000-2821.000=-232.000
mean8.836-8.809=0.028
σ0.289-0.307=-0.018
min8.512-8.332=0.179
max9.243-9.093=0.150
iters=5
new-facts=6402
prior-facts=6402
mean5001.139-5001.148=-0.010
σ0.021-0.017=0.005
min5001.113-5001.123=-0.011
max5001.162-5001.164=-0.001
mean3029.200-3025.800=3.400
σ322.845-209.028=113.817
min2589.000-2821.000=-232.000
max3335.000-3315.000=20.000
mean9.841-9.811=0.030
σ0.154-0.547=-0.393
min9.639-8.914=0.725
max9.962-10.391=-0.429

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.248-1.006=0.241
σ0.352-0.065=0.286
min0.946-0.926=0.020
max1.802-1.057=0.745

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.567-464.571=-0.005
σ574.792-574.768=0.024
min177.165-177.179=-0.014
max1326.755-1326.724=0.031
mean88.250
σ8.500
min84.000
max101.000
mean2589.000-2821.000=-232.000
σ0.000
min2589.000-2821.000=-232.000
max2589.000-2821.000=-232.000
mean0.552-0.408=0.144
σ0.558-0.260=0.297
min0.271-0.262=0.009
max1.388-0.798=0.590
policies=20
mean1772.016-1772.065=-0.049
σ0.360-0.353=0.007
min1771.772-1771.832=-0.060
max1772.549-1772.589=-0.040
mean840.000
σ0.000
min840.000
max840.000
mean2589.000-2821.000=-232.000
σ0.000
min2589.000-2821.000=-232.000
max2589.000-2821.000=-232.000
mean2.767-2.847=-0.080
σ0.050-0.058=-0.008
min2.717-2.809=-0.092
max2.819-2.931=-0.112
policies=200
mean17727.465-17727.550=-0.085
σ0.599-0.553=0.045
min17727.085-17727.166=-0.081
max17728.356-17728.352=0.004
mean8400.000
σ0.000
min8400.000
max8400.000
mean2589.000-2821.000=-232.000
σ0.000
min2589.000-2821.000=-232.000
max2589.000-2821.000=-232.000
mean27.545-27.997=-0.452
σ0.117-0.575=-0.458
min27.409-27.458=-0.049
max27.694-28.679=-0.986