Compare commits

Home / Compare 9d1f6020 .. fde8ae50

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.979=0.000
σ0.050-0.047=0.003
min33.944-33.952=-0.008
max34.117-34.110=0.007
mean410.000-413.000=-3.000
σ0.000
min410.000-413.000=-3.000
max410.000-413.000=-3.000
mean0.085-0.084=0.000
σ0.003-0.003=0.001
min0.082-0.082=0.000
max0.091-0.090=0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=-0.000
σ0.004-0.003=0.001
min23.313-23.314=-0.001
max23.325-23.321=0.004
mean410.000-413.000=-3.000
σ0.000
min410.000-413.000=-3.000
max410.000-413.000=-3.000
mean0.065-0.064=0.001
σ0.002-0.005=-0.003
min0.064-0.060=0.004
max0.071-0.073=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.429-1757.430=-0.001
σ0.364-0.365=-0.001
min1756.857-1756.855=0.002
max1758.017-1758.025=-0.008
mean1645.000-1644.500=0.500
σ624.300-625.072=-0.773
min670.000-634.000=36.000
max2583.000-2832.000=-249.000
mean2.379-2.362=0.017
σ0.119-0.093=0.026
min2.221-2.245=-0.024
max2.701-2.674=0.027

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.576-326.571=0.005
σ0.051-0.062=-0.011
min326.488-326.462=0.026
max326.616-326.616=-0.000
mean2583.000-2832.000=-249.000
σ0.000
min2583.000-2832.000=-249.000
max2583.000-2832.000=-249.000
mean0.426-0.423=0.003
σ0.003-0.026=-0.023
min0.423-0.379=0.044
max0.431-0.448=-0.017
iters=5
new-facts=1
prior-facts=6402
mean1988.739-1988.727=0.012
σ0.017-0.006=0.011
min1988.710-1988.721=-0.011
max1988.750-1988.735=0.016
mean2583.000-2832.000=-249.000
σ0.000
min2583.000-2832.000=-249.000
max2583.000-2832.000=-249.000
mean2.702-2.665=0.037
σ0.159-0.057=0.102
min2.507-2.577=-0.070
max2.934-2.729=0.205
iters=5
new-facts=6402
prior-facts=1
mean4813.593-4813.455=0.139
σ7.724-7.484=0.240
min4810.036-4810.074=-0.038
max4827.411-4826.842=0.568
mean2583.000-2832.000=-249.000
σ0.000
min2583.000-2832.000=-249.000
max2583.000-2832.000=-249.000
mean8.393-8.891=-0.498
σ0.580-0.274=0.306
min7.750-8.534=-0.784
max9.282-9.293=-0.010
iters=5
new-facts=6402
prior-facts=6402
mean5001.065-5001.145=-0.080
σ0.170-0.025=0.145
min5000.762-5001.119=-0.356
max5001.156-5001.185=-0.029
mean2916.000-3042.800=-126.800
σ356.419-189.096=167.323
min2583.000-2832.000=-249.000
max3418.000-3310.000=108.000
mean9.555-9.860=-0.305
σ0.226-0.156=0.070
min9.356-9.714=-0.359
max9.863-10.060=-0.197

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.391-0.943=0.448
σ0.336-0.059=0.277
min1.020-0.906=0.114
max1.738-1.045=0.693

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.559-464.565=-0.006
σ574.779-574.773=0.006
min177.167-177.174=-0.007
max1326.727-1326.724=0.002
mean88.250
σ8.500
min84.000
max101.000
mean2583.000-2832.000=-249.000
σ0.000
min2583.000-2832.000=-249.000
max2583.000-2832.000=-249.000
mean0.544-0.432=0.112
σ0.535-0.303=0.232
min0.273-0.278=-0.005
max1.347-0.887=0.460
policies=20
mean1772.030-1772.074=-0.044
σ0.350-0.355=-0.005
min1771.793-1771.828=-0.035
max1772.549-1772.599=-0.050
mean840.000
σ0.000
min840.000
max840.000
mean2583.000-2832.000=-249.000
σ0.000
min2583.000-2832.000=-249.000
max2583.000-2832.000=-249.000
mean2.718-2.798=-0.081
σ0.009-0.007=0.003
min2.705-2.792=-0.087
max2.728-2.807=-0.079
policies=200
mean17727.449-17727.669=-0.219
σ0.611-0.445=0.166
min17727.120-17727.343=-0.223
max17728.366-17728.325=0.041
mean8400.000
σ0.000
min8400.000
max8400.000
mean2583.000-2832.000=-249.000
σ0.000
min2583.000-2832.000=-249.000
max2583.000-2832.000=-249.000
mean27.562-28.080=-0.518
σ0.160-0.373=-0.213
min27.385-27.710=-0.325
max27.716-28.493=-0.776