Compare commits

Home / Compare a6a6b191 .. 3135fa12

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.567-70.566=0.001
σ0.047-0.044=0.002
min70.540-70.538=0.003
max70.694-70.686=0.008
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.158-0.158=0.000
σ0.006-0.004=0.002
min0.149-0.152=-0.004
max0.171-0.165=0.007
cache=y
dps=1
iters=10
policies=100
mean21.286-21.287=-0.001
σ0.003-0.003=0.000
min21.282-21.283=-0.000
max21.293-21.292=0.001
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.062-0.065=-0.003
σ0.003-0.003=-0.000
min0.058-0.063=-0.005
max0.065-0.074=-0.009

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.376-1753.374=0.002
σ0.362-0.359=0.003
min1752.804-1752.798=0.007
max1753.957-1753.946=0.011
mean1646.900-1644.350=2.550
σ642.154-634.942=7.212
min632.000-624.000=8.000
max2877.000-2857.000=20.000
mean2.819-2.773=0.046
σ0.136-0.194=-0.058
min2.544-2.394=0.150
max3.024-3.046=-0.022

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.761-271.760=0.001
σ0.004-0.009=-0.005
min271.756-271.753=0.003
max271.766-271.775=-0.009
mean2877.000-2857.000=20.000
σ0.000
min2877.000-2857.000=20.000
max2877.000-2857.000=20.000
mean0.385-0.385=0.000
σ0.012-0.010=0.003
min0.371-0.378=-0.007
max0.400-0.400=0.000
iters=5
new-facts=1
prior-facts=6402
mean1932.177-1932.174=0.002
σ0.018-0.006=0.012
min1932.150-1932.167=-0.018
max1932.197-1932.183=0.014
mean2877.000-2857.000=20.000
σ0.000
min2877.000-2857.000=20.000
max2877.000-2857.000=20.000
mean2.922-3.035=-0.113
σ0.261-0.094=0.167
min2.460-2.958=-0.498
max3.081-3.182=-0.100
iters=5
new-facts=6402
prior-facts=1
mean4752.936-4752.906=0.030
σ0.880-0.922=-0.042
min4752.439-4752.414=0.025
max4754.503-4754.543=-0.039
mean2877.000-2857.000=20.000
σ0.000
min2877.000-2857.000=20.000
max2877.000-2857.000=20.000
mean8.345-8.583=-0.238
σ0.466-0.530=-0.064
min7.600-7.796=-0.196
max8.851-8.997=-0.146
iters=5
new-facts=6402
prior-facts=6402
mean4943.236-4943.303=-0.067
σ0.197-0.152=0.045
min4943.009-4943.033=-0.024
max4943.395-4943.391=0.004
mean3025.200-3053.000=-27.800
σ174.507-193.271=-18.764
min2877.000-2857.000=20.000
max3304.000-3303.000=1.000
mean8.533-8.533=0.000
σ0.130-0.116=0.015
min8.422-8.406=0.016
max8.734-8.714=0.019

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.050-1.021=0.029
σ0.130-0.138=-0.008
min0.934-0.929=0.005
max1.255-1.245=0.010

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.859-467.864=-0.005
σ575.923-575.933=-0.010
min179.890-179.891=-0.000
max1331.743-1331.763=-0.021
mean86.250
σ8.500
min82.000
max99.000
mean2877.000-2857.000=20.000
σ0.000
min2877.000-2857.000=20.000
max2877.000-2857.000=20.000
mean0.422-0.448=-0.026
σ0.255-0.301=-0.046
min0.292-0.296=-0.004
max0.804-0.900=-0.095
policies=20
mean1799.167-1799.207=-0.040
σ0.376-0.393=-0.017
min1798.903-1798.937=-0.035
max1799.721-1799.787=-0.067
mean820.000
σ0.000
min820.000
max820.000
mean2877.000-2857.000=20.000
σ0.000
min2877.000-2857.000=20.000
max2877.000-2857.000=20.000
mean2.883-2.926=-0.043
σ0.013-0.063=-0.050
min2.870-2.888=-0.019
max2.894-3.020=-0.126
policies=200
mean17998.471-17998.539=-0.068
σ0.518-0.457=0.061
min17998.119-17998.284=-0.165
max17999.232-17999.223=0.009
mean8200.000
σ0.000
min8200.000
max8200.000
mean2877.000-2857.000=20.000
σ0.000
min2877.000-2857.000=20.000
max2877.000-2857.000=20.000
mean28.613-28.528=0.084
σ0.522-0.381=0.141
min28.157-28.194=-0.037
max29.135-29.067=0.067