Compare commits

Home / Compare 3bbb78c5 .. e0c42705

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.781=0.001
σ0.047-0.044=0.002
min70.755-70.750=0.004
max70.912-70.905=0.007
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.161-0.161=0.000
σ0.003-0.003=-0.001
min0.158-0.157=0.001
max0.166-0.166=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.493-21.493=0.001
σ0.003-0.002=0.000
min21.490-21.488=0.002
max21.498-21.497=0.001
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.065-0.065=0.000
σ0.003-0.002=0.001
min0.063-0.064=-0.000
max0.073-0.070=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1716.155-1754.091=-37.936
σ169.530-0.360=169.169
min995.905-1753.530=-757.625
max1754.612-1754.679=-0.067
mean1665.050-1661.750=3.300
σ634.229-635.073=-0.845
min630.000-628.000=2.000
max2778.000
mean2.719-2.802=-0.084
σ0.313-0.228=0.085
min1.556-2.222=-0.667
max2.981-3.381=-0.399

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.960-271.951=0.009
σ0.012-0.006=0.006
min271.951-271.945=0.006
max271.980-271.959=0.021
mean2778.000
σ0.000
min2778.000
max2778.000
mean0.383-0.380=0.003
σ0.007-0.001=0.006
min0.378-0.379=-0.001
max0.395-0.381=0.014
iters=5
new-facts=1
prior-facts=6402
mean1932.318-1932.319=-0.001
σ0.012-0.010=0.002
min1932.297-1932.307=-0.009
max1932.330-1932.334=-0.004
mean2778.000
σ0.000
min2778.000
max2778.000
mean3.056-2.957=0.099
σ0.160-0.121=0.038
min2.892-2.744=0.149
max3.298-3.038=0.260
iters=5
new-facts=6402
prior-facts=1
mean4753.057-4753.087=-0.030
σ0.935-0.857=0.078
min4752.557-4752.620=-0.063
max4754.727-4754.612=0.115
mean2778.000
σ0.000
min2778.000
max2778.000
mean8.680-8.484=0.196
σ0.539-0.392=0.147
min7.792-7.919=-0.127
max9.185-8.878=0.307
iters=5
new-facts=6402
prior-facts=6402
mean4943.348-4943.487=-0.138
σ0.323-0.152=0.171
min4942.838-4943.216=-0.378
max4943.574-4943.572=0.003
mean2994.200-2988.000=6.200
σ214.634-272.853=-58.219
min2778.000
max3308.000-3420.000=-112.000
mean8.621-8.355=0.266
σ0.232-0.049=0.183
min8.379-8.303=0.077
max8.912-8.427=0.485

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.052-1.032=0.019
σ0.129-0.134=-0.005
min0.934-0.943=-0.009
max1.248-1.247=0.001

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.663-468.662=0.000
σ574.938-574.924=0.014
min181.188-181.190=-0.002
max1331.069-1331.048=0.021
mean88.250
σ8.500
min84.000
max101.000
mean2778.000
σ0.000
min2778.000
max2778.000
mean0.451-0.447=0.004
σ0.307-0.310=-0.003
min0.294-0.291=0.003
max0.912-0.912=-0.000
policies=20
mean1812.243-1812.226=0.017
σ0.375-0.384=-0.008
min1811.997-1811.949=0.048
max1812.795-1812.785=0.010
mean840.000
σ0.000
min840.000
max840.000
mean2778.000
σ0.000
min2778.000
max2778.000
mean2.916-2.944=-0.028
σ0.007-0.050=-0.043
min2.908-2.915=-0.007
max2.924-3.019=-0.095
policies=200
mean18129.269-18129.048=0.221
σ0.541-0.487=0.054
min18128.949-18128.760=0.189
max18130.075-18129.776=0.299
mean8400.000
σ0.000
min8400.000
max8400.000
mean2778.000
σ0.000
min2778.000
max2778.000
mean28.870-28.534=0.336
σ0.372-0.062=0.310
min28.511-28.465=0.046
max29.393-28.605=0.788