Compare commits

Home / Compare 3aa69261 .. dfedb22a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.701-70.702=-0.002
σ0.048-0.045=0.003
min70.666-70.678=-0.012
max70.831-70.827=0.004
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.157-0.160=-0.003
σ0.006-0.003=0.003
min0.150-0.157=-0.008
max0.167-0.166=0.002
cache=y
dps=1
iters=10
policies=100
mean21.409-21.409=-0.000
σ0.002-0.003=-0.001
min21.405-21.404=0.001
max21.413-21.413=-0.001
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.065-0.065=-0.000
σ0.004-0.002=0.001
min0.059-0.063=-0.004
max0.073-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.930-1754.930=0.001
σ0.361-0.361=-0.000
min1754.362-1754.357=0.005
max1755.531-1755.512=0.019
mean1649.600-1650.500=-0.900
σ632.332-624.381=7.952
min624.000-623.000=1.000
max2772.000-2771.000=1.000
mean2.832-2.748=0.084
σ0.162-0.163=-0.000
min2.441-2.330=0.111
max3.191-3.033=0.158

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.731-272.755=-0.024
σ0.007-0.004=0.003
min272.723-272.749=-0.026
max272.738-272.759=-0.021
mean2772.000-2771.000=1.000
σ0.000
min2772.000-2771.000=1.000
max2772.000-2771.000=1.000
mean0.383-0.382=0.001
σ0.009-0.005=0.004
min0.378-0.379=-0.001
max0.399-0.391=0.008
iters=5
new-facts=1
prior-facts=6402
mean1933.157-1933.158=-0.001
σ0.020-0.015=0.004
min1933.122-1933.140=-0.018
max1933.170-1933.177=-0.007
mean2772.000-2771.000=1.000
σ0.000
min2772.000-2771.000=1.000
max2772.000-2771.000=1.000
mean3.030-2.959=0.070
σ0.140-0.132=0.008
min2.831-2.745=0.086
max3.186-3.092=0.095
iters=5
new-facts=6402
prior-facts=1
mean4756.779-4756.795=-0.016
σ7.708-7.679=0.029
min4752.923-4752.949=-0.027
max4770.560-4770.524=0.037
mean2772.000-2771.000=1.000
σ0.000
min2772.000-2771.000=1.000
max2772.000-2771.000=1.000
mean8.809-8.705=0.104
σ0.147-0.547=-0.400
min8.641-7.947=0.694
max9.002-9.326=-0.324
iters=5
new-facts=6402
prior-facts=6402
mean4944.257-4944.394=-0.137
σ0.176-0.018=0.158
min4944.062-4944.369=-0.307
max4944.387-4944.409=-0.022
mean3023.800-2987.400=36.400
σ251.364-220.205=31.159
min2772.000-2771.000=1.000
max3379.000-3309.000=70.000
mean8.620-8.514=0.106
σ0.202-0.082=0.120
min8.423-8.432=-0.010
max8.957-8.632=0.324

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.008-1.036=-0.027
σ0.133-0.134=-0.000
min0.920-0.915=0.005
max1.227-1.241=-0.014

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.345-468.360=-0.015
σ574.255-574.272=-0.018
min181.207-181.220=-0.013
max1329.727-1329.769=-0.042
mean88.250
σ8.500
min84.000
max101.000
mean2772.000-2771.000=1.000
σ0.000
min2772.000-2771.000=1.000
max2772.000-2771.000=1.000
mean0.447-0.485=-0.038
σ0.305-0.385=-0.079
min0.292-0.290=0.002
max0.905-1.062=-0.157
policies=20
mean1812.345-1812.526=-0.181
σ0.325-0.382=-0.057
min1812.102-1812.265=-0.163
max1812.815-1813.087=-0.272
mean840.000
σ0.000
min840.000
max840.000
mean2772.000-2771.000=1.000
σ0.000
min2772.000-2771.000=1.000
max2772.000-2771.000=1.000
mean2.896-2.889=0.006
σ0.008-0.001=0.007
min2.887-2.888=-0.001
max2.907-2.891=0.016
policies=200
mean18129.098-18129.050=0.049
σ0.470-0.481=-0.011
min18128.765-18128.516=0.248
max18129.790-18129.510=0.280
mean8400.000
σ0.000
min8400.000
max8400.000
mean2772.000-2771.000=1.000
σ0.000
min2772.000-2771.000=1.000
max2772.000-2771.000=1.000
mean28.399-28.439=-0.040
σ0.204-0.213=-0.009
min28.176-28.279=-0.103
max28.657-28.732=-0.075