Compare commits

Home / Compare 152fc4dd .. b0af22fd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.566-70.566=0.001
σ0.049-0.045=0.003
min70.541-70.535=0.007
max70.702-70.691=0.011
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.159-0.161=-0.002
σ0.004-0.005=-0.001
min0.153-0.156=-0.003
max0.166-0.168=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.289-21.287=0.002
σ0.003-0.003=0.000
min21.282-21.283=-0.001
max21.293-21.290=0.002
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.064-0.064=0.000
σ0.002-0.003=-0.001
min0.058-0.058=-0.000
max0.067-0.070=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.376-1753.375=0.001
σ0.359-0.362=-0.003
min1752.802-1752.806=-0.004
max1753.959-1753.976=-0.017
mean1649.650-1659.950=-10.300
σ642.904-637.803=5.101
min634.000-616.000=18.000
max2881.000-2811.000=70.000
mean2.805-2.802=0.003
σ0.149-0.205=-0.056
min2.340-2.287=0.053
max2.999-3.128=-0.129

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.757-271.752=0.006
σ0.007-0.007=0.001
min271.747-271.744=0.003
max271.766-271.758=0.008
mean2881.000-2811.000=70.000
σ0.000
min2881.000-2811.000=70.000
max2881.000-2811.000=70.000
mean0.381-0.382=-0.001
σ0.003-0.004=-0.002
min0.379-0.379=-0.000
max0.386-0.390=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1932.176-1932.180=-0.003
σ0.006-0.017=-0.011
min1932.171-1932.156=0.015
max1932.184-1932.201=-0.017
mean2881.000-2811.000=70.000
σ0.000
min2881.000-2811.000=70.000
max2881.000-2811.000=70.000
mean2.941-2.939=0.003
σ0.113-0.049=0.064
min2.751-2.852=-0.101
max3.051-2.974=0.077
iters=5
new-facts=6402
prior-facts=1
mean4752.898-4752.797=0.101
σ0.916-1.014=-0.098
min4752.392-4751.992=0.400
max4754.534-4754.567=-0.033
mean2881.000-2811.000=70.000
σ0.000
min2881.000-2811.000=70.000
max2881.000-2811.000=70.000
mean8.696-8.672=0.024
σ0.238-0.297=-0.059
min8.507-8.374=0.133
max9.070-9.094=-0.024
iters=5
new-facts=6402
prior-facts=6402
mean4943.297-4943.372=-0.074
σ0.161-0.019=0.142
min4943.012-4943.347=-0.335
max4943.391-4943.388=0.003
mean3030.400-3019.800=10.600
σ176.130-266.401=-90.271
min2881.000-2811.000=70.000
max3312.000-3428.000=-116.000
mean8.502-8.427=0.075
σ0.131-0.030=0.101
min8.373-8.404=-0.031
max8.644-8.474=0.170

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.018-1.021=-0.003
σ0.139-0.134=0.005
min0.918-0.928=-0.010
max1.244-1.239=0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.862-467.861=0.001
σ575.925-575.941=-0.016
min179.896-179.887=0.009
max1331.750-1331.773=-0.023
mean86.250
σ8.500
min82.000
max99.000
mean2881.000-2811.000=70.000
σ0.000
min2881.000-2811.000=70.000
max2881.000-2811.000=70.000
mean0.444-0.466=-0.022
σ0.299-0.369=-0.070
min0.291-0.280=0.012
max0.891-1.018=-0.127
policies=20
mean1799.221-1799.156=0.065
σ0.375-0.358=0.017
min1798.959-1798.924=0.035
max1799.772-1799.690=0.082
mean820.000
σ0.000
min820.000
max820.000
mean2881.000-2811.000=70.000
σ0.000
min2881.000-2811.000=70.000
max2881.000-2811.000=70.000
mean2.932-2.791=0.140
σ0.030-0.024=0.006
min2.889-2.764=0.125
max2.956-2.821=0.135
policies=200
mean17998.550-17998.478=0.072
σ0.417-0.508=-0.091
min17998.239-17998.196=0.042
max17999.165-17999.239=-0.074
mean8200.000
σ0.000
min8200.000
max8200.000
mean2881.000-2811.000=70.000
σ0.000
min2881.000-2811.000=70.000
max2881.000-2811.000=70.000
mean28.550-28.168=0.383
σ0.400-0.121=0.279
min28.121-28.046=0.075
max29.033-28.334=0.698