Compare commits

Home / Compare 8a4c2698 .. 0bd85afe

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.564-70.563=0.001
σ0.047-0.046=0.001
min70.534-70.539=-0.005
max70.696-70.692=0.004
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.160-0.159=0.002
σ0.003-0.003=0.000
min0.158-0.156=0.002
max0.166-0.163=0.003
cache=y
dps=1
iters=10
policies=100
mean21.290-21.286=0.004
σ0.012-0.004=0.008
min21.283-21.281=0.002
max21.323-21.292=0.031
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.062-0.062=0.000
σ0.003-0.003=0.001
min0.059-0.059=0.000
max0.070-0.068=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.567-1753.562=0.005
σ0.360-0.360=0.000
min1752.998-1752.989=0.009
max1754.133-1754.148=-0.015
mean1658.250-1673.550=-15.300
σ633.127-638.357=-5.230
min645.000-688.000=-43.000
max2851.000-2815.000=36.000
mean2.843-2.803=0.040
σ0.201-0.132=0.069
min2.309-2.478=-0.169
max3.271-2.992=0.279

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.012-272.016=-0.004
σ0.004-0.010=-0.005
min272.005-272.005=-0.000
max272.016-272.028=-0.012
mean2851.000-2815.000=36.000
σ0.000
min2851.000-2815.000=36.000
max2851.000-2815.000=36.000
mean0.384-0.392=-0.009
σ0.009-0.015=-0.006
min0.379-0.378=0.002
max0.399-0.413=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1932.438-1932.438=0.001
σ0.007-0.016=-0.009
min1932.429-1932.416=0.013
max1932.445-1932.458=-0.013
mean2851.000-2815.000=36.000
σ0.000
min2851.000-2815.000=36.000
max2851.000-2815.000=36.000
mean2.906-2.953=-0.047
σ0.129-0.203=-0.074
min2.734-2.736=-0.002
max3.049-3.166=-0.117
iters=5
new-facts=6402
prior-facts=1
mean4753.051-4753.168=-0.117
σ0.924-0.838=0.086
min4752.293-4752.694=-0.400
max4754.659-4754.659=-0.000
mean2851.000-2815.000=36.000
σ0.000
min2851.000-2815.000=36.000
max2851.000-2815.000=36.000
mean8.566-8.468=0.098
σ0.296-0.454=-0.157
min8.261-7.724=0.537
max9.043-8.868=0.175
iters=5
new-facts=6402
prior-facts=6402
mean4943.628-4943.632=-0.004
σ0.015-0.018=-0.003
min4943.615-4943.610=0.005
max4943.645-4943.654=-0.009
mean3056.800-3046.000=10.800
σ207.017-241.436=-34.419
min2851.000-2815.000=36.000
max3336.000-3392.000=-56.000
mean8.665-8.628=0.038
σ0.212-0.146=0.065
min8.448-8.408=0.040
max8.970-8.800=0.170

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.028-1.043=-0.015
σ0.134-0.128=0.006
min0.943-0.928=0.015
max1.251-1.241=0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.079-473.071=0.008
σ575.914-575.918=-0.003
min185.113-185.107=0.006
max1336.950-1336.947=0.003
mean88.250
σ8.500
min84.000
max101.000
mean2851.000-2815.000=36.000
σ0.000
min2851.000-2815.000=36.000
max2851.000-2815.000=36.000
mean0.447-0.453=-0.006
σ0.304-0.304=-0.000
min0.292-0.295=-0.004
max0.903-0.909=-0.006
policies=20
mean1851.436-1851.400=0.036
σ0.376-0.325=0.051
min1851.167-1851.165=0.001
max1851.986-1851.866=0.120
mean840.000
σ0.000
min840.000
max840.000
mean2851.000-2815.000=36.000
σ0.000
min2851.000-2815.000=36.000
max2851.000-2815.000=36.000
mean2.938-2.911=0.027
σ0.015-0.128=-0.113
min2.926-2.830=0.096
max2.960-3.102=-0.142
policies=200
mean18521.110-18520.948=0.162
σ0.424-0.588=-0.164
min18520.855-18520.387=0.468
max18521.740-18521.775=-0.035
mean8400.000
σ0.000
min8400.000
max8400.000
mean2851.000-2815.000=36.000
σ0.000
min2851.000-2815.000=36.000
max2851.000-2815.000=36.000
mean29.363-28.863=0.501
σ0.451-0.022=0.429
min28.960-28.845=0.115
max29.755-28.892=0.863