Compare commits

Home / Compare 665ebb69 .. c9d71365

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.565=-0.002
σ0.046-0.044=0.002
min70.542-70.542=-0.000
max70.693-70.688=0.006
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.162-0.160=0.002
σ0.003-0.010=-0.007
min0.158-0.148=0.009
max0.166-0.182=-0.016
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=0.000
σ0.003-0.004=-0.001
min21.284-21.283=0.001
max21.292-21.293=-0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.065-0.064=0.001
σ0.002-0.002=-0.000
min0.064-0.063=0.001
max0.070-0.071=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.174-1753.175=-0.001
σ0.362-0.360=0.002
min1752.609-1752.606=0.004
max1753.747-1753.760=-0.013
mean1651.550-1650.650=0.900
σ644.756-643.261=1.495
min631.000-629.000=2.000
max2894.000-2886.000=8.000
mean2.802-2.842=-0.040
σ0.213-0.144=0.069
min2.303-2.545=-0.242
max3.115-3.043=0.072

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.620-271.620=-0.000
σ0.005-0.005=0.000
min271.615-271.614=0.001
max271.629-271.628=0.001
mean2894.000-2886.000=8.000
σ0.000
min2894.000-2886.000=8.000
max2894.000-2886.000=8.000
mean0.384-0.381=0.002
σ0.007-0.006=0.001
min0.377-0.376=0.001
max0.396-0.391=0.004
iters=5
new-facts=1
prior-facts=6402
mean1932.039-1932.043=-0.004
σ0.012-0.016=-0.004
min1932.025-1932.024=0.001
max1932.056-1932.066=-0.010
mean2894.000-2886.000=8.000
σ0.000
min2894.000-2886.000=8.000
max2894.000-2886.000=8.000
mean2.988-3.054=-0.066
σ0.049-0.302=-0.253
min2.940-2.769=0.172
max3.049-3.563=-0.514
iters=5
new-facts=6402
prior-facts=1
mean4752.501-4752.696=-0.195
σ1.082-0.917=0.164
min4751.755-4751.873=-0.118
max4754.380-4754.266=0.115
mean2894.000-2886.000=8.000
σ0.000
min2894.000-2886.000=8.000
max2894.000-2886.000=8.000
mean8.979-8.132=0.847
σ0.316-0.634=-0.318
min8.537-7.664=0.873
max9.366-9.090=0.277
iters=5
new-facts=6402
prior-facts=6402
mean4943.164-4943.244=-0.080
σ0.143-0.019=0.124
min4942.911-4943.229=-0.318
max4943.253-4943.269=-0.017
mean3030.800-3070.800=-40.000
σ214.228-251.515=-37.287
min2894.000-2886.000=8.000
max3383.000-3465.000=-82.000
mean8.431-8.463=-0.032
σ0.098-0.085=0.012
min8.312-8.363=-0.051
max8.571-8.594=-0.023

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.044-1.021=0.024
σ0.179-0.135=0.043
min0.932-0.924=0.008
max1.346-1.236=0.110

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.290-472.293=-0.003
σ575.917-575.916=0.000
min184.328-184.326=0.002
max1336.165-1336.167=-0.002
mean88.250
σ8.500
min84.000
max101.000
mean2894.000-2886.000=8.000
σ0.000
min2894.000-2886.000=8.000
max2894.000-2886.000=8.000
mean0.448-0.450=-0.001
σ0.298-0.305=-0.007
min0.298-0.296=0.002
max0.896-0.907=-0.011
policies=20
mean1843.588-1843.592=-0.004
σ0.385-0.378=0.007
min1843.287-1843.302=-0.015
max1844.141-1844.138=0.003
mean840.000
σ0.000
min840.000
max840.000
mean2894.000-2886.000=8.000
σ0.000
min2894.000-2886.000=8.000
max2894.000-2886.000=8.000
mean2.983-2.962=0.021
σ0.045-0.030=0.015
min2.947-2.940=0.007
max3.042-3.007=0.035
policies=200
mean18442.214-18442.254=-0.040
σ0.327-0.484=-0.158
min18441.929-18441.971=-0.043
max18442.676-18442.979=-0.303
mean8400.000
σ0.000
min8400.000
max8400.000
mean2894.000-2886.000=8.000
σ0.000
min2894.000-2886.000=8.000
max2894.000-2886.000=8.000
mean29.344-29.313=0.031
σ0.543-0.475=0.068
min28.708-28.837=-0.129
max29.969-29.739=0.230