Compare commits

Home / Compare f0dbcf88 .. 3147d3d5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.696-70.561=0.135
σ0.047-0.047=0.000
min70.666-70.532=0.134
max70.829-70.693=0.136
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.158-0.156=0.003
σ0.004-0.005=-0.002
min0.152-0.149=0.003
max0.161-0.162=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.420-21.292=0.127
σ0.003-0.013=-0.010
min21.414-21.284=0.130
max21.424-21.328=0.095
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.065-0.065=-0.000
σ0.003-0.002=0.001
min0.062-0.063=-0.001
max0.073-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.459-1753.175=1.284
σ0.360-0.360=0.000
min1753.890-1752.605=1.285
max1755.060-1753.752=1.307
mean1658.250-1662.100=-3.850
σ627.157-626.116=1.041
min623.000-669.000=-46.000
max2837.000-2677.000=160.000
mean2.817-2.862=-0.045
σ0.193-0.107=0.086
min2.383-2.505=-0.122
max3.256-3.005=0.251

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.499-271.616=1.883
σ0.017-0.007=0.010
min273.475-271.609=1.865
max273.515-271.627=1.889
mean2837.000-2677.000=160.000
σ0.000
min2837.000-2677.000=160.000
max2837.000-2677.000=160.000
mean0.384-0.376=0.009
σ0.001-0.008=-0.007
min0.383-0.371=0.012
max0.386-0.390=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1933.897-1932.040=1.857
σ0.012-0.006=0.006
min1933.885-1932.033=1.852
max1933.912-1932.045=1.867
mean2837.000-2677.000=160.000
σ0.000
min2837.000-2677.000=160.000
max2837.000-2677.000=160.000
mean2.834-3.073=-0.239
σ0.196-0.085=0.111
min2.495-2.998=-0.503
max2.992-3.198=-0.206
iters=5
new-facts=6402
prior-facts=1
mean4754.564-4752.622=1.942
σ0.983-0.947=0.036
min4753.781-4751.933=1.848
max4756.277-4754.249=2.027
mean2837.000-2677.000=160.000
σ0.000
min2837.000-2677.000=160.000
max2837.000-2677.000=160.000
mean8.590-7.917=0.672
σ0.439-0.266=0.173
min7.931-7.727=0.204
max9.072-8.379=0.692
iters=5
new-facts=6402
prior-facts=6402
mean4945.048-4943.093=1.955
σ0.167-0.335=-0.168
min4944.753-4942.495=2.258
max4945.152-4943.265=1.887
mean3058.600-2985.800=72.800
σ232.355-331.805=-99.450
min2837.000-2677.000=160.000
max3393.000-3438.000=-45.000
mean8.563-8.456=0.107
σ0.252-0.110=0.143
min8.323-8.379=-0.056
max8.983-8.650=0.333

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.999-1.082=-0.084
σ0.142-0.153=-0.011
min0.934-0.930=0.004
max1.253-1.255=-0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.100-472.319=0.781
σ575.912-575.921=-0.010
min185.134-184.348=0.786
max1336.967-1336.201=0.766
mean88.250
σ8.500
min84.000
max101.000
mean2837.000-2677.000=160.000
σ0.000
min2837.000-2677.000=160.000
max2837.000-2677.000=160.000
mean0.487-0.548=-0.061
σ0.375-0.521=-0.146
min0.299-0.286=0.013
max1.050-1.330=-0.280
policies=20
mean1851.669-1843.812=7.857
σ0.373-0.400=-0.026
min1851.386-1843.533=7.853
max1852.212-1844.402=7.810
mean840.000
σ0.000
min840.000
max840.000
mean2837.000-2677.000=160.000
σ0.000
min2837.000-2677.000=160.000
max2837.000-2677.000=160.000
mean2.953-2.907=0.046
σ0.008-0.057=-0.050
min2.946-2.871=0.074
max2.963-2.993=-0.029
policies=200
mean18522.479-18444.601=77.878
σ0.583-0.362=0.221
min18521.689-18444.361=77.328
max18523.083-18445.130=77.953
mean8400.000
σ0.000
min8400.000
max8400.000
mean2837.000-2677.000=160.000
σ0.000
min2837.000-2677.000=160.000
max2837.000-2677.000=160.000
mean29.204-29.069=0.135
σ0.544-0.228=0.316
min28.729-28.760=-0.031
max29.895-29.253=0.642