Compare commits

Home / Compare 4d76a440 .. 09e6000c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.695-70.565=0.130
σ0.046-0.046=0.000
min70.669-70.539=0.130
max70.825-70.694=0.132
mean417.000-412.000=5.000
σ0.000
min417.000-412.000=5.000
max417.000-412.000=5.000
mean0.160-0.161=-0.001
σ0.004-0.004=0.000
min0.156-0.156=-0.000
max0.167-0.166=0.001
cache=y
dps=1
iters=10
policies=100
mean21.421-21.288=0.133
σ0.002-0.003=-0.001
min21.417-21.283=0.134
max21.425-21.292=0.133
mean417.000-412.000=5.000
σ0.000
min417.000-412.000=5.000
max417.000-412.000=5.000
mean0.066-0.061=0.005
σ0.003-0.003=0.000
min0.063-0.058=0.005
max0.072-0.067=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.458-1753.175=1.283
σ0.359-0.361=-0.002
min1753.892-1752.603=1.289
max1755.037-1753.761=1.276
mean1644.150-1650.850=-6.700
σ627.901-642.395=-14.495
min627.000-629.000=-2.000
max2858.000-2878.000=-20.000
mean2.797-2.901=-0.105
σ0.197-0.115=0.082
min2.145-2.563=-0.417
max2.967-3.063=-0.096

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.505-271.622=1.883
σ0.006-0.005=0.002
min273.495-271.617=1.878
max273.511-271.628=1.883
mean2858.000-2878.000=-20.000
σ0.000
min2858.000-2878.000=-20.000
max2858.000-2878.000=-20.000
mean0.379-0.384=-0.006
σ0.009-0.010=-0.002
min0.371-0.376=-0.004
max0.391-0.399=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1933.893-1932.053=1.840
σ0.005-0.012=-0.007
min1933.888-1932.040=1.849
max1933.902-1932.066=1.836
mean2858.000-2878.000=-20.000
σ0.000
min2858.000-2878.000=-20.000
max2858.000-2878.000=-20.000
mean3.027-3.062=-0.035
σ0.048-0.128=-0.080
min2.977-2.972=0.004
max3.099-3.287=-0.187
iters=5
new-facts=6402
prior-facts=1
mean4754.743-4752.701=2.042
σ0.775-0.893=-0.118
min4754.336-4751.945=2.391
max4756.128-4754.241=1.886
mean2858.000-2878.000=-20.000
σ0.000
min2858.000-2878.000=-20.000
max2858.000-2878.000=-20.000
mean8.111-8.159=-0.048
σ0.338-0.582=-0.244
min7.804-7.677=0.127
max8.503-9.105=-0.601
iters=5
new-facts=6402
prior-facts=6402
mean4945.045-4943.150=1.895
σ0.154-0.157=-0.002
min4944.770-4942.871=1.899
max4945.135-4943.235=1.900
mean3072.000-3069.600=2.400
σ287.482-261.915=25.567
min2858.000-2878.000=-20.000
max3520.000-3479.000=41.000
mean8.422-8.402=0.020
σ0.106-0.114=-0.008
min8.340-8.300=0.040
max8.600-8.595=0.005

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.039-1.079=-0.040
σ0.244-0.126=0.118
min0.928-0.934=-0.006
max1.475-1.282=0.193

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.083-472.292=0.790
σ575.919-575.922=-0.003
min185.115-184.327=0.788
max1336.961-1336.175=0.787
mean88.250
σ8.500
min84.000
max101.000
mean2858.000-2878.000=-20.000
σ0.000
min2858.000-2878.000=-20.000
max2858.000-2878.000=-20.000
mean0.448-0.497=-0.049
σ0.298-0.377=-0.079
min0.297-0.306=-0.009
max0.896-1.062=-0.167
policies=20
mean1851.451-1843.585=7.866
σ0.370-0.376=-0.006
min1851.178-1843.305=7.873
max1851.989-1844.131=7.858
mean840.000
σ0.000
min840.000
max840.000
mean2858.000-2878.000=-20.000
σ0.000
min2858.000-2878.000=-20.000
max2858.000-2878.000=-20.000
mean2.937-3.006=-0.069
σ0.011-0.047=-0.036
min2.921-2.963=-0.043
max2.946-3.049=-0.102
policies=200
mean18519.901-18442.234=77.667
σ0.762-0.448=0.314
min18519.208-18441.896=77.312
max18520.839-18442.892=77.946
mean8400.000
σ0.000
min8400.000
max8400.000
mean2858.000-2878.000=-20.000
σ0.000
min2858.000-2878.000=-20.000
max2858.000-2878.000=-20.000
mean29.113-29.383=-0.270
σ0.475-0.430=0.045
min28.726-29.040=-0.313
max29.787-30.011=-0.223