Compare commits

Home / Compare 51cbf3d4 .. a59f8e06

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.045-73.046=-0.001
σ0.047-0.048=-0.001
min73.021-73.022=-0.002
max73.178-73.181=-0.003
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.160-0.162=-0.002
σ0.004-0.004=-0.000
min0.152-0.158=-0.005
max0.167-0.168=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.740-23.740=-0.001
σ0.004-0.003=0.001
min23.735-23.736=-0.001
max23.747-23.744=0.002
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.066-0.066=-0.001
σ0.004-0.002=0.002
min0.059-0.065=-0.005
max0.073-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.787-1758.787=-0.000
σ0.357-0.361=-0.004
min1758.213-1758.211=0.003
max1759.369-1759.376=-0.007
mean1657.150-1655.600=1.550
σ622.031-627.734=-5.703
min622.000-620.000=2.000
max2500.000-2515.000=-15.000
mean2.815-2.775=0.041
σ0.137-0.169=-0.032
min2.470-2.327=0.143
max2.984-2.973=0.011

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.018-324.012=0.006
σ0.044-0.052=-0.007
min323.939-323.920=0.020
max324.047-324.039=0.008
mean2500.000-2515.000=-15.000
σ0.000
min2500.000-2515.000=-15.000
max2500.000-2515.000=-15.000
mean0.425-0.429=-0.003
σ0.002-0.005=-0.003
min0.423-0.425=-0.002
max0.428-0.437=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1984.592-1984.591=0.001
σ0.010-0.017=-0.007
min1984.575-1984.572=0.002
max1984.600-1984.610=-0.010
mean2500.000-2515.000=-15.000
σ0.000
min2500.000-2515.000=-15.000
max2500.000-2515.000=-15.000
mean2.636-2.662=-0.026
σ0.070-0.096=-0.026
min2.575-2.570=0.006
max2.738-2.812=-0.074
iters=5
new-facts=6402
prior-facts=1
mean4808.238-4808.234=0.004
σ7.813-7.771=0.042
min4804.724-4804.670=0.054
max4822.215-4822.135=0.080
mean2500.000-2515.000=-15.000
σ0.000
min2500.000-2515.000=-15.000
max2500.000-2515.000=-15.000
mean9.015-8.854=0.161
σ0.117-0.182=-0.066
min8.860-8.641=0.219
max9.141-9.092=0.049
iters=5
new-facts=6402
prior-facts=6402
mean4995.806-4995.806=0.000
σ0.025-0.020=0.005
min4995.777-4995.786=-0.009
max4995.832-4995.827=0.005
mean2939.600-2973.400=-33.800
σ372.098-407.210=-35.112
min2500.000-2515.000=-15.000
max3416.000-3488.000=-72.000
mean8.567-8.629=-0.063
σ0.146-0.195=-0.049
min8.431-8.467=-0.037
max8.781-8.924=-0.143

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.554-1.595=-0.041
σ0.219-0.271=-0.052
min1.252-1.232=0.021
max1.780-1.876=-0.096

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.325-468.328=-0.003
σ574.237-574.230=0.007
min181.205-181.207=-0.002
max1329.680-1329.674=0.006
mean88.250
σ8.500
min84.000
max101.000
mean2500.000-2515.000=-15.000
σ0.000
min2500.000-2515.000=-15.000
max2500.000-2515.000=-15.000
mean0.562-0.547=0.015
σ0.555-0.526=0.029
min0.283-0.282=0.001
max1.394-1.336=0.058
policies=20
mean1812.395-1812.428=-0.033
σ0.391-0.394=-0.003
min1812.145-1812.172=-0.027
max1812.976-1813.012=-0.036
mean840.000
σ0.000
min840.000
max840.000
mean2500.000-2515.000=-15.000
σ0.000
min2500.000-2515.000=-15.000
max2500.000-2515.000=-15.000
mean2.805-2.798=0.007
σ0.021-0.021=0.000
min2.777-2.771=0.006
max2.825-2.821=0.004
policies=200
mean18131.449-18131.639=-0.190
σ0.630-0.453=0.177
min18130.829-18131.348=-0.519
max18132.317-18132.316=0.001
mean8400.000
σ0.000
min8400.000
max8400.000
mean2500.000-2515.000=-15.000
σ0.000
min2500.000-2515.000=-15.000
max2500.000-2515.000=-15.000
mean28.300-28.239=0.061
σ0.020-0.100=-0.080
min28.273-28.172=0.101
max28.320-28.387=-0.067