Compare commits

Home / Compare 6a0c4388 .. c1d87c7f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.046-73.045=0.001
σ0.049-0.047=0.002
min73.018-73.023=-0.005
max73.184-73.179=0.005
mean413.800-414.000=-0.200
σ0.422-0.000=0.422
min413.000-414.000=-1.000
max414.000
mean0.161-0.160=0.000
σ0.003-0.003=0.000
min0.157-0.156=0.001
max0.167-0.167=0.000
cache=y
dps=1
iters=10
policies=100
mean23.740-23.741=-0.001
σ0.002-0.002=-0.000
min23.737-23.737=-0.000
max23.744-23.745=-0.002
mean414.000
σ0.000
min414.000
max414.000
mean0.064-0.066=-0.002
σ0.004-0.003=0.001
min0.060-0.064=-0.004
max0.073-0.073=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.771-1758.786=-0.015
σ0.361-0.361=-0.000
min1758.197-1758.214=-0.017
max1759.353-1759.373=-0.019
mean1660.050-1620.350=39.700
σ634.986-596.031=38.955
min617.000-648.000=-31.000
max2899.000-2411.000=488.000
mean2.816-2.866=-0.050
σ0.194-0.158=0.036
min2.309-2.506=-0.197
max3.132-3.271=-0.139

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.000-324.011=-0.011
σ0.055-0.055=0.000
min323.902-323.913=-0.011
max324.033-324.040=-0.007
mean2899.000-2411.000=488.000
σ0.000
min2899.000-2411.000=488.000
max2899.000-2411.000=488.000
mean0.430-0.430=-0.001
σ0.007-0.005=0.001
min0.424-0.424=-0.001
max0.439-0.438=0.001
iters=5
new-facts=1
prior-facts=6402
mean1984.578-1984.589=-0.011
σ0.015-0.016=-0.001
min1984.554-1984.563=-0.009
max1984.592-1984.602=-0.010
mean2899.000-2411.000=488.000
σ0.000
min2899.000-2411.000=488.000
max2899.000-2411.000=488.000
mean2.567-2.623=-0.056
σ0.072-0.077=-0.005
min2.496-2.558=-0.063
max2.685-2.724=-0.038
iters=5
new-facts=6402
prior-facts=1
mean4808.224-4808.135=0.089
σ7.814-7.847=-0.033
min4804.642-4804.268=0.374
max4822.201-4822.166=0.035
mean2899.000-2411.000=488.000
σ0.000
min2899.000-2411.000=488.000
max2899.000-2411.000=488.000
mean8.967-8.953=0.013
σ0.213-0.216=-0.003
min8.720-8.661=0.060
max9.303-9.255=0.048
iters=5
new-facts=6402
prior-facts=6402
mean4995.788-4995.663=0.125
σ0.028-0.306=-0.277
min4995.759-4995.117=0.641
max4995.821-4995.826=-0.005
mean3074.000-2947.600=126.400
σ240.269-419.529=-179.261
min2899.000-2413.000=486.000
max3437.000-3440.000=-3.000
mean8.507-8.539=-0.032
σ0.084-0.169=-0.084
min8.455-8.439=0.016
max8.654-8.839=-0.184

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.127-1.812=-0.686
σ0.246-0.034=0.211
min0.921-1.759=-0.838
max1.506-1.851=-0.345

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.330-468.321=0.009
σ574.242-574.227=0.014
min181.203-181.204=-0.002
max1329.692-1329.662=0.030
mean88.250
σ8.500
min84.000
max101.000
mean2899.000-2411.000=488.000
σ0.000
min2899.000-2411.000=488.000
max2899.000-2411.000=488.000
mean0.446-0.561=-0.115
σ0.304-0.554=-0.250
min0.289-0.282=0.007
max0.902-1.392=-0.490
policies=20
mean1812.356-1812.416=-0.060
σ0.390-0.390=0.000
min1812.067-1812.157=-0.090
max1812.922-1812.993=-0.071
mean840.000
σ0.000
min840.000
max840.000
mean2899.000-2411.000=488.000
σ0.000
min2899.000-2411.000=488.000
max2899.000-2411.000=488.000
mean2.894-2.830=0.064
σ0.013-0.024=-0.011
min2.883-2.802=0.082
max2.912-2.855=0.058
policies=200
mean18129.828-18131.331=-1.503
σ0.660-0.376=0.284
min18128.966-18131.084=-2.118
max18130.345-18131.890=-1.545
mean8400.000
σ0.000
min8400.000
max8400.000
mean2899.000-2411.000=488.000
σ0.000
min2899.000-2411.000=488.000
max2899.000-2411.000=488.000
mean28.810-28.439=0.371
σ0.355-0.131=0.223
min28.326-28.312=0.014
max29.114-28.610=0.504