Compare commits

Home / Compare e2e482d8 .. c30b1827

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.563-70.565=-0.002
σ0.044-0.044=-0.000
min70.538-70.532=0.006
max70.687-70.686=0.001
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.160-0.154=0.006
σ0.003-0.005=-0.002
min0.155-0.147=0.008
max0.166-0.162=0.003
cache=y
dps=1
iters=10
policies=100
mean21.288-21.289=-0.001
σ0.003-0.003=-0.000
min21.284-21.284=-0.001
max21.291-21.294=-0.002
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.065-0.065=-0.000
σ0.003-0.003=-0.000
min0.063-0.063=0.000
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.653-1753.655=-0.002
σ0.359-0.361=-0.002
min1753.085-1753.084=0.001
max1754.226-1754.247=-0.021
mean1643.450-1665.600=-22.150
σ631.867-653.695=-21.828
min631.000-628.000=3.000
max2790.000-2826.000=-36.000
mean2.809-2.816=-0.007
σ0.126-0.260=-0.134
min2.561-2.215=0.347
max2.994-3.230=-0.236

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.095-272.100=-0.005
σ0.009-0.005=0.004
min272.081-272.093=-0.011
max272.106-272.106=0.000
mean2790.000-2826.000=-36.000
σ0.000
min2790.000-2826.000=-36.000
max2790.000-2826.000=-36.000
mean0.383-0.394=-0.011
σ0.011-0.017=-0.006
min0.375-0.374=0.002
max0.402-0.418=-0.016
iters=5
new-facts=1
prior-facts=6402
mean1932.517-1932.522=-0.004
σ0.005-0.009=-0.004
min1932.511-1932.511=-0.000
max1932.523-1932.531=-0.008
mean2790.000-2826.000=-36.000
σ0.000
min2790.000-2826.000=-36.000
max2790.000-2826.000=-36.000
mean3.045-3.058=-0.013
σ0.076-0.164=-0.088
min2.973-2.924=0.050
max3.142-3.341=-0.199
iters=5
new-facts=6402
prior-facts=1
mean4753.252-4753.313=-0.061
σ0.824-0.831=-0.007
min4752.806-4752.865=-0.059
max4754.723-4754.796=-0.073
mean2790.000-2826.000=-36.000
σ0.000
min2790.000-2826.000=-36.000
max2790.000-2826.000=-36.000
mean8.417-8.164=0.253
σ0.321-0.382=-0.061
min7.970-7.872=0.098
max8.830-8.620=0.210
iters=5
new-facts=6402
prior-facts=6402
mean4943.711-4943.714=-0.002
σ0.021-0.014=0.007
min4943.679-4943.696=-0.017
max4943.730-4943.734=-0.003
mean3031.400-3040.200=-8.800
σ222.825-262.067=-39.243
min2790.000-2826.000=-36.000
max3359.000-3423.000=-64.000
mean8.584-8.439=0.145
σ0.284-0.185=0.100
min8.367-8.292=0.075
max9.062-8.762=0.299

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.023-1.021=0.003
σ0.192-0.143=0.049
min0.934-0.928=0.005
max1.366-1.254=0.112

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.286-472.306=-0.019
σ575.911-575.911=-0.000
min184.325-184.342=-0.017
max1336.153-1336.172=-0.020
mean88.250
σ8.500
min84.000
max101.000
mean2790.000-2826.000=-36.000
σ0.000
min2790.000-2826.000=-36.000
max2790.000-2826.000=-36.000
mean0.481-0.448=0.033
σ0.364-0.309=0.055
min0.297-0.290=0.007
max1.028-0.912=0.116
policies=20
mean1843.545-1843.670=-0.125
σ0.345-0.300=0.045
min1843.321-1843.466=-0.145
max1844.054-1844.114=-0.060
mean840.000
σ0.000
min840.000
max840.000
mean2790.000-2826.000=-36.000
σ0.000
min2790.000-2826.000=-36.000
max2790.000-2826.000=-36.000
mean2.910-2.969=-0.059
σ0.102-0.121=-0.019
min2.831-2.844=-0.013
max3.057-3.135=-0.078
policies=200
mean18442.027-18442.200=-0.172
σ0.316-0.550=-0.234
min18441.796-18441.866=-0.069
max18442.494-18443.020=-0.526
mean8400.000
σ0.000
min8400.000
max8400.000
mean2790.000-2826.000=-36.000
σ0.000
min2790.000-2826.000=-36.000
max2790.000-2826.000=-36.000
mean28.793-28.929=-0.135
σ0.154-0.125=0.029
min28.690-28.779=-0.089
max29.018-29.085=-0.067