Compare commits

Home / Compare 5c6f0700 .. 519b4116

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.148-73.063=0.084
σ0.053-0.046=0.007
min73.117-73.036=0.081
max73.296-73.192=0.104
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.169-0.157=0.012
σ0.015-0.006=0.009
min0.150-0.151=-0.001
max0.189-0.168=0.021
cache=y
dps=1
iters=10
policies=100
mean23.769-23.756=0.013
σ0.004-0.004=0.000
min23.764-23.750=0.013
max23.780-23.763=0.017
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.069-0.068=0.001
σ0.004-0.003=0.001
min0.067-0.066=0.001
max0.078-0.076=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.829-1758.792=-2.963
σ0.361-0.362=-0.001
min1755.260-1758.224=-2.964
max1756.410-1759.377=-2.967
mean1656.900-1645.700=11.200
σ648.936-629.207=19.729
min651.000-621.000=30.000
max2852.000-2771.000=81.000
mean2.863-2.780=0.083
σ0.130-0.230=-0.100
min2.639-2.171=0.468
max3.226-3.048=0.177

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean321.068-323.999=-2.931
σ0.029-0.049=-0.020
min321.018-323.914=-2.896
max321.090-324.040=-2.950
mean2852.000-2771.000=81.000
σ0.000
min2852.000-2771.000=81.000
max2852.000-2771.000=81.000
mean0.421-0.430=-0.009
σ0.001-0.003=-0.002
min0.420-0.427=-0.008
max0.423-0.435=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1981.640-1984.593=-2.953
σ0.010-0.021=-0.010
min1981.624-1984.565=-2.942
max1981.652-1984.611=-2.959
mean2852.000-2771.000=81.000
σ0.000
min2852.000-2771.000=81.000
max2852.000-2771.000=81.000
mean2.595-2.576=0.019
σ0.077-0.017=0.059
min2.533-2.554=-0.021
max2.703-2.598=0.105
iters=5
new-facts=6402
prior-facts=1
mean4805.032-4808.228=-3.196
σ7.854-7.813=0.041
min4801.184-4804.662=-3.478
max4819.070-4822.204=-3.134
mean2852.000-2771.000=81.000
σ0.000
min2852.000-2771.000=81.000
max2852.000-2771.000=81.000
mean8.921-9.017=-0.095
σ0.149-0.155=-0.006
min8.700-8.869=-0.169
max9.108-9.210=-0.102
iters=5
new-facts=6402
prior-facts=6402
mean4992.764-4995.817=-3.053
σ0.167-0.021=0.146
min4992.468-4995.785=-3.318
max4992.870-4995.838=-2.968
mean3070.400-3047.000=23.400
σ233.985-338.314=-104.330
min2852.000-2771.000=81.000
max3416.000-3558.000=-142.000
mean8.712-8.539=0.172
σ0.131-0.116=0.016
min8.517-8.441=0.075
max8.849-8.682=0.167

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.030-1.020=0.010
σ0.129-0.142=-0.013
min0.912-0.923=-0.011
max1.231-1.252=-0.021

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.432-468.368=-5.935
σ574.245-574.238=0.007
min175.300-181.238=-5.938
max1323.799-1329.724=-5.925
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2852.000-2771.000=81.000
σ0.000
min2852.000-2771.000=81.000
max2852.000-2771.000=81.000
mean0.420-0.434=-0.014
σ0.307-0.310=-0.003
min0.237-0.258=-0.021
max0.879-0.898=-0.019
policies=20
mean1753.315-1812.727=-59.412
σ0.386-0.385=0.001
min1753.072-1812.458=-59.387
max1753.891-1813.293=-59.401
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2852.000-2771.000=81.000
σ0.000
min2852.000-2771.000=81.000
max2852.000-2771.000=81.000
mean2.786-2.895=-0.108
σ0.035-0.013=0.022
min2.760-2.883=-0.123
max2.837-2.910=-0.073
policies=200
mean17539.735-18132.485=-592.749
σ0.369-0.576=-0.207
min17539.278-18132.118=-592.840
max17540.065-18133.342=-593.277
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2852.000-2771.000=81.000
σ0.000
min2852.000-2771.000=81.000
max2852.000-2771.000=81.000
mean27.752-28.424=-0.672
σ0.247-0.162=0.085
min27.442-28.229=-0.787
max27.971-28.559=-0.589