Compare commits

Home / Compare 5ce55ab1 .. 0cdc9165

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.780-70.691=0.089
σ0.052-0.048=0.004
min70.749-70.658=0.090
max70.927-70.826=0.101
mean416.000
σ0.000
min416.000
max416.000
mean0.158-0.161=-0.002
σ0.004-0.004=0.001
min0.152-0.158=-0.006
max0.166-0.168=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.494-21.420=0.074
σ0.002-0.003=-0.001
min21.490-21.416=0.074
max21.498-21.425=0.073
mean416.000
σ0.000
min416.000
max416.000
mean0.064-0.064=-0.000
σ0.004-0.004=-0.001
min0.059-0.058=0.001
max0.069-0.074=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.880-1754.458=-2.578
σ0.361-0.360=0.001
min1751.310-1753.881=-2.571
max1752.467-1755.039=-2.572
mean1665.400-1670.850=-5.450
σ627.395-628.866=-1.471
min684.000-664.000=20.000
max2757.000-2620.000=137.000
mean2.815-2.800=0.014
σ0.138-0.126=0.012
min2.435-2.412=0.023
max2.991-2.927=0.064

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.377-273.501=-4.124
σ0.004-0.005=-0.001
min269.373-273.493=-4.120
max269.382-273.506=-4.124
mean2757.000-2620.000=137.000
σ0.000
min2757.000-2620.000=137.000
max2757.000-2620.000=137.000
mean0.376-0.378=-0.002
σ0.005-0.004=0.001
min0.371-0.376=-0.005
max0.384-0.386=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1929.752-1933.892=-4.139
σ0.004-0.005=-0.002
min1929.747-1933.883=-4.136
max1929.755-1933.896=-4.141
mean2757.000-2620.000=137.000
σ0.000
min2757.000-2620.000=137.000
max2757.000-2620.000=137.000
mean3.083-3.035=0.049
σ0.104-0.137=-0.033
min2.989-2.820=0.169
max3.197-3.158=0.039
iters=5
new-facts=6402
prior-facts=1
mean4750.378-4613.988=136.390
σ0.931-314.468=-313.538
min4749.631-4051.453=698.179
max4752.005-4756.134=-4.130
mean2757.000-2620.000=137.000
σ0.000
min2757.000-2620.000=137.000
max2757.000-2620.000=137.000
mean8.476-8.081=0.396
σ0.459-0.725=-0.266
min7.809-7.000=0.809
max8.925-8.942=-0.017
iters=5
new-facts=6402
prior-facts=6402
mean4940.987-4945.056=-4.069
σ0.015-0.173=-0.158
min4940.968-4944.747=-3.780
max4941.000-4945.160=-4.160
mean3042.800-3014.000=28.800
σ239.603-378.325=-138.721
min2757.000-2620.000=137.000
max3331.000-3543.000=-212.000
mean8.511-8.815=-0.304
σ0.123-0.366=-0.244
min8.373-8.538=-0.165
max8.683-9.448=-0.765

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.993-1.286=-0.292
σ0.142-0.358=-0.217
min0.923-0.927=-0.005
max1.247-1.739=-0.492

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.699-472.567=-9.868
σ574.941-574.933=0.008
min175.223-185.096=-9.872
max1325.111-1334.966=-9.855
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2757.000-2620.000=137.000
σ0.000
min2757.000-2620.000=137.000
max2757.000-2620.000=137.000
mean0.562-0.558=0.004
σ0.568-0.534=0.034
min0.275-0.289=-0.014
max1.414-1.359=0.055
policies=20
mean1752.491-1851.234=-98.743
σ0.354-0.368=-0.014
min1752.265-1850.985=-98.720
max1753.020-1851.780=-98.760
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2757.000-2620.000=137.000
σ0.000
min2757.000-2620.000=137.000
max2757.000-2620.000=137.000
mean2.730-2.859=-0.129
σ0.015-0.021=-0.005
min2.715-2.836=-0.121
max2.748-2.877=-0.129
policies=200
mean17532.226-18519.214=-986.988
σ0.528-0.574=-0.046
min17531.864-18518.830=-986.965
max17533.002-18520.056=-987.055
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2757.000-2620.000=137.000
σ0.000
min2757.000-2620.000=137.000
max2757.000-2620.000=137.000
mean27.581-28.955=-1.374
σ0.043-0.032=0.012
min27.535-28.925=-1.390
max27.637-28.998=-1.361