Compare commits

Home / Compare e0d7dc04 .. d9361983

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.730-70.734=-0.004
σ0.050-0.045=0.005
min70.700-70.707=-0.007
max70.870-70.859=0.011
mean419.000
σ0.000
min419.000
max419.000
mean0.159-0.160=-0.000
σ0.002-0.003=-0.000
min0.157-0.156=0.001
max0.165-0.165=0.001
cache=y
dps=1
iters=10
policies=100
mean21.445-21.445=-0.000
σ0.003-0.004=-0.000
min21.441-21.440=0.001
max21.450-21.452=-0.002
mean419.600-419.000=0.600
σ0.516-0.000=0.516
min419.000
max420.000-419.000=1.000
mean0.065-0.063=0.001
σ0.004-0.004=-0.001
min0.058-0.059=-0.001
max0.073-0.073=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.526-1754.526=0.000
σ0.359-0.360=-0.001
min1753.955-1753.957=-0.002
max1755.104-1755.104=0.000
mean1644.700-1660.700=-16.000
σ630.627-626.007=4.620
min644.000-628.000=16.000
max2862.000-2838.000=24.000
mean2.779-2.784=-0.005
σ0.178-0.137=0.041
min2.378-2.340=0.038
max3.198-2.968=0.230

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.606-273.611=-0.005
σ0.006-0.006=0.000
min273.598-273.602=-0.004
max273.613-273.617=-0.004
mean2862.000-2838.000=24.000
σ0.000
min2862.000-2838.000=24.000
max2862.000-2838.000=24.000
mean0.385-0.386=-0.001
σ0.006-0.005=0.001
min0.380-0.381=-0.001
max0.396-0.394=0.002
iters=5
new-facts=1
prior-facts=6402
mean1934.003-1934.003=0.000
σ0.009-0.007=0.003
min1933.989-1933.993=-0.005
max1934.012-1934.011=0.001
mean2862.000-2838.000=24.000
σ0.000
min2862.000-2838.000=24.000
max2862.000-2838.000=24.000
mean3.147-2.901=0.245
σ0.144-0.320=-0.175
min2.929-2.387=0.542
max3.295-3.179=0.117
iters=5
new-facts=6402
prior-facts=1
mean4754.767-4754.776=-0.009
σ0.846-0.833=0.013
min4754.210-4754.310=-0.099
max4756.262-4756.259=0.003
mean2862.000-2838.000=24.000
σ0.000
min2862.000-2838.000=24.000
max2862.000-2838.000=24.000
mean8.622-8.411=0.211
σ0.502-0.463=0.039
min8.118-7.682=0.436
max9.388-8.859=0.530
iters=5
new-facts=6402
prior-facts=6402
mean4945.226-4945.151=0.076
σ0.012-0.141=-0.128
min4945.208-4944.901=0.307
max4945.238-4945.241=-0.003
mean3101.400-3057.800=43.600
σ245.879-229.327=16.552
min2862.000-2838.000=24.000
max3353.000-3295.000=58.000
mean8.816-8.825=-0.009
σ0.415-0.360=0.055
min8.424-8.440=-0.016
max9.421-9.355=0.066

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.046-1.001=0.045
σ0.186-0.140=0.046
min0.923-0.933=-0.011
max1.359-1.252=0.107

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.842-472.845=-0.003
σ574.925-574.928=-0.003
min185.370-185.375=-0.005
max1335.229-1335.236=-0.007
mean88.250
σ8.500
min84.000
max101.000
mean2862.000-2838.000=24.000
σ0.000
min2862.000-2838.000=24.000
max2862.000-2838.000=24.000
mean0.452-0.477=-0.025
σ0.307-0.358=-0.051
min0.296-0.298=-0.002
max0.912-1.014=-0.102
policies=20
mean1853.998-1854.030=-0.031
σ0.372-0.369=0.003
min1853.724-1853.756=-0.032
max1854.539-1854.567=-0.028
mean840.000
σ0.000
min840.000
max840.000
mean2862.000-2838.000=24.000
σ0.000
min2862.000-2838.000=24.000
max2862.000-2838.000=24.000
mean2.958-2.963=-0.005
σ0.013-0.006=0.007
min2.943-2.955=-0.012
max2.973-2.967=0.006
policies=200
mean18546.738-18546.762=-0.024
σ0.458-0.432=0.027
min18546.502-18546.485=0.017
max18547.425-18547.406=0.020
mean8400.000
σ0.000
min8400.000
max8400.000
mean2862.000-2838.000=24.000
σ0.000
min2862.000-2838.000=24.000
max2862.000-2838.000=24.000
mean29.194-29.233=-0.039
σ0.452-0.441=0.011
min28.830-28.796=0.034
max29.838-29.753=0.085