Compare commits

Home / Compare 5f1755d7 .. c1a4e652

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean34.101-34.100=0.000
σ0.048-0.049=-0.001
min34.068-34.072=-0.004
max34.231-34.235=-0.004
mean414.300-414.000=0.300
σ0.483-0.000=0.483
min414.000
max415.000-414.000=1.000
mean0.084-0.084=-0.000
σ0.003-0.003=-0.000
min0.082-0.082=0.000
max0.089-0.090=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.423-23.422=0.001
σ0.003-0.003=-0.001
min23.418-23.417=0.002
max23.427-23.428=-0.001
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.065-0.064=0.001
σ0.002-0.003=-0.001
min0.064-0.061=0.003
max0.071-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.513-1758.514=-0.001
σ0.364-0.365=-0.001
min1757.942-1757.938=0.003
max1759.104-1759.105=-0.001
mean1641.250-1664.650=-23.400
σ641.114-648.369=-7.255
min628.000-627.000=1.000
max2696.000-2849.000=-153.000
mean2.393-2.352=0.041
σ0.128-0.077=0.051
min2.172-2.247=-0.074
max2.687-2.546=0.141

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean329.707-329.713=-0.006
σ0.051-0.049=0.002
min329.617-329.627=-0.010
max329.737-329.747=-0.010
mean2696.000-2849.000=-153.000
σ0.000
min2696.000-2849.000=-153.000
max2696.000-2849.000=-153.000
mean0.427-0.427=0.001
σ0.000-0.001=-0.000
min0.427-0.426=0.001
max0.428-0.427=0.001
iters=5
new-facts=1
prior-facts=6402
mean1991.879-1991.870=0.010
σ0.010-0.011=-0.001
min1991.865-1991.854=0.011
max1991.891-1991.882=0.009
mean2696.000-2849.000=-153.000
σ0.000
min2696.000-2849.000=-153.000
max2696.000-2849.000=-153.000
mean2.665-2.749=-0.084
σ0.089-0.278=-0.189
min2.570-2.513=0.057
max2.767-3.230=-0.463
iters=5
new-facts=6402
prior-facts=1
mean4816.729-4816.731=-0.002
σ7.719-7.724=-0.005
min4813.214-4813.205=0.009
max4830.538-4830.549=-0.011
mean2696.000-2849.000=-153.000
σ0.000
min2696.000-2849.000=-153.000
max2696.000-2849.000=-153.000
mean8.856-8.807=0.049
σ0.332-0.612=-0.280
min8.371-7.987=0.384
max9.173-9.633=-0.460
iters=5
new-facts=6402
prior-facts=6402
mean5004.202-5004.268=-0.066
σ0.174-0.019=0.154
min5003.893-5004.248=-0.355
max5004.302-5004.296=0.006
mean3027.800-3015.000=12.800
σ288.567-192.302=96.265
min2696.000-2849.000=-153.000
max3417.000-3319.000=98.000
mean9.808-9.638=0.170
σ0.073-0.212=-0.139
min9.721-9.441=0.279
max9.912-9.948=-0.035

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.944-1.006=-0.062
σ0.053-0.069=-0.016
min0.913-0.916=-0.003
max1.037-1.058=-0.021

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.480-465.484=-0.004
σ574.772-574.768=0.004
min178.087-178.089=-0.001
max1327.637-1327.635=0.002
mean88.250
σ8.500
min84.000
max101.000
mean2696.000-2849.000=-153.000
σ0.000
min2696.000-2849.000=-153.000
max2696.000-2849.000=-153.000
mean0.538-0.436=0.102
σ0.527-0.312=0.216
min0.270-0.277=-0.007
max1.329-0.904=0.426
policies=20
mean1781.158-1781.181=-0.023
σ0.352-0.359=-0.007
min1780.932-1780.936=-0.004
max1781.683-1781.712=-0.030
mean840.000
σ0.000
min840.000
max840.000
mean2696.000-2849.000=-153.000
σ0.000
min2696.000-2849.000=-153.000
max2696.000-2849.000=-153.000
mean2.746-2.800=-0.054
σ0.007-0.010=-0.004
min2.736-2.792=-0.056
max2.750-2.815=-0.065
policies=200
mean17818.565-17818.710=-0.145
σ0.389-0.461=-0.072
min17818.287-17818.408=-0.121
max17819.131-17819.395=-0.264
mean8400.000
σ0.000
min8400.000
max8400.000
mean2696.000-2849.000=-153.000
σ0.000
min2696.000-2849.000=-153.000
max2696.000-2849.000=-153.000
mean27.617-27.969=-0.351
σ0.111-0.362=-0.251
min27.490-27.505=-0.016
max27.729-28.284=-0.554