Compare commits

Home / Compare 150d330f .. ffa9d979

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.264=0.354
σ0.055-0.053=0.003
min35.587-35.238=0.349
max35.775-35.412=0.363
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.086-0.085=0.000
σ0.004-0.004=0.000
min0.081-0.082=-0.000
max0.093-0.092=0.001
cache=y
dps=1
iters=10
policies=100
mean24.047-23.769=0.278
σ0.003-0.003=0.000
min24.045-23.765=0.280
max24.053-23.774=0.279
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.064-0.069=-0.005
σ0.004-0.004=0.000
min0.061-0.066=-0.005
max0.072-0.076=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1756.487=0.002
σ0.365-0.365=0.000
min1755.914-1755.910=0.005
max1757.076-1757.078=-0.002
mean1642.300-1656.250=-13.950
σ643.911-642.871=1.041
min616.000-630.000=-14.000
max2718.000-2839.000=-121.000
mean2.385-2.327=0.058
σ0.113-0.064=0.049
min2.221-2.231=-0.011
max2.633-2.435=0.198

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.765-324.705=0.060
σ0.042-0.056=-0.014
min324.691-324.606=0.085
max324.792-324.738=0.053
mean2718.000-2839.000=-121.000
σ0.000
min2718.000-2839.000=-121.000
max2718.000-2839.000=-121.000
mean0.428-0.424=0.004
σ0.009-0.002=0.007
min0.421-0.421=0.000
max0.442-0.426=0.015
iters=5
new-facts=1
prior-facts=6402
mean1985.316-1985.258=0.058
σ0.021-0.020=0.001
min1985.292-1985.231=0.061
max1985.334-1985.277=0.057
mean2718.000-2839.000=-121.000
σ0.000
min2718.000-2839.000=-121.000
max2718.000-2839.000=-121.000
mean2.631-2.625=0.006
σ0.102-0.091=0.011
min2.551-2.534=0.017
max2.761-2.765=-0.005
iters=5
new-facts=6402
prior-facts=1
mean4809.096-4808.864=0.232
σ7.647-7.642=0.005
min4805.611-4805.371=0.240
max4822.775-4822.534=0.241
mean2718.000-2839.000=-121.000
σ0.000
min2718.000-2839.000=-121.000
max2718.000-2839.000=-121.000
mean8.962-8.695=0.267
σ0.362-0.188=0.174
min8.581-8.494=0.088
max9.521-8.894=0.627
iters=5
new-facts=6402
prior-facts=6402
mean4996.621-4996.458=0.163
σ0.028-0.019=0.009
min4996.589-4996.429=0.160
max4996.652-4996.481=0.171
mean2982.200-3070.200=-88.000
σ310.297-303.047=7.250
min2718.000-2839.000=-121.000
max3430.000-3535.000=-105.000
mean8.458-8.536=-0.078
σ0.049-0.124=-0.075
min8.398-8.427=-0.029
max8.511-8.672=-0.161

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.974-0.995=-0.021
σ0.145-0.062=0.082
min0.902-0.911=-0.009
max1.232-1.045=0.187

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.224-462.972=0.252
σ574.795-574.254=0.541
min175.814-175.835=-0.021
max1325.417-1324.354=1.063
mean86.250
σ8.500
min82.000
max99.000
mean2718.000-2839.000=-121.000
σ0.000
min2718.000-2839.000=-121.000
max2718.000-2839.000=-121.000
mean0.531-0.433=0.098
σ0.514-0.301=0.212
min0.273-0.279=-0.006
max1.302-0.885=0.417
policies=20
mean1758.498-1758.691=-0.193
σ0.321-0.352=-0.032
min1758.281-1758.440=-0.158
max1758.973-1759.208=-0.236
mean820.000
σ0.000
min820.000
max820.000
mean2718.000-2839.000=-121.000
σ0.000
min2718.000-2839.000=-121.000
max2718.000-2839.000=-121.000
mean2.694-2.813=-0.119
σ0.016-0.027=-0.010
min2.677-2.790=-0.112
max2.711-2.849=-0.138
policies=200
mean17592.157-17593.290=-1.133
σ0.533-0.518=0.015
min17591.851-17592.554=-0.703
max17592.955-17593.673=-0.717
mean8200.000
σ0.000
min8200.000
max8200.000
mean2718.000-2839.000=-121.000
σ0.000
min2718.000-2839.000=-121.000
max2718.000-2839.000=-121.000
mean27.396-27.872=-0.477
σ0.121-0.350=-0.230
min27.239-27.523=-0.284
max27.519-28.230=-0.712