Compare commits

Home / Compare 842d25e6 .. b0a8d435

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.264=0.355
σ0.055-0.054=0.001
min35.587-35.234=0.353
max35.775-35.416=0.359
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.086-0.085=0.000
σ0.004-0.004=0.001
min0.081-0.080=0.001
max0.093-0.092=0.002
cache=y
dps=1
iters=10
policies=100
mean24.047-23.770=0.277
σ0.003-0.003=-0.000
min24.045-23.766=0.279
max24.053-23.774=0.279
mean414.000-412.700=1.300
σ0.000-0.483=-0.483
min414.000-412.000=2.000
max414.000-413.000=1.000
mean0.064-0.068=-0.005
σ0.004-0.003=0.001
min0.061-0.066=-0.005
max0.072-0.075=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1756.472=0.018
σ0.365-0.366=-0.000
min1755.914-1755.897=0.017
max1757.076-1757.064=0.013
mean1642.300-1654.000=-11.700
σ643.911-644.000=-0.088
min616.000-626.000=-10.000
max2718.000-2844.000=-126.000
mean2.385-2.368=0.017
σ0.113-0.087=0.026
min2.221-2.278=-0.058
max2.633-2.569=0.063

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.765-324.688=0.078
σ0.042-0.053=-0.011
min324.691-324.593=0.099
max324.792-324.719=0.072
mean2718.000-2844.000=-126.000
σ0.000
min2718.000-2844.000=-126.000
max2718.000-2844.000=-126.000
mean0.428-0.425=0.003
σ0.009-0.002=0.007
min0.421-0.424=-0.003
max0.442-0.428=0.014
iters=5
new-facts=1
prior-facts=6402
mean1985.316-1985.249=0.067
σ0.021-0.016=0.004
min1985.292-1985.228=0.064
max1985.334-1985.263=0.071
mean2718.000-2844.000=-126.000
σ0.000
min2718.000-2844.000=-126.000
max2718.000-2844.000=-126.000
mean2.631-2.671=-0.041
σ0.102-0.156=-0.054
min2.551-2.535=0.016
max2.761-2.851=-0.091
iters=5
new-facts=6402
prior-facts=1
mean4809.096-4808.856=0.240
σ7.647-7.673=-0.025
min4805.611-4805.322=0.289
max4822.775-4822.581=0.194
mean2718.000-2844.000=-126.000
σ0.000
min2718.000-2844.000=-126.000
max2718.000-2844.000=-126.000
mean8.962-8.883=0.079
σ0.362-0.177=0.185
min8.581-8.635=-0.053
max9.521-9.050=0.471
iters=5
new-facts=6402
prior-facts=6402
mean4996.621-4996.444=0.177
σ0.028-0.021=0.007
min4996.589-4996.417=0.172
max4996.652-4996.464=0.188
mean2982.200-3067.000=-84.800
σ310.297-297.220=13.077
min2718.000-2844.000=-126.000
max3430.000-3529.000=-99.000
mean8.458-8.523=-0.065
σ0.049-0.115=-0.067
min8.398-8.424=-0.026
max8.511-8.723=-0.212

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.974-1.117=-0.143
σ0.145-0.245=-0.101
min0.902-0.907=-0.005
max1.232-1.488=-0.255

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.224-462.949=0.276
σ574.795-574.248=0.547
min175.814-175.816=-0.001
max1325.417-1324.320=1.097
mean86.250
σ8.500
min82.000
max99.000
mean2718.000-2844.000=-126.000
σ0.000
min2718.000-2844.000=-126.000
max2718.000-2844.000=-126.000
mean0.531-0.430=0.101
σ0.514-0.295=0.219
min0.273-0.278=-0.005
max1.302-0.872=0.430
policies=20
mean1758.498-1758.486=0.013
σ0.321-0.352=-0.032
min1758.281-1758.253=0.028
max1758.973-1759.009=-0.036
mean820.000
σ0.000
min820.000
max820.000
mean2718.000-2844.000=-126.000
σ0.000
min2718.000-2844.000=-126.000
max2718.000-2844.000=-126.000
mean2.694-2.781=-0.087
σ0.016-0.008=0.008
min2.677-2.774=-0.097
max2.711-2.790=-0.079
policies=200
mean17592.157-17591.100=1.057
σ0.533-0.434=0.099
min17591.851-17590.517=1.334
max17592.955-17591.434=1.521
mean8200.000
σ0.000
min8200.000
max8200.000
mean2718.000-2844.000=-126.000
σ0.000
min2718.000-2844.000=-126.000
max2718.000-2844.000=-126.000
mean27.396-27.949=-0.553
σ0.121-0.298=-0.177
min27.239-27.579=-0.340
max27.519-28.260=-0.741