Compare commits

Home / Compare 209781bd .. 24a7c99e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-70.784=-35.521
σ0.055-0.047=0.007
min35.231-70.748=-35.517
max35.416-70.914=-35.498
mean414.600-414.000=0.600
σ0.516-0.000=0.516
min414.000
max415.000-414.000=1.000
mean0.085-0.158=-0.073
σ0.004-0.005=-0.002
min0.081-0.150=-0.069
max0.092-0.165=-0.073
cache=y
dps=1
iters=10
policies=100
mean23.769-21.493=2.276
σ0.003-0.002=0.001
min23.764-21.490=2.274
max23.774-21.496=2.278
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.066-0.065=0.001
σ0.004-0.002=0.001
min0.061-0.064=-0.003
max0.073-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1754.895=1.590
σ0.365-0.360=0.006
min1755.910-1754.322=1.589
max1757.085-1755.486=1.599
mean1649.750-1665.700=-15.950
σ644.632-642.651=1.981
min643.000-678.000=-35.000
max2840.000-2704.000=136.000
mean2.329-2.798=-0.470
σ0.098-0.254=-0.156
min2.151-2.150=0.000
max2.597-3.503=-0.905

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.713-272.759=51.954
σ0.038-0.006=0.032
min324.646-272.754=51.891
max324.737-272.767=51.970
mean2840.000-2704.000=136.000
σ0.000
min2840.000-2704.000=136.000
max2840.000-2704.000=136.000
mean0.424-0.383=0.040
σ0.001-0.004=-0.003
min0.422-0.379=0.043
max0.426-0.390=0.036
iters=5
new-facts=1
prior-facts=6402
mean1985.273-1933.130=52.143
σ0.007-0.011=-0.003
min1985.267-1933.121=52.147
max1985.285-1933.146=52.139
mean2840.000-2704.000=136.000
σ0.000
min2840.000-2704.000=136.000
max2840.000-2704.000=136.000
mean2.617-3.103=-0.485
σ0.084-0.094=-0.010
min2.553-2.990=-0.437
max2.728-3.189=-0.461
iters=5
new-facts=6402
prior-facts=1
mean4808.863-4753.838=55.026
σ7.653-0.938=6.716
min4805.387-4753.128=52.258
max4822.554-4755.479=67.075
mean2840.000-2704.000=136.000
σ0.000
min2840.000-2704.000=136.000
max2840.000-2704.000=136.000
mean8.926-8.480=0.445
σ0.201-0.498=-0.297
min8.636-7.962=0.674
max9.136-9.063=0.073
iters=5
new-facts=6402
prior-facts=6402
mean4996.465-4944.357=52.109
σ0.019-0.018=0.001
min4996.445-4944.332=52.113
max4996.490-4944.375=52.115
mean3041.400-2996.000=45.400
σ211.079-328.917=-117.838
min2840.000-2704.000=136.000
max3345.000-3465.000=-120.000
mean8.641-8.433=0.208
σ0.183-0.095=0.087
min8.493-8.327=0.166
max8.935-8.564=0.371

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.006-1.104=-0.098
σ0.064-0.142=-0.078
min0.920-0.930=-0.010
max1.059-1.257=-0.198

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.968-468.644=-5.676
σ574.252-574.894=-0.642
min175.836-181.186=-5.350
max1324.346-1330.985=-6.639
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2840.000-2704.000=136.000
σ0.000
min2840.000-2704.000=136.000
max2840.000-2704.000=136.000
mean0.464-0.583=-0.119
σ0.368-0.594=-0.227
min0.278-0.284=-0.007
max1.016-1.475=-0.459
policies=20
mean1758.714-1812.172=-53.458
σ0.357-0.379=-0.022
min1758.464-1811.926=-53.462
max1759.242-1812.733=-53.491
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2840.000-2704.000=136.000
σ0.000
min2840.000-2704.000=136.000
max2840.000-2704.000=136.000
mean2.782-2.833=-0.052
σ0.019-0.022=-0.003
min2.754-2.804=-0.051
max2.794-2.856=-0.063
policies=200
mean17593.365-18129.190=-535.825
σ0.631-0.528=0.103
min17592.632-18128.806=-536.174
max17593.900-18129.970=-536.070
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2840.000-2704.000=136.000
σ0.000
min2840.000-2704.000=136.000
max2840.000-2704.000=136.000
mean27.936-28.500=-0.564
σ0.367-0.071=0.296
min27.583-28.413=-0.830
max28.410-28.563=-0.153