Compare commits

Home / Compare 5a6374ca .. ab2768f3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.062-73.046=0.016
σ0.052-0.046=0.006
min73.040-73.012=0.028
max73.209-73.173=0.036
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.161-0.162=-0.001
σ0.003-0.004=-0.001
min0.157-0.158=-0.001
max0.166-0.169=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.755-23.739=0.016
σ0.003-0.001=0.001
min23.751-23.737=0.015
max23.759-23.741=0.018
mean414.500-413.000=1.500
σ0.527-0.000=0.527
min414.000-413.000=1.000
max415.000-413.000=2.000
mean0.068-0.066=0.002
σ0.004-0.003=0.001
min0.066-0.062=0.004
max0.076-0.074=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.819-1758.789=-2.971
σ0.363-0.362=0.001
min1755.251-1758.216=-2.965
max1756.413-1759.382=-2.970
mean1651.650-1650.550=1.100
σ630.599-627.412=3.187
min629.000-617.000=12.000
max2761.000-2856.000=-95.000
mean2.717-2.822=-0.104
σ0.269-0.193=0.076
min2.212-2.243=-0.031
max3.114-3.048=0.066

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean321.050-324.014=-2.965
σ0.037-0.055=-0.018
min320.985-323.918=-2.933
max321.073-324.049=-2.976
mean2761.000-2856.000=-95.000
σ0.000
min2761.000-2856.000=-95.000
max2761.000-2856.000=-95.000
mean0.421-0.433=-0.012
σ0.001-0.007=-0.006
min0.419-0.426=-0.007
max0.422-0.443=-0.021
iters=5
new-facts=1
prior-facts=6402
mean1981.621-1984.585=-2.964
σ0.013-0.018=-0.005
min1981.601-1984.557=-2.956
max1981.635-1984.604=-2.969
mean2761.000-2856.000=-95.000
σ0.000
min2761.000-2856.000=-95.000
max2761.000-2856.000=-95.000
mean2.699-2.579=0.120
σ0.112-0.100=0.012
min2.562-2.439=0.124
max2.847-2.709=0.138
iters=5
new-facts=6402
prior-facts=1
mean4805.256-4808.130=-2.874
σ7.706-7.900=-0.194
min4801.761-4804.097=-2.336
max4819.040-4822.251=-3.211
mean2761.000-2856.000=-95.000
σ0.000
min2761.000-2856.000=-95.000
max2761.000-2856.000=-95.000
mean8.888-8.899=-0.011
σ0.243-0.492=-0.248
min8.508-8.240=0.268
max9.151-9.488=-0.337
iters=5
new-facts=6402
prior-facts=6402
mean4992.833-4995.804=-2.970
σ0.015-0.021=-0.006
min4992.816-4995.778=-2.962
max4992.845-4995.825=-2.980
mean3053.400-3026.800=26.600
σ298.366-180.757=117.609
min2761.000-2856.000=-95.000
max3358.000-3290.000=68.000
mean8.848-8.668=0.181
σ0.322-0.214=0.108
min8.455-8.409=0.046
max9.310-8.929=0.381

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.025-1.006=0.020
σ0.114-0.136=-0.021
min0.916-0.916=0.000
max1.193-1.227=-0.034

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.417-468.350=-5.933
σ574.229-574.233=-0.003
min175.291-181.228=-5.937
max1323.761-1329.698=-5.938
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2761.000-2856.000=-95.000
σ0.000
min2761.000-2856.000=-95.000
max2761.000-2856.000=-95.000
mean0.423-0.440=-0.017
σ0.285-0.301=-0.016
min0.277-0.289=-0.011
max0.850-0.892=-0.041
policies=20
mean1753.215-1812.642=-59.427
σ0.348-0.396=-0.047
min1752.988-1812.366=-59.378
max1753.734-1813.224=-59.489
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2761.000-2856.000=-95.000
σ0.000
min2761.000-2856.000=-95.000
max2761.000-2856.000=-95.000
mean2.813-2.893=-0.079
σ0.076-0.021=0.055
min2.768-2.875=-0.107
max2.927-2.920=0.007
policies=200
mean17537.514-18132.363=-594.848
σ0.632-0.701=-0.069
min17537.056-18131.404=-594.348
max17538.449-18133.090=-594.642
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2761.000-2856.000=-95.000
σ0.000
min2761.000-2856.000=-95.000
max2761.000-2856.000=-95.000
mean27.354-28.746=-1.392
σ0.163-0.447=-0.284
min27.193-28.305=-1.112
max27.531-29.175=-1.644