Compare commits

Home / Compare 51e0f253 .. 22586d5d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean55.028-55.029=-0.001
σ0.053-0.052=0.002
min54.992-54.991=0.001
max55.174-55.169=0.005
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.138-0.138=0.000
σ0.004-0.004=-0.000
min0.134-0.131=0.003
max0.144-0.145=-0.001
cache=y
dps=1
iters=10
policies=100
mean44.363-44.362=0.002
σ0.003-0.004=-0.001
min44.360-44.355=0.006
max44.368-44.366=0.002
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.122-0.122=0.001
σ0.003-0.004=-0.001
min0.120-0.115=0.005
max0.128-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1767.298-1767.107=0.191
σ0.366-0.366=0.000
min1766.718-1766.529=0.190
max1767.887-1767.705=0.183
mean1614.050-1635.250=-21.200
σ594.380-621.345=-26.966
min633.000-624.000=9.000
max2413.000-2772.000=-359.000
mean2.369-2.366=0.004
σ0.082-0.100=-0.017
min2.250-2.170=0.081
max2.513-2.609=-0.095

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean350.826-350.633=0.193
σ0.069-0.069=0.001
min350.702-350.512=0.190
max350.865-350.677=0.188
mean2413.000-2772.000=-359.000
σ0.000
min2413.000-2772.000=-359.000
max2413.000-2772.000=-359.000
mean0.455-0.446=0.009
σ0.006-0.007=-0.001
min0.449-0.439=0.010
max0.463-0.456=0.007
iters=5
new-facts=1
prior-facts=6402
mean2012.895-2012.700=0.194
σ0.017-0.020=-0.003
min2012.868-2012.669=0.199
max2012.915-2012.717=0.197
mean2413.000-2772.000=-359.000
σ0.000
min2413.000-2772.000=-359.000
max2413.000-2772.000=-359.000
mean2.741-2.700=0.041
σ0.138-0.059=0.079
min2.632-2.655=-0.023
max2.981-2.800=0.181
iters=5
new-facts=6402
prior-facts=1
mean4837.802-4837.699=0.102
σ7.463-7.714=-0.251
min4834.315-4834.125=0.190
max4851.151-4851.498=-0.346
mean2413.000-2772.000=-359.000
σ0.000
min2413.000-2772.000=-359.000
max2413.000-2772.000=-359.000
mean8.334-8.432=-0.098
σ0.552-0.527=0.025
min7.706-7.738=-0.032
max9.183-9.021=0.162
iters=5
new-facts=6402
prior-facts=6402
mean5025.395-5025.203=0.192
σ0.023-0.025=-0.002
min5025.371-5025.178=0.193
max5025.426-5025.238=0.187
mean3041.800-3019.400=22.400
σ326.044-227.178=98.866
min2593.000-2772.000=-179.000
max3348.000-3316.000=32.000
mean9.653-9.819=-0.166
σ0.295-0.194=0.100
min9.423-9.490=-0.067
max10.128-9.980=0.148

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.679-0.971=0.708
σ0.097-0.067=0.030
min1.566-0.914=0.652
max1.786-1.045=0.741

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean469.200-469.030=0.170
σ574.767-574.769=-0.002
min181.815-181.632=0.183
max1331.351-1331.183=0.167
mean90.250
σ8.500
min86.000
max103.000
mean2413.000-2772.000=-359.000
σ0.000
min2413.000-2772.000=-359.000
max2413.000-2772.000=-359.000
mean0.570-0.439=0.131
σ0.549-0.298=0.251
min0.292-0.287=0.006
max1.393-0.886=0.507
policies=20
mean1818.483-1816.634=1.849
σ0.390-0.375=0.015
min1818.208-1816.368=1.840
max1819.057-1817.184=1.873
mean860.000
σ0.000
min860.000
max860.000
mean2413.000-2772.000=-359.000
σ0.000
min2413.000-2772.000=-359.000
max2413.000-2772.000=-359.000
mean2.789-2.850=-0.061
σ0.006-0.002=0.004
min2.782-2.849=-0.067
max2.796-2.852=-0.057
policies=200
mean18192.285-18173.301=18.984
σ0.422-0.458=-0.036
min18191.980-18173.034=18.946
max18192.897-18173.984=18.913
mean8600.000
σ0.000
min8600.000
max8600.000
mean2413.000-2772.000=-359.000
σ0.000
min2413.000-2772.000=-359.000
max2413.000-2772.000=-359.000
mean28.111-28.295=-0.184
σ0.065-0.137=-0.072
min28.064-28.203=-0.139
max28.203-28.496=-0.293