Compare commits

Home / Compare 1e8fea50 .. a16259d6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.060-73.062=-0.001
σ0.054-0.053=0.001
min73.026-73.038=-0.011
max73.212-73.213=-0.000
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.160-0.158=0.002
σ0.005-0.007=-0.002
min0.150-0.140=0.011
max0.167-0.165=0.002
cache=y
dps=1
iters=10
policies=100
mean23.754-23.755=-0.000
σ0.003-0.003=-0.000
min23.751-23.750=0.001
max23.761-23.759=0.001
mean413.000-414.500=-1.500
σ0.000-0.527=-0.527
min413.000-414.000=-1.000
max413.000-415.000=-2.000
mean0.068-0.068=-0.001
σ0.004-0.003=0.001
min0.062-0.066=-0.005
max0.075-0.075=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.819-1755.819=-0.000
σ0.360-0.361=-0.001
min1755.245-1755.246=-0.001
max1756.391-1756.400=-0.009
mean1648.250-1639.000=9.250
σ638.685-596.732=41.953
min648.000-677.000=-29.000
max2850.000-2425.000=425.000
mean2.808-2.794=0.015
σ0.166-0.140=0.025
min2.254-2.381=-0.127
max2.994-3.007=-0.013

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean321.044-321.041=0.003
σ0.059-0.057=0.002
min320.939-320.939=0.001
max321.083-321.070=0.013
mean2850.000-2425.000=425.000
σ0.000
min2850.000-2425.000=425.000
max2850.000-2425.000=425.000
mean0.430-0.426=0.004
σ0.005-0.006=-0.000
min0.421-0.420=0.002
max0.436-0.432=0.003
iters=5
new-facts=1
prior-facts=6402
mean1981.614-1981.620=-0.006
σ0.013-0.011=0.002
min1981.602-1981.603=-0.001
max1981.628-1981.632=-0.004
mean2850.000-2425.000=425.000
σ0.000
min2850.000-2425.000=425.000
max2850.000-2425.000=425.000
mean2.705-2.582=0.123
σ0.122-0.082=0.040
min2.570-2.488=0.082
max2.871-2.666=0.205
iters=5
new-facts=6402
prior-facts=1
mean4805.240-4805.277=-0.037
σ7.783-7.842=-0.060
min4801.734-4801.719=0.015
max4819.162-4819.306=-0.144
mean2850.000-2425.000=425.000
σ0.000
min2850.000-2425.000=425.000
max2850.000-2425.000=425.000
mean8.872-9.090=-0.218
σ0.333-0.416=-0.083
min8.340-8.739=-0.400
max9.169-9.789=-0.620
iters=5
new-facts=6402
prior-facts=6402
mean4992.759-4992.752=0.007
σ0.172-0.155=0.017
min4992.452-4992.478=-0.026
max4992.845-4992.851=-0.006
mean3087.400-2999.400=88.000
σ245.589-281.552=-35.963
min2850.000-2614.000=236.000
max3340.000-3317.000=23.000
mean9.007-8.613=0.394
σ0.436-0.126=0.310
min8.574-8.489=0.085
max9.536-8.773=0.763

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.061-1.709=-0.647
σ0.174-0.131=0.043
min0.923-1.554=-0.632
max1.351-1.853=-0.503

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.415-462.395=0.020
σ574.229-574.228=0.001
min175.295-175.277=0.018
max1323.758-1323.736=0.022
mean86.250
σ8.500
min82.000
max99.000
mean2850.000-2425.000=425.000
σ0.000
min2850.000-2425.000=425.000
max2850.000-2425.000=425.000
mean0.437-0.545=-0.108
σ0.305-0.544=-0.238
min0.281-0.271=0.010
max0.895-1.361=-0.466
policies=20
mean1753.177-1753.034=0.143
σ0.285-0.362=-0.077
min1752.972-1752.808=0.164
max1753.599-1753.575=0.024
mean820.000
σ0.000
min820.000
max820.000
mean2850.000-2425.000=425.000
σ0.000
min2850.000-2425.000=425.000
max2850.000-2425.000=425.000
mean2.789-2.724=0.065
σ0.010-0.021=-0.011
min2.782-2.699=0.083
max2.802-2.750=0.053
policies=200
mean17538.462-17537.534=0.928
σ0.503-0.457=0.046
min17537.825-17537.167=0.657
max17539.053-17538.199=0.854
mean8200.000
σ0.000
min8200.000
max8200.000
mean2850.000-2425.000=425.000
σ0.000
min2850.000-2425.000=425.000
max2850.000-2425.000=425.000
mean27.905-27.397=0.508
σ0.289-0.157=0.132
min27.528-27.277=0.251
max28.155-27.628=0.527