Compare commits

Home / Compare 4dec1d48 .. 42fecf2e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-35.244=-0.000
σ0.052-0.054=-0.002
min35.216-35.212=0.004
max35.391-35.397=-0.006
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.084-0.085=-0.002
σ0.004-0.004=0.000
min0.077-0.079=-0.002
max0.092-0.093=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.770-23.768=0.002
σ0.003-0.003=-0.000
min23.766-23.764=0.002
max23.777-23.776=0.001
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.069-0.064=0.005
σ0.004-0.003=0.000
min0.066-0.062=0.005
max0.077-0.071=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.362-1756.363=-0.002
σ0.365-0.365=0.000
min1755.790-1755.788=0.002
max1756.956-1756.949=0.007
mean1641.950-1658.300=-16.350
σ632.737-638.280=-5.543
min625.000-630.000=-5.000
max2837.000-2754.000=83.000
mean2.342-2.339=0.003
σ0.083-0.112=-0.029
min2.204-2.213=-0.009
max2.554-2.673=-0.119

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.580-324.591=-0.010
σ0.052-0.036=0.015
min324.489-324.527=-0.038
max324.610-324.616=-0.006
mean2837.000-2754.000=83.000
σ0.000
min2837.000-2754.000=83.000
max2837.000-2754.000=83.000
mean0.423-0.422=0.001
σ0.001-0.000=0.001
min0.422-0.422=0.000
max0.425-0.423=0.002
iters=5
new-facts=1
prior-facts=6402
mean1985.144-1985.138=0.005
σ0.006-0.013=-0.007
min1985.137-1985.125=0.012
max1985.151-1985.154=-0.003
mean2837.000-2754.000=83.000
σ0.000
min2837.000-2754.000=83.000
max2837.000-2754.000=83.000
mean2.555-2.698=-0.143
σ0.104-0.135=-0.032
min2.397-2.506=-0.109
max2.667-2.844=-0.176
iters=5
new-facts=6402
prior-facts=1
mean4808.749-4808.637=0.111
σ7.681-7.738=-0.057
min4805.301-4804.706=0.595
max4822.489-4822.471=0.019
mean2837.000-2754.000=83.000
σ0.000
min2837.000-2754.000=83.000
max2837.000-2754.000=83.000
mean8.982-8.686=0.296
σ0.098-0.328=-0.230
min8.885-8.208=0.676
max9.130-9.014=0.115
iters=5
new-facts=6402
prior-facts=6402
mean4996.348-4996.351=-0.004
σ0.020-0.012=0.008
min4996.322-4996.331=-0.009
max4996.368-4996.362=0.006
mean3035.600-3076.600=-41.000
σ207.254-282.281=-75.026
min2837.000-2754.000=83.000
max3332.000-3357.000=-25.000
mean8.568-8.980=-0.412
σ0.183-0.559=-0.376
min8.346-8.519=-0.173
max8.796-9.679=-0.884

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.981-0.944=0.038
σ0.069-0.060=0.008
min0.921-0.898=0.024
max1.062-1.048=0.015

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.977-462.964=0.013
σ574.252-574.254=-0.002
min175.842-175.833=0.009
max1324.355-1324.345=0.010
mean86.250
σ8.500
min82.000
max99.000
mean2837.000-2754.000=83.000
σ0.000
min2837.000-2754.000=83.000
max2837.000-2754.000=83.000
mean0.431-0.433=-0.002
σ0.296-0.304=-0.007
min0.281-0.278=0.003
max0.875-0.888=-0.013
policies=20
mean1758.708-1758.680=0.028
σ0.340-0.307=0.032
min1758.484-1758.463=0.022
max1759.212-1759.131=0.081
mean820.000
σ0.000
min820.000
max820.000
mean2837.000-2754.000=83.000
σ0.000
min2837.000-2754.000=83.000
max2837.000-2754.000=83.000
mean2.788-2.845=-0.058
σ0.005-0.077=-0.072
min2.782-2.778=0.004
max2.793-2.919=-0.126
policies=200
mean17593.329-17592.404=0.925
σ0.681-0.533=0.148
min17592.405-17591.957=0.447
max17593.846-17593.176=0.670
mean8200.000
σ0.000
min8200.000
max8200.000
mean2837.000-2754.000=83.000
σ0.000
min2837.000-2754.000=83.000
max2837.000-2754.000=83.000
mean27.908-27.406=0.502
σ0.339-0.098=0.241
min27.579-27.276=0.303
max28.308-27.482=0.826