Compare commits

Home / Compare fd5671ba .. c7c975da

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-35.244=-0.000
σ0.053-0.053=-0.000
min35.218-35.222=-0.004
max35.393-35.394=-0.001
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.084-0.081=0.003
σ0.005-0.005=0.000
min0.077-0.076=0.001
max0.093-0.091=0.002
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.001
σ0.002-0.003=-0.001
min23.767-23.766=0.001
max23.773-23.775=-0.002
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.069-0.068=0.001
σ0.003-0.004=-0.001
min0.066-0.061=0.005
max0.075-0.077=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.484-1718.416=38.068
σ0.364-169.604=-169.239
min1755.910-997.851=758.059
max1757.075-1756.950=0.125
mean1649.900-1631.750=18.150
σ643.772-599.163=44.609
min623.000-651.000=-28.000
max2835.000-2443.000=392.000
mean2.351-2.266=0.084
σ0.073-0.247=-0.173
min2.265-1.251=1.015
max2.534-2.464=0.070

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.701-324.585=0.116
σ0.056-0.044=0.012
min324.602-324.507=0.095
max324.734-324.616=0.118
mean2835.000-2443.000=392.000
σ0.000
min2835.000-2443.000=392.000
max2835.000-2443.000=392.000
mean0.426-0.426=-0.001
σ0.001-0.004=-0.003
min0.424-0.424=0.000
max0.427-0.434=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1985.254-1985.145=0.109
σ0.017-0.016=0.001
min1985.236-1985.118=0.118
max1985.275-1985.155=0.119
mean2835.000-2443.000=392.000
σ0.000
min2835.000-2443.000=392.000
max2835.000-2443.000=392.000
mean2.695-2.668=0.027
σ0.207-0.182=0.024
min2.567-2.511=0.057
max3.046-2.959=0.088
iters=5
new-facts=6402
prior-facts=1
mean4808.909-4808.746=0.163
σ7.610-7.678=-0.068
min4805.354-4805.293=0.062
max4822.520-4822.481=0.038
mean2835.000-2443.000=392.000
σ0.000
min2835.000-2443.000=392.000
max2835.000-2443.000=392.000
mean8.573-8.968=-0.395
σ0.744-0.103=0.641
min7.330-8.889=-1.559
max9.113-9.130=-0.017
iters=5
new-facts=6402
prior-facts=6402
mean4996.399-4996.346=0.053
σ0.151-0.012=0.140
min4996.130-4996.330=-0.199
max4996.485-4996.358=0.127
mean3064.800-2941.000=123.800
σ305.065-448.875=-143.810
min2835.000-2443.000=392.000
max3538.000-3549.000=-11.000
mean8.645-8.589=0.056
σ0.178-0.126=0.052
min8.452-8.456=-0.004
max8.832-8.730=0.102

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.945-1.579=-0.633
σ0.055-0.360=-0.305
min0.913-0.942=-0.030
max1.041-1.818=-0.777

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.973-462.941=0.032
σ574.254-574.252=0.003
min175.836-175.809=0.027
max1324.354-1324.318=0.036
mean86.250
σ8.500
min82.000
max99.000
mean2835.000-2443.000=392.000
σ0.000
min2835.000-2443.000=392.000
max2835.000-2443.000=392.000
mean0.463-0.560=-0.098
σ0.357-0.567=-0.210
min0.280-0.272=0.008
max0.998-1.411=-0.413
policies=20
mean1758.693-1758.485=0.208
σ0.345-0.340=0.005
min1758.452-1758.247=0.205
max1759.202-1758.987=0.215
mean820.000
σ0.000
min820.000
max820.000
mean2835.000-2443.000=392.000
σ0.000
min2835.000-2443.000=392.000
max2835.000-2443.000=392.000
mean2.806-2.702=0.104
σ0.015-0.009=0.006
min2.793-2.695=0.099
max2.828-2.713=0.115
policies=200
mean17593.253-17592.367=0.886
σ0.669-0.577=0.092
min17592.399-17591.991=0.407
max17593.853-17593.215=0.638
mean8200.000
σ0.000
min8200.000
max8200.000
mean2835.000-2443.000=392.000
σ0.000
min2835.000-2443.000=392.000
max2835.000-2443.000=392.000
mean27.994-27.471=0.523
σ0.381-0.232=0.149
min27.620-27.154=0.466
max28.373-27.675=0.698