Compare commits

Home / Compare ce25a4fc .. ede3d974

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.264=-0.001
σ0.053-0.053=0.000
min35.229-35.237=-0.008
max35.413-35.414=-0.001
mean414.000-413.600=0.400
σ0.000-0.516=-0.516
min414.000-413.000=1.000
max414.000
mean0.084-0.085=-0.001
σ0.004-0.003=0.000
min0.078-0.082=-0.005
max0.092-0.091=0.001
cache=y
dps=1
iters=10
policies=100
mean23.769-23.770=-0.001
σ0.003-0.003=0.001
min23.765-23.767=-0.001
max23.777-23.775=0.002
mean414.000
σ0.000
min414.000
max414.000
mean0.068-0.069=-0.001
σ0.003-0.003=-0.000
min0.065-0.066=-0.001
max0.074-0.075=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.484=0.001
σ0.364-0.365=-0.001
min1755.913-1755.910=0.003
max1757.076-1757.068=0.008
mean1660.500-1651.000=9.500
σ646.886-643.351=3.536
min628.000-626.000=2.000
max2810.000-2836.000=-26.000
mean2.363-2.347=0.016
σ0.117-0.079=0.038
min2.238-2.245=-0.007
max2.721-2.535=0.186

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.686-324.707=-0.021
σ0.034-0.060=-0.025
min324.625-324.601=0.024
max324.706-324.743=-0.038
mean2810.000-2836.000=-26.000
σ0.000
min2810.000-2836.000=-26.000
max2810.000-2836.000=-26.000
mean0.427-0.431=-0.004
σ0.006-0.011=-0.005
min0.424-0.417=0.007
max0.439-0.441=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1985.247-1985.267=-0.020
σ0.018-0.012=0.006
min1985.222-1985.251=-0.030
max1985.269-1985.278=-0.009
mean2810.000-2836.000=-26.000
σ0.000
min2810.000-2836.000=-26.000
max2810.000-2836.000=-26.000
mean2.630-2.618=0.012
σ0.085-0.060=0.025
min2.562-2.557=0.006
max2.761-2.693=0.068
iters=5
new-facts=6402
prior-facts=1
mean4808.746-4808.796=-0.050
σ7.386-7.725=-0.339
min4805.381-4805.038=0.343
max4821.958-4822.612=-0.653
mean2810.000-2836.000=-26.000
σ0.000
min2810.000-2836.000=-26.000
max2810.000-2836.000=-26.000
mean8.936-8.272=0.664
σ0.168-0.506=-0.338
min8.681-7.757=0.923
max9.117-8.945=0.172
iters=5
new-facts=6402
prior-facts=6402
mean4996.390-4996.461=-0.072
σ0.154-0.023=0.131
min4996.116-4996.433=-0.317
max4996.475-4996.487=-0.012
mean3059.600-3062.000=-2.400
σ316.687-302.185=14.502
min2810.000-2836.000=-26.000
max3540.000-3532.000=8.000
mean8.475-8.651=-0.176
σ0.129-0.391=-0.262
min8.307-8.368=-0.061
max8.664-9.297=-0.633

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.967-0.973=-0.007
σ0.066-0.063=0.003
min0.909-0.919=-0.010
max1.039-1.045=-0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.966-462.978=-0.011
σ574.252-574.254=-0.002
min175.837-175.835=0.002
max1324.344-1324.358=-0.014
mean86.250
σ8.500
min82.000
max99.000
mean2810.000-2836.000=-26.000
σ0.000
min2810.000-2836.000=-26.000
max2810.000-2836.000=-26.000
mean0.430-0.469=-0.039
σ0.300-0.379=-0.079
min0.278-0.276=0.002
max0.879-1.037=-0.157
policies=20
mean1758.718-1758.717=0.002
σ0.343-0.342=0.001
min1758.494-1758.484=0.010
max1759.228-1759.224=0.004
mean820.000
σ0.000
min820.000
max820.000
mean2810.000-2836.000=-26.000
σ0.000
min2810.000-2836.000=-26.000
max2810.000-2836.000=-26.000
mean2.785-2.779=0.006
σ0.022-0.009=0.013
min2.757-2.769=-0.011
max2.811-2.791=0.020
policies=200
mean17592.547-17593.254=-0.707
σ0.363-0.575=-0.213
min17592.254-17592.421=-0.167
max17593.052-17593.645=-0.592
mean8200.000
σ0.000
min8200.000
max8200.000
mean2810.000-2836.000=-26.000
σ0.000
min2810.000-2836.000=-26.000
max2810.000-2836.000=-26.000
mean27.367-27.869=-0.501
σ0.159-0.369=-0.210
min27.197-27.399=-0.202
max27.574-28.275=-0.702