Compare commits

Home / Compare 561d1ea9 .. 507f8833

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.245-35.245=0.000
σ0.055-0.054=0.000
min35.219-35.220=-0.001
max35.399-35.397=0.002
mean418.000-411.000=7.000
σ0.000
min418.000-411.000=7.000
max418.000-411.000=7.000
mean0.086-0.086=0.000
σ0.004-0.004=0.000
min0.082-0.083=-0.001
max0.094-0.092=0.001
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.000
σ0.003-0.003=0.001
min23.765-23.765=0.000
max23.774-23.773=0.001
mean418.000-411.000=7.000
σ0.000
min418.000-411.000=7.000
max418.000-411.000=7.000
mean0.068-0.068=-0.000
σ0.003-0.003=-0.001
min0.066-0.066=0.000
max0.075-0.075=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.363-1756.363=0.000
σ0.366-0.365=0.001
min1755.787-1755.787=-0.000
max1756.953-1756.948=0.005
mean1650.450-1644.400=6.050
σ641.089-632.355=8.734
min652.000-619.000=33.000
max2832.000-2824.000=8.000
mean2.353-2.352=0.001
σ0.098-0.065=0.034
min2.269-2.281=-0.012
max2.652-2.458=0.195

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.588
σ0.046-0.043=0.003
min324.507-324.512=-0.005
max324.618-324.617=0.001
mean2832.000-2824.000=8.000
σ0.000
min2832.000-2824.000=8.000
max2832.000-2824.000=8.000
mean0.424-0.423=0.001
σ0.002-0.001=0.001
min0.422-0.422=0.000
max0.427-0.425=0.002
iters=5
new-facts=1
prior-facts=6402
mean1985.134-1985.137=-0.003
σ0.014-0.020=-0.006
min1985.117-1985.106=0.011
max1985.149-1985.152=-0.003
mean2832.000-2824.000=8.000
σ0.000
min2832.000-2824.000=8.000
max2832.000-2824.000=8.000
mean2.597-2.697=-0.100
σ0.072-0.242=-0.170
min2.530-2.502=0.028
max2.677-3.112=-0.435
iters=5
new-facts=6402
prior-facts=1
mean4808.757-4808.752=0.005
σ7.666-7.696=-0.030
min4805.215-4805.204=0.011
max4822.469-4822.517=-0.048
mean2832.000-2824.000=8.000
σ0.000
min2832.000-2824.000=8.000
max2832.000-2824.000=8.000
mean9.001-8.936=0.065
σ0.304-0.389=-0.085
min8.701-8.529=0.172
max9.507-9.452=0.055
iters=5
new-facts=6402
prior-facts=6402
mean4996.345-4996.274=0.070
σ0.024-0.156=-0.132
min4996.323-4995.997=0.326
max4996.378-4996.360=0.018
mean3071.000-3041.600=29.400
σ227.190-291.512=-64.322
min2832.000-2824.000=8.000
max3400.000-3495.000=-95.000
mean8.830-8.495=0.335
σ0.321-0.109=0.212
min8.541-8.429=0.112
max9.311-8.685=0.626

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.981-1.005=-0.024
σ0.068-0.087=-0.019
min0.922-0.914=0.008
max1.058-1.113=-0.055

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.972-462.972=0.001
σ574.255-574.251=0.004
min175.835-175.836=-0.001
max1324.355-1324.348=0.007
mean86.250
σ8.500
min82.000
max99.000
mean2832.000-2824.000=8.000
σ0.000
min2832.000-2824.000=8.000
max2832.000-2824.000=8.000
mean0.430-0.429=0.001
σ0.300-0.292=0.008
min0.277-0.282=-0.004
max0.880-0.867=0.013
policies=20
mean1758.716-1758.690=0.026
σ0.354-0.351=0.002
min1758.482-1758.451=0.031
max1759.241-1759.211=0.031
mean820.000
σ0.000
min820.000
max820.000
mean2832.000-2824.000=8.000
σ0.000
min2832.000-2824.000=8.000
max2832.000-2824.000=8.000
mean2.781-2.799=-0.018
σ0.006-0.012=-0.006
min2.776-2.785=-0.010
max2.788-2.812=-0.023
policies=200
mean17593.318-17593.315=0.004
σ0.649-0.684=-0.035
min17592.480-17592.382=0.098
max17593.870-17593.889=-0.019
mean8200.000
σ0.000
min8200.000
max8200.000
mean2832.000-2824.000=8.000
σ0.000
min2832.000-2824.000=8.000
max2832.000-2824.000=8.000
mean27.791-27.918=-0.127
σ0.366-0.343=0.023
min27.441-27.556=-0.115
max28.162-28.275=-0.113