Compare commits

Home / Compare cc27d7ac .. ecced40f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-35.617=-0.000
σ0.055-0.053=0.003
min35.587-35.591=-0.003
max35.773-35.766=0.007
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.084-0.085=-0.001
σ0.005-0.005=0.000
min0.078-0.079=-0.001
max0.092-0.093=-0.002
cache=y
dps=1
iters=10
policies=100
mean24.047-24.047=-0.001
σ0.003-0.002=0.000
min24.043-24.044=-0.001
max24.051-24.051=-0.000
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.065-0.066=-0.002
σ0.003-0.005=-0.002
min0.061-0.062=-0.000
max0.069-0.075=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.489-1756.490=-0.000
σ0.365-0.363=0.001
min1755.915-1755.916=-0.002
max1757.081-1757.078=0.002
mean1655.850-1652.100=3.750
σ641.870-640.052=1.819
min623.000-636.000=-13.000
max2848.000-2830.000=18.000
mean2.354-2.354=0.000
σ0.068-0.074=-0.006
min2.266-2.241=0.024
max2.507-2.461=0.047

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.762-324.774=-0.012
σ0.056-0.024=0.032
min324.663-324.735=-0.071
max324.793-324.797=-0.003
mean2848.000-2830.000=18.000
σ0.000
min2848.000-2830.000=18.000
max2848.000-2830.000=18.000
mean0.429-0.417=0.012
σ0.009-0.003=0.006
min0.424-0.412=0.011
max0.445-0.421=0.024
iters=5
new-facts=1
prior-facts=6402
mean1985.316-1985.320=-0.004
σ0.015-0.021=-0.006
min1985.298-1985.296=0.002
max1985.332-1985.341=-0.009
mean2848.000-2830.000=18.000
σ0.000
min2848.000-2830.000=18.000
max2848.000-2830.000=18.000
mean2.658-2.625=0.032
σ0.105-0.168=-0.063
min2.567-2.490=0.077
max2.778-2.898=-0.120
iters=5
new-facts=6402
prior-facts=1
mean4809.000-4809.091=-0.091
σ7.774-7.712=0.063
min4805.014-4805.605=-0.591
max4822.897-4822.886=0.011
mean2848.000-2830.000=18.000
σ0.000
min2848.000-2830.000=18.000
max2848.000-2830.000=18.000
mean8.795-8.939=-0.144
σ0.409-0.318=0.091
min8.075-8.410=-0.335
max9.056-9.183=-0.127
iters=5
new-facts=6402
prior-facts=6402
mean4996.489-4996.625=-0.136
σ0.192-0.029=0.163
min4996.256-4996.589=-0.333
max4996.647-4996.652=-0.005
mean3067.000-3058.600=8.400
σ291.781-298.359=-6.578
min2848.000-2830.000=18.000
max3517.000-3516.000=1.000
mean8.543-8.534=0.009
σ0.132-0.114=0.018
min8.465-8.412=0.052
max8.777-8.703=0.074

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.009-1.030=-0.021
σ0.118-0.125=-0.007
min0.928-0.916=0.012
max1.194-1.222=-0.028

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.209-463.209=0.000
σ574.767-574.773=-0.006
min175.816-175.816=-0.000
max1325.360-1325.368=-0.009
mean86.250
σ8.500
min82.000
max99.000
mean2848.000-2830.000=18.000
σ0.000
min2848.000-2830.000=18.000
max2848.000-2830.000=18.000
mean0.435-0.432=0.003
σ0.301-0.305=-0.004
min0.283-0.276=0.007
max0.887-0.889=-0.002
policies=20
mean1758.501-1758.502=-0.001
σ0.352-0.347=0.004
min1758.253-1758.270=-0.017
max1759.020-1759.017=0.003
mean820.000
σ0.000
min820.000
max820.000
mean2848.000-2830.000=18.000
σ0.000
min2848.000-2830.000=18.000
max2848.000-2830.000=18.000
mean2.791-2.745=0.046
σ0.004-0.125=-0.121
min2.786-2.564=0.222
max2.795-2.845=-0.050
policies=200
mean17592.131-17592.160=-0.030
σ0.512-0.487=0.025
min17591.834-17591.839=-0.005
max17592.897-17592.872=0.024
mean8200.000
σ0.000
min8200.000
max8200.000
mean2848.000-2830.000=18.000
σ0.000
min2848.000-2830.000=18.000
max2848.000-2830.000=18.000
mean28.030-27.862=0.168
σ0.376-0.365=0.011
min27.662-27.566=0.096
max28.494-28.341=0.154