Compare commits

Home / Compare e49997e2 .. 632113cb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.224-73.047=-37.822
σ0.055-0.049=0.006
min35.199-73.020=-37.822
max35.379-73.184=-37.805
mean413.900-414.000=-0.100
σ0.316-0.000=0.316
min413.000-414.000=-1.000
max414.000
mean0.081-0.161=-0.080
σ0.005-0.005=0.000
min0.076-0.157=-0.080
max0.090-0.169=-0.079
cache=y
dps=1
iters=10
policies=100
mean23.755-23.741=0.014
σ0.003-0.002=0.001
min23.751-23.738=0.013
max23.760-23.744=0.016
mean414.700-414.000=0.700
σ0.483-0.000=0.483
min414.000
max415.000-414.000=1.000
mean0.066-0.065=0.001
σ0.004-0.003=0.001
min0.062-0.060=0.002
max0.075-0.071=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.359-1758.786=-2.427
σ0.367-0.363=0.004
min1755.783-1758.215=-2.433
max1756.951-1759.366=-2.415
mean1661.600-1627.100=34.500
σ621.821-599.410=22.411
min630.000-648.000=-18.000
max2501.000-2430.000=71.000
mean2.344-2.833=-0.489
σ0.119-0.193=-0.074
min2.245-2.384=-0.139
max2.776-3.187=-0.411

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.569-324.031=0.539
σ0.052-0.022=0.031
min324.477-323.995=0.482
max324.604-324.048=0.556
mean2501.000-2430.000=71.000
σ0.000
min2501.000-2430.000=71.000
max2501.000-2430.000=71.000
mean0.425-0.426=-0.001
σ0.001-0.002=-0.001
min0.424-0.424=-0.001
max0.425-0.429=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1985.133-1984.591=0.542
σ0.007-0.012=-0.006
min1985.122-1984.576=0.546
max1985.140-1984.605=0.535
mean2501.000-2430.000=71.000
σ0.000
min2501.000-2430.000=71.000
max2501.000-2430.000=71.000
mean2.627-2.628=-0.001
σ0.088-0.114=-0.026
min2.562-2.481=0.081
max2.770-2.792=-0.023
iters=5
new-facts=6402
prior-facts=1
mean4808.672-4808.235=0.437
σ7.703-7.741=-0.037
min4804.737-4804.669=0.068
max4822.442-4822.081=0.361
mean2501.000-2430.000=71.000
σ0.000
min2501.000-2430.000=71.000
max2501.000-2430.000=71.000
mean8.548-8.778=-0.230
σ0.594-0.246=0.348
min7.713-8.460=-0.747
max9.236-9.067=0.169
iters=5
new-facts=6402
prior-facts=6402
mean4996.338-4995.804=0.534
σ0.016-0.037=-0.021
min4996.317-4995.754=0.563
max4996.356-4995.846=0.510
mean2913.000-2922.600=-9.600
σ394.856-394.236=0.620
min2501.000-2430.000=71.000
max3440.000-3437.000=3.000
mean8.506-8.576=-0.069
σ0.035-0.148=-0.113
min8.451-8.461=-0.010
max8.539-8.809=-0.270

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.741-1.670=0.071
σ0.146-0.103=0.043
min1.491-1.498=-0.007
max1.869-1.757=0.112

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.934-468.327=-5.393
σ574.244-574.231=0.013
min175.809-181.206=-5.397
max1324.300-1329.672=-5.372
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2501.000-2430.000=71.000
σ0.000
min2501.000-2430.000=71.000
max2501.000-2430.000=71.000
mean0.543-0.558=-0.015
σ0.539-0.546=-0.007
min0.272-0.283=-0.012
max1.352-1.377=-0.025
policies=20
mean1758.406-1812.432=-54.026
σ0.350-0.386=-0.036
min1758.170-1812.166=-53.996
max1758.925-1813.001=-54.077
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2501.000-2430.000=71.000
σ0.000
min2501.000-2430.000=71.000
max2501.000-2430.000=71.000
mean2.728-2.821=-0.093
σ0.003-0.030=-0.027
min2.724-2.801=-0.077
max2.731-2.865=-0.134
policies=200
mean17591.336-18131.693=-540.357
σ0.391-0.448=-0.057
min17591.028-18131.380=-540.352
max17591.909-18132.358=-540.449
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2501.000-2430.000=71.000
σ0.000
min2501.000-2430.000=71.000
max2501.000-2430.000=71.000
mean27.419-28.357=-0.938
σ0.135-0.068=0.067
min27.326-28.269=-0.943
max27.613-28.425=-0.812