Compare commits

Home / Compare a7c0f6e4 .. 2067a706

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.262=0.001
σ0.054-0.054=-0.000
min35.239-35.232=0.006
max35.417-35.415=0.001
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.083-0.083=-0.001
σ0.004-0.005=-0.001
min0.077-0.078=-0.000
max0.091-0.092=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.770-23.768=0.001
σ0.002-0.002=0.001
min23.766-23.766=-0.000
max23.773-23.772=0.002
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.068-0.067=0.001
σ0.003-0.003=-0.000
min0.067-0.061=0.005
max0.077-0.075=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.470-1756.471=-0.001
σ0.364-0.365=-0.001
min1755.895-1755.893=0.001
max1757.067-1757.057=0.010
mean1647.050-1647.200=-0.150
σ635.198-639.606=-4.408
min627.000-624.000=3.000
max2834.000-2824.000=10.000
mean2.329-2.331=-0.001
σ0.081-0.089=-0.008
min2.248-2.201=0.047
max2.548-2.566=-0.018

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.693-324.694=-0.001
σ0.047-0.047=0.000
min324.611-324.612=-0.001
max324.728-324.727=0.001
mean2834.000-2824.000=10.000
σ0.000
min2834.000-2824.000=10.000
max2834.000-2824.000=10.000
mean0.425-0.429=-0.004
σ0.002-0.007=-0.005
min0.423-0.422=0.000
max0.427-0.439=-0.013
iters=5
new-facts=1
prior-facts=6402
mean1985.246-1985.252=-0.005
σ0.023-0.013=0.011
min1985.207-1985.237=-0.030
max1985.262-1985.265=-0.003
mean2834.000-2824.000=10.000
σ0.000
min2834.000-2824.000=10.000
max2834.000-2824.000=10.000
mean2.597-2.593=0.004
σ0.067-0.108=-0.041
min2.542-2.452=0.090
max2.690-2.742=-0.052
iters=5
new-facts=6402
prior-facts=1
mean4808.841-4808.535=0.306
σ7.680-7.903=-0.223
min4805.378-4804.188=1.190
max4822.580-4822.637=-0.057
mean2834.000-2824.000=10.000
σ0.000
min2834.000-2824.000=10.000
max2834.000-2824.000=10.000
mean8.871-8.566=0.305
σ0.135-0.664=-0.528
min8.663-7.769=0.895
max9.028-9.134=-0.107
iters=5
new-facts=6402
prior-facts=6402
mean4996.388-4996.384=0.004
σ0.149-0.165=-0.016
min4996.124-4996.090=0.034
max4996.484-4996.471=0.013
mean3042.200-3040.400=1.800
σ216.117-291.934=-75.816
min2834.000-2824.000=10.000
max3349.000-3498.000=-149.000
mean8.572-8.505=0.067
σ0.087-0.106=-0.019
min8.441-8.419=0.022
max8.684-8.685=-0.001

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.953-0.988=-0.036
σ0.067-0.153=-0.086
min0.907-0.915=-0.007
max1.070-1.261=-0.191

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.947-462.955=-0.008
σ574.248-574.257=-0.010
min175.817-175.813=0.005
max1324.318-1324.341=-0.023
mean86.250
σ8.500
min82.000
max99.000
mean2834.000-2824.000=10.000
σ0.000
min2834.000-2824.000=10.000
max2834.000-2824.000=10.000
mean0.399-0.538=-0.138
σ0.261-0.512=-0.252
min0.263-0.278=-0.015
max0.790-1.306=-0.516
policies=20
mean1758.501-1758.474=0.027
σ0.359-0.364=-0.005
min1758.277-1758.224=0.053
max1759.036-1759.014=0.022
mean820.000
σ0.000
min820.000
max820.000
mean2834.000-2824.000=10.000
σ0.000
min2834.000-2824.000=10.000
max2834.000-2824.000=10.000
mean2.806-2.780=0.026
σ0.017-0.012=0.005
min2.787-2.771=0.016
max2.821-2.797=0.025
policies=200
mean17591.034-17591.114=-0.080
σ0.759-0.713=0.046
min17590.083-17590.142=-0.059
max17591.666-17591.686=-0.020
mean8200.000
σ0.000
min8200.000
max8200.000
mean2834.000-2824.000=10.000
σ0.000
min2834.000-2824.000=10.000
max2834.000-2824.000=10.000
mean27.955-27.880=0.075
σ0.336-0.268=0.068
min27.657-27.627=0.029
max28.344-28.217=0.126