Compare commits

Home / Compare 82c71cbd .. dccb9922

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.913=0.000
σ0.368-0.367=0.002
min53.785-53.781=0.004
max54.962-54.957=0.004
mean417.800-413.000=4.800
σ0.422-0.000=0.422
min417.000-413.000=4.000
max418.000-413.000=5.000
mean0.137-0.139=-0.001
σ0.005-0.005=0.000
min0.132-0.133=-0.001
max0.145-0.145=0.000
cache=y
dps=1
iters=10
policies=100
mean43.140-43.142=-0.002
σ0.005-0.006=-0.000
min43.135-43.131=0.004
max43.150-43.151=-0.001
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.121-0.121=-0.000
σ0.004-0.004=-0.000
min0.117-0.114=0.003
max0.128-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.811-991.810=0.001
σ1.260-1.268=-0.007
min991.259-991.247=0.012
max997.116-997.150=-0.034
mean1069.350-1062.850=6.500
σ317.839-323.061=-5.222
min571.000-565.000=6.000
max1651.000-1636.000=15.000
mean1.549-1.554=-0.006
σ0.121-0.135=-0.015
min1.415-1.462=-0.046
max1.954-2.006=-0.053

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.412-285.410=0.001
σ0.009-0.008=0.001
min285.399-285.397=0.002
max285.421-285.418=0.004
mean1651.000-1636.000=15.000
σ0.000
min1651.000-1636.000=15.000
max1651.000-1636.000=15.000
mean0.383-0.379=0.004
σ0.005-0.006=-0.001
min0.379-0.375=0.004
max0.391-0.389=0.002
iters=5
new-facts=1
prior-facts=6402
mean1285.374-1285.372=0.002
σ0.134-0.132=0.002
min1285.310-1285.309=0.002
max1285.614-1285.609=0.006
mean1651.000-1636.000=15.000
σ0.000
min1651.000-1636.000=15.000
max1651.000-1636.000=15.000
mean1.975-1.936=0.039
σ0.116-0.162=-0.046
min1.845-1.824=0.021
max2.156-2.221=-0.065
iters=5
new-facts=6402
prior-facts=1
mean1807.723-1807.709=0.014
σ7.020-7.005=0.015
min1804.349-1804.360=-0.011
max1820.265-1820.224=0.040
mean1651.000-1636.000=15.000
σ0.000
min1651.000-1636.000=15.000
max1651.000-1636.000=15.000
mean4.231-4.196=0.034
σ0.203-0.120=0.083
min3.979-4.035=-0.056
max4.444-4.348=0.096
iters=5
new-facts=6402
prior-facts=6402
mean2070.195-2070.200=-0.006
σ0.015-0.012=0.003
min2070.182-2070.183=-0.002
max2070.219-2070.217=0.001
mean1840.400-1836.800=3.600
σ182.938-170.838=12.100
min1651.000-1636.000=15.000
max2095.000-2074.000=21.000
mean4.449-4.551=-0.101
σ0.062-0.113=-0.052
min4.361-4.460=-0.099
max4.526-4.738=-0.213

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.166-1.206=-0.041
σ0.346-0.270=0.076
min0.893-0.917=-0.024
max1.740-1.629=0.111

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.781-436.785=-0.004
σ572.365-572.365=0.000
min150.597-150.595=0.002
max1295.328-1295.332=-0.004
mean90.250
σ8.500
min86.000
max103.000
mean1651.000-1636.000=15.000
σ0.000
min1651.000-1636.000=15.000
max1651.000-1636.000=15.000
mean0.527-0.515=0.012
σ0.547-0.530=0.017
min0.252-0.246=0.006
max1.347-1.310=0.037
policies=20
mean1506.270-1506.259=0.011
σ0.259-0.254=0.005
min1506.115-1506.098=0.017
max1506.657-1506.638=0.020
mean860.000
σ0.000
min860.000
max860.000
mean1651.000-1636.000=15.000
σ0.000
min1651.000-1636.000=15.000
max1651.000-1636.000=15.000
mean2.554-2.534=0.020
σ0.012-0.023=-0.011
min2.541-2.504=0.037
max2.570-2.554=0.015
policies=200
mean15070.384-15070.336=0.047
σ0.068-0.133=-0.064
min15070.294-15070.201=0.093
max15070.443-15070.468=-0.024
mean8600.000
σ0.000
min8600.000
max8600.000
mean1651.000-1636.000=15.000
σ0.000
min1651.000-1636.000=15.000
max1651.000-1636.000=15.000
mean25.820-25.528=0.292
σ0.147-0.168=-0.021
min25.600-25.285=0.315
max25.911-25.669=0.242