Compare commits

Home / Compare 5fe72b72 .. df48e69e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.915-53.916=-0.000
σ0.367-0.368=-0.001
min53.786-53.786=0.001
max54.959-54.963=-0.004
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.139-0.140=-0.001
σ0.004-0.004=0.000
min0.133-0.136=-0.003
max0.146-0.146=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.142-43.140=0.002
σ0.005-0.006=-0.001
min43.136-43.130=0.006
max43.149-43.148=0.002
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.124-0.120=0.004
σ0.003-0.004=-0.001
min0.121-0.115=0.007
max0.129-0.127=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.817-991.808=0.009
σ1.248-1.262=-0.014
min991.231-991.248=-0.017
max997.062-997.124=-0.062
mean1069.500-1064.650=4.850
σ313.777-328.955=-15.178
min617.000-574.000=43.000
max1653.000-1635.000=18.000
mean1.528-1.564=-0.036
σ0.077-0.127=-0.051
min1.443-1.459=-0.015
max1.747-1.980=-0.232

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.408-285.409=-0.001
σ0.009-0.012=-0.003
min285.393-285.393=0.000
max285.416-285.418=-0.002
mean1653.000-1635.000=18.000
σ0.000
min1653.000-1635.000=18.000
max1653.000-1635.000=18.000
mean0.374-0.374=0.000
σ0.007-0.002=0.006
min0.367-0.372=-0.005
max0.383-0.377=0.006
iters=5
new-facts=1
prior-facts=6402
mean1285.369-1285.376=-0.007
σ0.123-0.140=-0.017
min1285.307-1285.307=0.000
max1285.589-1285.626=-0.037
mean1653.000-1635.000=18.000
σ0.000
min1653.000-1635.000=18.000
max1653.000-1635.000=18.000
mean1.932-1.949=-0.017
σ0.142-0.144=-0.002
min1.840-1.830=0.011
max2.182-2.166=0.017
iters=5
new-facts=6402
prior-facts=1
mean1807.692-1807.740=-0.048
σ7.011-6.997=0.014
min1804.338-1804.363=-0.025
max1820.222-1820.241=-0.019
mean1653.000-1635.000=18.000
σ0.000
min1653.000-1635.000=18.000
max1653.000-1635.000=18.000
mean4.163-4.251=-0.088
σ0.284-0.219=0.065
min3.761-4.005=-0.244
max4.435-4.518=-0.083
iters=5
new-facts=6402
prior-facts=6402
mean2070.197-2070.200=-0.003
σ0.011-0.011=-0.000
min2070.180-2070.193=-0.012
max2070.210-2070.219=-0.009
mean1838.000-1833.600=4.400
σ165.947-173.365=-7.417
min1653.000-1635.000=18.000
max2072.000-2068.000=4.000
mean4.601-4.558=0.043
σ0.208-0.054=0.154
min4.453-4.512=-0.059
max4.969-4.636=0.333

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.226-1.194=0.032
σ0.294-0.334=-0.040
min1.030-0.905=0.125
max1.733-1.764=-0.031

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.789-436.785=0.004
σ572.358-572.366=-0.008
min150.604-150.598=0.006
max1295.326-1295.334=-0.009
mean90.250
σ8.500
min86.000
max103.000
mean1653.000-1635.000=18.000
σ0.000
min1653.000-1635.000=18.000
max1653.000-1635.000=18.000
mean0.513-0.529=-0.016
σ0.517-0.554=-0.037
min0.254-0.249=0.005
max1.288-1.360=-0.072
policies=20
mean1506.269-1506.282=-0.014
σ0.236-0.253=-0.017
min1506.116-1506.125=-0.009
max1506.620-1506.660=-0.040
mean860.000
σ0.000
min860.000
max860.000
mean1653.000-1635.000=18.000
σ0.000
min1653.000-1635.000=18.000
max1653.000-1635.000=18.000
mean2.512-2.543=-0.031
σ0.012-0.028=-0.016
min2.496-2.519=-0.023
max2.525-2.583=-0.058
policies=200
mean15070.312-15070.368=-0.056
σ0.035-0.078=-0.042
min15070.260-15070.280=-0.020
max15070.335-15070.468=-0.133
mean8600.000
σ0.000
min8600.000
max8600.000
mean1653.000-1635.000=18.000
σ0.000
min1653.000-1635.000=18.000
max1653.000-1635.000=18.000
mean25.443-25.500=-0.057
σ0.132-0.269=-0.137
min25.306-25.282=0.024
max25.608-25.864=-0.256