Compare commits

Home / Compare c5e81b42 .. e64945c1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.649-53.914=-0.265
σ0.366-0.367=-0.001
min53.513-53.777=-0.264
max54.691-54.958=-0.267
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.144-0.138=0.006
σ0.009-0.004=0.005
min0.136-0.134=0.003
max0.159-0.147=0.012
cache=y
dps=1
iters=10
policies=100
mean42.943-43.141=-0.199
σ0.006-0.008=-0.002
min42.932-43.126=-0.194
max42.952-43.152=-0.200
mean416.000-414.900=1.100
σ0.000-0.316=-0.316
min416.000-414.000=2.000
max416.000-415.000=1.000
mean0.121-0.121=-0.000
σ0.005-0.003=0.001
min0.114-0.118=-0.004
max0.127-0.126=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.862-991.811=0.051
σ1.205-1.238=-0.033
min991.324-991.232=0.092
max996.908-997.017=-0.109
mean1068.950-1072.100=-3.150
σ325.120-314.090=11.031
min602.000-617.000=-15.000
max1641.000-1651.000=-10.000
mean1.552-1.526=0.026
σ0.100-0.071=0.029
min1.471-1.389=0.082
max1.811-1.723=0.088

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.437-285.405=0.032
σ0.011-0.014=-0.003
min285.418-285.385=0.033
max285.446-285.422=0.024
mean1641.000-1651.000=-10.000
σ0.000
min1641.000-1651.000=-10.000
max1641.000-1651.000=-10.000
mean0.379-0.370=0.009
σ0.007-0.004=0.003
min0.375-0.367=0.008
max0.391-0.376=0.015
iters=5
new-facts=1
prior-facts=6402
mean1285.491-1285.373=0.118
σ0.083-0.137=-0.054
min1285.352-1285.307=0.045
max1285.559-1285.618=-0.059
mean1641.000-1651.000=-10.000
σ0.000
min1641.000-1651.000=-10.000
max1641.000-1651.000=-10.000
mean1.982-1.866=0.116
σ0.191-0.043=0.148
min1.787-1.808=-0.022
max2.235-1.902=0.333
iters=5
new-facts=6402
prior-facts=1
mean1705.817-1807.702=-101.885
σ6.854-6.990=-0.136
min1702.636-1804.341=-101.705
max1718.074-1820.190=-102.115
mean1641.000-1651.000=-10.000
σ0.000
min1641.000-1651.000=-10.000
max1641.000-1651.000=-10.000
mean3.102-4.185=-1.084
σ0.256-0.224=0.032
min2.824-3.815=-0.990
max3.475-4.392=-0.917
iters=5
new-facts=6402
prior-facts=6402
mean1968.452-2070.196=-101.744
σ0.017-0.011=0.006
min1968.430-2070.182=-101.752
max1968.473-2070.212=-101.738
mean1892.000-1848.000=44.000
σ212.643-187.888=24.755
min1641.000-1651.000=-10.000
max2156.000-2089.000=67.000
mean3.280-4.513=-1.233
σ0.099-0.045=0.054
min3.168-4.477=-1.309
max3.433-4.590=-1.157

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.296-1.217=0.079
σ0.363-0.341=0.022
min0.905-0.921=-0.016
max1.723-1.794=-0.071

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.781-436.788=-0.007
σ572.363-572.361=0.002
min150.589-150.598=-0.009
max1295.326-1295.330=-0.004
mean90.250
σ8.500
min86.000
max103.000
mean1641.000-1651.000=-10.000
σ0.000
min1641.000-1651.000=-10.000
max1641.000-1651.000=-10.000
mean0.526-0.514=0.011
σ0.553-0.528=0.025
min0.248-0.249=-0.001
max1.355-1.306=0.048
policies=20
mean1506.178-1506.275=-0.096
σ0.231-0.241=-0.010
min1506.023-1506.120=-0.098
max1506.522-1506.634=-0.112
mean860.000
σ0.000
min860.000
max860.000
mean1641.000-1651.000=-10.000
σ0.000
min1641.000-1651.000=-10.000
max1641.000-1651.000=-10.000
mean2.513-2.521=-0.008
σ0.012-0.017=-0.005
min2.503-2.508=-0.005
max2.524-2.545=-0.021
policies=200
mean15069.481-15070.270=-0.789
σ0.067-0.070=-0.003
min15069.421-15070.206=-0.785
max15069.571-15070.368=-0.797
mean8600.000
σ0.000
min8600.000
max8600.000
mean1641.000-1651.000=-10.000
σ0.000
min1641.000-1651.000=-10.000
max1641.000-1651.000=-10.000
mean25.491-25.388=0.103
σ0.116-0.144=-0.029
min25.378-25.253=0.125
max25.591-25.537=0.053