Compare commits

Home / Compare bf64e88d .. 3dd5a9f8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.914=0.001
σ0.366-0.367=-0.001
min53.778-53.784=-0.006
max54.957-54.959=-0.002
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.140-0.140=0.001
σ0.004-0.005=-0.000
min0.136-0.131=0.005
max0.146-0.148=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.140-43.143=-0.003
σ0.006-0.013=-0.006
min43.131-43.131=-0.000
max43.150-43.175=-0.025
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.122-0.119=0.003
σ0.004-0.005=-0.001
min0.119-0.114=0.005
max0.128-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.808-991.807=0.000
σ1.260-1.232=0.028
min991.262-991.251=0.010
max997.114-996.991=0.123
mean1064.300-1063.800=0.500
σ322.204-321.990=0.214
min569.000-568.000=1.000
max1640.000-1635.000=5.000
mean1.550-1.547=0.002
σ0.093-0.103=-0.011
min1.359-1.461=-0.102
max1.781-1.943=-0.162

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.410-285.416=-0.005
σ0.011-0.010=0.001
min285.395-285.400=-0.005
max285.419-285.425=-0.006
mean1640.000-1635.000=5.000
σ0.000
min1640.000-1635.000=5.000
max1640.000-1635.000=5.000
mean0.386-0.385=0.001
σ0.015-0.009=0.005
min0.372-0.375=-0.003
max0.408-0.398=0.010
iters=5
new-facts=1
prior-facts=6402
mean1285.375-1285.374=0.001
σ0.128-0.128=-0.001
min1285.316-1285.310=0.006
max1285.603-1285.603=-0.000
mean1640.000-1635.000=5.000
σ0.000
min1640.000-1635.000=5.000
max1640.000-1635.000=5.000
mean1.906-2.094=-0.188
σ0.070-0.220=-0.151
min1.855-1.892=-0.037
max2.017-2.429=-0.412
iters=5
new-facts=6402
prior-facts=1
mean1807.712-1807.771=-0.059
σ7.034-6.972=0.062
min1804.342-1804.405=-0.062
max1820.280-1820.229=0.051
mean1640.000-1635.000=5.000
σ0.000
min1640.000-1635.000=5.000
max1640.000-1635.000=5.000
mean4.195-4.356=-0.162
σ0.238-0.147=0.091
min3.852-4.197=-0.344
max4.519-4.525=-0.006
iters=5
new-facts=6402
prior-facts=6402
mean2070.196-2070.197=-0.001
σ0.012-0.014=-0.002
min2070.181-2070.180=0.002
max2070.214-2070.218=-0.005
mean1842.400-1836.000=6.400
σ189.315-174.721=14.594
min1640.000-1635.000=5.000
max2085.000-2072.000=13.000
mean4.480-4.513=-0.033
σ0.031-0.052=-0.021
min4.453-4.444=0.008
max4.532-4.577=-0.045

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.161-1.216=-0.055
σ0.319-0.277=0.042
min0.913-0.912=0.001
max1.682-1.641=0.041

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.784-436.786=-0.002
σ572.366-572.361=0.005
min150.597-150.597=0.000
max1295.332-1295.327=0.006
mean90.250
σ8.500
min86.000
max103.000
mean1640.000-1635.000=5.000
σ0.000
min1640.000-1635.000=5.000
max1640.000-1635.000=5.000
mean0.516-0.526=-0.010
σ0.529-0.555=-0.025
min0.248-0.248=-0.001
max1.310-1.358=-0.048
policies=20
mean1506.278-1506.253=0.025
σ0.263-0.235=0.028
min1506.115-1506.101=0.013
max1506.670-1506.603=0.067
mean860.000
σ0.000
min860.000
max860.000
mean1640.000-1635.000=5.000
σ0.000
min1640.000-1635.000=5.000
max1640.000-1635.000=5.000
mean2.554-2.514=0.040
σ0.034-0.036=-0.003
min2.525-2.486=0.039
max2.603-2.565=0.038
policies=200
mean15070.408-15070.390=0.018
σ0.043-0.083=-0.040
min15070.350-15070.291=0.059
max15070.450-15070.473=-0.023
mean8600.000
σ0.000
min8600.000
max8600.000
mean1640.000-1635.000=5.000
σ0.000
min1640.000-1635.000=5.000
max1640.000-1635.000=5.000
mean25.528-25.531=-0.003
σ0.126-0.124=0.002
min25.417-25.383=0.034
max25.668-25.686=-0.018