Compare commits

Home / Compare 4671dcdf .. 35b6a128

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.915-53.914=0.001
σ0.367-0.366=0.000
min53.779-53.777=0.002
max54.958-54.956=0.002
mean418.600-416.000=2.600
σ0.843-0.000=0.843
min417.000-416.000=1.000
max419.000-416.000=3.000
mean0.137-0.138=-0.001
σ0.006-0.003=0.002
min0.130-0.135=-0.004
max0.149-0.144=0.005
cache=y
dps=1
iters=10
policies=100
mean43.140-43.146=-0.006
σ0.007-0.010=-0.004
min43.130-43.137=-0.007
max43.153-43.171=-0.018
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.121-0.126=-0.005
σ0.003-0.008=-0.005
min0.119-0.119=0.000
max0.127-0.140=-0.013

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.817-991.808=0.009
σ1.232-1.270=-0.038
min991.232-991.257=-0.025
max996.988-997.158=-0.171
mean1074.050-1064.150=9.900
σ312.555-322.248=-9.693
min620.000-569.000=51.000
max1646.000-1639.000=7.000
mean1.528-1.542=-0.014
σ0.065-0.097=-0.032
min1.463-1.451=0.012
max1.662-1.770=-0.109

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.412-285.412=0.000
σ0.008-0.007=0.001
min285.401-285.402=-0.001
max285.425-285.421=0.004
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean0.381-0.380=0.002
σ0.008-0.008=-0.000
min0.373-0.373=-0.000
max0.389-0.389=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1285.362-1285.366=-0.003
σ0.108-0.121=-0.013
min1285.312-1285.306=0.006
max1285.555-1285.581=-0.026
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean1.877-1.838=0.038
σ0.070-0.090=-0.020
min1.824-1.714=0.110
max1.998-1.927=0.071
iters=5
new-facts=6402
prior-facts=1
mean1807.723-1807.694=0.028
σ7.014-7.005=0.008
min1804.350-1804.337=0.012
max1820.253-1820.212=0.041
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean4.228-4.164=0.063
σ0.234-0.230=0.003
min3.871-3.911=-0.039
max4.441-4.484=-0.043
iters=5
new-facts=6402
prior-facts=6402
mean2070.198-2070.200=-0.001
σ0.011-0.009=0.001
min2070.187-2070.194=-0.006
max2070.216-2070.216=-0.001
mean1844.800-1862.800=-18.000
σ187.978-200.379=-12.401
min1646.000-1639.000=7.000
max2086.000-2093.000=-7.000
mean4.521-4.555=-0.034
σ0.052-0.121=-0.070
min4.477-4.421=0.056
max4.610-4.675=-0.065

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.218-1.220=-0.002
σ0.385-0.236=0.149
min0.906-0.909=-0.004
max1.835-1.476=0.359

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.788-436.788=0.001
σ572.359-572.360=-0.000
min150.598-150.599=-0.001
max1295.327-1295.327=0.000
mean90.250
σ8.500
min86.000
max103.000
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean0.528-0.527=0.001
σ0.551-0.554=-0.003
min0.250-0.249=0.002
max1.355-1.358=-0.003
policies=20
mean1506.275-1506.272=0.002
σ0.249-0.242=0.008
min1506.118-1506.120=-0.003
max1506.647-1506.633=0.014
mean860.000
σ0.000
min860.000
max860.000
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean2.537-2.524=0.012
σ0.022-0.004=0.018
min2.518-2.519=-0.001
max2.567-2.529=0.038
policies=200
mean15070.384-15070.295=0.089
σ0.038-0.096=-0.058
min15070.331-15070.160=0.172
max15070.416-15070.386=0.030
mean8600.000
σ0.000
min8600.000
max8600.000
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean25.443-25.492=-0.049
σ0.153-0.171=-0.017
min25.218-25.276=-0.058
max25.555-25.665=-0.110