Compare commits

Home / Compare 3b9af4ae .. 8e451ad8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.916-53.914=0.002
σ0.366-0.364=0.002
min53.788-53.782=0.006
max54.958-54.950=0.008
mean412.400-414.300=-1.900
σ0.516-0.483=0.033
min412.000-414.000=-2.000
max413.000-415.000=-2.000
mean0.140-0.136=0.005
σ0.004-0.004=-0.000
min0.137-0.130=0.007
max0.146-0.142=0.004
cache=y
dps=1
iters=10
policies=100
mean43.141-43.144=-0.002
σ0.005-0.013=-0.008
min43.129-43.130=-0.001
max43.151-43.177=-0.026
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.121-0.121=-0.001
σ0.005-0.005=0.001
min0.118-0.118=0.000
max0.134-0.131=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.816-991.799=0.018
σ1.224-1.235=-0.011
min991.230-991.251=-0.021
max996.954-997.001=-0.046
mean1065.950-1071.150=-5.200
σ317.921-328.071=-10.150
min605.000-568.000=37.000
max1638.000-1643.000=-5.000
mean1.516-1.521=-0.004
σ0.066-0.065=0.001
min1.457-1.452=0.005
max1.731-1.727=0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.412-285.413=-0.001
σ0.011-0.012=-0.001
min285.396-285.393=0.003
max285.425-285.423=0.002
mean1638.000-1643.000=-5.000
σ0.000
min1638.000-1643.000=-5.000
max1638.000-1643.000=-5.000
mean0.381-0.379=0.002
σ0.010-0.007=0.003
min0.373-0.374=-0.000
max0.396-0.389=0.006
iters=5
new-facts=1
prior-facts=6402
mean1285.374-1285.375=-0.000
σ0.136-0.135=0.001
min1285.308-1285.307=0.001
max1285.618-1285.617=0.001
mean1638.000-1643.000=-5.000
σ0.000
min1638.000-1643.000=-5.000
max1638.000-1643.000=-5.000
mean1.884-1.937=-0.052
σ0.068-0.112=-0.045
min1.819-1.829=-0.010
max1.999-2.104=-0.104
iters=5
new-facts=6402
prior-facts=1
mean1807.712-1807.743=-0.031
σ7.005-6.987=0.019
min1804.367-1804.396=-0.030
max1820.228-1820.226=0.003
mean1638.000-1643.000=-5.000
σ0.000
min1638.000-1643.000=-5.000
max1638.000-1643.000=-5.000
mean4.162-4.269=-0.108
σ0.159-0.145=0.014
min3.954-4.127=-0.173
max4.400-4.491=-0.090
iters=5
new-facts=6402
prior-facts=6402
mean2070.193-2070.196=-0.003
σ0.009-0.011=-0.002
min2070.184-2070.183=0.001
max2070.206-2070.212=-0.006
mean1847.000-1842.800=4.200
σ174.244-178.595=-4.351
min1638.000-1643.000=-5.000
max2090.000-2078.000=12.000
mean4.454-4.506=-0.052
σ0.053-0.041=0.012
min4.375-4.461=-0.087
max4.510-4.559=-0.049

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.215-1.207=0.009
σ0.223-0.318=-0.094
min1.031-0.910=0.121
max1.578-1.706=-0.129

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.786-436.785=0.000
σ572.363-572.364=-0.001
min150.595-150.596=-0.001
max1295.330-1295.331=-0.001
mean90.250
σ8.500
min86.000
max103.000
mean1638.000-1643.000=-5.000
σ0.000
min1638.000-1643.000=-5.000
max1638.000-1643.000=-5.000
mean0.533-0.518=0.014
σ0.568-0.536=0.033
min0.247-0.250=-0.002
max1.385-1.322=0.063
policies=20
mean1506.243-1506.250=-0.007
σ0.243-0.239=0.004
min1506.088-1506.091=-0.004
max1506.604-1506.605=-0.000
mean860.000
σ0.000
min860.000
max860.000
mean1638.000-1643.000=-5.000
σ0.000
min1638.000-1643.000=-5.000
max1638.000-1643.000=-5.000
mean2.515-2.513=0.001
σ0.014-0.017=-0.003
min2.501-2.496=0.005
max2.533-2.532=0.000
policies=200
mean15070.331-15070.321=0.009
σ0.139-0.092=0.047
min15070.183-15070.266=-0.083
max15070.486-15070.459=0.027
mean8600.000
σ0.000
min8600.000
max8600.000
mean1638.000-1643.000=-5.000
σ0.000
min1638.000-1643.000=-5.000
max1638.000-1643.000=-5.000
mean25.448-25.521=-0.073
σ0.083-0.203=-0.120
min25.339-25.338=0.001
max25.530-25.784=-0.254