Compare commits

Home / Compare 11d0d62c .. fa0b3413

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.391-70.389=0.002
σ0.045-0.046=-0.001
min70.366-70.361=0.005
max70.517-70.517=-0.000
mean415.000-417.400=-2.400
σ0.000-0.516=-0.516
min415.000-417.000=-2.000
max415.000-418.000=-3.000
mean0.159-0.159=0.000
σ0.003-0.003=0.000
min0.152-0.156=-0.003
max0.164-0.164=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.148-21.144=0.004
σ0.012-0.003=0.009
min21.141-21.140=0.001
max21.181-21.149=0.032
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.064-0.064=0.000
σ0.004-0.002=0.003
min0.060-0.062=-0.003
max0.072-0.069=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.393-1752.394=-0.001
σ0.362-0.363=-0.002
min1751.830-1751.825=0.004
max1752.983-1752.982=0.001
mean1648.100-1657.450=-9.350
σ609.912-628.177=-18.265
min639.000-621.000=18.000
max2473.000-2772.000=-299.000
mean2.779-2.818=-0.039
σ0.228-0.212=0.016
min2.341-2.207=0.134
max3.351-3.062=0.289

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.239-270.144=0.096
σ0.007-0.010=-0.003
min270.229-270.129=0.100
max270.248-270.154=0.093
mean2473.000-2772.000=-299.000
σ0.000
min2473.000-2772.000=-299.000
max2473.000-2772.000=-299.000
mean0.380-0.377=0.003
σ0.010-0.002=0.008
min0.369-0.374=-0.005
max0.396-0.380=0.016
iters=5
new-facts=1
prior-facts=6402
mean1930.698-1930.604=0.094
σ0.020-0.009=0.011
min1930.666-1930.597=0.070
max1930.714-1930.618=0.096
mean2473.000-2772.000=-299.000
σ0.000
min2473.000-2772.000=-299.000
max2473.000-2772.000=-299.000
mean2.579-2.503=0.075
σ0.101-0.116=-0.016
min2.494-2.346=0.147
max2.725-2.623=0.102
iters=5
new-facts=6402
prior-facts=1
mean4751.289-4751.355=-0.066
σ0.650-0.959=-0.309
min4750.892-4750.740=0.153
max4752.435-4753.051=-0.616
mean2473.000-2772.000=-299.000
σ0.000
min2473.000-2772.000=-299.000
max2473.000-2772.000=-299.000
mean8.602-8.427=0.174
σ0.481-0.681=-0.200
min7.841-7.644=0.197
max9.030-9.362=-0.332
iters=5
new-facts=6402
prior-facts=6402
mean4941.796-4941.773=0.023
σ0.136-0.016=0.120
min4941.555-4941.755=-0.200
max4941.875-4941.790=0.085
mean2998.200-3051.000=-52.800
σ287.828-256.482=31.346
min2585.000-2772.000=-187.000
max3310.000-3306.000=4.000
mean8.519-8.721=-0.202
σ0.107-0.391=-0.284
min8.387-8.378=0.009
max8.664-9.360=-0.696

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.756-1.049=0.707
σ0.165-0.124=0.041
min1.463-0.933=0.530
max1.873-1.240=0.633

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.748-466.374=0.375
σ575.930-575.929=0.002
min178.782-178.409=0.373
max1330.644-1330.267=0.377
mean86.250-84.250=2.000
σ8.500
min82.000-80.000=2.000
max99.000-97.000=2.000
mean2473.000-2772.000=-299.000
σ0.000
min2473.000-2772.000=-299.000
max2473.000-2772.000=-299.000
mean0.563-0.434=0.129
σ0.565-0.309=0.256
min0.279-0.258=0.021
max1.411-0.897=0.514
policies=20
mean1788.109-1784.369=3.740
σ0.375-0.369=0.006
min1787.875-1784.129=3.746
max1788.668-1784.915=3.753
mean820.000-800.000=20.000
σ0.000
min820.000-800.000=20.000
max820.000-800.000=20.000
mean2473.000-2772.000=-299.000
σ0.000
min2473.000-2772.000=-299.000
max2473.000-2772.000=-299.000
mean2.780-2.862=-0.081
σ0.015-0.114=-0.098
min2.767-2.757=0.010
max2.800-3.017=-0.217
policies=200
mean17888.030-17849.741=38.290
σ0.619-0.465=0.154
min17887.627-17849.466=38.162
max17888.944-17850.433=38.511
mean8200.000-8000.000=200.000
σ0.000
min8200.000-8000.000=200.000
max8200.000-8000.000=200.000
mean2473.000-2772.000=-299.000
σ0.000
min2473.000-2772.000=-299.000
max2473.000-2772.000=-299.000
mean28.103-27.955=0.148
σ0.017-0.108=-0.092
min28.089-27.861=0.228
max28.123-28.073=0.050