Compare commits

Home / Compare 8ce349e5 .. 9051ccdf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.782=-0.000
σ0.046-0.045=0.001
min70.751-70.755=-0.005
max70.909-70.908=0.002
mean415.800-414.000=1.800
σ0.422-0.000=0.422
min415.000-414.000=1.000
max416.000-414.000=2.000
mean0.160-0.159=0.001
σ0.003-0.004=-0.001
min0.158-0.152=0.005
max0.165-0.164=0.002
cache=y
dps=1
iters=10
policies=100
mean21.493-21.494=-0.001
σ0.003-0.003=0.000
min21.490-21.490=0.000
max21.500-21.499=0.001
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.065-0.066=-0.002
σ0.002-0.003=-0.001
min0.063-0.065=-0.001
max0.072-0.075=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.093-1754.093=-0.000
σ0.363-0.362=0.001
min1753.530-1753.536=-0.006
max1754.683-1754.678=0.005
mean1676.600-1642.150=34.450
σ644.090-604.214=39.875
min686.000-642.000=44.000
max2751.000-2455.000=296.000
mean2.816-2.791=0.025
σ0.138-0.201=-0.062
min2.498-2.271=0.227
max3.013-3.126=-0.114

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.954-271.600=0.355
σ0.008-0.006=0.002
min271.944-271.594=0.350
max271.963-271.608=0.355
mean2751.000-2455.000=296.000
σ0.000
min2751.000-2455.000=296.000
max2751.000-2455.000=296.000
mean0.383-0.383=-0.001
σ0.008-0.002=0.006
min0.377-0.381=-0.004
max0.397-0.385=0.012
iters=5
new-facts=1
prior-facts=6402
mean1932.326-1932.006=0.320
σ0.009-0.011=-0.002
min1932.311-1931.991=0.320
max1932.335-1932.021=0.314
mean2751.000-2455.000=296.000
σ0.000
min2751.000-2455.000=296.000
max2751.000-2455.000=296.000
mean3.000-2.508=0.491
σ0.055-0.094=-0.039
min2.919-2.393=0.526
max3.070-2.623=0.447
iters=5
new-facts=6402
prior-facts=1
mean4752.936-4752.774=0.162
σ0.975-0.844=0.131
min4752.145-4752.254=-0.109
max4754.637-4754.271=0.366
mean2751.000-2455.000=296.000
σ0.000
min2751.000-2455.000=296.000
max2751.000-2455.000=296.000
mean8.780-8.445=0.335
σ0.246-0.488=-0.243
min8.473-7.851=0.622
max9.132-8.945=0.187
iters=5
new-facts=6402
prior-facts=6402
mean4943.564-4943.138=0.426
σ0.017-0.167=-0.151
min4943.545-4942.840=0.705
max4943.579-4943.233=0.346
mean3020.600-3018.200=2.400
σ232.997-263.245=-30.247
min2751.000-2627.000=124.000
max3320.000-3330.000=-10.000
mean8.503-8.620=-0.117
σ0.117-0.129=-0.012
min8.357-8.445=-0.089
max8.636-8.746=-0.110

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.059-1.726=-0.667
σ0.148-0.123=0.025
min0.930-1.549=-0.619
max1.294-1.819=-0.525

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.643-468.632=0.011
σ574.949-574.925=0.024
min181.162-181.165=-0.004
max1331.067-1331.020=0.048
mean88.250
σ8.500
min84.000
max101.000
mean2751.000-2455.000=296.000
σ0.000
min2751.000-2455.000=296.000
max2751.000-2455.000=296.000
mean0.590-0.553=0.037
σ0.607-0.518=0.089
min0.284-0.288=-0.003
max1.501-1.331=0.171
policies=20
mean1811.930-1811.964=-0.034
σ0.376-0.393=-0.018
min1811.710-1811.703=0.007
max1812.490-1812.545=-0.055
mean840.000
σ0.000
min840.000
max840.000
mean2751.000-2455.000=296.000
σ0.000
min2751.000-2455.000=296.000
max2751.000-2455.000=296.000
mean2.841-2.846=-0.005
σ0.014-0.027=-0.013
min2.821-2.818=0.003
max2.851-2.882=-0.030
policies=200
mean18126.678-18126.638=0.041
σ0.602-0.590=0.011
min18126.264-18126.241=0.022
max18127.555-18127.497=0.057
mean8400.000
σ0.000
min8400.000
max8400.000
mean2751.000-2455.000=296.000
σ0.000
min2751.000-2455.000=296.000
max2751.000-2455.000=296.000
mean28.472-28.691=-0.218
σ0.069-0.036=0.033
min28.374-28.661=-0.288
max28.531-28.738=-0.208