Compare commits

Home / Compare a4866590 .. 7325d609

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.375-70.374=0.001
σ0.058-0.058=0.000
min70.339-70.335=0.004
max70.536-70.534=0.002
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.160-0.156=0.004
σ0.002-0.004=-0.002
min0.157-0.149=0.008
max0.164-0.161=0.004
cache=y
dps=1
iters=10
policies=100
mean21.142-21.143=-0.001
σ0.003-0.003=-0.000
min21.139-21.141=-0.002
max21.147-21.149=-0.002
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.061-0.064=-0.003
σ0.003-0.002=0.001
min0.059-0.062=-0.003
max0.070-0.070=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.199-1752.198=0.001
σ0.362-0.360=0.001
min1751.628-1751.626=0.002
max1752.780-1752.791=-0.011
mean1664.300-1661.050=3.250
σ625.500-622.763=2.738
min685.000-661.000=24.000
max2749.000-2507.000=242.000
mean2.813-2.820=-0.008
σ0.194-0.130=0.064
min2.277-2.487=-0.210
max3.031-3.103=-0.072

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.907-269.933=-0.027
σ0.007-0.004=0.003
min269.896-269.926=-0.030
max269.915-269.937=-0.022
mean2749.000-2507.000=242.000
σ0.000
min2749.000-2507.000=242.000
max2749.000-2507.000=242.000
mean0.374-0.383=-0.009
σ0.005-0.001=0.003
min0.370-0.381=-0.011
max0.379-0.385=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1930.393-1930.396=-0.003
σ0.006-0.006=-0.000
min1930.385-1930.387=-0.002
max1930.399-1930.405=-0.006
mean2749.000-2507.000=242.000
σ0.000
min2749.000-2507.000=242.000
max2749.000-2507.000=242.000
mean2.526-2.504=0.021
σ0.124-0.106=0.018
min2.356-2.417=-0.061
max2.658-2.681=-0.023
iters=5
new-facts=6402
prior-facts=1
mean4750.853-4750.847=0.006
σ0.816-0.875=-0.059
min4750.339-4750.331=0.008
max4752.304-4752.405=-0.101
mean2749.000-2507.000=242.000
σ0.000
min2749.000-2507.000=242.000
max2749.000-2507.000=242.000
mean8.500-8.603=-0.103
σ0.534-0.601=-0.066
min7.614-7.614=0.001
max8.873-9.084=-0.211
iters=5
new-facts=6402
prior-facts=6402
mean4941.262-4941.334=-0.072
σ0.125-0.081=0.044
min4941.072-4941.272=-0.199
max4941.423-4941.427=-0.004
mean3024.600-2994.200=30.400
σ249.937-318.194=-68.258
min2749.000-2574.000=175.000
max3362.000-3399.000=-37.000
mean8.504-8.581=-0.077
σ0.106-0.237=-0.132
min8.368-8.367=0.001
max8.628-8.964=-0.337

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.052-1.694=-0.642
σ0.124-0.097=0.027
min0.942-1.608=-0.667
max1.246-1.810=-0.564

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.912-465.903=0.009
σ575.770-575.757=0.013
min178.020-178.020=-0.000
max1329.567-1329.538=0.029
mean81.750
σ7.500
min78.000
max93.000
mean2749.000-2507.000=242.000
σ0.000
min2749.000-2507.000=242.000
max2749.000-2507.000=242.000
mean0.567-0.560=0.006
σ0.561-0.561=-0.000
min0.283-0.277=0.005
max1.408-1.402=0.005
policies=20
mean1780.434-1780.448=-0.014
σ0.347-0.346=0.000
min1780.202-1780.218=-0.016
max1780.949-1780.962=-0.013
mean780.000
σ0.000
min780.000
max780.000
mean2749.000-2507.000=242.000
σ0.000
min2749.000-2507.000=242.000
max2749.000-2507.000=242.000
mean2.766-2.735=0.031
σ0.021-0.014=0.008
min2.746-2.715=0.031
max2.794-2.746=0.048
policies=200
mean17811.233-17811.193=0.040
σ0.525-0.584=-0.060
min17810.803-17810.837=-0.034
max17811.996-17812.067=-0.071
mean7800.000
σ0.000
min7800.000
max7800.000
mean2749.000-2507.000=242.000
σ0.000
min2749.000-2507.000=242.000
max2749.000-2507.000=242.000
mean27.773-27.823=-0.050
σ0.159-0.018=0.141
min27.659-27.806=-0.147
max28.008-27.842=0.166