Compare commits

Home / Compare aa8e937d .. 5920c694

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.374-70.374=0.000
σ0.048-0.045=0.003
min70.345-70.347=-0.002
max70.506-70.499=0.007
mean410.000-419.000=-9.000
σ0.000
min410.000-419.000=-9.000
max410.000-419.000=-9.000
mean0.159-0.158=0.001
σ0.003-0.004=-0.001
min0.156-0.150=0.006
max0.165-0.165=0.001
cache=y
dps=1
iters=10
policies=100
mean21.141-21.141=-0.000
σ0.002-0.002=-0.000
min21.138-21.137=0.001
max21.145-21.144=0.001
mean410.000-419.000=-9.000
σ0.000
min410.000-419.000=-9.000
max410.000-419.000=-9.000
mean0.064-0.064=-0.000
σ0.002-0.003=-0.001
min0.062-0.062=0.000
max0.069-0.071=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.386-1752.387=-0.001
σ0.359-0.362=-0.003
min1751.818-1751.818=-0.000
max1752.954-1752.968=-0.014
mean1656.250-1648.800=7.450
σ636.893-628.219=8.675
min617.000-639.000=-22.000
max2800.000-2849.000=-49.000
mean2.830-2.805=0.026
σ0.102-0.153=-0.051
min2.607-2.264=0.343
max3.091-3.008=0.083

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.126-270.114=0.012
σ0.005-0.012=-0.007
min270.120-270.097=0.023
max270.132-270.127=0.006
mean2800.000-2849.000=-49.000
σ0.000
min2800.000-2849.000=-49.000
max2800.000-2849.000=-49.000
mean0.372-0.386=-0.014
σ0.001-0.006=-0.005
min0.371-0.380=-0.009
max0.373-0.395=-0.023
iters=5
new-facts=1
prior-facts=6402
mean1930.588-1930.593=-0.005
σ0.007-0.007=0.000
min1930.581-1930.583=-0.002
max1930.596-1930.603=-0.007
mean2800.000-2849.000=-49.000
σ0.000
min2800.000-2849.000=-49.000
max2800.000-2849.000=-49.000
mean2.519-2.487=0.032
σ0.088-0.057=0.031
min2.438-2.440=-0.002
max2.651-2.578=0.073
iters=5
new-facts=6402
prior-facts=1
mean4750.972-4751.090=-0.119
σ0.985-0.893=0.092
min4750.345-4750.509=-0.164
max4752.722-4752.667=0.055
mean2800.000-2849.000=-49.000
σ0.000
min2800.000-2849.000=-49.000
max2800.000-2849.000=-49.000
mean8.501-8.558=-0.058
σ0.615-0.465=0.150
min7.602-7.996=-0.394
max9.099-9.077=0.023
iters=5
new-facts=6402
prior-facts=6402
mean4941.492-4941.491=0.001
σ0.212-0.214=-0.002
min4941.130-4941.127=0.003
max4941.634-4941.627=0.007
mean3024.600-3057.000=-32.400
σ221.344-185.451=35.893
min2800.000-2849.000=-49.000
max3319.000-3321.000=-2.000
mean8.529-8.528=0.001
σ0.218-0.133=0.085
min8.335-8.380=-0.045
max8.804-8.716=0.089

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.034-1.153=-0.119
σ0.131-0.248=-0.117
min0.947-0.945=0.002
max1.247-1.531=-0.284

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.363-466.359=0.004
σ575.918-575.930=-0.013
min178.394-178.390=0.004
max1330.240-1330.255=-0.015
mean84.000
σ8.000
min80.000
max96.000
mean2800.000-2849.000=-49.000
σ0.000
min2800.000-2849.000=-49.000
max2800.000-2849.000=-49.000
mean0.443-0.443=0.001
σ0.307-0.309=-0.002
min0.285-0.285=-0.000
max0.903-0.906=-0.002
policies=20
mean1784.251-1784.256=-0.005
σ0.340-0.369=-0.029
min1784.014-1783.993=0.021
max1784.751-1784.799=-0.048
mean800.000
σ0.000
min800.000
max800.000
mean2800.000-2849.000=-49.000
σ0.000
min2800.000-2849.000=-49.000
max2800.000-2849.000=-49.000
mean2.860-2.861=-0.001
σ0.071-0.013=0.057
min2.784-2.846=-0.062
max2.955-2.873=0.082
policies=200
mean17848.790-17848.826=-0.036
σ0.465-0.374=0.091
min17848.443-17848.595=-0.152
max17849.473-17849.380=0.093
mean8000.000
σ0.000
min8000.000
max8000.000
mean2800.000-2849.000=-49.000
σ0.000
min2800.000-2849.000=-49.000
max2800.000-2849.000=-49.000
mean27.948-28.431=-0.483
σ0.176-0.569=-0.393
min27.738-27.917=-0.179
max28.165-28.962=-0.797