Compare commits

Home / Compare 335cf48b .. 5176b84a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.388-70.389=-0.001
σ0.048-0.046=0.002
min70.360-70.360=0.001
max70.521-70.518=0.003
mean412.000-416.200=-4.200
σ0.000-0.422=-0.422
min412.000-416.000=-4.000
max412.000-417.000=-5.000
mean0.157-0.157=-0.000
σ0.006-0.004=0.002
min0.149-0.150=-0.002
max0.165-0.164=0.002
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=0.000
σ0.002-0.003=-0.001
min21.141-21.141=0.001
max21.147-21.150=-0.003
mean412.000-417.000=-5.000
σ0.000
min412.000-417.000=-5.000
max412.000-417.000=-5.000
mean0.064-0.064=-0.000
σ0.002-0.003=-0.001
min0.062-0.062=0.000
max0.071-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.393-1752.394=-0.001
σ0.362-0.362=-0.000
min1751.824-1751.825=-0.001
max1752.981-1752.999=-0.018
mean1662.400-1655.150=7.250
σ647.948-643.260=4.688
min622.000-634.000=-12.000
max2824.000-2847.000=-23.000
mean2.823-2.794=0.029
σ0.099-0.183=-0.084
min2.625-2.425=0.199
max3.061-3.131=-0.071

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.142-270.143=-0.001
σ0.006-0.004=0.002
min270.136-270.136=-0.001
max270.151-270.149=0.002
mean2824.000-2847.000=-23.000
σ0.000
min2824.000-2847.000=-23.000
max2824.000-2847.000=-23.000
mean0.377-0.376=0.001
σ0.005-0.003=0.002
min0.369-0.370=-0.001
max0.384-0.378=0.006
iters=5
new-facts=1
prior-facts=6402
mean1930.612-1930.608=0.005
σ0.004-0.011=-0.007
min1930.608-1930.596=0.012
max1930.617-1930.623=-0.006
mean2824.000-2847.000=-23.000
σ0.000
min2824.000-2847.000=-23.000
max2824.000-2847.000=-23.000
mean2.537-2.513=0.024
σ0.131-0.061=0.071
min2.443-2.441=0.001
max2.760-2.584=0.176
iters=5
new-facts=6402
prior-facts=1
mean4751.303-4751.338=-0.035
σ0.934-0.893=0.041
min4750.795-4750.769=0.026
max4752.962-4752.920=0.042
mean2824.000-2847.000=-23.000
σ0.000
min2824.000-2847.000=-23.000
max2824.000-2847.000=-23.000
mean8.667-8.797=-0.130
σ0.470-0.529=-0.059
min8.066-8.098=-0.032
max9.142-9.361=-0.219
iters=5
new-facts=6402
prior-facts=6402
mean4941.699-4941.700=-0.002
σ0.161-0.166=-0.006
min4941.413-4941.405=0.008
max4941.792-4941.792=0.000
mean3048.400-3077.000=-28.600
σ234.385-231.353=3.032
min2824.000-2847.000=-23.000
max3291.000-3422.000=-131.000
mean8.728-8.582=0.147
σ0.282-0.228=0.054
min8.391-8.344=0.048
max9.122-8.865=0.257

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.996-1.053=-0.058
σ0.143-0.127=0.015
min0.925-0.938=-0.013
max1.251-1.250=0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.374-466.376=-0.002
σ575.930-575.925=0.005
min178.404-178.407=-0.004
max1330.270-1330.264=0.006
mean84.250
σ8.500
min80.000
max97.000
mean2824.000-2847.000=-23.000
σ0.000
min2824.000-2847.000=-23.000
max2824.000-2847.000=-23.000
mean0.441-0.438=0.003
σ0.302-0.289=0.013
min0.287-0.284=0.004
max0.893-0.871=0.022
policies=20
mean1784.366-1784.355=0.012
σ0.328-0.364=-0.037
min1784.120-1784.094=0.026
max1784.846-1784.889=-0.044
mean800.000
σ0.000
min800.000
max800.000
mean2824.000-2847.000=-23.000
σ0.000
min2824.000-2847.000=-23.000
max2824.000-2847.000=-23.000
mean2.869-2.862=0.007
σ0.112-0.012=0.100
min2.749-2.851=-0.102
max3.019-2.879=0.140
policies=200
mean17849.745-17849.966=-0.220
σ0.568-0.481=0.087
min17849.371-17849.631=-0.260
max17850.592-17850.679=-0.087
mean8000.000
σ0.000
min8000.000
max8000.000
mean2824.000-2847.000=-23.000
σ0.000
min2824.000-2847.000=-23.000
max2824.000-2847.000=-23.000
mean27.856-28.332=-0.476
σ0.094-0.490=-0.396
min27.764-27.819=-0.055
max27.969-28.776=-0.807