Compare commits

Home / Compare 37dd7f1e .. a6aed75d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.379-70.379=-0.000
σ0.045-0.048=-0.003
min70.352-70.350=0.002
max70.504-70.512=-0.009
mean416.400-414.000=2.400
σ0.516-0.000=0.516
min416.000-414.000=2.000
max417.000-414.000=3.000
mean0.160-0.158=0.002
σ0.003-0.002=0.001
min0.157-0.156=0.001
max0.166-0.162=0.004
cache=y
dps=1
iters=10
policies=100
mean21.144-21.145=-0.001
σ0.002-0.002=0.000
min21.141-21.142=-0.001
max21.147-21.148=-0.001
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.064-0.066=-0.002
σ0.002-0.003=-0.001
min0.062-0.064=-0.002
max0.071-0.075=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.385-1752.385=-0.000
σ0.364-0.361=0.003
min1751.818-1751.819=-0.001
max1752.972-1752.969=0.002
mean1655.100-1635.050=20.050
σ643.327-602.760=40.567
min624.000-668.000=-44.000
max2793.000-2454.000=339.000
mean2.804-2.750=0.054
σ0.204-0.232=-0.028
min2.173-2.322=-0.149
max3.332-3.057=0.276

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.129-270.124=0.005
σ0.014-0.006=0.008
min270.110-270.118=-0.008
max270.149-270.134=0.016
mean2793.000-2454.000=339.000
σ0.000
min2793.000-2454.000=339.000
max2793.000-2454.000=339.000
mean0.375-0.373=0.002
σ0.005-0.004=0.001
min0.371-0.371=0.001
max0.383-0.380=0.003
iters=5
new-facts=1
prior-facts=6402
mean1930.590-1930.589=0.001
σ0.011-0.025=-0.013
min1930.572-1930.551=0.021
max1930.600-1930.615=-0.016
mean2793.000-2454.000=339.000
σ0.000
min2793.000-2454.000=339.000
max2793.000-2454.000=339.000
mean2.523-2.557=-0.034
σ0.131-0.096=0.035
min2.403-2.464=-0.060
max2.693-2.681=0.012
iters=5
new-facts=6402
prior-facts=1
mean4751.028-4751.123=-0.095
σ0.897-0.780=0.117
min4750.196-4750.651=-0.455
max4752.557-4752.509=0.049
mean2793.000-2454.000=339.000
σ0.000
min2793.000-2454.000=339.000
max2793.000-2454.000=339.000
mean8.046-8.064=-0.018
σ0.395-0.396=-0.001
min7.630-7.676=-0.045
max8.640-8.517=0.124
iters=5
new-facts=6402
prior-facts=6402
mean4941.528-4941.526=0.001
σ0.084-0.089=-0.004
min4941.446-4941.451=-0.005
max4941.628-4941.629=-0.001
mean3060.600-2900.200=160.400
σ333.346-394.471=-61.125
min2793.000-2454.000=339.000
max3567.000-3427.000=140.000
mean8.522-8.455=0.066
σ0.360-0.126=0.234
min8.217-8.345=-0.127
max9.113-8.619=0.494

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.042-1.722=-0.679
σ0.116-0.140=-0.024
min0.931-1.541=-0.611
max1.211-1.923=-0.711

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.373-466.364=0.009
σ575.932-575.935=-0.003
min178.401-178.393=0.008
max1330.271-1330.266=0.005
mean84.250-84.000=0.250
σ8.500-8.000=0.500
min80.000
max97.000-96.000=1.000
mean2793.000-2454.000=339.000
σ0.000
min2793.000-2454.000=339.000
max2793.000-2454.000=339.000
mean0.441-0.550=-0.109
σ0.306-0.539=-0.233
min0.285-0.276=0.009
max0.899-1.358=-0.459
policies=20
mean1784.274-1784.213=0.061
σ0.368-0.361=0.006
min1784.029-1783.981=0.049
max1784.819-1784.750=0.069
mean800.000
σ0.000
min800.000
max800.000
mean2793.000-2454.000=339.000
σ0.000
min2793.000-2454.000=339.000
max2793.000-2454.000=339.000
mean2.844-2.763=0.081
σ0.101-0.012=0.089
min2.768-2.745=0.023
max2.984-2.772=0.212
policies=200
mean17848.751-17848.862=-0.111
σ0.578-0.483=0.095
min17848.360-17848.600=-0.239
max17849.608-17849.585=0.022
mean8000.000
σ0.000
min8000.000
max8000.000
mean2793.000-2454.000=339.000
σ0.000
min2793.000-2454.000=339.000
max2793.000-2454.000=339.000
mean27.893-27.959=-0.066
σ0.132-0.093=0.039
min27.797-27.853=-0.056
max28.088-28.078=0.010