Compare commits

Home / Compare 468da384 .. bd995394

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.396-70.394=0.002
σ0.045-0.045=-0.001
min70.369-70.370=-0.001
max70.518-70.521=-0.003
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.160-0.161=-0.001
σ0.004-0.004=0.000
min0.153-0.152=0.001
max0.168-0.167=0.001
cache=y
dps=1
iters=10
policies=100
mean21.144-21.147=-0.003
σ0.003-0.009=-0.007
min21.139-21.140=-0.000
max21.148-21.172=-0.025
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.063-0.063=0.000
σ0.002-0.002=-0.000
min0.057-0.057=0.001
max0.067-0.066=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.393-1752.395=-0.002
σ0.360-0.361=-0.001
min1751.822-1751.826=-0.004
max1752.961-1752.989=-0.028
mean1655.750-1662.350=-6.600
σ645.809-634.625=11.184
min634.000-618.000=16.000
max2849.000-2777.000=72.000
mean2.757-2.783=-0.026
σ0.193-0.235=-0.043
min2.298-2.191=0.107
max3.003-3.113=-0.110

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.243-270.238=0.005
σ0.008-0.005=0.003
min270.230-270.233=-0.003
max270.253-270.246=0.007
mean2849.000-2777.000=72.000
σ0.000
min2849.000-2777.000=72.000
max2849.000-2777.000=72.000
mean0.380-0.383=-0.004
σ0.003-0.005=-0.002
min0.377-0.379=-0.003
max0.384-0.392=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1930.701-1930.694=0.008
σ0.015-0.017=-0.002
min1930.679-1930.667=0.011
max1930.715-1930.706=0.010
mean2849.000-2777.000=72.000
σ0.000
min2849.000-2777.000=72.000
max2849.000-2777.000=72.000
mean2.568-2.636=-0.068
σ0.129-0.260=-0.132
min2.471-2.460=0.012
max2.776-3.089=-0.312
iters=5
new-facts=6402
prior-facts=1
mean4751.301-4751.294=0.006
σ0.653-0.662=-0.009
min4750.905-4750.877=0.028
max4752.455-4752.456=-0.000
mean2849.000-2777.000=72.000
σ0.000
min2849.000-2777.000=72.000
max2849.000-2777.000=72.000
mean8.507-8.752=-0.245
σ0.473-0.574=-0.101
min7.777-7.841=-0.064
max8.942-9.394=-0.452
iters=5
new-facts=6402
prior-facts=6402
mean4941.797-4941.865=-0.068
σ0.170-0.022=0.148
min4941.494-4941.847=-0.353
max4941.890-4941.893=-0.003
mean3062.000-2998.800=63.200
σ207.864-219.121=-11.257
min2849.000-2777.000=72.000
max3324.000-3309.000=15.000
mean8.528-8.566=-0.038
σ0.116-0.121=-0.006
min8.361-8.466=-0.105
max8.648-8.751=-0.102

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.049-0.989=0.060
σ0.131-0.140=-0.010
min0.928-0.919=0.008
max1.246-1.240=0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.758-466.753=0.004
σ575.937-575.931=0.006
min178.778-178.783=-0.004
max1330.663-1330.650=0.013
mean86.250
σ8.500
min82.000
max99.000
mean2849.000-2777.000=72.000
σ0.000
min2849.000-2777.000=72.000
max2849.000-2777.000=72.000
mean0.482-0.443=0.039
σ0.379-0.300=0.079
min0.287-0.291=-0.004
max1.051-0.893=0.157
policies=20
mean1788.127-1788.155=-0.027
σ0.374-0.356=0.018
min1787.855-1787.907=-0.052
max1788.676-1788.680=-0.004
mean820.000
σ0.000
min820.000
max820.000
mean2849.000-2777.000=72.000
σ0.000
min2849.000-2777.000=72.000
max2849.000-2777.000=72.000
mean2.863-2.869=-0.006
σ0.004-0.119=-0.115
min2.859-2.785=0.074
max2.868-3.041=-0.173
policies=200
mean17888.154-17888.124=0.030
σ0.468-0.366=0.102
min17887.838-17887.907=-0.069
max17888.849-17888.670=0.179
mean8200.000
σ0.000
min8200.000
max8200.000
mean2849.000-2777.000=72.000
σ0.000
min2849.000-2777.000=72.000
max2849.000-2777.000=72.000
mean28.581-28.128=0.454
σ0.403-0.192=0.211
min28.214-27.999=0.215
max29.002-28.412=0.590