Compare commits

Home / Compare 9f398cc3 .. b8b270ed

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.568-70.393=0.174
σ0.046-0.046=0.001
min70.541-70.371=0.170
max70.694-70.522=0.172
mean415.000
σ0.000
min415.000
max415.000
mean0.162-0.160=0.002
σ0.004-0.003=0.001
min0.157-0.156=0.001
max0.170-0.165=0.004
cache=y
dps=1
iters=10
policies=100
mean21.287-21.144=0.143
σ0.003-0.003=-0.000
min21.283-21.137=0.146
max21.291-21.148=0.143
mean415.000
σ0.000
min415.000
max415.000
mean0.063-0.064=-0.000
σ0.003-0.003=-0.000
min0.058-0.062=-0.004
max0.066-0.071=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.375-1752.394=0.981
σ0.359-0.362=-0.003
min1752.806-1751.828=0.978
max1753.953-1752.977=0.976
mean1670.500-1660.550=9.950
σ646.104-637.810=8.294
min620.000-625.000=-5.000
max2712.000-2814.000=-102.000
mean2.858-2.791=0.067
σ0.207-0.136=0.072
min2.294-2.495=-0.201
max3.127-3.083=0.045

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.756-270.238=1.518
σ0.006-0.009=-0.003
min271.749-270.224=1.525
max271.764-270.246=1.518
mean2712.000-2814.000=-102.000
σ0.000
min2712.000-2814.000=-102.000
max2712.000-2814.000=-102.000
mean0.381-0.382=-0.000
σ0.005-0.008=-0.003
min0.376-0.374=0.002
max0.389-0.396=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1932.175-1930.707=1.468
σ0.014-0.006=0.008
min1932.155-1930.698=1.457
max1932.192-1930.714=1.477
mean2712.000-2814.000=-102.000
σ0.000
min2712.000-2814.000=-102.000
max2712.000-2814.000=-102.000
mean2.981-2.519=0.462
σ0.172-0.077=0.096
min2.709-2.446=0.262
max3.165-2.613=0.552
iters=5
new-facts=6402
prior-facts=1
mean4752.796-4751.397=1.399
σ1.019-0.845=0.174
min4751.943-4750.919=1.024
max4754.556-4752.898=1.658
mean2712.000-2814.000=-102.000
σ0.000
min2712.000-2814.000=-102.000
max2712.000-2814.000=-102.000
mean8.572-8.436=0.135
σ0.587-0.450=0.137
min7.628-7.862=-0.234
max9.168-8.918=0.250
iters=5
new-facts=6402
prior-facts=6402
mean4943.301-4941.870=1.430
σ0.155-0.019=0.137
min4943.024-4941.851=1.173
max4943.384-4941.894=1.490
mean2968.600-3029.000=-60.400
σ302.531-215.841=86.689
min2712.000-2814.000=-102.000
max3417.000-3319.000=98.000
mean8.454-8.552=-0.099
σ0.138-0.169=-0.031
min8.332-8.361=-0.029
max8.684-8.805=-0.121

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.138-1.020=0.118
σ0.165-0.138=0.027
min0.932-0.931=0.002
max1.353-1.247=0.106

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.860-466.756=1.104
σ575.947-575.926=0.021
min179.884-178.786=1.098
max1331.781-1330.645=1.136
mean86.250
σ8.500
min82.000
max99.000
mean2712.000-2814.000=-102.000
σ0.000
min2712.000-2814.000=-102.000
max2712.000-2814.000=-102.000
mean0.566-0.438=0.128
σ0.566-0.302=0.264
min0.281-0.283=-0.003
max1.415-0.891=0.524
policies=20
mean1799.131-1788.138=10.993
σ0.374-0.360=0.014
min1798.889-1787.892=10.997
max1799.687-1788.668=11.018
mean820.000
σ0.000
min820.000
max820.000
mean2712.000-2814.000=-102.000
σ0.000
min2712.000-2814.000=-102.000
max2712.000-2814.000=-102.000
mean2.800-2.881=-0.080
σ0.015-0.108=-0.092
min2.785-2.766=0.019
max2.818-3.026=-0.208
policies=200
mean17998.391-17888.131=110.260
σ0.550-0.443=0.107
min17998.038-17887.875=110.164
max17999.198-17888.792=110.406
mean8200.000
σ0.000
min8200.000
max8200.000
mean2712.000-2814.000=-102.000
σ0.000
min2712.000-2814.000=-102.000
max2712.000-2814.000=-102.000
mean28.094-28.028=0.066
σ0.067-0.096=-0.029
min28.035-27.958=0.077
max28.171-28.169=0.002