Compare commits

Home / Compare ad671a11 .. 1718b7b7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.395-70.391=0.004
σ0.045-0.045=0.000
min70.368-70.366=0.002
max70.521-70.517=0.004
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.161-0.159=0.002
σ0.004-0.003=0.000
min0.157-0.152=0.004
max0.167-0.164=0.003
cache=y
dps=1
iters=10
policies=100
mean21.144-21.148=-0.004
σ0.003-0.012=-0.009
min21.138-21.141=-0.003
max21.148-21.181=-0.032
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.065-0.064=0.001
σ0.002-0.004=-0.002
min0.063-0.060=0.004
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.395-1752.393=0.002
σ0.363-0.362=0.002
min1751.821-1751.830=-0.009
max1753.001-1752.983=0.019
mean1660.450-1648.100=12.350
σ638.185-609.912=28.273
min621.000-639.000=-18.000
max2814.000-2473.000=341.000
mean2.777-2.779=-0.002
σ0.182-0.228=-0.046
min2.289-2.341=-0.052
max2.998-3.351=-0.353

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.242-270.239=0.002
σ0.010-0.007=0.003
min270.228-270.229=-0.001
max270.255-270.248=0.007
mean2814.000-2473.000=341.000
σ0.000
min2814.000-2473.000=341.000
max2814.000-2473.000=341.000
mean0.385-0.380=0.005
σ0.010-0.010=0.000
min0.373-0.369=0.004
max0.400-0.396=0.004
iters=5
new-facts=1
prior-facts=6402
mean1930.700-1930.698=0.002
σ0.010-0.020=-0.010
min1930.686-1930.666=0.019
max1930.709-1930.714=-0.005
mean2814.000-2473.000=341.000
σ0.000
min2814.000-2473.000=341.000
max2814.000-2473.000=341.000
mean2.547-2.579=-0.032
σ0.106-0.101=0.005
min2.426-2.494=-0.067
max2.703-2.725=-0.023
iters=5
new-facts=6402
prior-facts=1
mean4751.334-4751.289=0.044
σ0.930-0.650=0.280
min4750.595-4750.892=-0.297
max4752.936-4752.435=0.501
mean2814.000-2473.000=341.000
σ0.000
min2814.000-2473.000=341.000
max2814.000-2473.000=341.000
mean8.249-8.602=-0.352
σ0.632-0.481=0.150
min7.711-7.841=-0.130
max9.246-9.030=0.216
iters=5
new-facts=6402
prior-facts=6402
mean4941.860-4941.796=0.064
σ0.028-0.136=-0.108
min4941.830-4941.555=0.275
max4941.891-4941.875=0.016
mean3064.600-2998.200=66.400
σ316.472-287.828=28.644
min2814.000-2585.000=229.000
max3548.000-3310.000=238.000
mean8.429-8.519=-0.091
σ0.165-0.107=0.058
min8.210-8.387=-0.176
max8.669-8.664=0.005

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.083-1.756=-0.673
σ0.113-0.165=-0.053
min0.939-1.463=-0.525
max1.255-1.873=-0.618

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.756-466.748=0.007
σ575.942-575.930=0.011
min178.778-178.782=-0.004
max1330.668-1330.644=0.024
mean86.250
σ8.500
min82.000
max99.000
mean2814.000-2473.000=341.000
σ0.000
min2814.000-2473.000=341.000
max2814.000-2473.000=341.000
mean0.441-0.563=-0.122
σ0.299-0.565=-0.266
min0.290-0.279=0.011
max0.889-1.411=-0.522
policies=20
mean1788.141-1788.109=0.032
σ0.377-0.375=0.003
min1787.867-1787.875=-0.008
max1788.696-1788.668=0.028
mean820.000
σ0.000
min820.000
max820.000
mean2814.000-2473.000=341.000
σ0.000
min2814.000-2473.000=341.000
max2814.000-2473.000=341.000
mean2.887-2.780=0.107
σ0.054-0.015=0.039
min2.843-2.767=0.076
max2.966-2.800=0.165
policies=200
mean17888.049-17888.030=0.019
σ0.437-0.619=-0.182
min17887.756-17887.627=0.129
max17888.698-17888.944=-0.246
mean8200.000
σ0.000
min8200.000
max8200.000
mean2814.000-2473.000=341.000
σ0.000
min2814.000-2473.000=341.000
max2814.000-2473.000=341.000
mean28.055-28.103=-0.048
σ0.104-0.017=0.087
min27.989-28.089=-0.100
max28.210-28.123=0.086