Compare commits

Home / Compare e1536762 .. 7ecc3571

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.392-70.390=0.002
σ0.049-0.046=0.003
min70.364-70.362=0.002
max70.531-70.518=0.013
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.159-0.160=-0.001
σ0.003-0.003=-0.000
min0.156-0.157=-0.001
max0.163-0.165=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.145-21.144=0.000
σ0.002-0.003=-0.001
min21.140-21.140=-0.000
max21.148-21.150=-0.002
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.066-0.064=0.002
σ0.003-0.003=0.001
min0.064-0.062=0.002
max0.073-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.395-1752.392=0.003
σ0.363-0.361=0.003
min1751.827-1751.827=-0.000
max1752.975-1752.973=0.002
mean1623.750-1651.700=-27.950
σ590.847-643.148=-52.300
min635.000-615.000=20.000
max2409.000-2775.000=-366.000
mean2.834-2.799=0.035
σ0.092-0.115=-0.024
min2.650-2.550=0.100
max3.057-2.935=0.122

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.238-270.141=0.097
σ0.010-0.009=0.001
min270.225-270.126=0.099
max270.249-270.149=0.100
mean2409.000-2775.000=-366.000
σ0.000
min2409.000-2775.000=-366.000
max2409.000-2775.000=-366.000
mean0.378-0.377=0.001
σ0.009-0.006=0.002
min0.369-0.368=0.001
max0.392-0.386=0.006
iters=5
new-facts=1
prior-facts=6402
mean1930.706-1930.605=0.101
σ0.009-0.011=-0.002
min1930.692-1930.590=0.102
max1930.714-1930.617=0.096
mean2409.000-2775.000=-366.000
σ0.000
min2409.000-2775.000=-366.000
max2409.000-2775.000=-366.000
mean2.544-2.564=-0.021
σ0.090-0.158=-0.068
min2.461-2.454=0.007
max2.652-2.817=-0.165
iters=5
new-facts=6402
prior-facts=1
mean4751.392-4751.335=0.058
σ0.851-0.880=-0.029
min4750.910-4750.835=0.075
max4752.904-4752.902=0.002
mean2409.000-2775.000=-366.000
σ0.000
min2409.000-2775.000=-366.000
max2409.000-2775.000=-366.000
mean8.531-8.460=0.071
σ0.462-0.304=0.158
min7.817-8.001=-0.184
max8.943-8.831=0.112
iters=5
new-facts=6402
prior-facts=6402
mean4941.865-4941.770=0.095
σ0.023-0.018=0.005
min4941.846-4941.754=0.092
max4941.894-4941.798=0.096
mean2983.000-3040.200=-57.200
σ300.444-245.460=54.984
min2592.000-2775.000=-183.000
max3370.000-3291.000=79.000
mean8.528-8.665=-0.137
σ0.072-0.231=-0.159
min8.426-8.423=0.003
max8.622-8.926=-0.304

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.718-0.993=0.725
σ0.083-0.138=-0.055
min1.600-0.925=0.676
max1.830-1.240=0.590

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.750-466.370=0.379
σ575.926-575.932=-0.006
min178.783-178.397=0.385
max1330.639-1330.268=0.371
mean86.250-84.250=2.000
σ8.500
min82.000-80.000=2.000
max99.000-97.000=2.000
mean2409.000-2775.000=-366.000
σ0.000
min2409.000-2775.000=-366.000
max2409.000-2775.000=-366.000
mean0.555-0.441=0.114
σ0.544-0.297=0.248
min0.276-0.291=-0.014
max1.371-0.886=0.486
policies=20
mean1788.108-1784.349=3.759
σ0.369-0.340=0.029
min1787.879-1784.112=3.767
max1788.659-1784.850=3.809
mean820.000-800.000=20.000
σ0.000
min820.000-800.000=20.000
max820.000-800.000=20.000
mean2409.000-2775.000=-366.000
σ0.000
min2409.000-2775.000=-366.000
max2409.000-2775.000=-366.000
mean2.775-2.852=-0.077
σ0.008-0.088=-0.081
min2.765-2.741=0.024
max2.781-2.957=-0.176
policies=200
mean17888.078-17849.613=38.464
σ0.431-0.399=0.031
min17887.751-17849.368=38.383
max17888.712-17850.208=38.504
mean8200.000-8000.000=200.000
σ0.000
min8200.000-8000.000=200.000
max8200.000-8000.000=200.000
mean2409.000-2775.000=-366.000
σ0.000
min2409.000-2775.000=-366.000
max2409.000-2775.000=-366.000
mean28.010-27.948=0.062
σ0.057-0.104=-0.047
min27.948-27.844=0.104
max28.087-28.092=-0.006