Compare commits

Home / Compare 0bd85afe .. 8ca6675e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.571-70.564=0.008
σ0.048-0.047=0.001
min70.541-70.534=0.006
max70.707-70.696=0.011
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.177-0.160=0.016
σ0.010-0.003=0.007
min0.157-0.158=-0.001
max0.186-0.166=0.020
cache=y
dps=1
iters=10
policies=100
mean21.288-21.290=-0.002
σ0.002-0.012=-0.009
min21.286-21.283=0.003
max21.292-21.323=-0.031
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.065-0.062=0.003
σ0.003-0.003=-0.001
min0.063-0.059=0.005
max0.072-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.567-1753.567=-0.000
σ0.362-0.360=0.002
min1752.992-1752.998=-0.006
max1754.163-1754.133=0.030
mean1664.600-1658.250=6.350
σ646.180-633.127=13.053
min687.000-645.000=42.000
max2770.000-2851.000=-81.000
mean2.803-2.843=-0.040
σ0.146-0.201=-0.055
min2.340-2.309=0.032
max2.963-3.271=-0.308

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.012-272.012=-0.001
σ0.011-0.004=0.007
min271.998-272.005=-0.006
max272.028-272.016=0.011
mean2770.000-2851.000=-81.000
σ0.000
min2770.000-2851.000=-81.000
max2770.000-2851.000=-81.000
mean0.396-0.384=0.012
σ0.018-0.009=0.009
min0.379-0.379=-0.000
max0.426-0.399=0.027
iters=5
new-facts=1
prior-facts=6402
mean1932.432-1932.438=-0.006
σ0.007-0.007=-0.000
min1932.421-1932.429=-0.008
max1932.440-1932.445=-0.006
mean2770.000-2851.000=-81.000
σ0.000
min2770.000-2851.000=-81.000
max2770.000-2851.000=-81.000
mean3.052-2.906=0.146
σ0.122-0.129=-0.007
min2.943-2.734=0.208
max3.187-3.049=0.138
iters=5
new-facts=6402
prior-facts=1
mean4753.254-4753.051=0.203
σ0.928-0.924=0.004
min4752.636-4752.293=0.343
max4754.900-4754.659=0.241
mean2770.000-2851.000=-81.000
σ0.000
min2770.000-2851.000=-81.000
max2770.000-2851.000=-81.000
mean8.129-8.566=-0.436
σ0.779-0.296=0.482
min7.597-8.261=-0.664
max9.504-9.043=0.461
iters=5
new-facts=6402
prior-facts=6402
mean4943.626-4943.628=-0.002
σ0.011-0.015=-0.004
min4943.612-4943.615=-0.003
max4943.642-4943.645=-0.004
mean3000.000-3056.800=-56.800
σ291.018-207.017=84.001
min2770.000-2851.000=-81.000
max3451.000-3336.000=115.000
mean8.319-8.665=-0.347
σ0.102-0.212=-0.110
min8.159-8.448=-0.289
max8.415-8.970=-0.555

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.022-1.028=-0.007
σ0.136-0.134=0.002
min0.932-0.943=-0.011
max1.243-1.251=-0.008

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.094-473.079=0.015
σ575.951-575.914=0.037
min185.109-185.113=-0.004
max1337.021-1336.950=0.071
mean88.250
σ8.500
min84.000
max101.000
mean2770.000-2851.000=-81.000
σ0.000
min2770.000-2851.000=-81.000
max2770.000-2851.000=-81.000
mean0.584-0.447=0.137
σ0.591-0.304=0.287
min0.288-0.292=-0.003
max1.471-0.903=0.568
policies=20
mean1851.389-1851.436=-0.048
σ0.377-0.376=0.001
min1851.125-1851.167=-0.041
max1851.946-1851.986=-0.041
mean840.000
σ0.000
min840.000
max840.000
mean2770.000-2851.000=-81.000
σ0.000
min2770.000-2851.000=-81.000
max2770.000-2851.000=-81.000
mean2.848-2.938=-0.090
σ0.021-0.015=0.006
min2.825-2.926=-0.101
max2.873-2.960=-0.087
policies=200
mean18520.900-18521.110=-0.209
σ0.506-0.424=0.082
min18520.540-18520.855=-0.315
max18521.627-18521.740=-0.113
mean8400.000
σ0.000
min8400.000
max8400.000
mean2770.000-2851.000=-81.000
σ0.000
min2770.000-2851.000=-81.000
max2770.000-2851.000=-81.000
mean28.807-29.363=-0.557
σ0.063-0.451=-0.388
min28.723-28.960=-0.237
max28.874-29.755=-0.881