Compare commits

Home / Compare 7b2a7584 .. 5e5dc4e3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.792-35.793=-0.001
σ0.107-0.107=0.000
min35.743-35.751=-0.008
max36.095-36.096=-0.001
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.074-0.073=0.001
σ0.005-0.004=0.001
min0.068-0.068=-0.000
max0.083-0.080=0.003
cache=y
dps=1
iters=10
policies=100
mean26.064-26.065=-0.000
σ0.004-0.005=-0.001
min26.059-26.059=0.000
max26.069-26.075=-0.006
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.059-0.059=0.000
σ0.003-0.003=-0.000
min0.056-0.056=0.001
max0.064-0.064=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.889-1752.888=0.001
σ0.363-0.365=-0.001
min1752.313-1752.318=-0.005
max1753.477-1753.467=0.010
mean1655.450-1656.450=-1.000
σ619.693-621.276=-1.583
min669.000-670.000=-1.000
max2647.000-2650.000=-3.000
mean2.862-2.871=-0.009
σ0.124-0.131=-0.007
min2.552-2.565=-0.013
max3.058-3.098=-0.040

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.192-277.193=-0.001
σ0.004-0.005=-0.000
min277.187-277.189=-0.002
max277.199-277.198=0.000
mean2647.000-2650.000=-3.000
σ0.000
min2647.000-2650.000=-3.000
max2647.000-2650.000=-3.000
mean0.395-0.393=0.001
σ0.002-0.008=-0.006
min0.393-0.389=0.004
max0.399-0.407=-0.009
iters=5
new-facts=1
prior-facts=6402
mean2169.694-2169.689=0.004
σ0.021-0.011=0.011
min2169.677-2169.671=0.006
max2169.730-2169.700=0.030
mean2647.000-2650.000=-3.000
σ0.000
min2647.000-2650.000=-3.000
max2647.000-2650.000=-3.000
mean2.861-2.787=0.075
σ0.120-0.062=0.057
min2.758-2.734=0.024
max3.030-2.893=0.137
iters=5
new-facts=6402
prior-facts=1
mean5049.434-5049.443=-0.009
σ1.067-1.086=-0.019
min5048.637-5048.479=0.157
max5051.306-5051.311=-0.005
mean2647.000-2650.000=-3.000
σ0.000
min2647.000-2650.000=-3.000
max2647.000-2650.000=-3.000
mean8.906-8.933=-0.028
σ0.527-0.563=-0.036
min8.088-8.056=0.032
max9.437-9.482=-0.045
iters=5
new-facts=6402
prior-facts=6402
mean5180.643-5180.659=-0.016
σ0.109-0.086=0.023
min5180.513-5180.588=-0.076
max5180.763-5180.758=0.005
mean3213.200-3212.200=1.000
σ480.122-481.628=-1.506
min2647.000-2650.000=-3.000
max3860.000-3863.000=-3.000
mean8.715-8.824=-0.109
σ0.211-0.364=-0.152
min8.566-8.632=-0.066
max9.088-9.473=-0.384

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.230-1.144=0.086
σ0.337-0.178=0.159
min0.936-0.940=-0.004
max1.791-1.396=0.395

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.853-464.857=-0.005
σ572.661-572.659=0.001
min178.519-178.523=-0.004
max1323.844-1323.846=-0.003
mean79.500
σ7.000
min76.000
max90.000
mean2647.000-2650.000=-3.000
σ0.000
min2647.000-2650.000=-3.000
max2647.000-2650.000=-3.000
mean0.548-0.558=-0.010
σ0.537-0.539=-0.002
min0.278-0.281=-0.003
max1.353-1.366=-0.013
policies=20
mean1785.484-1785.487=-0.003
σ0.346-0.346=0.000
min1785.262-1785.263=-0.001
max1785.999-1786.001=-0.002
mean760.000
σ0.000
min760.000
max760.000
mean2647.000-2650.000=-3.000
σ0.000
min2647.000-2650.000=-3.000
max2647.000-2650.000=-3.000
mean2.779-2.776=0.003
σ0.004-0.013=-0.009
min2.776-2.759=0.017
max2.785-2.789=-0.004
policies=200
mean17861.504-17861.512=-0.008
σ0.497-0.499=-0.001
min17861.234-17861.205=0.028
max17862.250-17862.257=-0.008
mean7600.000
σ0.000
min7600.000
max7600.000
mean2647.000-2650.000=-3.000
σ0.000
min2647.000-2650.000=-3.000
max2647.000-2650.000=-3.000
mean28.083-28.104=-0.021
σ0.117-0.133=-0.016
min27.922-27.978=-0.056
max28.200-28.283=-0.084