Compare commits

Home / Compare 036a5b2e .. cac6ffcd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.798=0.001
σ0.108-0.107=0.001
min35.751-35.753=-0.002
max36.107-36.103=0.004
mean410.000-413.000=-3.000
σ0.000
min410.000-413.000=-3.000
max410.000-413.000=-3.000
mean0.075-0.076=-0.001
σ0.005-0.003=0.001
min0.070-0.073=-0.003
max0.084-0.084=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.065-26.065=0.000
σ0.004-0.004=-0.000
min26.060-26.059=0.001
max26.071-26.072=-0.001
mean410.000-413.000=-3.000
σ0.000
min410.000-413.000=-3.000
max410.000-413.000=-3.000
mean0.059-0.061=-0.002
σ0.003-0.002=0.000
min0.056-0.059=-0.003
max0.065-0.068=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.923-1755.923=0.000
σ0.364-0.367=-0.003
min1755.351-1755.351=0.000
max1756.492-1756.519=-0.027
mean1657.950-1660.700=-2.750
σ619.471-628.359=-8.888
min628.000-673.000=-45.000
max2496.000-2660.000=-164.000
mean2.831-2.784=0.047
σ0.110-0.192=-0.083
min2.495-2.286=0.209
max2.988-3.079=-0.091

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.197-277.199=-0.003
σ0.006-0.006=0.000
min277.188-277.192=-0.004
max277.206-277.207=-0.002
mean2496.000-2660.000=-164.000
σ0.000
min2496.000-2660.000=-164.000
max2496.000-2660.000=-164.000
mean0.396-0.416=-0.020
σ0.008-0.013=-0.005
min0.391-0.402=-0.011
max0.410-0.432=-0.022
iters=5
new-facts=1
prior-facts=6402
mean2174.389-2174.437=-0.047
σ0.081-0.023=0.058
min2174.244-2174.418=-0.174
max2174.436-2174.477=-0.040
mean2496.000-2660.000=-164.000
σ0.000
min2496.000-2660.000=-164.000
max2496.000-2660.000=-164.000
mean2.940-2.950=-0.009
σ0.105-0.143=-0.038
min2.795-2.785=0.011
max3.051-3.093=-0.042
iters=5
new-facts=6402
prior-facts=1
mean5052.519-5052.471=0.048
σ1.034-1.076=-0.042
min5051.837-5051.681=0.156
max5054.350-5054.359=-0.009
mean2496.000-2660.000=-164.000
σ0.000
min2496.000-2660.000=-164.000
max2496.000-2660.000=-164.000
mean8.579-9.029=-0.449
σ0.620-0.606=0.015
min8.034-7.991=0.043
max9.474-9.522=-0.048
iters=5
new-facts=6402
prior-facts=6402
mean5188.425-5188.431=-0.006
σ0.089-0.087=0.001
min5188.352-5188.353=-0.002
max5188.524-5188.528=-0.004
mean3225.600-3232.200=-6.600
σ369.153-371.091=-1.938
min2693.000-2709.000=-16.000
max3685.000-3687.000=-2.000
mean8.959-9.105=-0.146
σ0.395-0.729=-0.334
min8.700-8.693=0.007
max9.655-10.399=-0.745

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.652-1.162=0.491
σ0.159-0.195=-0.036
min1.459-0.948=0.511
max1.844-1.450=0.393

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.846-464.857=-0.011
σ572.648-572.663=-0.015
min178.521-178.523=-0.002
max1323.818-1323.852=-0.034
mean79.500
σ7.000
min76.000
max90.000
mean2496.000-2660.000=-164.000
σ0.000
min2496.000-2660.000=-164.000
max2496.000-2660.000=-164.000
mean0.566-0.567=-0.001
σ0.568-0.556=0.012
min0.280-0.283=-0.002
max1.418-1.401=0.018
policies=20
mean1785.459-1785.465=-0.005
σ0.349-0.345=0.004
min1785.230-1785.236=-0.007
max1785.977-1785.977=0.000
mean760.000
σ0.000
min760.000
max760.000
mean2496.000-2660.000=-164.000
σ0.000
min2496.000-2660.000=-164.000
max2496.000-2660.000=-164.000
mean2.789-2.798=-0.009
σ0.017-0.015=0.002
min2.770-2.780=-0.010
max2.812-2.811=0.001
policies=200
mean17861.482-17861.530=-0.048
σ0.527-0.554=-0.026
min17861.088-17861.150=-0.062
max17862.260-17862.353=-0.093
mean7600.000
σ0.000
min7600.000
max7600.000
mean2496.000-2660.000=-164.000
σ0.000
min2496.000-2660.000=-164.000
max2496.000-2660.000=-164.000
mean28.229-28.167=0.062
σ0.100-0.071=0.028
min28.131-28.076=0.055
max28.341-28.236=0.105