Compare commits

Home / Compare 8e1d1d1f .. ed6c2df7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.973-35.974=-0.002
σ0.107-0.107=-0.000
min35.925-35.930=-0.004
max36.276-36.279=-0.003
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.075-0.078=-0.003
σ0.004-0.004=0.000
min0.071-0.074=-0.003
max0.082-0.086=-0.004
cache=y
dps=1
iters=10
policies=100
mean26.208-26.209=-0.001
σ0.003-0.003=-0.000
min26.204-26.201=0.002
max26.213-26.212=0.001
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.059-0.062=-0.002
σ0.003-0.003=0.001
min0.057-0.060=-0.003
max0.067-0.069=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.364-1758.365=-0.001
σ0.371-0.369=0.002
min1757.787-1757.790=-0.003
max1758.954-1758.956=-0.001
mean1665.000-1655.700=9.300
σ631.149-620.520=10.629
min690.000-687.000=3.000
max2814.000-2747.000=67.000
mean2.408-2.374=0.034
σ0.154-0.103=0.051
min2.188-2.183=0.005
max2.908-2.617=0.291

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.513-279.512=0.001
σ0.007-0.005=0.001
min279.506-279.506=-0.000
max279.522-279.519=0.003
mean2814.000-2747.000=67.000
σ0.000
min2814.000-2747.000=67.000
max2814.000-2747.000=67.000
mean0.417-0.412=0.005
σ0.008-0.006=0.002
min0.406-0.407=-0.000
max0.426-0.423=0.003
iters=5
new-facts=1
prior-facts=6402
mean2178.446-2178.446=0.000
σ0.031-0.026=0.005
min2178.404-2178.408=-0.004
max2178.491-2178.474=0.017
mean2814.000-2747.000=67.000
σ0.000
min2814.000-2747.000=67.000
max2814.000-2747.000=67.000
mean3.215-3.334=-0.119
σ0.297-0.205=0.092
min2.730-3.027=-0.297
max3.540-3.559=-0.018
iters=5
new-facts=6402
prior-facts=1
mean5056.367-5056.349=0.018
σ0.994-1.000=-0.006
min5055.811-5055.777=0.034
max5058.135-5058.131=0.005
mean2814.000-2747.000=67.000
σ0.000
min2814.000-2747.000=67.000
max2814.000-2747.000=67.000
mean8.973-8.835=0.138
σ0.555-0.543=0.011
min8.138-8.052=0.086
max9.507-9.538=-0.032
iters=5
new-facts=6402
prior-facts=6402
mean5193.714-5193.753=-0.039
σ0.150-0.083=0.067
min5193.493-5193.680=-0.186
max5193.858-5193.848=0.010
mean3186.400-3221.200=-34.800
σ378.827-464.861=-86.035
min2853.000-2747.000=106.000
max3744.000-3866.000=-122.000
mean8.718-8.724=-0.006
σ0.121-0.137=-0.016
min8.580-8.595=-0.014
max8.895-8.945=-0.050

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.066-1.056=0.010
σ0.279-0.167=0.112
min0.939-0.948=-0.009
max1.565-1.338=0.227

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.477-465.482=-0.005
σ572.654-572.660=-0.006
min179.142-179.143=-0.000
max1324.457-1324.472=-0.015
mean79.500
σ7.000
min76.000
max90.000
mean2814.000-2747.000=67.000
σ0.000
min2814.000-2747.000=67.000
max2814.000-2747.000=67.000
mean0.444-0.481=-0.037
σ0.302-0.397=-0.095
min0.289-0.282=0.008
max0.898-1.076=-0.179
policies=20
mean1791.695-1791.705=-0.011
σ0.356-0.329=0.027
min1791.452-1791.519=-0.067
max1792.221-1792.197=0.024
mean760.000
σ0.000
min760.000
max760.000
mean2814.000-2747.000=67.000
σ0.000
min2814.000-2747.000=67.000
max2814.000-2747.000=67.000
mean2.868-2.801=0.067
σ0.102-0.007=0.095
min2.787-2.796=-0.009
max3.012-2.812=0.201
policies=200
mean17923.387-17923.528=-0.141
σ0.521-0.498=0.023
min17922.984-17923.235=-0.250
max17924.152-17924.271=-0.120
mean7600.000
σ0.000
min7600.000
max7600.000
mean2814.000-2747.000=67.000
σ0.000
min2814.000-2747.000=67.000
max2814.000-2747.000=67.000
mean28.266-28.253=0.013
σ0.144-0.111=0.033
min28.100-28.151=-0.051
max28.430-28.402=0.027