Compare commits

Home / Compare 59839dcf .. cfd0a213

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.793-35.792=0.001
σ0.107-0.109=-0.002
min35.738-35.737=0.001
max36.094-36.099=-0.005
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.074-0.073=0.000
σ0.005-0.005=0.000
min0.069-0.068=0.000
max0.080-0.083=-0.003
cache=y
dps=1
iters=10
policies=100
mean26.065-26.065=0.001
σ0.004-0.002=0.003
min26.057-26.062=-0.005
max26.071-26.068=0.003
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.061-0.061=0.001
σ0.003-0.002=0.001
min0.059-0.059=0.001
max0.069-0.066=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.106-1756.107=-0.001
σ0.367-0.368=-0.001
min1755.531-1755.536=-0.005
max1756.700-1756.709=-0.009
mean1668.300-1658.500=9.800
σ630.811-634.099=-3.288
min665.000
max2624.000-2611.000=13.000
mean2.789-2.830=-0.041
σ0.184-0.135=0.050
min2.317-2.526=-0.209
max3.092-2.995=0.097

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.385-277.387=-0.002
σ0.006-0.005=0.001
min277.377-277.382=-0.005
max277.393-277.394=-0.001
mean2624.000-2611.000=13.000
σ0.000
min2624.000-2611.000=13.000
max2624.000-2611.000=13.000
mean0.394-0.394=0.000
σ0.005-0.004=0.001
min0.391-0.391=0.000
max0.403-0.401=0.002
iters=5
new-facts=1
prior-facts=6402
mean2174.626-2174.618=0.008
σ0.010-0.012=-0.002
min2174.612-2174.601=0.012
max2174.640-2174.634=0.006
mean2624.000-2611.000=13.000
σ0.000
min2624.000-2611.000=13.000
max2624.000-2611.000=13.000
mean2.984-2.847=0.137
σ0.126-0.122=0.005
min2.795-2.745=0.050
max3.148-3.028=0.120
iters=5
new-facts=6402
prior-facts=1
mean5052.780-5052.667=0.112
σ0.969-1.059=-0.089
min5052.172-5051.768=0.404
max5054.485-5054.497=-0.012
mean2624.000-2611.000=13.000
σ0.000
min2624.000-2611.000=13.000
max2624.000-2611.000=13.000
mean9.004-9.022=-0.018
σ0.620-0.413=0.207
min8.107-8.521=-0.415
max9.631-9.625=0.007
iters=5
new-facts=6402
prior-facts=6402
mean5188.600-5188.619=-0.019
σ0.111-0.088=0.023
min5188.457-5188.546=-0.089
max5188.716-5188.720=-0.005
mean3223.600-3206.000=17.600
σ386.268-494.302=-108.034
min2684.000-2611.000=73.000
max3708.000-3866.000=-158.000
mean8.953-8.699=0.254
σ0.426-0.130=0.296
min8.676-8.561=0.115
max9.699-8.913=0.786

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.359-1.397=-0.038
σ0.375-0.374=0.002
min0.944-1.072=-0.128
max1.843-1.893=-0.050

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.226-465.219=0.007
σ572.663-572.652=0.011
min178.891-178.890=0.001
max1324.220-1324.197=0.023
mean81.750
σ7.500
min78.000
max93.000
mean2624.000-2611.000=13.000
σ0.000
min2624.000-2611.000=13.000
max2624.000-2611.000=13.000
mean0.543-0.562=-0.020
σ0.524-0.554=-0.031
min0.279-0.282=-0.003
max1.329-1.394=-0.066
policies=20
mean1789.146-1789.151=-0.006
σ0.358-0.366=-0.009
min1788.941-1788.928=0.014
max1789.679-1789.696=-0.017
mean780.000
σ0.000
min780.000
max780.000
mean2624.000-2611.000=13.000
σ0.000
min2624.000-2611.000=13.000
max2624.000-2611.000=13.000
mean2.806-2.810=-0.005
σ0.012-0.010=0.002
min2.789-2.796=-0.008
max2.813-2.818=-0.005
policies=200
mean17898.315-17898.238=0.077
σ0.502-0.368=0.134
min17898.053-17898.019=0.034
max17899.068-17898.787=0.281
mean7800.000
σ0.000
min7800.000
max7800.000
mean2624.000-2611.000=13.000
σ0.000
min2624.000-2611.000=13.000
max2624.000-2611.000=13.000
mean28.299-28.288=0.011
σ0.105-0.142=-0.037
min28.181-28.127=0.054
max28.411-28.426=-0.015