Compare commits

Home / Compare 14ff0e70 .. f05867b4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.993-35.993=-0.000
σ0.103-0.103=0.000
min35.947-35.948=-0.001
max36.286-36.286=0.001
mean3922.000-3952.000=-30.000
σ0.000
min3922.000-3952.000=-30.000
max3922.000-3952.000=-30.000
mean0.076-0.075=0.001
σ0.002-0.001=0.002
min0.074-0.074=-0.000
max0.080-0.076=0.004
cache=y
dps=1
iters=10
policies=100
mean26.213-26.218=-0.005
σ0.005-0.008=-0.003
min26.204-26.211=-0.007
max26.220-26.238=-0.018
mean3922.000-3952.000=-30.000
σ0.000
min3922.000-3952.000=-30.000
max3922.000-3952.000=-30.000
mean0.059-0.082=-0.024
σ0.002-0.070=-0.068
min0.055-0.059=-0.004
max0.061-0.283=-0.221

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.369-1756.368=0.001
σ0.373-0.372=0.001
min1755.791-1755.802=-0.011
max1756.967-1756.971=-0.003
mean1656.450-1659.150=-2.700
σ626.535-628.014=-1.480
min617.000-618.000=-1.000
max2635.000-2642.000=-7.000
mean2.278-2.289=-0.010
σ0.179-0.174=0.005
min2.126-2.152=-0.027
max2.782-2.766=0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.699-278.697=0.002
σ0.014-0.012=0.002
min278.686-278.687=-0.001
max278.722-278.718=0.005
mean2635.000-2642.000=-7.000
σ0.000
min2635.000-2642.000=-7.000
max2635.000-2642.000=-7.000
mean0.419-0.419=-0.000
σ0.001-0.001=-0.000
min0.418-0.418=0.000
max0.421-0.421=-0.000
iters=5
new-facts=1
prior-facts=6402
mean2268.875-2268.876=-0.001
σ0.006-0.006=-0.000
min2268.864-2268.870=-0.005
max2268.880-2268.883=-0.003
mean2635.000-2642.000=-7.000
σ0.000
min2635.000-2642.000=-7.000
max2635.000-2642.000=-7.000
mean2.889-2.942=-0.053
σ0.061-0.146=-0.086
min2.803-2.818=-0.015
max2.973-3.191=-0.217
iters=5
new-facts=6402
prior-facts=1
mean4952.213-4952.180=0.033
σ0.784-0.802=-0.017
min4951.833-4951.602=0.231
max4953.615-4953.594=0.021
mean2635.000-2642.000=-7.000
σ0.000
min2635.000-2642.000=-7.000
max2635.000-2642.000=-7.000
mean7.825-8.052=-0.226
σ0.134-0.577=-0.443
min7.678-7.710=-0.032
max7.968-9.072=-1.104
iters=5
new-facts=6402
prior-facts=6402
mean5166.915-5166.712=0.203
σ0.011-0.308=-0.297
min5166.906-5166.220=0.686
max5166.933-5166.925=0.008
mean3354.400-3382.800=-28.400
σ436.874-447.693=-10.819
min2768.000-2778.000=-10.000
max3922.000-3952.000=-30.000
mean9.144-9.254=-0.110
σ0.362-0.419=-0.058
min8.841-8.957=-0.116
max9.614-9.989=-0.374

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.061-1.080=-0.019
σ0.222-0.164=0.058
min0.928-0.944=-0.015
max1.448-1.349=0.099

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.260-460.261=-0.001
σ572.605-572.608=-0.003
min173.953-173.954=-0.000
max1319.167-1319.173=-0.005
mean79.500
σ7.000
min76.000
max90.000
mean435.000-437.000=-2.000
σ0.000
min435.000-437.000=-2.000
max435.000-437.000=-2.000
mean0.557-0.554=0.002
σ0.565-0.559=0.006
min0.266-0.273=-0.007
max1.404-1.392=0.012
policies=20
mean1740.081-1740.077=0.004
σ0.334-0.328=0.006
min1739.840-1739.838=0.002
max1740.571-1740.558=0.013
mean760.000
σ0.000
min760.000
max760.000
mean446.000-446.250=-0.250
σ10.520-9.032=1.487
min435.000-437.000=-2.000
max455.000-454.000=1.000
mean2.666-2.658=0.008
σ0.016-0.014=0.001
min2.646-2.644=0.001
max2.680-2.673=0.006
policies=200
mean17409.955-17410.053=-0.098
σ0.101-0.047=0.054
min17409.860-17410.010=-0.150
max17410.097-17410.120=-0.023
mean7600.000
σ0.000
min7600.000
max7600.000
mean489.500-490.000=-0.500
σ2.380-2.828=-0.448
min487.000-486.000=1.000
max492.000
mean26.939-26.932=0.007
σ0.193-0.119=0.074
min26.775-26.809=-0.034
max27.216-27.092=0.124