Compare commits

Home / Compare b5b054d2 .. 9328fd12

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.985-33.986=-0.001
σ0.050-0.049=0.000
min33.956-33.955=0.001
max34.124-34.123=0.001
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.083-0.082=0.002
σ0.005-0.005=0.000
min0.077-0.076=0.001
max0.091-0.090=0.001
cache=y
dps=1
iters=10
policies=100
mean23.323-23.325=-0.002
σ0.003-0.003=0.000
min23.320-23.322=-0.002
max23.328-23.330=-0.002
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.064-0.065=-0.001
σ0.003-0.002=0.001
min0.059-0.063=-0.004
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.298-1757.294=0.005
σ0.363-0.360=0.003
min1756.727-1756.723=0.003
max1757.882-1757.870=0.012
mean1641.600-1649.100=-7.500
σ626.941-637.584=-10.643
min620.000-643.000=-23.000
max2698.000-2839.000=-141.000
mean2.375-2.361=0.014
σ0.104-0.104=-0.000
min2.243-2.254=-0.011
max2.633-2.674=-0.041

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.414-326.446=-0.032
σ0.043-0.046=-0.003
min326.338-326.366=-0.028
max326.439-326.476=-0.037
mean2698.000-2839.000=-141.000
σ0.000
min2698.000-2839.000=-141.000
max2698.000-2839.000=-141.000
mean0.427-0.428=-0.001
σ0.001-0.005=-0.004
min0.425-0.424=0.002
max0.428-0.434=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1988.613-1988.606=0.007
σ0.003-0.013=-0.011
min1988.609-1988.586=0.024
max1988.616-1988.618=-0.003
mean2698.000-2839.000=-141.000
σ0.000
min2698.000-2839.000=-141.000
max2698.000-2839.000=-141.000
mean2.732-2.796=-0.064
σ0.154-0.231=-0.077
min2.619-2.653=-0.034
max3.001-3.200=-0.199
iters=5
new-facts=6402
prior-facts=1
mean4812.283-4812.380=-0.098
σ7.792-7.759=0.033
min4808.269-4808.898=-0.629
max4826.210-4826.260=-0.050
mean2698.000-2839.000=-141.000
σ0.000
min2698.000-2839.000=-141.000
max2698.000-2839.000=-141.000
mean8.437-8.928=-0.491
σ0.561-0.337=0.224
min7.831-8.384=-0.553
max9.242-9.292=-0.050
iters=5
new-facts=6402
prior-facts=6402
mean4999.858-4999.925=-0.067
σ0.146-0.026=0.120
min4999.600-4999.896=-0.296
max4999.960-4999.961=-0.001
mean3010.400-3010.000=0.400
σ369.650-183.655=185.996
min2698.000-2839.000=-141.000
max3556.000-3282.000=274.000
mean9.712-9.409=0.303
σ0.146-0.374=-0.228
min9.455-8.801=0.654
max9.819-9.795=0.024

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.005-0.983=0.022
σ0.122-0.072=0.050
min0.916-0.918=-0.002
max1.200-1.061=0.139

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.422-464.420=0.001
σ574.773-574.772=0.001
min177.032-177.021=0.012
max1326.582-1326.579=0.003
mean88.250
σ8.500
min84.000
max101.000
mean2698.000-2839.000=-141.000
σ0.000
min2698.000-2839.000=-141.000
max2698.000-2839.000=-141.000
mean0.559-0.434=0.125
σ0.562-0.311=0.252
min0.273-0.277=-0.004
max1.402-0.900=0.502
policies=20
mean1770.639-1770.575=0.065
σ0.354-0.367=-0.014
min1770.416-1770.316=0.101
max1771.167-1771.117=0.050
mean840.000
σ0.000
min840.000
max840.000
mean2698.000-2839.000=-141.000
σ0.000
min2698.000-2839.000=-141.000
max2698.000-2839.000=-141.000
mean2.756-2.816=-0.060
σ0.026-0.016=0.010
min2.730-2.792=-0.062
max2.792-2.825=-0.033
policies=200
mean17713.793-17713.398=0.395
σ0.498-0.720=-0.222
min17713.389-17712.775=0.613
max17714.518-17714.435=0.083
mean8400.000
σ0.000
min8400.000
max8400.000
mean2698.000-2839.000=-141.000
σ0.000
min2698.000-2839.000=-141.000
max2698.000-2839.000=-141.000
mean27.641-27.985=-0.344
σ0.084-0.439=-0.355
min27.544-27.391=0.153
max27.739-28.353=-0.614