Compare commits

Home / Compare 01a83eb1 .. 46e18e6a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.564-70.567=-0.003
σ0.046-0.045=0.001
min70.539-70.539=0.000
max70.694-70.692=0.002
mean413.000
σ0.000
min413.000
max413.000
mean0.161-0.161=-0.000
σ0.006-0.004=0.002
min0.150-0.157=-0.007
max0.171-0.168=0.003
cache=y
dps=1
iters=10
policies=100
mean21.288-21.288=-0.000
σ0.004-0.003=0.001
min21.284-21.284=-0.000
max21.296-21.292=0.003
mean413.000
σ0.000
min413.000
max413.000
mean0.063-0.064=-0.002
σ0.004-0.002=0.002
min0.058-0.062=-0.004
max0.070-0.069=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.375-1753.373=0.001
σ0.362-0.363=-0.001
min1752.802-1752.805=-0.004
max1753.959-1753.956=0.003
mean1659.200-1663.600=-4.400
σ634.358-630.825=3.534
min617.000-681.000=-64.000
max2777.000-2665.000=112.000
mean2.735-2.797=-0.061
σ0.213-0.189=0.025
min2.281-2.351=-0.070
max3.090-3.021=0.069

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.753-271.755=-0.001
σ0.009-0.007=0.002
min271.740-271.744=-0.005
max271.763-271.762=0.002
mean2777.000-2665.000=112.000
σ0.000
min2777.000-2665.000=112.000
max2777.000-2665.000=112.000
mean0.382-0.384=-0.003
σ0.007-0.009=-0.002
min0.374-0.377=-0.003
max0.392-0.397=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1932.175-1932.179=-0.005
σ0.008-0.008=0.000
min1932.169-1932.170=-0.000
max1932.188-1932.188=0.000
mean2777.000-2665.000=112.000
σ0.000
min2777.000-2665.000=112.000
max2777.000-2665.000=112.000
mean2.978-3.020=-0.043
σ0.178-0.164=0.013
min2.719-2.802=-0.084
max3.205-3.243=-0.038
iters=5
new-facts=6402
prior-facts=1
mean4752.785-4752.853=-0.068
σ0.969-0.975=-0.005
min4752.021-4752.005=0.017
max4754.482-4754.530=-0.048
mean2777.000-2665.000=112.000
σ0.000
min2777.000-2665.000=112.000
max2777.000-2665.000=112.000
mean8.572-8.256=0.316
σ0.284-0.425=-0.141
min8.189-7.806=0.384
max8.869-8.929=-0.061
iters=5
new-facts=6402
prior-facts=6402
mean4943.379-4943.315=0.064
σ0.023-0.150=-0.126
min4943.350-4943.050=0.300
max4943.408-4943.401=0.007
mean2990.200-2979.600=10.600
σ213.412-335.554=-122.142
min2777.000-2665.000=112.000
max3303.000-3461.000=-158.000
mean8.501-8.566=-0.065
σ0.086-0.168=-0.082
min8.398-8.369=0.029
max8.584-8.782=-0.198

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.033-1.073=-0.040
σ0.139-0.186=-0.047
min0.941-0.936=0.005
max1.256-1.293=-0.037

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.860-467.864=-0.004
σ575.938-575.933=0.005
min179.887-179.890=-0.002
max1331.767-1331.764=0.003
mean86.250
σ8.500
min82.000
max99.000
mean2777.000-2665.000=112.000
σ0.000
min2777.000-2665.000=112.000
max2777.000-2665.000=112.000
mean0.470-0.570=-0.100
σ0.371-0.569=-0.197
min0.281-0.283=-0.002
max1.027-1.423=-0.396
policies=20
mean1799.175-1799.159=0.016
σ0.357-0.373=-0.016
min1798.965-1798.915=0.050
max1799.708-1799.714=-0.005
mean820.000
σ0.000
min820.000
max820.000
mean2777.000-2665.000=112.000
σ0.000
min2777.000-2665.000=112.000
max2777.000-2665.000=112.000
mean2.812-2.810=0.003
σ0.008-0.023=-0.015
min2.801-2.786=0.015
max2.819-2.834=-0.015
policies=200
mean17998.397-17998.426=-0.029
σ0.470-0.609=-0.140
min17997.982-17998.067=-0.086
max17999.068-17999.337=-0.269
mean8200.000
σ0.000
min8200.000
max8200.000
mean2777.000-2665.000=112.000
σ0.000
min2777.000-2665.000=112.000
max2777.000-2665.000=112.000
mean28.333-28.262=0.071
σ0.118-0.218=-0.100
min28.221-28.140=0.081
max28.436-28.588=-0.153