Compare commits

Home / Compare 08ac370e .. f9c2e1be

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.264-35.263=0.001
σ0.053-0.054=-0.001
min35.239-35.230=0.008
max35.415-35.416=-0.001
mean411.000-412.000=-1.000
σ0.000
min411.000-412.000=-1.000
max411.000-412.000=-1.000
mean0.085-0.084=0.001
σ0.003-0.003=0.000
min0.082-0.082=-0.000
max0.091-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.770-23.770=0.000
σ0.002-0.004=-0.002
min23.768-23.764=0.003
max23.774-23.776=-0.001
mean412.000
σ0.000
min412.000
max412.000
mean0.068-0.069=-0.000
σ0.003-0.003=-0.000
min0.066-0.066=0.000
max0.074-0.075=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.486=-0.001
σ0.366-0.365=0.001
min1755.912-1755.909=0.003
max1757.075-1757.072=0.003
mean1644.850-1647.900=-3.050
σ642.027-642.307=-0.280
min667.000-623.000=44.000
max2724.000-2840.000=-116.000
mean2.375-2.345=0.030
σ0.119-0.098=0.021
min2.192-2.245=-0.053
max2.581-2.583=-0.002

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.699-324.683=0.016
σ0.056-0.041=0.015
min324.600-324.611=-0.011
max324.737-324.708=0.029
mean2724.000-2840.000=-116.000
σ0.000
min2724.000-2840.000=-116.000
max2724.000-2840.000=-116.000
mean0.424-0.430=-0.006
σ0.002-0.007=-0.006
min0.422-0.423=-0.001
max0.426-0.440=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1985.266-1985.261=0.004
σ0.014-0.015=-0.001
min1985.242-1985.244=-0.002
max1985.274-1985.273=0.002
mean2724.000-2840.000=-116.000
σ0.000
min2724.000-2840.000=-116.000
max2724.000-2840.000=-116.000
mean2.610-2.659=-0.049
σ0.084-0.146=-0.062
min2.533-2.520=0.013
max2.727-2.855=-0.129
iters=5
new-facts=6402
prior-facts=1
mean4808.797-4808.898=-0.101
σ7.735-7.688=0.047
min4804.797-4805.396=-0.599
max4822.622-4822.651=-0.029
mean2724.000-2840.000=-116.000
σ0.000
min2724.000-2840.000=-116.000
max2724.000-2840.000=-116.000
mean8.810-9.109=-0.299
σ0.612-0.292=0.321
min7.743-8.673=-0.930
max9.263-9.362=-0.099
iters=5
new-facts=6402
prior-facts=6402
mean4996.393-4996.469=-0.076
σ0.153-0.009=0.144
min4996.121-4996.458=-0.337
max4996.482-4996.480=0.003
mean3017.600-3041.800=-24.200
σ345.238-203.884=141.354
min2724.000-2840.000=-116.000
max3528.000-3319.000=209.000
mean8.504-8.806=-0.302
σ0.119-0.247=-0.128
min8.431-8.501=-0.070
max8.714-9.144=-0.430

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.945-0.998=-0.053
σ0.053-0.062=-0.009
min0.911-0.920=-0.009
max1.038-1.048=-0.009

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.963-462.978=-0.015
σ574.281-574.252=0.029
min175.818-175.838=-0.020
max1324.384-1324.356=0.028
mean86.250
σ8.500
min82.000
max99.000
mean2724.000-2840.000=-116.000
σ0.000
min2724.000-2840.000=-116.000
max2724.000-2840.000=-116.000
mean0.541-0.431=0.110
σ0.537-0.299=0.238
min0.270-0.276=-0.006
max1.347-0.880=0.467
policies=20
mean1758.530-1758.707=-0.177
σ0.343-0.347=-0.004
min1758.298-1758.470=-0.172
max1759.037-1759.220=-0.183
mean820.000
σ0.000
min820.000
max820.000
mean2724.000-2840.000=-116.000
σ0.000
min2724.000-2840.000=-116.000
max2724.000-2840.000=-116.000
mean2.712-2.803=-0.091
σ0.017-0.007=0.010
min2.694-2.797=-0.103
max2.736-2.814=-0.078
policies=200
mean17592.502-17593.288=-0.786
σ0.460-0.676=-0.216
min17592.243-17592.420=-0.177
max17593.191-17593.861=-0.670
mean8200.000
σ0.000
min8200.000
max8200.000
mean2724.000-2840.000=-116.000
σ0.000
min2724.000-2840.000=-116.000
max2724.000-2840.000=-116.000
mean27.403-27.931=-0.529
σ0.115-0.374=-0.259
min27.278-27.475=-0.197
max27.526-28.362=-0.836