Compare commits

Home / Compare 43d19fa0 .. 553cb0c3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.262-35.263=-0.000
σ0.052-0.053=-0.001
min35.238-35.235=0.004
max35.411-35.413=-0.002
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.085-0.085=-0.000
σ0.003-0.003=0.000
min0.082-0.083=-0.000
max0.091-0.091=0.000
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=0.000
σ0.003-0.003=-0.000
min23.765-23.766=-0.001
max23.773-23.774=-0.001
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.067-0.067=-0.000
σ0.005-0.003=0.002
min0.061-0.063=-0.001
max0.075-0.074=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.487-1756.484=0.002
σ0.366-0.364=0.002
min1755.911-1755.910=0.001
max1757.078-1757.068=0.010
mean1661.350-1647.250=14.100
σ616.750-626.702=-9.952
min629.000-633.000=-4.000
max2494.000-2836.000=-342.000
mean2.348-2.382=-0.034
σ0.110-0.103=0.008
min2.223-2.089=0.134
max2.728-2.581=0.147

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.706-324.707=-0.000
σ0.054-0.058=-0.003
min324.609-324.604=0.005
max324.736-324.741=-0.006
mean2494.000-2836.000=-342.000
σ0.000
min2494.000-2836.000=-342.000
max2494.000-2836.000=-342.000
mean0.429-0.433=-0.004
σ0.003-0.011=-0.007
min0.427-0.423=0.004
max0.435-0.448=-0.013
iters=5
new-facts=1
prior-facts=6402
mean1985.268-1985.270=-0.001
σ0.011-0.013=-0.002
min1985.250-1985.250=0.000
max1985.277-1985.282=-0.005
mean2494.000-2836.000=-342.000
σ0.000
min2494.000-2836.000=-342.000
max2494.000-2836.000=-342.000
mean2.569-2.685=-0.116
σ0.080-0.169=-0.089
min2.461-2.468=-0.007
max2.686-2.890=-0.203
iters=5
new-facts=6402
prior-facts=1
mean4809.028-4808.937=0.091
σ7.678-7.784=-0.106
min4805.588-4804.924=0.665
max4822.763-4822.850=-0.087
mean2494.000-2836.000=-342.000
σ0.000
min2494.000-2836.000=-342.000
max2494.000-2836.000=-342.000
mean8.904-8.910=-0.005
σ0.049-0.414=-0.365
min8.865-8.212=0.652
max8.975-9.308=-0.334
iters=5
new-facts=6402
prior-facts=6402
mean4996.573-4996.485=0.088
σ0.021-0.148=-0.127
min4996.548-4996.229=0.319
max4996.592-4996.584=0.008
mean3021.000-3071.600=-50.600
σ329.133-309.249=19.884
min2556.000-2836.000=-280.000
max3313.000-3550.000=-237.000
mean8.922-8.659=0.263
σ0.387-0.211=0.175
min8.498-8.431=0.067
max9.467-8.896=0.571

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.663-1.069=0.594
σ0.113-0.261=-0.148
min1.541-0.919=0.621
max1.825-1.524=0.301

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.205-463.211=-0.006
σ574.762-574.771=-0.009
min175.820-175.818=0.002
max1325.348-1325.367=-0.020
mean86.250
σ8.500
min82.000
max99.000
mean2494.000-2836.000=-342.000
σ0.000
min2494.000-2836.000=-342.000
max2494.000-2836.000=-342.000
mean0.538-0.433=0.105
σ0.525-0.302=0.223
min0.269-0.278=-0.009
max1.325-0.886=0.440
policies=20
mean1758.531-1758.553=-0.022
σ0.358-0.357=0.001
min1758.278-1758.302=-0.024
max1759.061-1759.081=-0.020
mean820.000
σ0.000
min820.000
max820.000
mean2494.000-2836.000=-342.000
σ0.000
min2494.000-2836.000=-342.000
max2494.000-2836.000=-342.000
mean2.735-2.800=-0.065
σ0.018-0.013=0.005
min2.717-2.787=-0.070
max2.760-2.818=-0.058
policies=200
mean17592.482-17592.633=-0.151
σ0.471-0.493=-0.022
min17592.134-17592.200=-0.066
max17593.172-17593.342=-0.169
mean8200.000
σ0.000
min8200.000
max8200.000
mean2494.000-2836.000=-342.000
σ0.000
min2494.000-2836.000=-342.000
max2494.000-2836.000=-342.000
mean27.552-28.000=-0.448
σ0.130-0.459=-0.329
min27.400-27.547=-0.147
max27.688-28.570=-0.882