Compare commits

Home / Compare 77ef8df7 .. 14d6abce

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.263=0.000
σ0.054-0.054=-0.001
min35.231-35.230=0.000
max35.414-35.416=-0.002
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.085-0.084=0.000
σ0.003-0.003=0.000
min0.083-0.082=0.000
max0.090-0.092=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.770-23.770=-0.000
σ0.005-0.004=0.001
min23.766-23.764=0.002
max23.782-23.776=0.006
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.069-0.069=0.001
σ0.004-0.003=0.000
min0.066-0.066=-0.000
max0.077-0.075=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.469-1756.486=-0.016
σ0.366-0.365=0.001
min1755.895-1755.909=-0.014
max1757.041-1757.072=-0.030
mean1658.400-1647.900=10.500
σ642.286-642.307=-0.022
min630.000-623.000=7.000
max2798.000-2840.000=-42.000
mean2.340-2.345=-0.006
σ0.109-0.098=0.011
min2.235-2.245=-0.009
max2.617-2.583=0.034

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.706-324.683=0.023
σ0.022-0.041=-0.019
min324.669-324.611=0.057
max324.723-324.708=0.015
mean2798.000-2840.000=-42.000
σ0.000
min2798.000-2840.000=-42.000
max2798.000-2840.000=-42.000
mean0.427-0.430=-0.003
σ0.008-0.007=0.001
min0.422-0.423=-0.002
max0.442-0.440=0.001
iters=5
new-facts=1
prior-facts=6402
mean1985.249-1985.261=-0.012
σ0.015-0.015=0.000
min1985.225-1985.244=-0.019
max1985.260-1985.273=-0.013
mean2798.000-2840.000=-42.000
σ0.000
min2798.000-2840.000=-42.000
max2798.000-2840.000=-42.000
mean2.625-2.659=-0.034
σ0.090-0.146=-0.056
min2.554-2.520=0.034
max2.754-2.855=-0.101
iters=5
new-facts=6402
prior-facts=1
mean4808.855-4808.898=-0.044
σ7.716-7.688=0.028
min4805.382-4805.396=-0.013
max4822.658-4822.651=0.007
mean2798.000-2840.000=-42.000
σ0.000
min2798.000-2840.000=-42.000
max2798.000-2840.000=-42.000
mean9.044-9.109=-0.064
σ0.186-0.292=-0.105
min8.843-8.673=0.170
max9.291-9.362=-0.071
iters=5
new-facts=6402
prior-facts=6402
mean4996.450-4996.469=-0.018
σ0.017-0.009=0.008
min4996.429-4996.458=-0.029
max4996.467-4996.480=-0.013
mean3042.200-3041.800=0.400
σ309.942-203.884=106.058
min2798.000-2840.000=-42.000
max3512.000-3319.000=193.000
mean8.575-8.806=-0.231
σ0.114-0.247=-0.133
min8.485-8.501=-0.016
max8.763-9.144=-0.381

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.945-0.998=-0.054
σ0.054-0.062=-0.008
min0.914-0.920=-0.006
max1.040-1.048=-0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.952-462.978=-0.026
σ574.254-574.252=0.002
min175.814-175.838=-0.024
max1324.333-1324.356=-0.023
mean86.250
σ8.500
min82.000
max99.000
mean2798.000-2840.000=-42.000
σ0.000
min2798.000-2840.000=-42.000
max2798.000-2840.000=-42.000
mean0.429-0.431=-0.003
σ0.295-0.299=-0.004
min0.279-0.276=0.003
max0.871-0.880=-0.009
policies=20
mean1758.473-1758.707=-0.234
σ0.354-0.347=0.007
min1758.229-1758.470=-0.241
max1758.997-1759.220=-0.223
mean820.000
σ0.000
min820.000
max820.000
mean2798.000-2840.000=-42.000
σ0.000
min2798.000-2840.000=-42.000
max2798.000-2840.000=-42.000
mean2.839-2.803=0.036
σ0.091-0.007=0.084
min2.788-2.797=-0.009
max2.975-2.814=0.162
policies=200
mean17590.102-17593.288=-3.186
σ0.459-0.676=-0.217
min17589.752-17592.420=-2.668
max17590.778-17593.861=-3.083
mean8200.000
σ0.000
min8200.000
max8200.000
mean2798.000-2840.000=-42.000
σ0.000
min2798.000-2840.000=-42.000
max2798.000-2840.000=-42.000
mean27.425-27.931=-0.506
σ0.150-0.374=-0.224
min27.261-27.475=-0.214
max27.566-28.362=-0.796