Compare commits

Home / Compare b55e24ea .. 23cf3c1f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.980=-0.001
σ0.049-0.049=0.000
min33.953-33.955=-0.002
max34.114-34.115=-0.001
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.085-0.083=0.003
σ0.004-0.004=-0.000
min0.082-0.077=0.005
max0.094-0.091=0.003
cache=y
dps=1
iters=10
policies=100
mean23.318-23.318=0.000
σ0.002-0.003=-0.001
min23.314-23.314=0.000
max23.322-23.323=-0.001
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.066-0.066=0.000
σ0.003-0.003=0.000
min0.063-0.064=-0.000
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.429-1757.301=0.129
σ0.365-0.364=0.001
min1756.854-1756.727=0.127
max1758.024-1757.890=0.133
mean1662.000-1646.900=15.100
σ622.841-624.046=-1.205
min667.000-636.000=31.000
max2591.000-2826.000=-235.000
mean2.364-2.349=0.015
σ0.122-0.086=0.035
min2.245-2.242=0.003
max2.676-2.601=0.075

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.571-326.452=0.119
σ0.046-0.036=0.010
min326.492-326.391=0.101
max326.604-326.480=0.124
mean2591.000-2826.000=-235.000
σ0.000
min2591.000-2826.000=-235.000
max2591.000-2826.000=-235.000
mean0.422-0.424=-0.002
σ0.001-0.003=-0.002
min0.420-0.421=-0.001
max0.423-0.430=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1988.726-1988.610=0.115
σ0.019-0.011=0.008
min1988.710-1988.598=0.112
max1988.748-1988.624=0.124
mean2591.000-2826.000=-235.000
σ0.000
min2591.000-2826.000=-235.000
max2591.000-2826.000=-235.000
mean2.671-2.716=-0.044
σ0.100-0.152=-0.052
min2.551-2.565=-0.013
max2.816-2.951=-0.136
iters=5
new-facts=6402
prior-facts=1
mean4813.457-4813.244=0.214
σ7.470-7.882=-0.412
min4810.091-4808.868=1.223
max4826.819-4827.314=-0.495
mean2591.000-2826.000=-235.000
σ0.000
min2591.000-2826.000=-235.000
max2591.000-2826.000=-235.000
mean8.919-8.567=0.352
σ0.194-0.551=-0.357
min8.606-7.949=0.657
max9.114-9.269=-0.155
iters=5
new-facts=6402
prior-facts=6402
mean5001.134-5001.011=0.124
σ0.026-0.026=0.000
min5001.105-5000.970=0.135
max5001.168-5001.038=0.130
mean3003.200-3061.200=-58.000
σ318.399-307.611=10.788
min2591.000-2826.000=-235.000
max3408.000-3532.000=-124.000
mean9.722-9.754=-0.032
σ0.233-0.331=-0.098
min9.319-9.412=-0.093
max9.882-10.139=-0.256

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.350-0.920=0.429
σ0.350-0.013=0.336
min1.048-0.912=0.136
max1.853-0.944=0.909

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.564-464.432=0.131
σ574.779-574.766=0.013
min177.170-177.043=0.127
max1326.732-1326.581=0.151
mean88.250
σ8.500
min84.000
max101.000
mean2591.000-2826.000=-235.000
σ0.000
min2591.000-2826.000=-235.000
max2591.000-2826.000=-235.000
mean0.550-0.438=0.112
σ0.551-0.306=0.245
min0.272-0.282=-0.010
max1.376-0.897=0.479
policies=20
mean1772.019-1770.792=1.227
σ0.349-0.356=-0.008
min1771.796-1770.566=1.230
max1772.538-1771.323=1.215
mean840.000
σ0.000
min840.000
max840.000
mean2591.000-2826.000=-235.000
σ0.000
min2591.000-2826.000=-235.000
max2591.000-2826.000=-235.000
mean2.706-2.802=-0.095
σ0.012-0.021=-0.008
min2.693-2.776=-0.083
max2.718-2.826=-0.108
policies=200
mean17727.501-17714.848=12.654
σ0.446-0.413=0.033
min17727.072-17714.571=12.500
max17728.128-17715.462=12.666
mean8400.000
σ0.000
min8400.000
max8400.000
mean2591.000-2826.000=-235.000
σ0.000
min2591.000-2826.000=-235.000
max2591.000-2826.000=-235.000
mean27.474-27.898=-0.424
σ0.232-0.314=-0.082
min27.270-27.612=-0.343
max27.785-28.252=-0.466