Compare commits

Home / Compare 25a8b3ab .. 4a312353

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.980=-0.000
σ0.048-0.048=0.000
min33.955-33.956=-0.001
max34.112-34.112=0.000
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.084-0.085=-0.001
σ0.003-0.004=-0.000
min0.081-0.083=-0.001
max0.090-0.091=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.001
σ0.002-0.003=-0.000
min23.314-23.313=0.000
max23.322-23.322=-0.001
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.065-0.065=-0.000
σ0.002-0.003=-0.000
min0.063-0.064=-0.000
max0.071-0.073=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.303-1757.303=-0.000
σ0.365-0.364=0.001
min1756.731-1756.728=0.003
max1757.891-1757.894=-0.003
mean1653.350-1668.450=-15.100
σ626.009-615.107=10.902
min624.000-668.000=-44.000
max2665.000-2590.000=75.000
mean2.362-2.405=-0.043
σ0.103-0.205=-0.102
min2.208-2.250=-0.042
max2.655-3.069=-0.414

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.437-326.427=0.010
σ0.056-0.022=0.033
min326.338-326.388=-0.050
max326.469-326.441=0.028
mean2665.000-2590.000=75.000
σ0.000
min2665.000-2590.000=75.000
max2665.000-2590.000=75.000
mean0.429-0.425=0.003
σ0.009-0.003=0.006
min0.422-0.423=-0.001
max0.445-0.431=0.013
iters=5
new-facts=1
prior-facts=6402
mean1988.609-1988.604=0.005
σ0.012-0.014=-0.003
min1988.590-1988.588=0.002
max1988.621-1988.620=0.001
mean2665.000-2590.000=75.000
σ0.000
min2665.000-2590.000=75.000
max2665.000-2590.000=75.000
mean2.697-2.763=-0.066
σ0.155-0.274=-0.118
min2.487-2.516=-0.028
max2.899-3.232=-0.333
iters=5
new-facts=6402
prior-facts=1
mean4813.376-4813.461=-0.085
σ7.493-7.718=-0.224
min4809.911-4809.938=-0.027
max4826.780-4827.266=-0.487
mean2665.000-2590.000=75.000
σ0.000
min2665.000-2590.000=75.000
max2665.000-2590.000=75.000
mean8.492-8.708=-0.216
σ0.615-0.559=0.056
min7.836-8.024=-0.188
max9.502-9.316=0.186
iters=5
new-facts=6402
prior-facts=6402
mean5000.934-5000.950=-0.015
σ0.141-0.176=-0.035
min5000.684-5000.639=0.045
max5001.020-5001.076=-0.056
mean2989.800-2980.200=9.600
σ366.685-286.667=80.018
min2665.000-2594.000=71.000
max3516.000-3317.000=199.000
mean9.538-9.810=-0.272
σ0.498-0.269=0.229
min8.651-9.565=-0.914
max9.844-10.242=-0.398

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.020-1.198=-0.178
σ0.161-0.327=-0.167
min0.910-0.906=0.004
max1.290-1.704=-0.413

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.442-464.434=0.008
σ574.787-574.780=0.006
min177.040-177.040=0.000
max1326.623-1326.605=0.017
mean88.250
σ8.500
min84.000
max101.000
mean2665.000-2590.000=75.000
σ0.000
min2665.000-2590.000=75.000
max2665.000-2590.000=75.000
mean0.556-0.557=-0.000
σ0.554-0.573=-0.019
min0.277-0.268=0.009
max1.388-1.416=-0.028
policies=20
mean1770.764-1770.740=0.024
σ0.352-0.363=-0.011
min1770.531-1770.490=0.041
max1771.287-1771.278=0.009
mean840.000
σ0.000
min840.000
max840.000
mean2665.000-2590.000=75.000
σ0.000
min2665.000-2590.000=75.000
max2665.000-2590.000=75.000
mean2.730-2.729=0.001
σ0.013-0.017=-0.005
min2.718-2.711=0.007
max2.744-2.752=-0.009
policies=200
mean17714.796-17714.784=0.012
σ0.602-0.524=0.078
min17714.413-17714.407=0.006
max17715.689-17715.557=0.132
mean8400.000
σ0.000
min8400.000
max8400.000
mean2665.000-2590.000=75.000
σ0.000
min2665.000-2590.000=75.000
max2665.000-2590.000=75.000
mean27.546-27.465=0.081
σ0.146-0.174=-0.028
min27.366-27.245=0.122
max27.721-27.618=0.103