Compare commits

Home / Compare af8c3312 .. 79906aca

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.979=-0.000
σ0.049-0.049=0.001
min33.952-33.953=-0.001
max34.114-34.114=-0.000
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.085-0.085=-0.001
σ0.003-0.004=-0.001
min0.082-0.082=0.000
max0.091-0.094=-0.003
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.001
σ0.002-0.002=-0.000
min23.314-23.314=-0.000
max23.321-23.322=-0.001
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.065-0.066=-0.000
σ0.002-0.003=-0.001
min0.064-0.063=0.000
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.429-1757.429=-0.000
σ0.364-0.365=-0.001
min1756.855-1756.854=0.002
max1758.016-1758.024=-0.008
mean1655.850-1662.000=-6.150
σ642.846-622.841=20.005
min623.000-667.000=-44.000
max2737.000-2591.000=146.000
mean2.374-2.364=0.011
σ0.085-0.122=-0.037
min2.277-2.245=0.032
max2.567-2.676=-0.109

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.581-326.571=0.009
σ0.027-0.046=-0.019
min326.535-326.492=0.043
max326.606-326.604=0.001
mean2737.000-2591.000=146.000
σ0.000
min2737.000-2591.000=146.000
max2737.000-2591.000=146.000
mean0.421-0.422=-0.001
σ0.001-0.001=-0.001
min0.421-0.420=0.000
max0.423-0.423=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1988.740-1988.726=0.014
σ0.014-0.019=-0.005
min1988.723-1988.710=0.013
max1988.754-1988.748=0.006
mean2737.000-2591.000=146.000
σ0.000
min2737.000-2591.000=146.000
max2737.000-2591.000=146.000
mean2.672-2.671=0.001
σ0.054-0.100=-0.046
min2.614-2.551=0.063
max2.762-2.816=-0.054
iters=5
new-facts=6402
prior-facts=1
mean4813.457-4813.457=-0.000
σ7.767-7.470=0.297
min4809.546-4810.091=-0.545
max4827.344-4826.819=0.524
mean2737.000-2591.000=146.000
σ0.000
min2737.000-2591.000=146.000
max2737.000-2591.000=146.000
mean8.787-8.919=-0.131
σ0.293-0.194=0.099
min8.323-8.606=-0.283
max9.072-9.114=-0.043
iters=5
new-facts=6402
prior-facts=6402
mean5001.157-5001.134=0.022
σ0.035-0.026=0.009
min5001.113-5001.105=0.008
max5001.200-5001.168=0.032
mean3014.800-3003.200=11.600
σ230.554-318.399=-87.845
min2737.000-2591.000=146.000
max3288.000-3408.000=-120.000
mean9.993-9.722=0.272
σ0.189-0.233=-0.044
min9.674-9.319=0.355
max10.173-9.882=0.291

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.964-1.350=-0.385
σ0.067-0.350=-0.283
min0.905-1.048=-0.142
max1.046-1.853=-0.807

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.565-464.564=0.001
σ574.771-574.779=-0.008
min177.173-177.170=0.002
max1326.721-1326.732=-0.011
mean88.250
σ8.500
min84.000
max101.000
mean2737.000-2591.000=146.000
σ0.000
min2737.000-2591.000=146.000
max2737.000-2591.000=146.000
mean0.551-0.550=0.001
σ0.556-0.551=0.005
min0.271-0.272=-0.002
max1.384-1.376=0.008
policies=20
mean1772.053-1772.019=0.034
σ0.363-0.349=0.014
min1771.821-1771.796=0.025
max1772.594-1772.538=0.056
mean840.000
σ0.000
min840.000
max840.000
mean2737.000-2591.000=146.000
σ0.000
min2737.000-2591.000=146.000
max2737.000-2591.000=146.000
mean2.750-2.706=0.044
σ0.043-0.012=0.031
min2.703-2.693=0.010
max2.796-2.718=0.078
policies=200
mean17727.453-17727.501=-0.048
σ0.610-0.446=0.164
min17727.073-17727.072=0.001
max17728.363-17728.128=0.235
mean8400.000
σ0.000
min8400.000
max8400.000
mean2737.000-2591.000=146.000
σ0.000
min2737.000-2591.000=146.000
max2737.000-2591.000=146.000
mean27.494-27.474=0.019
σ0.125-0.232=-0.107
min27.347-27.270=0.078
max27.631-27.785=-0.155