Compare commits

Home / Compare 14ac1954 .. 01cbbfc8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.978-33.979=-0.001
σ0.048-0.047=0.001
min33.952-33.950=0.002
max34.112-34.108=0.004
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.081-0.082=-0.001
σ0.004-0.004=0.000
min0.076-0.076=0.000
max0.090-0.089=0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=0.000
σ0.002-0.004=-0.002
min23.314-23.310=0.005
max23.322-23.324=-0.001
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.065-0.065=-0.000
σ0.002-0.002=-0.000
min0.063-0.063=-0.000
max0.070-0.070=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.365-1757.365=-0.001
σ0.364-0.365=-0.000
min1756.789-1756.788=0.001
max1757.952-1757.952=0.000
mean1660.350-1660.650=-0.300
σ620.646-620.397=0.249
min671.000-669.000=2.000
max2589.000-2587.000=2.000
mean2.371-2.381=-0.009
σ0.107-0.114=-0.007
min2.253-2.256=-0.002
max2.742-2.691=0.051

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.500-326.511=-0.010
σ0.059-0.034=0.025
min326.395-326.451=-0.056
max326.534-326.536=-0.002
mean2589.000-2587.000=2.000
σ0.000
min2589.000-2587.000=2.000
max2589.000-2587.000=2.000
mean0.428-0.424=0.004
σ0.007-0.003=0.004
min0.423-0.421=0.002
max0.441-0.429=0.012
iters=5
new-facts=1
prior-facts=6402
mean1988.679-1988.673=0.007
σ0.006-0.012=-0.005
min1988.672-1988.653=0.020
max1988.688-1988.682=0.006
mean2589.000-2587.000=2.000
σ0.000
min2589.000-2587.000=2.000
max2589.000-2587.000=2.000
mean2.723-2.698=0.025
σ0.171-0.090=0.081
min2.609-2.617=-0.008
max3.024-2.798=0.226
iters=5
new-facts=6402
prior-facts=1
mean4813.402-4813.509=-0.106
σ7.807-7.724=0.083
min4809.547-4809.980=-0.434
max4827.363-4827.326=0.037
mean2589.000-2587.000=2.000
σ0.000
min2589.000-2587.000=2.000
max2589.000-2587.000=2.000
mean8.527-8.747=-0.219
σ0.582-0.272=0.310
min7.635-8.459=-0.824
max9.268-9.180=0.088
iters=5
new-facts=6402
prior-facts=6402
mean5001.068-5001.076=-0.008
σ0.019-0.031=-0.012
min5001.044-5001.047=-0.003
max5001.090-5001.123=-0.033
mean2969.400-2959.800=9.600
σ402.295-254.740=147.555
min2589.000-2637.000=-48.000
max3529.000-3303.000=226.000
mean9.713-9.905=-0.192
σ0.257-0.201=0.056
min9.328-9.710=-0.382
max10.049-10.242=-0.194

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.298-1.271=0.028
σ0.350-0.427=-0.077
min0.911-0.913=-0.002
max1.713-1.836=-0.123

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.494-464.503=-0.010
σ574.777-574.793=-0.016
min177.104-177.103=0.001
max1326.659-1326.692=-0.034
mean88.250
σ8.500
min84.000
max101.000
mean2589.000-2587.000=2.000
σ0.000
min2589.000-2587.000=2.000
max2589.000-2587.000=2.000
mean0.559-0.541=0.017
σ0.557-0.530=0.027
min0.275-0.274=0.001
max1.394-1.337=0.057
policies=20
mean1771.367-1771.349=0.018
σ0.365-0.358=0.007
min1771.131-1771.121=0.010
max1771.910-1771.881=0.029
mean840.000
σ0.000
min840.000
max840.000
mean2589.000-2587.000=2.000
σ0.000
min2589.000-2587.000=2.000
max2589.000-2587.000=2.000
mean2.754-2.734=0.020
σ0.029-0.030=-0.001
min2.732-2.704=0.028
max2.797-2.763=0.034
policies=200
mean17720.992-17721.033=-0.041
σ0.401-0.617=-0.216
min17720.623-17720.643=-0.021
max17721.561-17721.953=-0.392
mean8400.000
σ0.000
min8400.000
max8400.000
mean2589.000-2587.000=2.000
σ0.000
min2589.000-2587.000=2.000
max2589.000-2587.000=2.000
mean27.591-27.574=0.017
σ0.181-0.282=-0.101
min27.442-27.380=0.062
max27.820-27.983=-0.162