Compare commits

Home / Compare 9078299c .. 0dfff9e7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.730-70.729=0.000
σ0.053-0.049=0.004
min70.698-70.698=0.000
max70.877-70.867=0.010
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.161-0.160=0.001
σ0.004-0.004=0.000
min0.155-0.154=0.001
max0.165-0.166=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.445-21.445=0.000
σ0.002-0.002=-0.000
min21.442-21.442=-0.000
max21.449-21.450=-0.001
mean415.800-414.000=1.800
σ0.422-0.000=0.422
min415.000-414.000=1.000
max416.000-414.000=2.000
mean0.065-0.065=0.000
σ0.002-0.002=0.000
min0.064-0.064=-0.000
max0.072-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.284-1754.527=0.757
σ0.359-0.363=-0.004
min1754.717-1753.957=0.760
max1755.868-1755.119=0.749
mean1654.550-1659.000=-4.450
σ634.022-627.320=6.702
min622.000-625.000=-3.000
max2848.000-2836.000=12.000
mean2.817-2.757=0.060
σ0.157-0.225=-0.067
min2.458-2.186=0.272
max3.016-3.029=-0.013

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean274.364-273.610=0.754
σ0.006-0.004=0.003
min274.360-273.606=0.754
max274.375-273.614=0.762
mean2848.000-2836.000=12.000
σ0.000
min2848.000-2836.000=12.000
max2848.000-2836.000=12.000
mean0.382-0.387=-0.005
σ0.004-0.008=-0.004
min0.375-0.380=-0.004
max0.384-0.396=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1934.759-1934.002=0.757
σ0.007-0.005=0.002
min1934.751-1933.997=0.754
max1934.770-1934.009=0.760
mean2848.000-2836.000=12.000
σ0.000
min2848.000-2836.000=12.000
max2848.000-2836.000=12.000
mean3.091-2.980=0.111
σ0.304-0.111=0.193
min2.856-2.827=0.030
max3.622-3.138=0.484
iters=5
new-facts=6402
prior-facts=1
mean4755.472-4754.637=0.835
σ0.895-0.929=-0.034
min4755.037-4753.861=1.176
max4757.073-4756.250=0.822
mean2848.000-2836.000=12.000
σ0.000
min2848.000-2836.000=12.000
max2848.000-2836.000=12.000
mean8.626-8.587=0.039
σ0.501-0.219=0.282
min7.740-8.397=-0.657
max8.956-8.946=0.010
iters=5
new-facts=6402
prior-facts=6402
mean4945.983-4945.153=0.829
σ0.022-0.142=-0.119
min4945.953-4944.901=1.053
max4946.007-4945.241=0.766
mean3069.600-3058.800=10.800
σ232.960-193.301=39.659
min2848.000-2836.000=12.000
max3406.000-3327.000=79.000
mean8.545-8.514=0.031
σ0.135-0.169=-0.034
min8.410-8.284=0.126
max8.724-8.730=-0.005

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.996-1.055=-0.059
σ0.139-0.132=0.007
min0.931-0.934=-0.003
max1.246-1.257=-0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.840-472.842=-0.001
σ574.924-574.930=-0.006
min185.368-185.366=0.002
max1335.226-1335.237=-0.011
mean88.250
σ8.500
min84.000
max101.000
mean2848.000-2836.000=12.000
σ0.000
min2848.000-2836.000=12.000
max2848.000-2836.000=12.000
mean0.456-0.450=0.006
σ0.304-0.298=0.006
min0.303-0.298=0.005
max0.912-0.896=0.016
policies=20
mean1853.993-1854.010=-0.017
σ0.363-0.382=-0.019
min1853.724-1853.717=0.007
max1854.521-1854.561=-0.040
mean840.000
σ0.000
min840.000
max840.000
mean2848.000-2836.000=12.000
σ0.000
min2848.000-2836.000=12.000
max2848.000-2836.000=12.000
mean2.963-2.974=-0.011
σ0.012-0.032=-0.020
min2.950-2.953=-0.004
max2.977-3.021=-0.044
policies=200
mean18546.518-18546.555=-0.037
σ0.432-0.455=-0.023
min18546.129-18546.211=-0.082
max18547.134-18547.210=-0.076
mean8400.000
σ0.000
min8400.000
max8400.000
mean2848.000-2836.000=12.000
σ0.000
min2848.000-2836.000=12.000
max2848.000-2836.000=12.000
mean29.306-29.272=0.034
σ0.502-0.524=-0.023
min28.845-28.821=0.024
max29.765-29.889=-0.124