Compare commits

Home / Compare 67cc8b10 .. a56dbd2d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.419-36.592=-0.172
σ0.093-0.093=0.001
min36.372-36.548=-0.175
max36.684-36.855=-0.171
mean411.000-411.800=-0.800
σ0.000-0.422=-0.422
min411.000
max411.000-412.000=-1.000
mean0.077-0.076=0.001
σ0.005-0.004=0.001
min0.073-0.072=0.001
max0.084-0.083=0.001
cache=y
dps=1
iters=10
policies=100
mean26.322-26.465=-0.143
σ0.003-0.002=0.002
min26.316-26.462=-0.146
max26.328-26.467=-0.139
mean411.000-412.000=-1.000
σ0.000
min411.000-412.000=-1.000
max411.000-412.000=-1.000
mean0.061-0.058=0.003
σ0.003-0.002=0.001
min0.058-0.057=0.001
max0.068-0.061=0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1748.621-1750.983=-2.362
σ0.384-0.382=0.002
min1748.027-1750.385=-2.358
max1749.247-1751.599=-2.352
mean1649.550-1664.900=-15.350
σ618.711-621.669=-2.958
min623.000-657.000=-34.000
max2646.000-2604.000=42.000
mean2.400-2.821=-0.421
σ0.159-0.118=0.041
min2.273-2.450=-0.177
max2.823-2.963=-0.140

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.577-281.910=-2.333
σ0.010-0.007=0.003
min279.566-281.902=-2.336
max279.587-281.919=-2.332
mean2646.000-2604.000=42.000
σ0.000
min2646.000-2604.000=42.000
max2646.000-2604.000=42.000
mean0.412-0.404=0.008
σ0.005-0.005=-0.000
min0.409-0.400=0.009
max0.421-0.411=0.010
iters=5
new-facts=1
prior-facts=6402
mean2172.207-2176.113=-3.906
σ0.018-0.016=0.002
min2172.176-2176.103=-3.927
max2172.218-2176.141=-3.923
mean2646.000-2604.000=42.000
σ0.000
min2646.000-2604.000=42.000
max2646.000-2604.000=42.000
mean3.026-2.865=0.162
σ0.154-0.141=0.014
min2.795-2.750=0.045
max3.208-3.110=0.098
iters=5
new-facts=6402
prior-facts=1
mean5054.048-4899.392=154.655
σ1.054-354.927=-353.872
min5053.212-4264.482=788.729
max5055.883-5059.636=-3.753
mean2646.000-2604.000=42.000
σ0.000
min2646.000-2604.000=42.000
max2646.000-2604.000=42.000
mean9.348-9.144=0.204
σ0.189-0.761=-0.573
min9.068-7.789=1.280
max9.527-9.593=-0.066
iters=5
new-facts=6402
prior-facts=6402
mean5201.398-5206.459=-5.061
σ0.105-0.177=-0.072
min5201.292-5206.160=-4.868
max5201.508-5206.597=-5.089
mean3293.000-3141.800=151.200
σ412.667-453.662=-40.995
min2717.000-2604.000=113.000
max3671.000-3755.000=-84.000
mean10.143-9.913=0.230
σ0.293-0.351=-0.058
min9.677-9.499=0.178
max10.466-10.296=0.170

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.225-1.579=-0.355
σ0.275-0.350=-0.074
min0.993-1.195=-0.202
max1.644-1.978=-0.334

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean511.739-512.397=-0.658
σ663.631-663.607=0.025
min179.920-180.591=-0.671
max1507.186-1507.807=-0.621
mean79.500
σ7.000
min76.000
max90.000
mean2646.000-2604.000=42.000
σ0.000
min2646.000-2604.000=42.000
max2646.000-2604.000=42.000
mean0.585-0.582=0.003
σ0.584-0.590=-0.006
min0.289-0.284=0.005
max1.461-1.467=-0.006
policies=20
mean1799.447-1806.188=-6.741
σ0.351-0.342=0.009
min1799.204-1805.943=-6.739
max1799.965-1806.691=-6.725
mean760.000
σ0.000
min760.000
max760.000
mean2646.000-2604.000=42.000
σ0.000
min2646.000-2604.000=42.000
max2646.000-2604.000=42.000
mean2.829-2.858=-0.029
σ0.017-0.051=-0.034
min2.806-2.822=-0.016
max2.845-2.933=-0.089
policies=200
mean18001.135-18068.654=-67.520
σ0.507-0.457=0.050
min18000.841-18068.292=-67.451
max18001.891-18069.316=-67.426
mean7600.000
σ0.000
min7600.000
max7600.000
mean2646.000-2604.000=42.000
σ0.000
min2646.000-2604.000=42.000
max2646.000-2604.000=42.000
mean28.574-28.580=-0.006
σ0.225-0.129=0.096
min28.333-28.506=-0.173
max28.826-28.773=0.053