Compare commits

Home / Compare 9ad1a939 .. 397b5510

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.986-33.986=-0.000
σ0.053-0.054=-0.001
min33.956-33.956=0.000
max34.136-34.139=-0.003
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.081-0.085=-0.004
σ0.005-0.003=0.002
min0.077-0.082=-0.006
max0.088-0.092=-0.004
cache=y
dps=1
iters=10
policies=100
mean23.324-23.324=-0.000
σ0.003-0.004=-0.001
min23.319-23.321=-0.001
max23.330-23.332=-0.002
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.067-0.065=0.001
σ0.002-0.004=-0.002
min0.065-0.062=0.003
max0.073-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.726-1756.726=0.000
σ0.364-0.364=-0.000
min1756.152-1756.154=-0.003
max1757.317-1757.315=0.002
mean1631.250-1661.400=-30.150
σ627.321-630.582=-3.261
min644.000-627.000=17.000
max2828.000-2740.000=88.000
mean2.398-2.393=0.005
σ0.111-0.185=-0.074
min2.272-2.185=0.087
max2.666-3.066=-0.399

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean325.321-325.316=0.005
σ0.042-0.055=-0.013
min325.247-325.218=0.029
max325.350-325.346=0.003
mean2828.000-2740.000=88.000
σ0.000
min2828.000-2740.000=88.000
max2828.000-2740.000=88.000
mean0.431-0.430=0.001
σ0.005-0.006=-0.002
min0.427-0.425=0.002
max0.438-0.439=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1985.873-1985.875=-0.002
σ0.013-0.007=0.007
min1985.851-1985.863=-0.012
max1985.887-1985.881=0.007
mean2828.000-2740.000=88.000
σ0.000
min2828.000-2740.000=88.000
max2828.000-2740.000=88.000
mean2.704-2.817=-0.114
σ0.101-0.284=-0.183
min2.591-2.585=0.006
max2.815-3.290=-0.475
iters=5
new-facts=6402
prior-facts=1
mean4809.666-4809.646=0.020
σ7.719-7.751=-0.032
min4806.134-4806.143=-0.009
max4823.474-4823.512=-0.038
mean2828.000-2740.000=88.000
σ0.000
min2828.000-2740.000=88.000
max2828.000-2740.000=88.000
mean9.126-8.690=0.435
σ0.239-0.637=-0.398
min8.874-7.811=1.063
max9.421-9.461=-0.039
iters=5
new-facts=6402
prior-facts=6402
mean4997.027-4997.106=-0.079
σ0.323-0.147=0.176
min4996.455-4996.845=-0.390
max4997.206-4997.192=0.014
mean3014.800-3006.000=8.800
σ259.382-324.517=-65.135
min2828.000-2740.000=88.000
max3424.000-3497.000=-73.000
mean8.561-8.581=-0.020
σ0.083-0.086=-0.003
min8.475-8.507=-0.032
max8.696-8.698=-0.002

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.924-1.004=-0.080
σ0.013-0.066=-0.052
min0.915-0.921=-0.006
max0.947-1.059=-0.111

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.374-463.370=0.003
σ574.773-574.773=0.000
min175.979-175.982=-0.003
max1325.534-1325.531=0.003
mean86.250
σ8.500
min82.000
max99.000
mean2828.000-2740.000=88.000
σ0.000
min2828.000-2740.000=88.000
max2828.000-2740.000=88.000
mean0.470-0.549=-0.079
σ0.373-0.561=-0.188
min0.281-0.250=0.031
max1.029-1.390=-0.361
policies=20
mean1760.157-1760.107=0.050
σ0.355-0.341=0.014
min1759.908-1759.889=0.018
max1760.681-1760.615=0.066
mean820.000
σ0.000
min820.000
max820.000
mean2828.000-2740.000=88.000
σ0.000
min2828.000-2740.000=88.000
max2828.000-2740.000=88.000
mean2.805-2.728=0.077
σ0.013-0.015=-0.003
min2.792-2.714=0.078
max2.823-2.750=0.073
policies=200
mean17608.306-17608.390=-0.085
σ0.486-0.504=-0.018
min17607.919-17608.085=-0.166
max17608.990-17609.141=-0.151
mean8200.000
σ0.000
min8200.000
max8200.000
mean2828.000-2740.000=88.000
σ0.000
min2828.000-2740.000=88.000
max2828.000-2740.000=88.000
mean27.824-27.550=0.274
σ0.357-0.108=0.249
min27.436-27.438=-0.002
max28.206-27.691=0.514