Compare commits

Home / Compare fb9f459b .. b9f12728

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.985-33.953=0.032
σ0.054-0.054=-0.000
min33.955-33.923=0.032
max34.138-34.106=0.032
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.082-0.085=-0.003
σ0.005-0.003=0.002
min0.076-0.083=-0.006
max0.092-0.092=0.000
cache=y
dps=1
iters=10
policies=100
mean23.324-23.325=-0.001
σ0.002-0.004=-0.002
min23.321-23.321=0.001
max23.327-23.333=-0.006
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.065-0.066=-0.001
σ0.003-0.003=-0.000
min0.063-0.064=-0.000
max0.073-0.073=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.727-1756.726=0.000
σ0.365-0.364=0.001
min1756.152-1756.152=-0.000
max1757.318-1757.315=0.003
mean1645.850-1651.450=-5.600
σ635.305-643.426=-8.120
min626.000-630.000=-4.000
max2835.000-2892.000=-57.000
mean2.330-2.367=-0.037
σ0.080-0.099=-0.018
min2.236-2.270=-0.034
max2.568-2.707=-0.138

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean325.313-325.314=-0.001
σ0.055-0.055=0.000
min325.215-325.216=-0.002
max325.345-325.348=-0.003
mean2835.000-2892.000=-57.000
σ0.000
min2835.000-2892.000=-57.000
max2835.000-2892.000=-57.000
mean0.426-0.425=0.001
σ0.003-0.001=0.002
min0.424-0.424=-0.001
max0.431-0.426=0.005
iters=5
new-facts=1
prior-facts=6402
mean1985.880-1985.858=0.022
σ0.012-0.010=0.002
min1985.863-1985.846=0.017
max1985.894-1985.873=0.022
mean2835.000-2892.000=-57.000
σ0.000
min2835.000-2892.000=-57.000
max2835.000-2892.000=-57.000
mean2.665-2.842=-0.177
σ0.049-0.116=-0.067
min2.611-2.676=-0.065
max2.741-2.987=-0.246
iters=5
new-facts=6402
prior-facts=1
mean4809.409-4809.537=-0.128
σ7.491-7.717=-0.226
min4805.745-4805.787=-0.042
max4822.806-4823.338=-0.532
mean2835.000-2892.000=-57.000
σ0.000
min2835.000-2892.000=-57.000
max2835.000-2892.000=-57.000
mean8.686-8.662=0.025
σ0.354-0.406=-0.051
min8.147-8.009=0.137
max9.049-9.006=0.043
iters=5
new-facts=6402
prior-facts=6402
mean4997.182-4997.048=0.133
σ0.021-0.191=-0.170
min4997.159-4996.825=0.335
max4997.210-4997.196=0.014
mean3059.000-3088.800=-29.800
σ238.566-196.008=42.557
min2835.000-2892.000=-57.000
max3409.000-3284.000=125.000
mean8.730-8.768=-0.038
σ0.084-0.168=-0.084
min8.582-8.552=0.030
max8.786-9.003=-0.218

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.040-1.005=0.034
σ0.132-0.190=-0.058
min0.924-0.918=0.006
max1.248-1.344=-0.096

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.382-463.378=0.004
σ574.771-574.766=0.005
min175.982-175.984=-0.002
max1325.539-1325.527=0.012
mean86.250
σ8.500
min82.000
max99.000
mean2835.000-2892.000=-57.000
σ0.000
min2835.000-2892.000=-57.000
max2835.000-2892.000=-57.000
mean0.475-0.432=0.043
σ0.387-0.297=0.089
min0.280-0.281=-0.001
max1.055-0.878=0.177
policies=20
mean1760.154-1760.173=-0.020
σ0.352-0.372=-0.019
min1759.911-1759.920=-0.009
max1760.674-1760.723=-0.049
mean820.000
σ0.000
min820.000
max820.000
mean2835.000-2892.000=-57.000
σ0.000
min2835.000-2892.000=-57.000
max2835.000-2892.000=-57.000
mean2.786-2.815=-0.029
σ0.006-0.013=-0.006
min2.780-2.802=-0.022
max2.791-2.832=-0.041
policies=200
mean17608.389-17608.336=0.054
σ0.449-0.519=-0.070
min17607.918-17607.895=0.023
max17608.993-17609.077=-0.084
mean8200.000
σ0.000
min8200.000
max8200.000
mean2835.000-2892.000=-57.000
σ0.000
min2835.000-2892.000=-57.000
max2835.000-2892.000=-57.000
mean27.821-28.043=-0.222
σ0.470-0.384=0.086
min27.354-27.677=-0.323
max28.407-28.460=-0.052