Compare commits

Home / Compare d72eb070 .. 7fd197d9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.974-36.727=-0.753
σ0.105-0.614=-0.508
min35.927-35.925=0.002
max36.273-37.222=-0.949
mean414.000-3972.000=-3558.000
σ0.000
min414.000-3972.000=-3558.000
max414.000-3972.000=-3558.000
mean0.077-0.075=0.002
σ0.004-0.001=0.003
min0.071-0.074=-0.003
max0.084-0.077=0.007
cache=y
dps=1
iters=10
policies=100
mean26.209-26.713=-0.504
σ0.005-0.646=-0.641
min26.202-26.208=-0.006
max26.218-27.470=-1.252
mean414.000-3972.000=-3558.000
σ0.000
min414.000-3972.000=-3558.000
max414.000-3972.000=-3558.000
mean0.061-0.061=0.001
σ0.002-0.001=0.002
min0.060-0.060=-0.000
max0.068-0.062=0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.365-1756.369=1.996
σ0.372-0.372=0.000
min1757.787-1755.797=1.990
max1758.964-1756.967=1.998
mean1660.350-1653.850=6.500
σ622.534-627.740=-5.206
min688.000-680.000=8.000
max2745.000-2604.000=141.000
mean2.412-2.275=0.137
σ0.119-0.141=-0.022
min2.300-2.160=0.140
max2.674-2.805=-0.132

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.514-278.696=0.818
σ0.007-0.013=-0.006
min279.504-278.684=0.820
max279.520-278.718=0.802
mean2745.000-2604.000=141.000
σ0.000
min2745.000-2604.000=141.000
max2745.000-2604.000=141.000
mean0.418-0.418=0.000
σ0.005-0.004=0.002
min0.412-0.416=-0.003
max0.425-0.425=0.000
iters=5
new-facts=1
prior-facts=6402
mean2178.399-2268.872=-90.473
σ0.045-0.004=0.041
min2178.345-2268.868=-90.523
max2178.450-2268.877=-90.427
mean2745.000-2604.000=141.000
σ0.000
min2745.000-2604.000=141.000
max2745.000-2604.000=141.000
mean3.386-2.954=0.432
σ0.208-0.121=0.087
min3.103-2.875=0.228
max3.650-3.165=0.486
iters=5
new-facts=6402
prior-facts=1
mean5056.384-4952.326=104.058
σ1.011-0.864=0.147
min5055.808-4951.869=103.939
max5058.181-4953.867=104.313
mean2745.000-2604.000=141.000
σ0.000
min2745.000-2604.000=141.000
max2745.000-2604.000=141.000
mean9.111-8.128=0.983
σ0.570-0.291=0.279
min8.375-7.696=0.679
max9.714-8.407=1.307
iters=5
new-facts=6402
prior-facts=6402
mean5193.742-5167.006=26.736
σ0.100-0.160=-0.061
min5193.636-5166.720=26.917
max5193.852-5167.091=26.762
mean3232.800-3407.000=-174.200
σ466.038-464.641=1.397
min2745.000-2752.000=-7.000
max3873.000-3972.000=-99.000
mean8.754-9.290=-0.536
σ0.124-0.104=0.020
min8.676-9.125=-0.449
max8.972-9.386=-0.414

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.037-1.110=-0.073
σ0.139-0.152=-0.013
min0.942-0.957=-0.015
max1.262-1.364=-0.103

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.481-460.259=5.222
σ572.659-572.608=0.051
min179.143-173.954=5.188
max1324.470-1319.171=5.299
mean79.500
σ7.000
min76.000
max90.000
mean2745.000-435.000=2310.000
σ0.000
min2745.000-435.000=2310.000
max2745.000-435.000=2310.000
mean0.497-0.555=-0.058
σ0.420-0.563=-0.143
min0.284-0.273=0.012
max1.126-1.399=-0.273
policies=20
mean1791.702-1740.059=51.642
σ0.332-0.328=0.004
min1791.498-1739.813=51.685
max1792.195-1740.539=51.656
mean760.000
σ0.000
min760.000
max760.000
mean2745.000-444.500=2300.500
σ0.000-8.813=-8.813
min2745.000-435.000=2310.000
max2745.000-452.000=2293.000
mean2.819-2.655=0.164
σ0.022-0.006=0.017
min2.793-2.648=0.145
max2.838-2.662=0.177
policies=200
mean17923.417-17409.810=513.606
σ0.381-0.064=0.318
min17923.192-17409.732=513.460
max17923.987-17409.880=514.107
mean7600.000
σ0.000
min7600.000
max7600.000
mean2745.000-488.500=2256.500
σ0.000-2.082=-2.082
min2745.000-486.000=2259.000
max2745.000-491.000=2254.000
mean28.328-26.832=1.496
σ0.119-0.167=-0.048
min28.209-26.668=1.541
max28.450-27.023=1.427