Compare commits

Home / Compare 9055f829 .. a7c9cda9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.974-35.967=0.007
σ0.105-0.102=0.003
min35.927-35.922=0.005
max36.273-36.255=0.018
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.077-0.077=-0.001
σ0.004-0.003=0.000
min0.071-0.075=-0.003
max0.084-0.084=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.209-26.209=-0.001
σ0.005-0.002=0.003
min26.202-26.207=-0.005
max26.218-26.214=0.003
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.061-0.060=0.002
σ0.002-0.003=-0.000
min0.060-0.057=0.002
max0.068-0.067=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.365-1756.316=2.049
σ0.372-0.368=0.004
min1757.787-1755.736=2.050
max1758.964-1756.906=2.058
mean1660.350-1656.400=3.950
σ622.534-625.477=-2.943
min688.000-613.000=75.000
max2745.000-2700.000=45.000
mean2.412-2.374=0.038
σ0.119-0.140=-0.021
min2.300-2.212=0.088
max2.674-2.743=-0.069

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.514-278.838=0.676
σ0.007-0.018=-0.011
min279.504-278.807=0.697
max279.520-278.849=0.671
mean2745.000-2700.000=45.000
σ0.000
min2745.000-2700.000=45.000
max2745.000-2700.000=45.000
mean0.418-0.417=0.002
σ0.005-0.008=-0.002
min0.412-0.410=0.002
max0.425-0.429=-0.003
iters=5
new-facts=1
prior-facts=6402
mean2178.399-2268.900=-90.501
σ0.045-0.019=0.026
min2178.345-2268.877=-90.532
max2178.450-2268.921=-90.471
mean2745.000-2700.000=45.000
σ0.000
min2745.000-2700.000=45.000
max2745.000-2700.000=45.000
mean3.386-2.935=0.451
σ0.208-0.045=0.163
min3.103-2.897=0.206
max3.650-3.012=0.638
iters=5
new-facts=6402
prior-facts=1
mean5056.384-4954.245=102.140
σ1.011-0.881=0.130
min5055.808-4953.689=102.120
max5058.181-4955.809=102.372
mean2745.000-2700.000=45.000
σ0.000
min2745.000-2700.000=45.000
max2745.000-2700.000=45.000
mean9.111-8.099=1.012
σ0.570-0.459=0.110
min8.375-7.722=0.653
max9.714-8.694=1.019
iters=5
new-facts=6402
prior-facts=6402
mean5193.742-5168.677=25.065
σ0.100-0.192=-0.093
min5193.636-5168.413=25.223
max5193.852-5168.901=24.951
mean3232.800-3368.200=-135.400
σ466.038-473.088=-7.050
min2745.000-2741.000=4.000
max3873.000-3996.000=-123.000
mean8.754-9.549=-0.795
σ0.124-0.264=-0.140
min8.676-9.117=-0.441
max8.972-9.824=-0.852

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.037-0.973=0.064
σ0.139-0.055=0.084
min0.942-0.940=0.002
max1.262-1.069=0.192

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.481-460.358=5.124
σ572.659-572.654=0.005
min179.143-174.028=5.114
max1324.470-1319.338=5.132
mean79.500
σ7.000
min76.000
max90.000
mean2745.000-2700.000=45.000
σ0.000
min2745.000-2700.000=45.000
max2745.000-2700.000=45.000
mean0.497-0.546=-0.050
σ0.420-0.538=-0.119
min0.284-0.270=0.015
max1.126-1.354=-0.228
policies=20
mean1791.702-1740.471=51.231
σ0.332-0.311=0.021
min1791.498-1740.283=51.215
max1792.195-1740.935=51.259
mean760.000
σ0.000
min760.000
max760.000
mean2745.000-2700.000=45.000
σ0.000
min2745.000-2700.000=45.000
max2745.000-2700.000=45.000
mean2.819-2.678=0.141
σ0.022-0.016=0.006
min2.793-2.662=0.130
max2.838-2.701=0.138
policies=200
mean17923.417-17411.880=511.536
σ0.381-0.552=-0.170
min17923.192-17411.546=511.647
max17923.987-17412.705=511.282
mean7600.000
σ0.000
min7600.000
max7600.000
mean2745.000-2700.000=45.000
σ0.000
min2745.000-2700.000=45.000
max2745.000-2700.000=45.000
mean28.328-27.061=1.266
σ0.119-0.187=-0.068
min28.209-26.928=1.281
max28.450-27.335=1.115