Compare commits

Home / Compare e0129b0f .. 5edc1701

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.054=-0.001
σ0.370-0.367=0.003
min53.908-53.911=-0.003
max55.106-55.099=0.007
mean417.000
σ0.000
min417.000
max417.000
mean0.141-0.139=0.002
σ0.005-0.004=0.000
min0.137-0.133=0.004
max0.149-0.145=0.004
cache=y
dps=1
iters=10
policies=100
mean43.393-43.394=-0.001
σ0.008-0.006=0.002
min43.382-43.385=-0.003
max43.409-43.405=0.004
mean417.000
σ0.000
min417.000
max417.000
mean0.121-0.123=-0.001
σ0.004-0.004=-0.000
min0.115-0.115=-0.000
max0.127-0.129=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.000-1007.003=-0.003
σ1.225-1.193=0.032
min1006.465-1006.454=0.011
max1012.141-1012.007=0.134
mean1045.800-1041.500=4.300
σ304.331-304.831=-0.500
min577.000-589.000=-12.000
max1660.000-1627.000=33.000
mean1.571-1.569=0.002
σ0.105-0.097=0.008
min1.471-1.474=-0.003
max1.808-1.839=-0.031

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1660.000-1627.000=33.000
σ0.000
min1660.000-1627.000=33.000
max1660.000-1627.000=33.000
mean0.411-0.425=-0.015
σ0.111-0.146=-0.035
min0.345-0.340=0.006
max0.607-0.686=-0.079
name=error_case.art
mean2.339-2.339=0.000
σ0.003-0.003=0.000
min2.337
max2.342
mean1660.000-1627.000=33.000
σ0.000
min1660.000-1627.000=33.000
max1660.000-1627.000=33.000
mean0.881-0.905=-0.024
σ0.100-0.146=-0.046
min0.819-0.813=0.007
max1.058-1.163=-0.105
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1660.000-1627.000=33.000
σ0.000
min1660.000-1627.000=33.000
max1660.000-1627.000=33.000
mean0.532-0.532=0.000
σ0.048-0.040=0.008
min0.491-0.503=-0.012
max0.610-0.602=0.009
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1660.000-1627.000=33.000
σ0.000
min1660.000-1627.000=33.000
max1660.000-1627.000=33.000
mean0.878-0.824=0.054
σ0.068-0.040=0.028
min0.813-0.795=0.019
max0.975-0.891=0.084

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.837=0.003
σ0.034-0.025=0.010
min964.811-964.820=-0.009
max964.894-964.878=0.016
mean1660.000-1627.000=33.000
σ0.000
min1660.000-1627.000=33.000
max1660.000-1627.000=33.000
mean0.852-0.818=0.034
σ0.006-0.048=-0.043
min0.845-0.755=0.090
max0.860-0.854=0.006
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.007-0.007=-0.001
min885.505-885.504=0.001
max885.522-885.522=-0.000
mean1660.000-1627.000=33.000
σ0.000
min1660.000-1627.000=33.000
max1660.000-1627.000=33.000
mean0.728-0.720=0.008
σ0.025-0.047=-0.022
min0.683-0.636=0.047
max0.742-0.751=-0.009

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.002
mean1660.000-1627.000=33.000
σ0.000
min1660.000-1627.000=33.000
max1660.000-1627.000=33.000
mean4.224-4.180=0.045
σ0.091-0.081=0.010
min3.782-4.044=-0.262
max4.588-4.444=0.144
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.670-7.668=0.003
mean1660.000-1627.000=33.000
σ0.000
min1660.000-1627.000=33.000
max1660.000-1627.000=33.000
mean4.221-4.194=0.027
σ0.124-0.064=0.060
min4.087-4.079=0.009
max5.183-4.383=0.800
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1660.000-1627.000=33.000
σ0.000
min1660.000-1627.000=33.000
max1660.000-1627.000=33.000
mean0.735-0.747=-0.012
σ0.019-0.018=0.001
min0.700-0.718=-0.018
max0.850-0.869=-0.018
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1660.000-1627.000=33.000
σ0.000
min1660.000-1627.000=33.000
max1660.000-1627.000=33.000
mean0.691-0.709=-0.018
σ0.025-0.014=0.011
min0.483-0.685=-0.202
max0.768-0.770=-0.002

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.037-296.987=0.050
σ0.229-0.226=0.003
min296.888-296.800=0.088
max297.673-297.603=0.070
mean1952.000-1917.000=35.000
σ0.000
min1952.000-1917.000=35.000
max1952.000-1917.000=35.000
mean0.568-0.583=-0.014
σ0.033-0.035=-0.003
min0.511-0.522=-0.011
max0.602-0.653=-0.050

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.823-286.824=-0.000
σ0.036-0.037=-0.001
min286.777-286.776=0.001
max286.861-286.864=-0.003
mean1660.000-1627.000=33.000
σ0.000
min1660.000-1627.000=33.000
max1660.000-1627.000=33.000
mean0.395-0.396=-0.001
σ0.007-0.007=0.000
min0.389-0.388=0.001
max0.403-0.402=0.001
iters=5
new-facts=1
prior-facts=6402
mean1297.256-1297.254=0.002
σ0.111-0.080=0.031
min1297.100-1297.157=-0.057
max1297.396-1297.364=0.032
mean1660.000-1627.000=33.000
σ0.000
min1660.000-1627.000=33.000
max1660.000-1627.000=33.000
mean2.287-2.113=0.174
σ0.230-0.094=0.136
min2.093-2.003=0.090
max2.660-2.221=0.439
iters=5
new-facts=6402
prior-facts=1
mean1541.348-1541.311=0.037
σ6.840-6.839=0.001
min1538.090-1538.075=0.015
max1553.580-1553.542=0.038
mean1660.000-1627.000=33.000
σ0.000
min1660.000-1627.000=33.000
max1660.000-1627.000=33.000
mean2.280-2.186=0.094
σ0.180-0.088=0.093
min2.124-2.117=0.007
max2.527-2.312=0.215
iters=5
new-facts=6402
prior-facts=6402
mean1859.112-1859.113=-0.001
σ0.065-0.084=-0.019
min1859.020-1858.989=0.031
max1859.186-1859.194=-0.008
mean1770.400-1767.400=3.000
σ120.544-145.364=-24.821
min1660.000-1627.000=33.000
max1952.000-1917.000=35.000
mean2.965-3.048=-0.083
σ0.103-0.154=-0.051
min2.861-2.866=-0.005
max3.087-3.214=-0.127

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.197-1.183=0.014
σ0.142-0.323=-0.181
min1.021-0.957=0.064
max1.346-1.754=-0.408

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.821=-0.000
σ581.372-581.372=0.000
min158.134-158.131=0.003
max1320.880
mean96.250
σ8.500
min92.000
max109.000
mean1660.000-1627.000=33.000
σ0.000
min1660.000-1627.000=33.000
max1660.000-1627.000=33.000
mean0.554-0.553=0.001
σ0.571-0.571=0.000
min0.264-0.264=0.001
max1.410-1.410=0.001
policies=20
mean1581.621-1581.629=-0.008
σ0.359-0.367=-0.008
min1581.385-1581.383=0.002
max1582.155-1582.175=-0.019
mean920.000
σ0.000
min920.000
max920.000
mean1660.000-1627.000=33.000
σ0.000
min1660.000-1627.000=33.000
max1660.000-1627.000=33.000
mean2.651-2.641=0.010
σ0.015-0.010=0.005
min2.631-2.631=0.000
max2.668-2.651=0.017
policies=200
mean15824.170-15824.130=0.040
σ0.184-0.125=0.059
min15823.996-15823.982=0.013
max15824.424-15824.273=0.151
mean9200.000
σ0.000
min9200.000
max9200.000
mean1660.000-1627.000=33.000
σ0.000
min1660.000-1627.000=33.000
max1660.000-1627.000=33.000
mean26.668-26.671=-0.003
σ0.054-0.101=-0.047
min26.599-26.563=0.036
max26.718-26.807=-0.089