Compare commits

Home / Compare c4dbc4f6 .. 4f272922

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.057-54.057=0.000
σ0.368-0.369=-0.001
min53.914-53.910=0.003
max55.103-55.105=-0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.139-0.141=-0.002
σ0.003-0.006=-0.003
min0.136-0.136=0.000
max0.145-0.154=-0.009
cache=y
dps=1
iters=10
policies=100
mean43.396-43.397=-0.001
σ0.005-0.006=-0.001
min43.388-43.386=0.001
max43.405-43.405=0.000
mean415.000
σ0.000
min415.000
max415.000
mean0.121-0.125=-0.004
σ0.004-0.006=-0.002
min0.114-0.118=-0.005
max0.126-0.137=-0.010

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.966-1006.961=0.004
σ0.863-0.879=-0.016
min1006.465-1006.473=-0.007
max1010.527-1010.604=-0.077
mean1037.400-1036.650=0.750
σ300.923-301.419=-0.496
min548.000-546.000=2.000
max1584.000-1583.000=1.000
mean1.575-1.573=0.002
σ0.107-0.123=-0.016
min1.472-1.390=0.083
max1.862-1.882=-0.020

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.884=-0.000
σ0.003-0.002=0.000
min0.882
max0.887
mean1584.000-1583.000=1.000
σ0.000
min1584.000-1583.000=1.000
max1584.000-1583.000=1.000
mean0.447-0.404=0.043
σ0.199-0.124=0.075
min0.347-0.329=0.018
max0.803-0.623=0.180
name=error_case.art
mean2.340-2.339=0.001
σ0.002-0.003=-0.001
min2.338-2.337=0.001
max2.342
mean1584.000-1583.000=1.000
σ0.000
min1584.000-1583.000=1.000
max1584.000-1583.000=1.000
mean0.912-0.879=0.033
σ0.171-0.078=0.092
min0.814-0.827=-0.014
max1.214-1.015=0.199
name=heavy_item.art
mean1.524-1.524=0.000
σ0.002-0.002=0.000
min1.522
max1.527-1.526=0.000
mean1584.000-1583.000=1.000
σ0.000
min1584.000-1583.000=1.000
max1584.000-1583.000=1.000
mean0.535-0.539=-0.004
σ0.049-0.048=0.001
min0.502-0.501=0.001
max0.620-0.621=-0.001
name=nested_use.art
mean2.361-2.361=0.000
σ0.002-0.002=-0.000
min2.360
max2.364
mean1584.000-1583.000=1.000
σ0.000
min1584.000-1583.000=1.000
max1584.000-1583.000=1.000
mean0.843-0.855=-0.012
σ0.034-0.034=0.001
min0.806-0.830=-0.024
max0.895-0.914=-0.019

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.836-964.836=-0.000
σ0.026-0.028=-0.002
min964.813-964.815=-0.001
max964.879-964.885=-0.006
mean1584.000-1583.000=1.000
σ0.000
min1584.000-1583.000=1.000
max1584.000-1583.000=1.000
mean0.773-0.830=-0.057
σ0.062-0.030=0.032
min0.695-0.789=-0.094
max0.868-0.857=0.011
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.007-0.006=0.000
min885.506-885.504=0.001
max885.522-885.520=0.002
mean1584.000-1583.000=1.000
σ0.000
min1584.000-1583.000=1.000
max1584.000-1583.000=1.000
mean0.718-0.719=-0.001
σ0.033-0.032=0.001
min0.661-0.662=-0.001
max0.739-0.741=-0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.001
mean1584.000-1583.000=1.000
σ0.000
min1584.000-1583.000=1.000
max1584.000-1583.000=1.000
mean3.998-4.197=-0.199
σ0.348-0.074=0.273
min3.392-4.034=-0.643
max4.482-4.443=0.039
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.668
mean1584.000-1583.000=1.000
σ0.000
min1584.000-1583.000=1.000
max1584.000-1583.000=1.000
mean4.274-4.207=0.068
σ0.069-0.068=0.001
min4.125-4.068=0.058
max4.541-4.378=0.162
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1584.000-1583.000=1.000
σ0.000
min1584.000-1583.000=1.000
max1584.000-1583.000=1.000
mean0.745-0.748=-0.003
σ0.021-0.020=0.000
min0.705-0.712=-0.007
max0.865-0.867=-0.002
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1584.000-1583.000=1.000
σ0.000
min1584.000-1583.000=1.000
max1584.000-1583.000=1.000
mean0.700-0.706=-0.007
σ0.023-0.025=-0.002
min0.578-0.517=0.060
max0.772-0.786=-0.014

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.821-295.724=0.097
σ0.194-0.199=-0.005
min295.641-295.581=0.061
max296.280-296.261=0.019
mean1907.000-1903.000=4.000
σ0.000
min1907.000-1903.000=4.000
max1907.000-1903.000=4.000
mean0.564-0.582=-0.018
σ0.035-0.033=0.002
min0.506-0.508=-0.001
max0.637-0.617=0.021

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.373-285.396=-0.023
σ0.034-0.036=-0.002
min285.326-285.350=-0.024
max285.404-285.435=-0.032
mean1584.000-1583.000=1.000
σ0.000
min1584.000-1583.000=1.000
max1584.000-1583.000=1.000
mean0.388-0.388=0.000
σ0.007-0.005=0.002
min0.383-0.381=0.002
max0.397-0.392=0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.782-1295.777=0.005
σ0.114-0.114=-0.000
min1295.665-1295.662=0.003
max1295.922-1295.919=0.003
mean1584.000-1583.000=1.000
σ0.000
min1584.000-1583.000=1.000
max1584.000-1583.000=1.000
mean1.911-1.905=0.007
σ0.106-0.086=0.020
min1.795-1.804=-0.009
max2.012-2.012=0.001
iters=5
new-facts=6402
prior-facts=1
mean1539.904-1539.917=-0.013
σ6.891-6.860=0.032
min1536.632-1536.631=0.001
max1552.227-1552.182=0.044
mean1584.000-1583.000=1.000
σ0.000
min1584.000-1583.000=1.000
max1584.000-1583.000=1.000
mean2.257-2.303=-0.046
σ0.233-0.207=0.027
min2.034-2.045=-0.011
max2.528-2.500=0.028
iters=5
new-facts=6402
prior-facts=6402
mean1857.680-1857.686=-0.006
σ0.065-0.063=0.002
min1857.602-1857.613=-0.011
max1857.772-1857.771=0.001
mean1761.600-1760.000=1.600
σ146.145-143.607=2.538
min1584.000-1583.000=1.000
max1907.000-1903.000=4.000
mean3.052-3.092=-0.039
σ0.234-0.332=-0.098
min2.867-2.893=-0.026
max3.461-3.669=-0.209

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.237-1.249=-0.012
σ0.252-0.341=-0.088
min0.944-0.927=0.018
max1.600-1.736=-0.136

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.709-445.706=0.003
σ580.934-580.934=-0.000
min155.240-155.238=0.003
max1317.110-1317.107=0.003
mean96.250
σ8.500
min92.000
max109.000
mean1584.000-1583.000=1.000
σ0.000
min1584.000-1583.000=1.000
max1584.000-1583.000=1.000
mean0.539-0.541=-0.002
σ0.567-0.559=0.008
min0.248-0.261=-0.013
max1.389-1.379=0.010
policies=20
mean1552.676-1552.647=0.029
σ0.335-0.324=0.011
min1552.446-1552.422=0.023
max1553.174-1553.128=0.046
mean920.000
σ0.000
min920.000
max920.000
mean1584.000-1583.000=1.000
σ0.000
min1584.000-1583.000=1.000
max1584.000-1583.000=1.000
mean2.594-2.579=0.015
σ0.011-0.013=-0.003
min2.579-2.564=0.015
max2.602-2.592=0.010
policies=200
mean15534.837-15534.632=0.205
σ0.017-0.074=-0.058
min15534.824-15534.557=0.267
max15534.861-15534.730=0.131
mean9200.000
σ0.000
min9200.000
max9200.000
mean1584.000-1583.000=1.000
σ0.000
min1584.000-1583.000=1.000
max1584.000-1583.000=1.000
mean26.009-26.112=-0.103
σ0.031-0.274=-0.243
min25.982-25.937=0.045
max26.049-26.520=-0.471