Compare commits

Home / Compare a8b62607 .. 0cb5435e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.057-54.057=0.000
σ0.369-0.369=-0.001
min53.910-53.916=-0.005
max55.105-55.107=-0.002
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.141-0.137=0.003
σ0.006-0.005=0.001
min0.136-0.132=0.004
max0.154-0.148=0.006
cache=y
dps=1
iters=10
policies=100
mean43.397-43.394=0.003
σ0.006-0.006=-0.000
min43.386-43.387=-0.000
max43.405-43.407=-0.002
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.125-0.121=0.004
σ0.006-0.004=0.002
min0.118-0.116=0.002
max0.137-0.127=0.009

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.961-1006.961=0.000
σ0.879-0.897=-0.019
min1006.473-1006.475=-0.002
max1010.604-1010.684=-0.080
mean1036.650-1054.350=-17.700
σ301.419-308.223=-6.803
min546.000-577.000=-31.000
max1583.000-1619.000=-36.000
mean1.573-1.552=0.021
σ0.123-0.056=0.066
min1.390-1.496=-0.106
max1.882-1.689=0.193

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.883=0.000
σ0.002-0.003=-0.000
min0.882
max0.887
mean1583.000-1619.000=-36.000
σ0.000
min1583.000-1619.000=-36.000
max1583.000-1619.000=-36.000
mean0.404-0.414=-0.010
σ0.124-0.131=-0.007
min0.329-0.330=-0.001
max0.623-0.646=-0.023
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1583.000-1619.000=-36.000
σ0.000
min1583.000-1619.000=-36.000
max1583.000-1619.000=-36.000
mean0.879-0.882=-0.003
σ0.078-0.094=-0.016
min0.827-0.827=0.000
max1.015-1.047=-0.033
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1583.000-1619.000=-36.000
σ0.000
min1583.000-1619.000=-36.000
max1583.000-1619.000=-36.000
mean0.539-0.543=-0.004
σ0.048-0.052=-0.004
min0.501-0.492=0.009
max0.621-0.627=-0.006
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1583.000-1619.000=-36.000
σ0.000
min1583.000-1619.000=-36.000
max1583.000-1619.000=-36.000
mean0.855-0.840=0.015
σ0.034-0.045=-0.012
min0.830-0.799=0.031
max0.914-0.917=-0.003

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.836-964.839=-0.004
σ0.028-0.032=-0.003
min964.815-964.812=0.003
max964.885-964.894=-0.009
mean1583.000-1619.000=-36.000
σ0.000
min1583.000-1619.000=-36.000
max1583.000-1619.000=-36.000
mean0.830-0.842=-0.012
σ0.030-0.023=0.007
min0.789-0.800=-0.012
max0.857-0.859=-0.002
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.006-0.004=0.003
min885.504-885.505=-0.001
max885.520-885.515=0.005
mean1583.000-1619.000=-36.000
σ0.000
min1583.000-1619.000=-36.000
max1583.000-1619.000=-36.000
mean0.719-0.738=-0.019
σ0.032-0.003=0.030
min0.662-0.735=-0.072
max0.741-0.742=-0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.721-7.722=-0.002
mean1583.000-1619.000=-36.000
σ0.000
min1583.000-1619.000=-36.000
max1583.000-1619.000=-36.000
mean4.197-4.268=-0.071
σ0.074-0.104=-0.030
min4.034-4.114=-0.080
max4.443-4.959=-0.515
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1583.000-1619.000=-36.000
σ0.000
min1583.000-1619.000=-36.000
max1583.000-1619.000=-36.000
mean4.207-4.237=-0.031
σ0.068-0.082=-0.014
min4.068-4.095=-0.027
max4.378-4.516=-0.138
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1583.000-1619.000=-36.000
σ0.000
min1583.000-1619.000=-36.000
max1583.000-1619.000=-36.000
mean0.748-0.748=-0.000
σ0.020-0.021=-0.001
min0.712-0.710=0.002
max0.867-0.873=-0.006
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1583.000-1619.000=-36.000
σ0.000
min1583.000-1619.000=-36.000
max1583.000-1619.000=-36.000
mean0.706-0.713=-0.006
σ0.025-0.026=-0.001
min0.517-0.528=-0.011
max0.786-0.786=0.000

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.724-295.377=0.347
σ0.199-0.169=0.030
min295.581-295.228=0.353
max296.261-295.812=0.449
mean1903.000-2026.000=-123.000
σ0.000
min1903.000-2026.000=-123.000
max1903.000-2026.000=-123.000
mean0.582-0.534=0.048
σ0.033-0.032=0.001
min0.508-0.498=0.010
max0.617-0.574=0.042

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.396-285.393=0.002
σ0.036-0.038=-0.002
min285.350-285.348=0.002
max285.435-285.442=-0.007
mean1583.000-1619.000=-36.000
σ0.000
min1583.000-1619.000=-36.000
max1583.000-1619.000=-36.000
mean0.388-0.388=-0.000
σ0.005-0.006=-0.001
min0.381-0.381=0.000
max0.392-0.394=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.777-1295.739=0.038
σ0.114-0.119=-0.005
min1295.662-1295.653=0.009
max1295.919-1295.932=-0.013
mean1583.000-1619.000=-36.000
σ0.000
min1583.000-1619.000=-36.000
max1583.000-1619.000=-36.000
mean1.905-1.954=-0.050
σ0.086-0.190=-0.103
min1.804-1.800=0.004
max2.012-2.258=-0.246
iters=5
new-facts=6402
prior-facts=1
mean1539.917-1539.957=-0.040
σ6.860-6.792=0.068
min1536.631-1536.804=-0.173
max1552.182-1552.105=0.078
mean1583.000-1619.000=-36.000
σ0.000
min1583.000-1619.000=-36.000
max1583.000-1619.000=-36.000
mean2.303-2.302=0.001
σ0.207-0.263=-0.056
min2.045-2.096=-0.051
max2.500-2.746=-0.246
iters=5
new-facts=6402
prior-facts=6402
mean1857.686-1857.689=-0.003
σ0.063-0.055=0.009
min1857.613-1857.619=-0.006
max1857.771-1857.759=0.012
mean1760.000-1764.600=-4.600
σ143.607-178.071=-34.464
min1583.000-1619.000=-36.000
max1903.000-2026.000=-123.000
mean3.092-2.927=0.165
σ0.332-0.151=0.181
min2.893-2.817=0.075
max3.669-3.173=0.496

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.249-1.287=-0.037
σ0.341-0.313=0.028
min0.927-1.060=-0.133
max1.736-1.825=-0.090

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.706-445.707=-0.001
σ580.934-580.933=0.001
min155.238-155.239=-0.001
max1317.107-1317.107=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1583.000-1619.000=-36.000
σ0.000
min1583.000-1619.000=-36.000
max1583.000-1619.000=-36.000
mean0.541-0.534=0.007
σ0.559-0.556=0.002
min0.261-0.255=0.006
max1.379-1.368=0.010
policies=20
mean1552.647-1552.659=-0.012
σ0.324-0.331=-0.007
min1552.422-1552.430=-0.007
max1553.128-1553.150=-0.022
mean920.000
σ0.000
min920.000
max920.000
mean1583.000-1619.000=-36.000
σ0.000
min1583.000-1619.000=-36.000
max1583.000-1619.000=-36.000
mean2.579-2.590=-0.011
σ0.013-0.022=-0.009
min2.564-2.561=0.002
max2.592-2.612=-0.020
policies=200
mean15534.632-15534.644=-0.012
σ0.074-0.176=-0.101
min15534.557-15534.463=0.094
max15534.730-15534.884=-0.154
mean9200.000
σ0.000
min9200.000
max9200.000
mean1583.000-1619.000=-36.000
σ0.000
min1583.000-1619.000=-36.000
max1583.000-1619.000=-36.000
mean26.112-26.123=-0.011
σ0.274-0.161=0.114
min25.937-25.899=0.038
max26.520-26.280=0.241