Compare commits

Home / Compare 76e27af4 .. 28cf7739

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.057-54.054=0.002
σ0.369-0.370=-0.001
min53.910-53.910=0.000
max55.105-55.106=-0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.139-0.139=0.000
σ0.004-0.003=0.001
min0.134-0.136=-0.002
max0.146-0.146=0.000
cache=y
dps=1
iters=10
policies=100
mean43.395-43.392=0.003
σ0.006-0.005=0.001
min43.385-43.386=-0.001
max43.406-43.398=0.008
mean415.000
σ0.000
min415.000
max415.000
mean0.120-0.120=0.001
σ0.004-0.003=0.000
min0.115-0.114=0.001
max0.127-0.124=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.922-1007.006=-0.084
σ0.898-1.190=-0.292
min1006.456-1006.432=0.023
max1010.647-1011.989=-1.341
mean1048.900-1044.500=4.400
σ317.382-305.405=11.977
min546.000-585.000=-39.000
max1649.000-1616.000=33.000
mean1.580-1.539=0.040
σ0.098-0.098=-0.000
min1.470-1.465=0.005
max1.839-1.922=-0.083

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.884=-0.000
σ0.003-0.002=0.000
min0.882
max0.887
mean1649.000-1616.000=33.000
σ0.000
min1649.000-1616.000=33.000
max1649.000-1616.000=33.000
mean0.416-0.419=-0.003
σ0.127-0.141=-0.014
min0.347-0.349=-0.001
max0.643-0.671=-0.029
name=error_case.art
mean2.339-2.339=-0.001
σ0.003-0.003=-0.001
min2.337
max2.342-2.344=-0.002
mean1649.000-1616.000=33.000
σ0.000
min1649.000-1616.000=33.000
max1649.000-1616.000=33.000
mean0.911-0.936=-0.025
σ0.088-0.185=-0.097
min0.842-0.838=0.004
max1.045-1.267=-0.221
name=heavy_item.art
mean1.524-1.524=-0.000
σ0.002-0.002=-0.000
min1.522
max1.526-1.527=-0.001
mean1649.000-1616.000=33.000
σ0.000
min1649.000-1616.000=33.000
max1649.000-1616.000=33.000
mean0.518-0.516=0.002
σ0.052-0.055=-0.003
min0.471-0.479=-0.009
max0.604-0.613=-0.009
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1649.000-1616.000=33.000
σ0.000
min1649.000-1616.000=33.000
max1649.000-1616.000=33.000
mean0.836-0.831=0.005
σ0.054-0.041=0.012
min0.792-0.802=-0.010
max0.927-0.904=0.023

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.836=0.004
σ0.035-0.019=0.015
min964.809-964.820=-0.010
max964.896-964.868=0.028
mean1649.000-1616.000=33.000
σ0.000
min1649.000-1616.000=33.000
max1649.000-1616.000=33.000
mean0.850-0.810=0.040
σ0.009-0.056=-0.047
min0.842-0.743=0.099
max0.862-0.856=0.007
name=cdr_enhanced_4k_loc.art
mean885.511-885.512=-0.001
σ0.007-0.007=-0.000
min885.504
max885.522-885.523=-0.001
mean1649.000-1616.000=33.000
σ0.000
min1649.000-1616.000=33.000
max1649.000-1616.000=33.000
mean0.721-0.710=0.011
σ0.030-0.040=-0.010
min0.669-0.663=0.006
max0.743-0.741=0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1649.000-1616.000=33.000
σ0.000
min1649.000-1616.000=33.000
max1649.000-1616.000=33.000
mean4.212-3.485=0.727
σ0.069-0.095=-0.025
min4.084-3.312=0.772
max4.572-3.802=0.770
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.002
mean1649.000-1616.000=33.000
σ0.000
min1649.000-1616.000=33.000
max1649.000-1616.000=33.000
mean4.234-3.781=0.454
σ0.085-0.389=-0.304
min4.073-3.333=0.740
max4.496-4.481=0.015
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1649.000-1616.000=33.000
σ0.000
min1649.000-1616.000=33.000
max1649.000-1616.000=33.000
mean0.733-0.749=-0.016
σ0.022-0.024=-0.003
min0.697-0.659=0.038
max0.854-0.855=-0.001
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1649.000-1616.000=33.000
σ0.000
min1649.000-1616.000=33.000
max1649.000-1616.000=33.000
mean0.693-0.666=0.026
σ0.016-0.082=-0.066
min0.662-0.483=0.179
max0.761-0.768=-0.008

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.440-297.139=-1.699
σ0.199-0.201=-0.003
min295.280-296.948=-1.668
max295.964-297.677=-1.712
mean1898.000-2029.000=-131.000
σ0.000
min1898.000-2029.000=-131.000
max1898.000-2029.000=-131.000
mean0.584-0.547=0.036
σ0.039-0.033=0.006
min0.518-0.514=0.004
max0.666-0.609=0.057

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.357-286.819=-1.462
σ0.037-0.037=0.001
min285.307-286.767=-1.461
max285.396-286.856=-1.461
mean1649.000-1616.000=33.000
σ0.000
min1649.000-1616.000=33.000
max1649.000-1616.000=33.000
mean0.387-0.392=-0.005
σ0.009-0.007=0.001
min0.380-0.385=-0.005
max0.399-0.400=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.739-1297.251=-1.512
σ0.113-0.086=0.027
min1295.616-1297.145=-1.529
max1295.883-1297.365=-1.482
mean1649.000-1616.000=33.000
σ0.000
min1649.000-1616.000=33.000
max1649.000-1616.000=33.000
mean1.869-2.087=-0.217
σ0.116-0.093=0.023
min1.723-1.997=-0.274
max2.004-2.218=-0.214
iters=5
new-facts=6402
prior-facts=1
mean1539.845-1541.306=-1.461
σ6.814-6.833=-0.019
min1536.570-1538.051=-1.482
max1552.027-1553.524=-1.497
mean1649.000-1616.000=33.000
σ0.000
min1649.000-1616.000=33.000
max1649.000-1616.000=33.000
mean2.268-2.179=0.089
σ0.246-0.097=0.150
min2.005-2.092=-0.088
max2.582-2.342=0.240
iters=5
new-facts=6402
prior-facts=6402
mean1857.645-1859.108=-1.463
σ0.067-0.082=-0.015
min1857.565-1858.989=-1.424
max1857.737-1859.188=-1.451
mean1769.200-1773.200=-4.000
σ123.700-181.104=-57.404
min1649.000-1616.000=33.000
max1898.000-2029.000=-131.000
mean3.027-3.056=-0.029
σ0.299-0.197=0.101
min2.665-2.832=-0.166
max3.497-3.373=0.123

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.208-1.174=0.035
σ0.320-0.207=0.113
min0.929-0.936=-0.008
max1.740-1.419=0.321

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.488-448.822=-3.334
σ580.640-581.372=-0.732
min155.167-158.135=-2.968
max1316.449-1320.881=-4.432
mean96.250
σ8.500
min92.000
max109.000
mean1649.000-1616.000=33.000
σ0.000
min1649.000-1616.000=33.000
max1649.000-1616.000=33.000
mean0.533-0.549=-0.016
σ0.550-0.569=-0.019
min0.256-0.259=-0.003
max1.358-1.402=-0.044
policies=20
mean1551.926-1581.626=-29.700
σ0.324-0.361=-0.036
min1551.707-1581.386=-29.679
max1552.408-1582.163=-29.755
mean920.000
σ0.000
min920.000
max920.000
mean1649.000-1616.000=33.000
σ0.000
min1649.000-1616.000=33.000
max1649.000-1616.000=33.000
mean2.584-2.644=-0.059
σ0.028-0.017=0.010
min2.546-2.630=-0.084
max2.611-2.669=-0.058
policies=200
mean15527.568-15824.141=-296.573
σ0.233-0.175=0.058
min15527.292-15823.992=-296.700
max15527.851-15824.394=-296.542
mean9200.000
σ0.000
min9200.000
max9200.000
mean1649.000-1616.000=33.000
σ0.000
min1649.000-1616.000=33.000
max1649.000-1616.000=33.000
mean26.073-26.538=-0.464
σ0.065-0.072=-0.007
min26.011-26.448=-0.437
max26.148-26.624=-0.476