Compare commits

Home / Compare ec680cd7 .. cd359361

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-53.964=0.091
σ0.370-0.371=-0.000
min53.912-53.819=0.093
max55.109-55.018=0.091
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.143-0.137=0.006
σ0.006-0.004=0.002
min0.136-0.130=0.006
max0.156-0.143=0.013
cache=y
dps=1
iters=10
policies=100
mean43.394-43.322=0.072
σ0.007-0.007=-0.000
min43.386-43.312=0.074
max43.405-43.336=0.069
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.126-0.121=0.005
σ0.010-0.002=0.008
min0.114-0.118=-0.004
max0.147-0.125=0.022

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.006-1006.512=0.494
σ1.209-1.169=0.039
min1006.433-1005.949=0.485
max1012.075-1011.410=0.665
mean1053.800-1056.150=-2.350
σ308.918-316.025=-7.107
min579.000-568.000=11.000
max1652.000-1619.000=33.000
mean1.557-1.536=0.022
σ0.061-0.056=0.005
min1.479-1.465=0.014
max1.692-1.649=0.042

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1652.000-1619.000=33.000
σ0.000
min1652.000-1619.000=33.000
max1652.000-1619.000=33.000
mean0.423-0.402=0.021
σ0.151-0.131=0.020
min0.350-0.315=0.035
max0.692-0.631=0.061
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1652.000-1619.000=33.000
σ0.000
min1652.000-1619.000=33.000
max1652.000-1619.000=33.000
mean0.897-0.876=0.021
σ0.097-0.093=0.004
min0.831-0.805=0.026
max1.068-1.034=0.034
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1652.000-1619.000=33.000
σ0.000
min1652.000-1619.000=33.000
max1652.000-1619.000=33.000
mean0.531-0.517=0.014
σ0.049-0.062=-0.014
min0.495-0.468=0.027
max0.614-0.620=-0.006
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1652.000-1619.000=33.000
σ0.000
min1652.000-1619.000=33.000
max1652.000-1619.000=33.000
mean0.845-0.849=-0.004
σ0.037-0.053=-0.016
min0.812-0.812=-0.000
max0.905-0.940=-0.035

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.839=0.000
σ0.033-0.032=0.000
min964.813-964.811=0.001
max964.894-964.894=-0.001
mean1652.000-1619.000=33.000
σ0.000
min1652.000-1619.000=33.000
max1652.000-1619.000=33.000
mean0.848-0.823=0.025
σ0.026-0.051=-0.025
min0.803-0.743=0.060
max0.872-0.867=0.005
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.007-0.007=-0.000
min885.504
max885.522-885.522=0.000
mean1652.000-1619.000=33.000
σ0.000
min1652.000-1619.000=33.000
max1652.000-1619.000=33.000
mean0.711-0.716=-0.005
σ0.032-0.024=0.007
min0.680-0.685=-0.005
max0.746-0.737=0.009

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.721=-0.000
mean1652.000-1619.000=33.000
σ0.000
min1652.000-1619.000=33.000
max1652.000-1619.000=33.000
mean4.234-3.467=0.767
σ0.075-0.084=-0.008
min4.092-3.310=0.782
max4.538-3.915=0.623
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1652.000-1619.000=33.000
σ0.000
min1652.000-1619.000=33.000
max1652.000-1619.000=33.000
mean4.242-3.448=0.794
σ0.096-0.067=0.029
min4.089-3.349=0.739
max4.524-3.726=0.798
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1652.000-1619.000=33.000
σ0.000
min1652.000-1619.000=33.000
max1652.000-1619.000=33.000
mean0.740-0.581=0.159
σ0.039-0.094=-0.055
min0.542-0.505=0.037
max0.937-0.831=0.106
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1652.000-1619.000=33.000
σ0.000
min1652.000-1619.000=33.000
max1652.000-1619.000=33.000
mean0.697-0.508=0.189
σ0.016-0.011=0.004
min0.665-0.477=0.188
max0.781-0.551=0.230

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.830-296.344=0.486
σ0.266-0.250=0.016
min296.633-296.192=0.441
max297.569-297.033=0.536
mean1899.000-2027.000=-128.000
σ0.000
min1899.000-2027.000=-128.000
max1899.000-2027.000=-128.000
mean0.592-0.587=0.005
σ0.033-0.008=0.025
min0.556-0.576=-0.019
max0.673-0.597=0.076

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.821-285.032=1.789
σ0.039-0.041=-0.003
min286.770-284.977=1.793
max286.860-285.074=1.786
mean1652.000-1619.000=33.000
σ0.000
min1652.000-1619.000=33.000
max1652.000-1619.000=33.000
mean0.396-0.395=0.000
σ0.007-0.008=-0.000
min0.387-0.387=0.001
max0.401-0.404=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1297.226-1295.423=1.803
σ0.076-0.111=-0.035
min1297.131-1295.299=1.832
max1297.300-1295.563=1.737
mean1652.000-1619.000=33.000
σ0.000
min1652.000-1619.000=33.000
max1652.000-1619.000=33.000
mean2.039-1.893=0.146
σ0.059-0.088=-0.029
min1.993-1.821=0.172
max2.139-2.029=0.110
iters=5
new-facts=6402
prior-facts=1
mean1541.317-1539.512=1.805
σ6.837-6.847=-0.010
min1538.058-1536.236=1.822
max1553.542-1551.756=1.786
mean1652.000-1619.000=33.000
σ0.000
min1652.000-1619.000=33.000
max1652.000-1619.000=33.000
mean2.247-2.291=-0.044
σ0.139-0.227=-0.089
min2.087-2.047=0.040
max2.415-2.529=-0.114
iters=5
new-facts=6402
prior-facts=6402
mean1859.114-1857.328=1.785
σ0.079-0.060=0.019
min1858.995-1857.267=1.728
max1859.187-1857.406=1.781
mean1770.600-1774.800=-4.200
σ122.680-176.579=-53.899
min1652.000-1619.000=33.000
max1899.000-2027.000=-128.000
mean3.096-3.037=0.059
σ0.265-0.247=0.018
min2.872-2.836=0.035
max3.547-3.447=0.100

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.225-1.268=-0.043
σ0.340-0.321=0.019
min0.938-0.927=0.010
max1.793-1.761=0.032

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.191=0.629
σ581.372-581.332=0.041
min158.131-157.524=0.607
max1320.879-1320.189=0.690
mean96.250
σ8.500
min92.000
max109.000
mean1652.000-1619.000=33.000
σ0.000
min1652.000-1619.000=33.000
max1652.000-1619.000=33.000
mean0.537-0.566=-0.028
σ0.547-0.606=-0.059
min0.262-0.261=0.000
max1.358-1.475=-0.117
policies=20
mean1581.629-1575.572=6.057
σ0.359-0.359=-0.000
min1581.387-1575.333=6.054
max1582.163-1576.107=6.056
mean920.000
σ0.000
min920.000
max920.000
mean1652.000-1619.000=33.000
σ0.000
min1652.000-1619.000=33.000
max1652.000-1619.000=33.000
mean2.638-2.634=0.004
σ0.020-0.012=0.008
min2.625-2.626=-0.001
max2.668-2.652=0.016
policies=200
mean15824.218-15763.731=60.487
σ0.037-0.086=-0.049
min15824.182-15763.665=60.517
max15824.263-15763.855=60.408
mean9200.000
σ0.000
min9200.000
max9200.000
mean1652.000-1619.000=33.000
σ0.000
min1652.000-1619.000=33.000
max1652.000-1619.000=33.000
mean26.637-26.528=0.110
σ0.058-0.085=-0.027
min26.555-26.439=0.116
max26.679-26.643=0.037