6a5fc74a1d79f2b5ba4af7af43ee19552c72a74d

Home / Branches / danbrooks/exp-1442-implement-sectioned-mrc-import-progress-section-picker / 6a5fc74a1d79f2b5ba4af7af43ee19552c72a74d

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.618
σ0.348
min54.485
max55.607
mean416.000
σ0.000
min416.000
max416.000
mean0.139
σ0.005
min0.133
max0.146
cache=y
dps=1
iters=10
policies=100
mean43.788
σ0.006
min43.780
max43.800
mean416.000
σ0.000
min416.000
max416.000
mean0.123
σ0.004
min0.120
max0.130

CSV - indexed operations

Factorallocated MiBpeak allocated MiBtime (ms)
op=column_set() on indexed
mean36.618
σ0.002
min36.615
max36.620
mean4111.125
σ1551.211
min2068.000
max6037.000
mean12.401
σ0.218
min12.156
max12.653
op=column_set() on indexed, repeat
mean36.617
σ0.002
min36.615
max36.620
mean4111.125
σ1551.211
min2068.000
max6037.000
mean12.583
σ0.609
min11.401
max13.127
op=table_records(), no indexes
mean41.928
σ0.000
min41.928
max41.929
mean6037.000
σ0.000
min6037.000
max6037.000
mean13.348
σ1.187
min11.010
max14.700
op=table_records(), repeat
mean41.928
σ0.002
min41.927
max41.932
mean4111.125
σ1551.211
min2068.000
max6037.000
mean12.365
σ2.007
min10.442
max14.799
op=vertical_lookup_list() on indexed, after table_records()
mean27.605
σ0.002
min27.603
max27.607
mean4111.125
σ1551.211
min2068.000
max6037.000
mean8.441
σ0.306
min8.056
max8.827
op=vertical_lookup_list() on indexed, after table_records(), repeat
mean26.401
σ0.002
min26.399
max26.403
mean4111.125
σ1551.211
min2068.000
max6037.000
mean6.545
σ0.177
min6.299
max6.883
op=vertical_lookup_row_list() on 2 indexed
mean25.666
σ0.002
min25.664
max25.670
mean4111.125
σ1551.211
min2068.000
max6037.000
mean5.531
σ0.093
min5.393
max5.631
op=vertical_lookup_row_list() on 3 (1 unindexed)
mean25.968
σ0.002
min25.967
max25.971
mean4111.125
σ1551.211
min2068.000
max6037.000
mean5.432
σ0.131
min5.245
max5.711

CSV - loading a lazy table

Factorallocated MiBpeak allocated MiBtime (ms)
op=load_product(), no indexes
mean2524.603
σ0.000
min2524.603
max2524.603
mean6037.000
σ0.000
min6037.000
max6037.000
mean1566.267
σ823.448
min1049.414
max3007.520
op=load_product(), with indexes
mean8744.567
σ0.033
min8744.554
max8744.649
mean3840.250
σ1619.368
min2068.000
max6037.000
mean4413.846
σ1097.082
min3570.626
max6245.260

CSV - unindexed operations

Factorallocated MiBpeak allocated MiBtime (ms)
op=column_set() on unindexed, dense
mean62.077
σ0.002
min62.076
max62.080
mean4111.125
σ1551.211
min2068.000
max6037.000
mean81.529
σ10.321
min71.372
max97.880
op=vertical_lookup_list() on unindexed missing Int
mean40.944
σ0.001
min40.944
max40.945
mean6037.000
σ0.000
min6037.000
max6037.000
mean94.957
σ12.185
min73.289
max107.663
op=vertical_lookup_row_list() on unindexed small unique Int
mean66.686
σ0.000
min66.685
max66.687
mean6037.000
σ0.000
min6037.000
max6037.000
mean221.394
σ229.008
min108.137
max786.412

CSV - warmup

Factorallocated MiBpeak allocated MiBtime (ms)
op=table_records()
mean11656.833
σ4.317
min11655.305
max11667.517
mean4111.125
σ1551.211
min2068.000
max6037.000
mean6213.337
σ1380.079
min4965.882
max8267.611
op=vertical_lookup_list() on indexed
mean11560.069
σ0.001
min11560.068
max11560.070
mean6037.000
σ0.000
min6037.000
max6037.000
mean6600.241
σ1431.956
min4424.035
max7929.616

CSV internal benchmark: pointedIndexFromKvs

Factorallocated MiBpeak allocated MiBtime (ms)
op=pointedIndexFromKvs
rows=200000
mean172.590
σ0.028
min172.558
max172.626
mean2068.000
σ0.000
min2068.000
max2068.000
mean364.411
σ44.193
min324.730
max456.535
op=pointedIndexFromKvs
rows=400000
mean357.367
σ0.035
min357.321
max357.408
mean2068.000
σ0.000
min2068.000
max2068.000
mean733.275
σ49.857
min651.385
max800.037

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1008.480
σ0.875
min1007.980
max1012.105
mean1039.550
σ304.928
min546.000
max1465.000
mean1.513
σ0.079
min1.433
max1.739

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.002
min0.881
max0.886
mean1465.000
σ0.000
min1465.000
max1465.000
mean0.445
σ0.188
min0.342
max0.781
name=error_case.art
mean2.334
σ0.002
min2.332
max2.337
mean1465.000
σ0.000
min1465.000
max1465.000
mean0.922
σ0.157
min0.833
max1.201
name=heavy_item.art
mean1.521
σ0.002
min1.520
max1.524
mean1465.000
σ0.000
min1465.000
max1465.000
mean0.539
σ0.050
min0.490
max0.619
name=nested_use.art
mean2.356
σ0.002
min2.355
max2.358
mean1465.000
σ0.000
min1465.000
max1465.000
mean0.844
σ0.043
min0.812
max0.913

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.920
σ0.027
min963.902
max963.966
mean1465.000
σ0.000
min1465.000
max1465.000
mean0.806
σ0.018
min0.775
max0.820
name=cdr_enhanced_4k_loc.art
mean884.889
σ0.006
min884.883
max884.894
mean1465.000
σ0.000
min1465.000
max1465.000
mean0.744
σ0.003
min0.741
max0.748

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706
σ0.002
min7.705
max7.709
mean1465.000
σ0.000
min1465.000
max1465.000
mean3.579
σ0.082
min3.430
max3.991
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1465.000
σ0.000
min1465.000
max1465.000
mean4.178
σ0.275
min3.509
max4.609
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1465.000
σ0.000
min1465.000
max1465.000
mean0.746
σ0.017
min0.715
max0.846
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1465.000
σ0.000
min1465.000
max1465.000
mean0.713
σ0.014
min0.682
max0.765

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.700
σ0.263
min297.472
max298.403
mean2068.000
σ0.000
min2068.000
max2068.000
mean0.573
σ0.044
min0.501
max0.620

Timed compile per phase

Factorallocated MiBpeak allocated MiBtime (ms)
phase=buildDeclTree
mean222.011
σ0.000
min222.011
max222.011
mean1616.125
σ70.379
min1465.000
max1652.000
mean202.753
σ2.588
min198.303
max206.540
phase=macro expansion
mean6.133
σ0.000
min6.133
max6.133
mean1616.125
σ70.379
min1465.000
max1652.000
mean9.942
σ2.440
min6.244
max12.679
phase=parser
mean1041.159
σ0.000
min1041.158
max1041.159
mean1616.125
σ70.379
min1465.000
max1652.000
mean595.319
σ134.517
min383.391
max724.999
phase=processProdDef
mean6169.660
σ0.001
min6169.659
max6169.661
mean1639.500
σ35.355
min1552.000
max1652.000
mean6130.895
σ972.797
min3947.107
max7218.997
phase=renaming
mean21.667
σ0.000
min21.667
max21.667
mean1616.125
σ70.379
min1465.000
max1652.000
mean40.321
σ8.012
min26.148
max48.098
phase=type checker
mean958.690
σ0.055
min958.604
max958.760
mean1616.125
σ70.379
min1465.000
max1652.000
mean748.305
σ79.676
min656.820
max874.388

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean292.998
σ0.038
min292.946
max293.035
mean1652.000
σ0.000
min1652.000
max1652.000
mean0.404
σ0.012
min0.392
max0.417
iters=5
new-facts=1
prior-facts=6402
mean1302.826
σ0.116
min1302.731
max1303.015
mean1652.000
σ0.000
min1652.000
max1652.000
mean1.909
σ0.156
min1.804
max2.175
iters=5
new-facts=6402
prior-facts=1
mean1545.878
σ4.077
min1543.839
max1553.166
mean1652.000
σ0.000
min1652.000
max1652.000
mean2.351
σ0.335
min2.121
max2.919
iters=5
new-facts=6402
prior-facts=6402
mean1864.868
σ0.053
min1864.810
max1864.922
mean1782.400
σ180.745
min1652.000
max2068.000
mean2.928
σ0.069
min2.876
max3.020

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.796
σ0.132
min1.567
max1.891

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean446.792
σ577.190
min158.193
max1312.577
mean96.250
σ8.500
min92.000
max109.000
mean1652.000
σ0.000
min1652.000
max1652.000
mean0.454
σ0.354
min0.273
max0.985
policies=20
mean1582.281
σ0.410
min1582.009
max1582.892
mean920.000
σ0.000
min920.000
max920.000
mean1652.000
σ0.000
min1652.000
max1652.000
mean2.724
σ0.014
min2.714
max2.744
policies=200
mean15830.762
σ0.153
min15830.602
max15830.970
mean9200.000
σ0.000
min9200.000
max9200.000
mean1652.000
σ0.000
min1652.000
max1652.000
mean26.603
σ0.153
min26.403
max26.765