240774cddb1a06ae0116cfa5009c49c2870aa577

Home / Branches / sergeiwinitzki/lan-71-investigate-reducing-the-memory-impact-of-tables / 240774cddb1a06ae0116cfa5009c49c2870aa577

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.579
σ0.342
min54.451
max55.552
mean418.000
σ0.000
min418.000
max418.000
mean0.141
σ0.005
min0.133
max0.149
cache=y
dps=1
iters=10
policies=100
mean43.704
σ0.005
min43.695
max43.710
mean418.000
σ0.000
min418.000
max418.000
mean0.123
σ0.005
min0.117
max0.131

CSV - indexed operations

Factorallocated MiBpeak allocated MiBtime (ms)
op=column_set() on indexed
mean36.617
σ0.002
min36.615
max36.620
mean3888.750
σ1859.158
min1280.000
max6184.000
mean13.478
σ1.653
min12.473
max17.490
op=column_set() on indexed, repeat
mean36.617
σ0.002
min36.616
max36.620
mean3888.750
σ1859.158
min1280.000
max6184.000
mean13.288
σ2.064
min11.967
max18.136
op=table_records(), no indexes
mean41.930
σ0.002
min41.928
max41.932
mean6184.000
σ0.000
min6184.000
max6184.000
mean11.596
σ0.179
min11.360
max11.783
op=table_records(), repeat
mean41.928
σ0.002
min41.927
max41.932
mean3741.375
σ1832.473
min1280.000
max6184.000
mean11.871
σ1.195
min11.165
max14.753
op=vertical_lookup_list() on indexed, after table_records()
mean27.653
σ0.136
min27.603
max27.990
mean3741.375
σ1832.473
min1280.000
max6184.000
mean8.943
σ0.427
min8.426
max9.598
op=vertical_lookup_list() on indexed, after table_records(), repeat
mean26.401
σ0.002
min26.399
max26.403
mean3741.375
σ1832.473
min1280.000
max6184.000
mean6.889
σ0.613
min5.722
max7.382
op=vertical_lookup_row_list() on 2 indexed
mean25.666
σ0.002
min25.664
max25.669
mean3888.750
σ1859.158
min1280.000
max6184.000
mean6.255
σ0.564
min5.872
max7.606
op=vertical_lookup_row_list() on 3 (1 unindexed)
mean25.969
σ0.002
min25.967
max25.972
mean3888.750
σ1859.158
min1280.000
max6184.000
mean6.039
σ0.530
min5.797
max7.346

CSV - loading a lazy table

Factorallocated MiBpeak allocated MiBtime (ms)
op=load_product(), no indexes
mean2524.604
σ0.002
min2524.602
max2524.606
mean6184.000
σ0.000
min6184.000
max6184.000
mean1308.682
σ460.349
min1057.355
max2179.044
op=load_product(), with indexes
mean2956.548
σ0.469
min2956.381
max2957.710
mean3245.000
σ1850.558
min810.000
max6184.000
mean1739.216
σ573.100
min1361.528
max2891.874

CSV - unindexed operations

Factorallocated MiBpeak allocated MiBtime (ms)
op=column_set() on unindexed, dense
mean62.078
σ0.002
min62.076
max62.080
mean3888.750
σ1859.158
min1280.000
max6184.000
mean165.156
σ242.742
min67.217
max764.993
op=vertical_lookup_list() on unindexed missing Int
mean40.945
σ0.002
min40.944
max40.949
mean6184.000
σ0.000
min6184.000
max6184.000
mean54.426
σ3.922
min52.290
max63.824
op=vertical_lookup_row_list() on unindexed small unique Int
mean66.687
σ0.002
min66.685
max66.690
mean6184.000
σ0.000
min6184.000
max6184.000
mean91.352
σ5.834
min88.109
max105.046

CSV - warmup

Factorallocated MiBpeak allocated MiBtime (ms)
op=table_records()
mean1792.405
σ4.324
min1790.874
max1803.107
mean3741.375
σ1832.473
min1280.000
max6184.000
mean2463.868
σ304.534
min2135.778
max2902.490
op=vertical_lookup_list() on indexed
mean734.407
σ0.002
min734.404
max734.409
mean6184.000
σ0.000
min6184.000
max6184.000
mean2321.398
σ549.670
min2026.611
max3512.928

CSV internal benchmark: pointedIndexFromKvs

Factorallocated MiBpeak allocated MiBtime (ms)
op=pointedIndexFromKvs
rows=200000
mean172.559
σ0.001
min172.558
max172.562
mean477.000
σ0.000
min477.000
max477.000
mean375.482
σ25.010
min338.244
max400.259
op=pointedIndexFromKvs
rows=400000
mean357.322
σ0.001
min357.321
max357.325
mean560.000
σ0.000
min560.000
max560.000
mean740.897
σ53.783
min641.137
max788.502

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1008.502
σ0.759
min1008.026
max1011.643
mean1052.350
σ302.256
min574.000
max1469.000
mean1.541
σ0.089
min1.463
max1.789

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.913
σ0.020
min0.903
max0.949
mean401.000
σ0.000
min401.000
max401.000
mean0.380
σ0.450
min0.149
max1.181
name=error_case.art
mean2.339
σ0.012
min2.333
max2.361
mean401.000
σ0.000
min401.000
max401.000
mean0.423
σ0.196
min0.325
max0.773
name=heavy_item.art
mean1.522
σ0.002
min1.521
max1.525
mean401.000
σ0.000
min401.000
max401.000
mean0.224
σ0.022
min0.202
max0.259
name=nested_use.art
mean2.357
σ0.002
min2.356
max2.360
mean401.000
σ0.000
min401.000
max401.000
mean0.343
σ0.021
min0.327
max0.379

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.741
σ0.011
min964.736
max964.760
mean435.600
σ6.066
min430.000
max442.000
mean0.569
σ0.033
min0.519
max0.596
name=cdr_enhanced_4k_loc.art
mean885.814
σ0.002
min885.812
max885.816
mean442.000
σ0.000
min442.000
max442.000
mean0.489
σ0.045
min0.422
max0.536

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.708
σ0.002
min7.707
max7.711
mean442.000
σ0.000
min442.000
max442.000
mean1.965
σ0.071
min1.850
max2.246
name=record_render_large_syntax_err.art
mean7.656
σ0.002
min7.655
max7.659
mean442.000
σ0.000
min442.000
max442.000
mean1.969
σ0.091
min1.825
max2.638
name=record_render_success.art
mean2.289
σ0.002
min2.288
max2.292
mean442.000
σ0.000
min442.000
max442.000
mean0.303
σ0.009
min0.291
max0.360
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean442.000
σ0.000
min442.000
max442.000
mean0.296
σ0.051
min0.276
max0.791

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean298.092
σ1.019
min297.653
max300.984
mean441.200
σ15.083
min418.000
max468.000
mean0.609
σ0.010
min0.584
max0.618

Timed compile per phase

Factorallocated MiBpeak allocated MiBtime (ms)
phase=buildDeclTree
mean222.008
σ0.000
min222.008
max222.008
mean1008.125
σ0.991
min1006.000
max1009.000
mean201.170
σ1.813
min198.819
max204.316
phase=macro expansion
mean6.130
σ0.000
min6.130
max6.130
mean1008.125
σ0.991
min1006.000
max1009.000
mean11.182
σ2.677
min6.504
max12.732
phase=parser
mean1042.101
σ0.000
min1042.100
max1042.101
mean1008.125
σ0.991
min1006.000
max1009.000
mean663.154
σ106.452
min429.420
max730.453
phase=processProdDef
mean4817.023
σ0.000
min4817.023
max4817.024
mean1008.500
σ0.535
min1008.000
max1009.000
mean4830.843
σ778.059
min3613.009
max6087.181
phase=renaming
mean21.667
σ0.000
min21.667
max21.667
mean1008.125
σ0.991
min1006.000
max1009.000
mean41.595
σ11.307
min20.711
max48.398
phase=type checker
mean958.461
σ0.066
min958.363
max958.551
mean1008.125
σ0.991
min1006.000
max1009.000
mean810.478
σ101.338
min661.082
max905.269

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean293.688
σ0.037
min293.636
max293.727
mean441.200
σ1.643
min440.000
max443.000
mean0.407
σ0.010
min0.399
max0.419
iters=5
new-facts=1
prior-facts=6402
mean1303.793
σ0.053
min1303.712
max1303.840
mean1062.800
σ168.105
min841.000
max1272.000
mean2.023
σ0.198
min1.804
max2.219
iters=5
new-facts=6402
prior-facts=1
mean1545.376
σ0.866
min1544.760
max1546.896
mean611.000
σ74.783
min493.000
max690.000
mean2.251
σ0.250
min1.915
max2.583
iters=5
new-facts=6402
prior-facts=6402
mean1865.799
σ0.054
min1865.742
max1865.880
mean1712.800
σ249.845
min1419.000
max2066.000
mean2.973
σ0.115
min2.885
max3.146

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.786
σ0.097
min1.667
max1.887

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean386.254
σ451.594
min160.452
max1063.646
mean102.250
σ8.500
min98.000
max115.000
mean441.000
σ0.000
min441.000
max441.000
mean0.513
σ0.489
min0.267
max1.247
policies=20
mean1604.894
σ0.420
min1604.606
max1605.519
mean980.000
σ0.000
min980.000
max980.000
mean447.000
σ6.928
min441.000
max453.000
mean2.697
σ0.024
min2.682
max2.732
policies=200
mean16057.277
σ0.204
min16057.056
max16057.546
mean9800.000
σ0.000
min9800.000
max9800.000
mean496.250
σ4.573
min491.000
max502.000
mean27.148
σ0.160
min26.986
max27.305