Compare commits

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.618
σ	0.349
min	54.480
max	55.610

*mean*	417.000
σ	0.000
min	417.000
max	417.000

*mean*	0.141
σ	0.004
min	0.138
max	0.149

cache=y

dps=1

iters=10

policies=100

*mean*	43.785
σ	0.006
min	43.779
max	43.796

*mean*	417.000
σ	0.000
min	417.000
max	417.000

*mean*	0.123
σ	0.004
min	0.120
max	0.129

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.002
min	36.616
max	36.620

*mean*	4258.875
σ	1893.704
min	1906.000
max	7553.000

*mean*	12.397
σ	0.461
min	11.597
max	12.874

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.002
min	36.616
max	36.619

*mean*	4258.875
σ	1893.704
min	1906.000
max	7553.000

*mean*	11.927
σ	0.843
min	10.864
max	12.903

op=table_records(), no indexes

*mean*	41.932
σ	0.000
min	41.932
max	41.933

*mean*	7553.000
σ	0.000
min	7553.000
max	7553.000

*mean*	13.824
σ	1.067
min	12.498
max	15.028

op=table_records(), repeat

*mean*	41.928
σ	0.002
min	41.927
max	41.931

*mean*	4258.875
σ	1893.704
min	1906.000
max	7553.000

*mean*	12.106
σ	1.798
min	10.278
max	14.638

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.605
σ	0.002
min	27.603
max	27.609

*mean*	4258.875
σ	1893.704
min	1906.000
max	7553.000

*mean*	8.437
σ	0.696
min	7.872
max	10.014

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.400
σ	0.002
min	26.399
max	26.403

*mean*	4258.875
σ	1893.704
min	1906.000
max	7553.000

*mean*	6.325
σ	0.733
min	5.819
max	8.071

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.666
σ	0.002
min	25.665
max	25.668

*mean*	4258.875
σ	1893.704
min	1906.000
max	7553.000

*mean*	5.383
σ	0.062
min	5.304
max	5.507

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.968
σ	0.002
min	25.967
max	25.971

*mean*	4258.875
σ	1893.704
min	1906.000
max	7553.000

*mean*	5.101
σ	0.169
min	4.871
max	5.363

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.597
σ	0.000
min	2524.597
max	2524.598

*mean*	7553.000
σ	0.000
min	7553.000
max	7553.000

*mean*	1048.702
σ	4.636
min	1039.723
max	1054.863

op=load_product(), with indexes

*mean*	8744.559
σ	0.034
min	8744.544
max	8744.643

*mean*	3771.500
σ	1633.859
min	1906.000
max	5949.000

*mean*	4401.660
σ	1399.965
min	3532.024
max	7354.243

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.078
σ	0.003
min	62.076
max	62.084

*mean*	4258.875
σ	1893.704
min	1906.000
max	7553.000

*mean*	84.854
σ	11.185
min	71.537
max	98.956

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.944
σ	0.001
min	40.944
max	40.945

*mean*	7553.000
σ	0.000
min	7553.000
max	7553.000

*mean*	247.614
σ	416.122
min	84.709
max	1277.295

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.686
σ	0.001
min	66.685
max	66.689

*mean*	7553.000
σ	0.000
min	7553.000
max	7553.000

*mean*	151.030
σ	13.409
min	133.600
max	168.009

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11656.833
σ	4.317
min	11655.305
max	11667.517

*mean*	4258.875
σ	1893.704
min	1906.000
max	7553.000

*mean*	6300.930
σ	1182.759
min	4922.497
max	8340.364

op=vertical_lookup_list() on indexed

*mean*	11560.065
σ	0.001
min	11560.064
max	11560.066

*mean*	7553.000
σ	0.000
min	7553.000
max	7553.000

*mean*	5419.689
σ	1317.469
min	4347.027
max	7185.913

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.580
σ	0.023
min	172.558
max	172.625

*mean*	1906.000
σ	0.000
min	1906.000
max	1906.000

*mean*	329.958
σ	62.578
min	260.483
max	398.910

op=pointedIndexFromKvs

rows=400000

*mean*	357.369
σ	0.042
min	357.321
max	357.414

*mean*	1906.000
σ	0.000
min	1906.000
max	1906.000

*mean*	761.708
σ	66.708
min	605.666
max	821.629

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1008.191
σ	0.865
min	1007.683
max	1011.754

*mean*	1041.350
σ	306.518
min	546.000
max	1470.000

*mean*	1.556
σ	0.105
min	1.464
max	1.873

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.883
σ	0.003
min	0.881
max	0.887

*mean*	1470.000
σ	0.000
min	1470.000
max	1470.000

*mean*	0.431
σ	0.152
min	0.342
max	0.701

name=error_case.art

*mean*	2.334
σ	0.002
min	2.332
max	2.337

*mean*	1470.000
σ	0.000
min	1470.000
max	1470.000

*mean*	0.923
σ	0.165
min	0.828
max	1.216

name=heavy_item.art

*mean*	1.522
σ	0.002
min	1.520
max	1.524

*mean*	1470.000
σ	0.000
min	1470.000
max	1470.000

*mean*	0.549
σ	0.044
min	0.514
max	0.624

name=nested_use.art

*mean*	2.355
σ	0.002
min	2.355
max	2.358

*mean*	1470.000
σ	0.000
min	1470.000
max	1470.000

*mean*	0.843
σ	0.041
min	0.808
max	0.911

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	963.543
σ	0.025
min	963.523
max	963.584

*mean*	1470.000
σ	0.000
min	1470.000
max	1470.000

*mean*	0.855
σ	0.018
min	0.822
max	0.866

name=cdr_enhanced_4k_loc.art

*mean*	884.854
σ	0.006
min	884.847
max	884.861

*mean*	1470.000
σ	0.000
min	1470.000
max	1470.000

*mean*	0.708
σ	0.035
min	0.670
max	0.746

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.706
σ	0.002
min	7.705
max	7.709

*mean*	1470.000
σ	0.000
min	1470.000
max	1470.000

*mean*	3.519
σ	0.103
min	2.994
max	3.830

name=record_render_large_syntax_err.art

*mean*	7.655
σ	0.002
min	7.654
max	7.659

*mean*	1470.000
σ	0.000
min	1470.000
max	1470.000

*mean*	3.518
σ	0.077
min	3.396
max	3.817

name=record_render_success.art

*mean*	2.288
σ	0.002
min	2.287
max	2.291

*mean*	1470.000
σ	0.000
min	1470.000
max	1470.000

*mean*	0.538
σ	0.013
min	0.513
max	0.623

name=record_render_syntax_err.art

*mean*	2.163
σ	0.002
min	2.163
max	2.166

*mean*	1470.000
σ	0.000
min	1470.000
max	1470.000

*mean*	0.508
σ	0.012
min	0.487
max	0.550

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	297.305
σ	0.194
min	297.146
max	297.793

*mean*	1906.000
σ	0.000
min	1906.000
max	1906.000

*mean*	0.599
σ	0.016
min	0.571
max	0.622

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	289.778
σ	0.034
min	289.739
max	289.818

*mean*	1470.000
σ	0.000
min	1470.000
max	1470.000

*mean*	0.408
σ	0.013
min	0.397
max	0.425

iters=5

new-facts=1

prior-facts=6402

*mean*	1299.608
σ	0.088
min	1299.499
max	1299.722

*mean*	1470.000
σ	0.000
min	1470.000
max	1470.000

*mean*	1.894
σ	0.065
min	1.832
max	1.967

iters=5

new-facts=6402

prior-facts=1

*mean*	1542.615
σ	4.062
min	1540.545
max	1549.872

*mean*	1470.000
σ	0.000
min	1470.000
max	1470.000

*mean*	2.242
σ	0.241
min	2.056
max	2.651

iters=5

new-facts=6402

prior-facts=6402

*mean*	1861.638
σ	0.053
min	1861.581
max	1861.705

*mean*	1742.800
σ	174.745
min	1498.000
max	1906.000

*mean*	3.065
σ	0.242
min	2.880
max	3.482

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.694
σ	0.305
min	1.220
max	1.937

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	446.186
σ	577.140
min	157.614
max	1311.896

*mean*	96.250
σ	8.500
min	92.000
max	109.000

*mean*	1470.000
σ	0.000
min	1470.000
max	1470.000

*mean*	0.535
σ	0.545
min	0.260
max	1.353

policies=20

*mean*	1576.419
σ	0.344
min	1576.183
max	1576.930

*mean*	920.000
σ	0.000
min	920.000
max	920.000

*mean*	1470.000
σ	0.000
min	1470.000
max	1470.000

*mean*	2.611
σ	0.012
min	2.598
max	2.627

policies=200

*mean*	15772.211
σ	0.098
min	15772.102
max	15772.327

*mean*	9200.000
σ	0.000
min	9200.000
max	9200.000

*mean*	1470.000
σ	0.000
min	1470.000
max	1470.000

*mean*	26.487
σ	0.120
min	26.380
max	26.645