Compare commits

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.575
σ	0.348
min	54.446
max	55.565

*mean*	416.000
σ	0.000
min	416.000
max	416.000

*mean*	0.138
σ	0.004
min	0.132
max	0.146

cache=y

dps=1

iters=10

policies=100

*mean*	43.706
σ	0.005
min	43.699
max	43.717

*mean*	416.300
σ	0.483
min	416.000
max	417.000

*mean*	0.124
σ	0.004
min	0.120
max	0.132

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.002
min	36.615
max	36.620

*mean*	4151.500
σ	1900.331
min	1554.000
max	7301.000

*mean*	12.722
σ	0.202
min	12.362
max	12.973

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.002
min	36.615
max	36.619

*mean*	4151.500
σ	1900.331
min	1554.000
max	7301.000

*mean*	11.932
σ	0.265
min	11.534
max	12.279

op=table_records(), no indexes

*mean*	41.932
σ	0.001
min	41.928
max	41.933

*mean*	7301.000
σ	0.000
min	7301.000
max	7301.000

*mean*	15.297
σ	0.597
min	13.943
max	15.848

op=table_records(), repeat

*mean*	41.928
σ	0.002
min	41.927
max	41.931

*mean*	4151.500
σ	1900.331
min	1554.000
max	7301.000

*mean*	13.343
σ	1.801
min	10.967
max	15.868

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.653
σ	0.136
min	27.603
max	27.990

*mean*	4151.500
σ	1900.331
min	1554.000
max	7301.000

*mean*	8.712
σ	0.350
min	8.194
max	9.215

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.400
σ	0.002
min	26.399
max	26.403

*mean*	4151.500
σ	1900.331
min	1554.000
max	7301.000

*mean*	6.761
σ	0.211
min	6.375
max	6.984

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.666
σ	0.002
min	25.665
max	25.668

*mean*	4151.500
σ	1900.331
min	1554.000
max	7301.000

*mean*	5.948
σ	0.117
min	5.795
max	6.176

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.968
σ	0.002
min	25.967
max	25.972

*mean*	4151.500
σ	1900.331
min	1554.000
max	7301.000

*mean*	5.793
σ	0.176
min	5.670
max	6.212

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.606
σ	0.000
min	2524.606
max	2524.606

*mean*	7301.000
σ	0.000
min	7301.000
max	7301.000

*mean*	1293.794
σ	414.038
min	1036.640
max	2197.784

op=load_product(), with indexes

*mean*	8744.722
σ	0.469
min	8744.553
max	8745.883

*mean*	3572.875
σ	1796.964
min	1044.000
max	5797.000

*mean*	4806.777
σ	1392.897
min	3518.536
max	6656.836

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.078
σ	0.002
min	62.076
max	62.081

*mean*	4151.500
σ	1900.331
min	1554.000
max	7301.000

*mean*	80.690
σ	9.991
min	70.768
max	97.294

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.944
σ	0.000
min	40.944
max	40.945

*mean*	7301.000
σ	0.000
min	7301.000
max	7301.000

*mean*	107.210
σ	3.132
min	102.041
max	111.318

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.686
σ	0.000
min	66.685
max	66.687

*mean*	7301.000
σ	0.000
min	7301.000
max	7301.000

*mean*	163.304
σ	6.049
min	149.177
max	167.438

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11656.836
σ	4.324
min	11655.305
max	11667.538

*mean*	4151.500
σ	1900.331
min	1554.000
max	7301.000

*mean*	6448.563
σ	1090.450
min	4923.586
max	7810.620

op=vertical_lookup_list() on indexed

*mean*	11560.065
σ	0.001
min	11560.064
max	11560.066

*mean*	7301.000
σ	0.000
min	7301.000
max	7301.000

*mean*	5727.379
σ	1418.083
min	4397.033
max	7727.376

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.559
σ	0.001
min	172.558
max	172.562

*mean*	477.000
σ	0.000
min	477.000
max	477.000

*mean*	381.298
σ	16.171
min	351.657
max	394.446

op=pointedIndexFromKvs

rows=400000

*mean*	357.322
σ	0.001
min	357.321
max	357.325

*mean*	560.000
σ	0.000
min	560.000
max	560.000

*mean*	763.357
σ	26.888
min	705.999
max	791.847

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1008.501
σ	0.759
min	1008.027
max	1011.638

*mean*	1047.200
σ	314.227
min	572.000
max	1512.000

*mean*	1.527
σ	0.075
min	1.452
max	1.719

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.913
σ	0.020
min	0.903
max	0.949

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.302
σ	0.299
min	0.144
max	0.835

name=error_case.art

*mean*	2.339
σ	0.012
min	2.333
max	2.361

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.487
σ	0.322
min	0.330
max	1.062

name=heavy_item.art

*mean*	1.522
σ	0.002
min	1.521
max	1.525

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.219
σ	0.031
min	0.193
max	0.270

name=nested_use.art

*mean*	2.357
σ	0.002
min	2.356
max	2.360

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.332
σ	0.017
min	0.319
max	0.360

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	964.741
σ	0.011
min	964.736
max	964.760

*mean*	432.800
σ	3.033
min	430.000
max	436.000

*mean*	0.565
σ	0.022
min	0.527
max	0.582

name=cdr_enhanced_4k_loc.art

*mean*	885.814
σ	0.002
min	885.812
max	885.816

*mean*	436.000
σ	0.000
min	436.000
max	436.000

*mean*	0.493
σ	0.056
min	0.394
max	0.529

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.708
σ	0.002
min	7.707
max	7.711

*mean*	436.000
σ	0.000
min	436.000
max	436.000

*mean*	1.966
σ	0.071
min	1.822
max	2.224

name=record_render_large_syntax_err.art

*mean*	7.656
σ	0.002
min	7.655
max	7.659

*mean*	436.000
σ	0.000
min	436.000
max	436.000

*mean*	1.968
σ	0.091
min	1.821
max	2.275

name=record_render_success.art

*mean*	2.289
σ	0.002
min	2.288
max	2.292

*mean*	436.000
σ	0.000
min	436.000
max	436.000

*mean*	0.306
σ	0.008
min	0.293
max	0.345

name=record_render_syntax_err.art

*mean*	2.165
σ	0.002
min	2.164
max	2.168

*mean*	436.000
σ	0.000
min	436.000
max	436.000

*mean*	0.293
σ	0.007
min	0.280
max	0.322

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	297.942
σ	1.019
min	297.573
max	300.841

*mean*	442.600
σ	14.976
min	418.000
max	464.000

*mean*	0.614
σ	0.020
min	0.578
max	0.634

Timed compile per phase

Factor

allocated MiB

peak allocated MiB

time (ms)

phase=buildDeclTree

*mean*	222.008
σ	0.000
min	222.008
max	222.008

*mean*	1726.000
σ	0.000
min	1726.000
max	1726.000

*mean*	207.901
σ	1.465
min	205.344
max	209.887

phase=macro expansion

*mean*	6.130
σ	0.000
min	6.130
max	6.130

*mean*	1726.000
σ	0.000
min	1726.000
max	1726.000

*mean*	11.425
σ	1.485
min	9.394
max	12.620

phase=parser

*mean*	1042.097
σ	0.000
min	1042.096
max	1042.097

*mean*	1726.000
σ	0.000
min	1726.000
max	1726.000

*mean*	704.090
σ	46.759
min	588.789
max	728.759

phase=processProdDef

*mean*	6169.660
σ	0.001
min	6169.659
max	6169.661

*mean*	1728.000
σ	5.657
min	1726.000
max	1742.000

*mean*	5338.930
σ	1375.105
min	3750.397
max	7578.379

phase=renaming

*mean*	21.667
σ	0.000
min	21.667
max	21.667

*mean*	1726.000
σ	0.000
min	1726.000
max	1726.000

*mean*	42.110
σ	7.872
min	29.069
max	47.640

phase=type checker

*mean*	958.461
σ	0.066
min	958.363
max	958.551

*mean*	1726.000
σ	0.000
min	1726.000
max	1726.000

*mean*	797.340
σ	112.309
min	636.187
max	920.570

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	293.381
σ	0.034
min	293.333
max	293.418

*mean*	442.400
σ	0.894
min	442.000
max	444.000

*mean*	0.401
σ	0.006
min	0.397
max	0.412

iters=5

new-facts=1

prior-facts=6402

*mean*	1303.467
σ	0.086
min	1303.319
max	1303.529

*mean*	1116.000
σ	186.377
min	894.000
max	1369.000

*mean*	2.076
σ	0.164
min	1.892
max	2.270

iters=5

new-facts=6402

prior-facts=1

*mean*	1546.518
σ	4.021
min	1544.593
max	1553.707

*mean*	619.200
σ	87.964
min	523.000
max	728.000

*mean*	2.338
σ	0.219
min	2.125
max	2.647

iters=5

new-facts=6402

prior-facts=6402

*mean*	1865.456
σ	0.076
min	1865.373
max	1865.571

*mean*	1739.400
σ	215.587
min	1452.000
max	1942.000

*mean*	3.213
σ	0.229
min	2.922
max	3.450

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.721
σ	0.158
min	1.518
max	1.905

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	447.979
σ	579.240
min	158.356
max	1316.839

*mean*	96.250
σ	8.500
min	92.000
max	109.000

*mean*	440.000
σ	0.000
min	440.000
max	440.000

*mean*	0.536
σ	0.552
min	0.252
max	1.363

policies=20

*mean*	1583.923
σ	0.370
min	1583.669
max	1584.471

*mean*	920.000
σ	0.000
min	920.000
max	920.000

*mean*	446.000
σ	6.928
min	440.000
max	452.000

*mean*	2.654
σ	0.069
min	2.607
max	2.754

policies=200

*mean*	15847.267
σ	0.156
min	15847.067
max	15847.440

*mean*	9200.000
σ	0.000
min	9200.000
max	9200.000

*mean*	493.000
σ	3.916
min	489.000
max	498.000

*mean*	26.596
σ	0.086
min	26.492
max	26.678