Compare commits

AST compact size (buildDeclTree)

Factor

compact size MiB

phase=buildDeclTree

*mean*	0.203
σ	0.000
min	0.203
max	0.203

AST compact size (macro expansion)

Factor

compact size MiB

phase=macro expansion

*mean*	5.082
σ	0.000
min	5.082
max	5.082

AST compact size (parser)

Factor

compact size MiB

phase=parser

*mean*	4.988
σ	0.000
min	4.988
max	4.988

AST compact size (processProdDef Decls)

Factor

compact size MiB

phase=processProdDef Decls

*mean*	5.395
σ	0.000
min	5.395
max	5.395

AST compact size (processProdDef)

Factor

compact size MiB

phase=processProdDef

*mean*	446.633
σ	0.000
min	446.633
max	446.633

AST compact size (renaming)

Factor

compact size MiB

phase=renaming

*mean*	5.238
σ	0.000
min	5.238
max	5.238

AST compact size (type checker)

Factor

compact size MiB

phase=type checker

*mean*	6.395
σ	0.000
min	6.395
max	6.395

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.729
σ	0.360
min	54.580
max	55.754

*mean*	418.000
σ	0.000
min	418.000
max	418.000

*mean*	0.141
σ	0.004
min	0.137
max	0.149

cache=y

dps=1

iters=10

policies=100

*mean*	43.774
σ	0.006
min	43.762
max	43.781

*mean*	418.000
σ	0.000
min	418.000
max	418.000

*mean*	0.122
σ	0.005
min	0.116
max	0.131

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.604
σ	0.000
min	36.604
max	36.605

*mean*	4589.500
σ	2251.114
min	1484.000
max	7388.000

*mean*	82.323
σ	196.144
min	11.837
max	567.731

op=column_set() on indexed, repeat

*mean*	36.604
σ	0.000
min	36.604
max	36.605

*mean*	4589.500
σ	2251.114
min	1484.000
max	7388.000

*mean*	14.100
σ	3.835
min	11.522
max	22.139

op=table_records(), no indexes

*mean*	41.940
σ	0.002
min	41.938
max	41.942

*mean*	7388.000
σ	0.000
min	7388.000
max	7388.000

*mean*	11.357
σ	0.207
min	11.115
max	11.685

op=table_records(), repeat

*mean*	41.925
σ	0.000
min	41.924
max	41.925

*mean*	4179.625
σ	1946.715
min	1484.000
max	7388.000

*mean*	12.037
σ	1.637
min	11.138
max	16.056

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.633
σ	0.137
min	27.584
max	27.971

*mean*	4179.625
σ	1946.715
min	1484.000
max	7388.000

*mean*	9.051
σ	1.319
min	7.729
max	12.173

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.384
σ	0.000
min	26.384
max	26.384

*mean*	4179.625
σ	1946.715
min	1484.000
max	7388.000

*mean*	6.621
σ	0.925
min	6.052
max	8.854

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.662
σ	0.004
min	25.661
max	25.673

*mean*	4589.500
σ	2251.114
min	1484.000
max	7388.000

*mean*	6.521
σ	1.089
min	5.808
max	8.904

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.961
σ	0.001
min	25.960
max	25.962

*mean*	4589.500
σ	2251.114
min	1484.000
max	7388.000

*mean*	6.279
σ	1.017
min	5.522
max	8.455

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	1021.610
σ	0.002
min	1021.608
max	1021.612

*mean*	7388.000
σ	0.000
min	7388.000
max	7388.000

*mean*	359.328
σ	40.692
min	340.524
max	459.888

op=load_product(), with indexes

*mean*	3495.857
σ	0.456
min	3495.696
max	3496.985

*mean*	3756.000
σ	2300.815
min	720.000
max	7388.000

*mean*	1720.414
σ	574.996
min	1379.434
max	2863.113

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense, minor warmup

*mean*	107.841
σ	0.000
min	107.840
max	107.841

*mean*	4409.500
σ	2220.799
min	1484.000
max	7388.000

*mean*	240.183
σ	299.161
min	126.499
max	979.653

op=column_set() on unindexed, dense, repeat

*mean*	62.068
σ	0.001
min	62.065
max	62.068

*mean*	4409.500
σ	2220.799
min	1484.000
max	7388.000

*mean*	46.368
σ	9.526
min	41.306
max	69.655

op=vertical_lookup_list() repeated on unindexed missing Int

*mean*	40.926
σ	0.002
min	40.925
max	40.928

*mean*	7388.000
σ	0.000
min	7388.000
max	7388.000

*mean*	22.802
σ	1.430
min	21.884
max	26.246

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	71.294
σ	0.002
min	71.292
max	71.296

*mean*	7388.000
σ	0.000
min	7388.000
max	7388.000

*mean*	263.208
σ	584.559
min	54.697
max	1709.907

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	4646.842
σ	0.013
min	4646.837
max	4646.875

*mean*	4179.625
σ	1946.715
min	1484.000
max	7388.000

*mean*	3182.661
σ	701.240
min	2522.232
max	4615.441

op=vertical_lookup_list() on indexed

*mean*	1973.829
σ	0.002
min	1973.827
max	1973.832

*mean*	7388.000
σ	0.000
min	7388.000
max	7388.000

*mean*	1064.219
σ	258.755
min	927.050
max	1680.436

op=vertical_lookup_list() on unindexed missing Int, minor warmup

*mean*	905.082
σ	0.002
min	905.080
max	905.086

*mean*	7388.000
σ	0.000
min	7388.000
max	7388.000

*mean*	402.796
σ	7.293
min	385.556
max	407.314

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	148.144
σ	0.001
min	148.144
max	148.148

*mean*	478.000
σ	0.000
min	478.000
max	478.000

*mean*	395.207
σ	23.179
min	368.982
max	444.355

op=pointedIndexFromKvs

rows=400000

*mean*	308.493
σ	0.001
min	308.493
max	308.497

*mean*	563.000
σ	0.000
min	563.000
max	563.000

*mean*	752.540
σ	52.796
min	702.938
max	876.669

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	963.970
σ	1.822
min	963.262
max	971.673

*mean*	1053.700
σ	318.822
min	562.000
max	1522.000

*mean*	1.271
σ	0.124
min	1.069
max	1.572

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.914
σ	0.020
min	0.904
max	0.951

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.277
σ	0.267
min	0.131
max	0.752

name=error_case.art

*mean*	2.347
σ	0.012
min	2.341
max	2.369

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.487
σ	0.306
min	0.331
max	1.033

name=heavy_item.art

*mean*	1.525
σ	0.002
min	1.524
max	1.528

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.222
σ	0.021
min	0.204
max	0.258

name=nested_use.art

*mean*	2.365
σ	0.002
min	2.364
max	2.368

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.336
σ	0.014
min	0.323
max	0.358

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	966.287
σ	0.009
min	966.281
max	966.303

*mean*	433.000
σ	0.707
min	432.000
max	434.000

*mean*	0.572
σ	0.045
min	0.507
max	0.609

name=cdr_enhanced_4k_loc.art

*mean*	886.717
σ	0.002
min	886.716
max	886.720

*mean*	441.000
σ	0.000
min	441.000
max	441.000

*mean*	0.512
σ	0.024
min	0.471
max	0.532

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.722
σ	0.002
min	7.721
max	7.725

*mean*	441.000
σ	0.000
min	441.000
max	441.000

*mean*	2.664
σ	0.085
min	2.473
max	2.961

name=record_render_large_syntax_err.art

*mean*	7.670
σ	0.002
min	7.670
max	7.673

*mean*	441.000
σ	0.000
min	441.000
max	441.000

*mean*	2.663
σ	0.107
min	2.500
max	3.040

name=record_render_success.art

*mean*	2.294
σ	0.002
min	2.293
max	2.297

*mean*	441.000
σ	0.000
min	441.000
max	441.000

*mean*	0.325
σ	0.100
min	0.295
max	1.160

name=record_render_syntax_err.art

*mean*	2.169
σ	0.002
min	2.168
max	2.172

*mean*	441.000
σ	0.000
min	441.000
max	441.000

*mean*	0.299
σ	0.040
min	0.276
max	0.586

Revision Creation

Factor

allocated MiB

peak allocated MiB

time_s

number of threads=8

revision count=1000

*mean*	11.646
σ	11.861
min	0.574
max	98.246

*mean*	463.084
σ	18.997
min	407.000
max	478.000

*mean*	0.027
σ	0.029
min	0.001
max	0.235

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	278.816
σ	1.070
min	278.431
max	281.861

*mean*	443.100
σ	16.326
min	413.000
max	470.000

*mean*	0.571
σ	0.031
min	0.518
max	0.601

Timed compile per phase

Factor

allocated MiB

peak allocated MiB

time (ms)

phase=buildDeclTree

*mean*	169.258
σ	0.000
min	169.258
max	169.258

*mean*	699.000
σ	0.000
min	699.000
max	699.000

*mean*	232.725
σ	22.776
min	187.020
max	250.626

phase=macro expansion

*mean*	5.900
σ	0.000
min	5.900
max	5.900

*mean*	699.000
σ	0.000
min	699.000
max	699.000

*mean*	5.975
σ	0.070
min	5.883
max	6.103

phase=parser

*mean*	1043.350
σ	0.000
min	1043.350
max	1043.351

*mean*	699.000
σ	0.000
min	699.000
max	699.000

*mean*	571.537
σ	78.886
min	443.416
max	618.566

phase=processProdDef

*mean*	2243.722
σ	0.000
min	2243.722
max	2243.722

*mean*	699.000
σ	0.000
min	699.000
max	699.000

*mean*	3048.282
σ	283.868
min	2430.566
max	3315.741

phase=renaming

*mean*	21.438
σ	0.000
min	21.438
max	21.438

*mean*	699.000
σ	0.000
min	699.000
max	699.000

*mean*	35.037
σ	1.703
min	33.029
max	37.429

phase=type checker

*mean*	958.597
σ	0.047
min	958.573
max	958.698

*mean*	699.000
σ	0.000
min	699.000
max	699.000

*mean*	668.778
σ	16.822
min	637.373
max	684.671

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	282.366
σ	0.037
min	282.317
max	282.407

*mean*	443.400
σ	0.548
min	443.000
max	444.000

*mean*	0.377
σ	0.006
min	0.372
max	0.387

iters=5

new-facts=1

prior-facts=6402

*mean*	1267.090
σ	0.090
min	1266.975
max	1267.194

*mean*	1057.400
σ	171.451
min	846.000
max	1283.000

*mean*	1.953
σ	0.174
min	1.740
max	2.139

iters=5

new-facts=6402

prior-facts=1

*mean*	1506.061
σ	2.952
min	1504.493
max	1511.329

*mean*	623.200
σ	80.298
min	495.000
max	694.000

*mean*	2.239
σ	0.236
min	2.044
max	2.626

iters=5

new-facts=6402

prior-facts=6402

*mean*	1829.072
σ	0.057
min	1829.006
max	1829.143

*mean*	1693.600
σ	237.452
min	1408.000
max	2012.000

*mean*	2.867
σ	0.136
min	2.789
max	3.109

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.623
σ	0.100
min	1.527
max	1.780

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	393.632
σ	509.937
min	138.661
max	1158.538

*mean*	97.750
σ	7.500
min	94.000
max	109.000

*mean*	446.000
σ	0.000
min	446.000
max	446.000

*mean*	0.484
σ	0.504
min	0.230
max	1.239

policies=20

*mean*	1386.749
σ	0.155
min	1386.641
max	1386.978

*mean*	940.000
σ	0.000
min	940.000
max	940.000

*mean*	448.000
σ	2.309
min	446.000
max	450.000

*mean*	2.308
σ	0.012
min	2.298
max	2.320

policies=200

*mean*	13876.151
σ	0.108
min	13876.093
max	13876.313

*mean*	9400.000
σ	0.000
min	9400.000
max	9400.000

*mean*	496.000
σ	4.967
min	491.000
max	502.000

*mean*	23.498
σ	0.110
min	23.384
max	23.593