Compare commits

AST compact size (buildDeclTree)

Factor

compact size MiB

phase=buildDeclTree

*mean*	0.203
σ	0.000
min	0.203
max	0.203

AST compact size (macro expansion)

Factor

compact size MiB

phase=macro expansion

*mean*	5.301
σ	0.000
min	5.301
max	5.301

AST compact size (parser)

Factor

compact size MiB

phase=parser

*mean*	5.176
σ	0.000
min	5.176
max	5.176

AST compact size (processProdDef Decls)

Factor

compact size MiB

phase=processProdDef Decls

*mean*	5.676
σ	0.000
min	5.676
max	5.676

AST compact size (processProdDef)

Factor

compact size MiB

phase=processProdDef

*mean*	446.883
σ	0.000
min	446.883
max	446.883

AST compact size (renaming)

Factor

compact size MiB

phase=renaming

*mean*	5.488
σ	0.000
min	5.488
max	5.488

AST compact size (type checker)

Factor

compact size MiB

phase=type checker

*mean*	6.645
σ	0.000
min	6.645
max	6.645

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.774
σ	0.363
min	54.628
max	55.805

*mean*	421.000
σ	0.000
min	421.000
max	421.000

*mean*	0.141
σ	0.005
min	0.137
max	0.151

cache=y

dps=1

iters=10

policies=100

*mean*	43.774
σ	0.006
min	43.763
max	43.783

*mean*	421.000
σ	0.000
min	421.000
max	421.000

*mean*	0.124
σ	0.004
min	0.122
max	0.133

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.617
σ	0.000
min	36.617
max	36.618

*mean*	4426.375
σ	2226.997
min	1484.000
max	7407.000

*mean*	12.417
σ	1.950
min	11.399
max	17.110

op=column_set() on indexed, repeat

*mean*	36.618
σ	0.000
min	36.617
max	36.618

*mean*	4606.625
σ	2258.183
min	1484.000
max	7407.000

*mean*	146.533
σ	377.890
min	11.957
max	1081.752

op=table_records(), no indexes

*mean*	41.948
σ	0.002
min	41.946
max	41.951

*mean*	7407.000
σ	0.000
min	7407.000
max	7407.000

*mean*	10.351
σ	0.236
min	10.109
max	10.840

op=table_records(), repeat

*mean*	41.934
σ	0.002
min	41.933
max	41.937

*mean*	4197.625
σ	1954.402
min	1484.000
max	7407.000

*mean*	10.859
σ	0.872
min	10.290
max	12.981

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.655
σ	0.137
min	27.606
max	27.993

*mean*	4197.625
σ	1954.402
min	1484.000
max	7407.000

*mean*	7.959
σ	0.669
min	7.011
max	9.384

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.406
σ	0.000
min	26.406
max	26.406

*mean*	4197.625
σ	1954.402
min	1484.000
max	7407.000

*mean*	6.161
σ	0.474
min	5.551
max	7.181

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.681
σ	0.003
min	25.680
max	25.688

*mean*	4606.625
σ	2258.183
min	1484.000
max	7407.000

*mean*	6.171
σ	1.144
min	5.376
max	8.594

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.984
σ	0.000
min	25.984
max	25.985

*mean*	4606.625
σ	2258.183
min	1484.000
max	7407.000

*mean*	5.922
σ	1.052
min	5.343
max	8.246

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	1021.627
σ	0.002
min	1021.625
max	1021.630

*mean*	7407.000
σ	0.000
min	7407.000
max	7407.000

*mean*	345.474
σ	3.367
min	340.570
max	350.243

op=load_product(), with indexes

*mean*	3495.878
σ	0.469
min	3495.713
max	3497.038

*mean*	3770.750
σ	2310.534
min	720.000
max	7407.000

*mean*	1753.579
σ	628.000
min	1377.811
max	2791.707

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense, minor warmup

*mean*	107.854
σ	0.000
min	107.853
max	107.854

*mean*	4197.625
σ	1954.402
min	1484.000
max	7407.000

*mean*	130.027
σ	7.879
min	124.014
max	148.791

op=column_set() on unindexed, dense, repeat

*mean*	62.082
σ	0.000
min	62.081
max	62.082

*mean*	4426.375
σ	2226.997
min	1484.000
max	7407.000

*mean*	161.782
σ	335.839
min	41.443
max	992.932

op=vertical_lookup_list() repeated on unindexed missing Int

*mean*	40.948
σ	0.002
min	40.947
max	40.951

*mean*	7407.000
σ	0.000
min	7407.000
max	7407.000

*mean*	106.574
σ	240.069
min	20.943
max	700.707

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	71.308
σ	0.002
min	71.307
max	71.311

*mean*	7407.000
σ	0.000
min	7407.000
max	7407.000

*mean*	57.201
σ	6.276
min	54.757
max	72.704

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	4646.850
σ	0.013
min	4646.845
max	4646.883

*mean*	4197.625
σ	1954.402
min	1484.000
max	7407.000

*mean*	3120.107
σ	737.759
min	2486.962
max	4254.240

op=vertical_lookup_list() on indexed

*mean*	1973.851
σ	0.002
min	1973.849
max	1973.853

*mean*	7407.000
σ	0.000
min	7407.000
max	7407.000

*mean*	1005.371
σ	202.955
min	907.904
max	1494.501

op=vertical_lookup_list() on unindexed missing Int, minor warmup

*mean*	905.105
σ	0.002
min	905.102
max	905.108

*mean*	7407.000
σ	0.000
min	7407.000
max	7407.000

*mean*	404.556
σ	39.750
min	379.640
max	501.756

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	148.144
σ	0.001
min	148.144
max	148.148

*mean*	475.250
σ	1.035
min	474.000
max	476.000

*mean*	377.708
σ	8.396
min	366.066
max	386.514

op=pointedIndexFromKvs

rows=400000

*mean*	308.493
σ	0.001
min	308.493
max	308.497

*mean*	564.000
σ	0.000
min	564.000
max	564.000

*mean*	735.511
σ	38.183
min	691.194
max	798.699

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	963.970
σ	1.822
min	963.264
max	971.677

*mean*	1029.800
σ	298.070
min	552.000
max	1450.000

*mean*	1.246
σ	0.067
min	1.183
max	1.447

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.913
σ	0.020
min	0.903
max	0.949

*mean*	401.000
σ	0.000
min	401.000
max	401.000

*mean*	0.318
σ	0.321
min	0.148
max	0.888

name=error_case.art

*mean*	2.340
σ	0.012
min	2.334
max	2.362

*mean*	401.000
σ	0.000
min	401.000
max	401.000

*mean*	0.416
σ	0.190
min	0.324
max	0.755

name=heavy_item.art

*mean*	1.523
σ	0.002
min	1.521
max	1.525

*mean*	401.000
σ	0.000
min	401.000
max	401.000

*mean*	0.222
σ	0.023
min	0.204
max	0.263

name=nested_use.art

*mean*	2.358
σ	0.002
min	2.357
max	2.361

*mean*	401.000
σ	0.000
min	401.000
max	401.000

*mean*	0.337
σ	0.019
min	0.316
max	0.362

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	964.971
σ	0.011
min	964.965
max	964.989

*mean*	430.000
σ	0.000
min	430.000
max	430.000

*mean*	0.535
σ	0.042
min	0.500
max	0.586

name=cdr_enhanced_4k_loc.art

*mean*	885.898
σ	0.002
min	885.897
max	885.901

*mean*	430.000
σ	0.000
min	430.000
max	430.000

*mean*	0.476
σ	0.035
min	0.421
max	0.517

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.710
σ	0.002
min	7.709
max	7.713

*mean*	430.000
σ	0.000
min	430.000
max	430.000

*mean*	2.631
σ	0.107
min	2.430
max	2.964

name=record_render_large_syntax_err.art

*mean*	7.658
σ	0.002
min	7.657
max	7.661

*mean*	430.000
σ	0.000
min	430.000
max	430.000

*mean*	2.591
σ	0.087
min	2.418
max	2.801

name=record_render_success.art

*mean*	2.290
σ	0.002
min	2.289
max	2.293

*mean*	430.000
σ	0.000
min	430.000
max	430.000

*mean*	0.308
σ	0.009
min	0.290
max	0.362

name=record_render_syntax_err.art

*mean*	2.165
σ	0.002
min	2.164
max	2.168

*mean*	430.000
σ	0.000
min	430.000
max	430.000

*mean*	0.297
σ	0.011
min	0.282
max	0.377

Revision Creation

Factor

allocated MiB

peak allocated MiB

time_s

number of threads=8

revision count=1000

*mean*	11.912
σ	12.185
min	0.574
max	98.208

*mean*	463.692
σ	20.376
min	407.000
max	482.000

*mean*	0.027
σ	0.030
min	0.001
max	0.239

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	278.720
σ	0.997
min	278.277
max	281.547

*mean*	447.000
σ	19.293
min	418.000
max	473.000

*mean*	0.577
σ	0.019
min	0.532
max	0.610

Timed compile per phase

Factor

allocated MiB

peak allocated MiB

time (ms)

phase=buildDeclTree

*mean*	173.738
σ	0.000
min	173.738
max	173.738

*mean*	845.000
σ	0.000
min	845.000
max	845.000

*mean*	218.075
σ	34.578
min	151.490
max	252.301

phase=macro expansion

*mean*	6.130
σ	0.000
min	6.130
max	6.130

*mean*	844.125
σ	2.475
min	838.000
max	845.000

*mean*	8.730
σ	1.513
min	6.250
max	9.689

phase=parser

*mean*	1042.436
σ	0.000
min	1042.436
max	1042.436

*mean*	844.125
σ	2.475
min	838.000
max	845.000

*mean*	573.919
σ	52.717
min	453.910
max	610.199

phase=processProdDef

*mean*	2243.974
σ	0.000
min	2243.974
max	2243.974

*mean*	845.000
σ	0.000
min	845.000
max	845.000

*mean*	2615.097
σ	546.622
min	1965.971
max	3431.967

phase=renaming

*mean*	21.675
σ	0.000
min	21.675
max	21.675

*mean*	844.125
σ	2.475
min	838.000
max	845.000

*mean*	35.553
σ	9.314
min	20.311
max	41.203

phase=type checker

*mean*	989.752
σ	0.066
min	989.654
max	989.841

*mean*	844.125
σ	2.475
min	838.000
max	845.000

*mean*	698.964
σ	82.835
min	640.177
max	896.829

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	282.394
σ	0.024
min	282.373
max	282.424

*mean*	445.200
σ	1.643
min	444.000
max	447.000

*mean*	0.382
σ	0.006
min	0.375
max	0.387

iters=5

new-facts=1

prior-facts=6402

*mean*	1267.114
σ	0.091
min	1267.001
max	1267.255

*mean*	1114.600
σ	169.060
min	899.000
max	1325.000

*mean*	2.031
σ	0.140
min	1.859
max	2.212

iters=5

new-facts=6402

prior-facts=1

*mean*	1506.148
σ	2.922
min	1504.648
max	1511.365

*mean*	630.200
σ	90.062
min	506.000
max	729.000

*mean*	2.380
σ	0.294
min	2.061
max	2.650

iters=5

new-facts=6402

prior-facts=6402

*mean*	1829.116
σ	0.094
min	1829.016
max	1829.259

*mean*	1751.600
σ	211.931
min	1465.000
max	1951.000

*mean*	3.189
σ	0.383
min	2.818
max	3.703

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.656
σ	0.084
min	1.573
max	1.782

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	397.697
σ	518.051
min	138.668
max	1174.773

*mean*	97.750
σ	7.500
min	94.000
max	109.000

*mean*	446.000
σ	0.000
min	446.000
max	446.000

*mean*	0.474
σ	0.469
min	0.236
max	1.177

policies=20

*mean*	1386.826
σ	0.166
min	1386.712
max	1387.072

*mean*	940.000
σ	0.000
min	940.000
max	940.000

*mean*	446.000
σ	0.000
min	446.000
max	446.000

*mean*	2.321
σ	0.011
min	2.311
max	2.334

policies=200

*mean*	13876.864
σ	0.120
min	13876.720
max	13877.014

*mean*	9400.000
σ	0.000
min	9400.000
max	9400.000

*mean*	493.750
σ	3.202
min	491.000
max	497.000

*mean*	23.417
σ	0.080
min	23.330
max	23.511