Compare commits

AST compact size (buildDeclTree)

Factor

compact size MiB

phase=buildDeclTree

*mean*	0.203
σ	0.000
min	0.203
max	0.203

AST compact size (macro expansion)

Factor

compact size MiB

phase=macro expansion

*mean*	5.301
σ	0.000
min	5.301
max	5.301

AST compact size (parser)

Factor

compact size MiB

phase=parser

*mean*	5.176
σ	0.000
min	5.176
max	5.176

AST compact size (processProdDef Decls)

Factor

compact size MiB

phase=processProdDef Decls

*mean*	5.676
σ	0.000
min	5.676
max	5.676

AST compact size (processProdDef)

Factor

compact size MiB

phase=processProdDef

*mean*	446.883
σ	0.000
min	446.883
max	446.883

AST compact size (renaming)

Factor

compact size MiB

phase=renaming

*mean*	5.488
σ	0.000
min	5.488
max	5.488

AST compact size (type checker)

Factor

compact size MiB

phase=type checker

*mean*	6.645
σ	0.000
min	6.645
max	6.645

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.865
σ	0.361
min	54.727
max	55.890

*mean*	420.000
σ	0.000
min	420.000
max	420.000

*mean*	0.158
σ	0.012
min	0.140
max	0.174

cache=y

dps=1

iters=10

policies=100

*mean*	43.849
σ	0.005
min	43.841
max	43.855

*mean*	420.000
σ	0.000
min	420.000
max	420.000

*mean*	0.133
σ	0.009
min	0.124
max	0.145

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.617
σ	0.000
min	36.617
max	36.618

*mean*	4423.250
σ	2225.917
min	1487.000
max	7403.000

*mean*	12.948
σ	1.775
min	12.169
max	17.324

op=column_set() on indexed, repeat

*mean*	36.618
σ	0.000
min	36.617
max	36.618

*mean*	4603.875
σ	2257.131
min	1487.000
max	7403.000

*mean*	144.601
σ	371.163
min	11.805
max	1063.170

op=table_records(), no indexes

*mean*	41.948
σ	0.002
min	41.946
max	41.951

*mean*	7403.000
σ	0.000
min	7403.000
max	7403.000

*mean*	11.279
σ	0.811
min	10.785
max	13.244

op=table_records(), repeat

*mean*	41.934
σ	0.002
min	41.933
max	41.937

*mean*	4194.750
σ	1953.490
min	1487.000
max	7403.000

*mean*	11.653
σ	1.826
min	10.737
max	16.129

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.655
σ	0.137
min	27.606
max	27.993

*mean*	4194.750
σ	1953.490
min	1487.000
max	7403.000

*mean*	9.023
σ	1.323
min	7.959
max	12.185

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.406
σ	0.000
min	26.406
max	26.406

*mean*	4194.750
σ	1953.490
min	1487.000
max	7403.000

*mean*	6.782
σ	1.031
min	5.592
max	9.019

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.681
σ	0.003
min	25.680
max	25.688

*mean*	4603.875
σ	2257.131
min	1487.000
max	7403.000

*mean*	6.548
σ	1.153
min	5.824
max	9.134

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.984
σ	0.000
min	25.984
max	25.986

*mean*	4603.875
σ	2257.131
min	1487.000
max	7403.000

*mean*	6.333
σ	1.186
min	5.490
max	9.049

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	1021.627
σ	0.002
min	1021.625
max	1021.629

*mean*	7403.000
σ	0.000
min	7403.000
max	7403.000

*mean*	349.259
σ	2.395
min	346.038
max	352.214

op=load_product(), with indexes

*mean*	3495.878
σ	0.469
min	3495.713
max	3497.038

*mean*	3768.500
σ	2309.268
min	720.000
max	7403.000

*mean*	1777.720
σ	663.612
min	1387.433
max	2931.967

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense, minor warmup

*mean*	107.854
σ	0.000
min	107.854
max	107.854

*mean*	4194.750
σ	1953.490
min	1487.000
max	7403.000

*mean*	133.847
σ	16.303
min	125.450
max	173.614

op=column_set() on unindexed, dense, repeat

*mean*	62.082
σ	0.000
min	62.081
max	62.082

*mean*	4423.250
σ	2225.917
min	1487.000
max	7403.000

*mean*	142.798
σ	281.747
min	41.407
max	840.075

op=vertical_lookup_list() repeated on unindexed missing Int

*mean*	40.948
σ	0.002
min	40.947
max	40.951

*mean*	7403.000
σ	0.000
min	7403.000
max	7403.000

*mean*	93.933
σ	200.805
min	21.549
max	590.845

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	71.308
σ	0.002
min	71.307
max	71.311

*mean*	7403.000
σ	0.000
min	7403.000
max	7403.000

*mean*	61.190
σ	9.744
min	55.761
max	83.619

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	4646.850
σ	0.013
min	4646.845
max	4646.883

*mean*	4194.750
σ	1953.490
min	1487.000
max	7403.000

*mean*	3150.672
σ	642.659
min	2488.438
max	4014.888

op=vertical_lookup_list() on indexed

*mean*	1973.851
σ	0.002
min	1973.849
max	1973.853

*mean*	7403.000
σ	0.000
min	7403.000
max	7403.000

*mean*	1045.660
σ	263.524
min	921.846
max	1678.098

op=vertical_lookup_list() on unindexed missing Int, minor warmup

*mean*	905.105
σ	0.002
min	905.102
max	905.108

*mean*	7403.000
σ	0.000
min	7403.000
max	7403.000

*mean*	401.809
σ	34.935
min	386.998
max	488.162

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	148.144
σ	0.001
min	148.144
max	148.148

*mean*	476.000
σ	0.000
min	476.000
max	476.000

*mean*	391.121
σ	14.539
min	369.894
max	418.100

op=pointedIndexFromKvs

rows=400000

*mean*	308.493
σ	0.001
min	308.493
max	308.497

*mean*	562.875
σ	0.354
min	562.000
max	563.000

*mean*	733.925
σ	42.181
min	644.715
max	790.496

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1024.566
σ	0.759
min	1024.095
max	1027.705

*mean*	1049.450
σ	311.802
min	587.000
max	1511.000

*mean*	1.393
σ	0.082
min	1.317
max	1.586

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.913
σ	0.020
min	0.903
max	0.949

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.303
σ	0.300
min	0.149
max	0.835

name=error_case.art

*mean*	2.340
σ	0.012
min	2.334
max	2.362

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.481
σ	0.322
min	0.331
max	1.057

name=heavy_item.art

*mean*	1.523
σ	0.002
min	1.521
max	1.525

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.222
σ	0.024
min	0.202
max	0.261

name=nested_use.art

*mean*	2.358
σ	0.002
min	2.357
max	2.361

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.328
σ	0.022
min	0.313
max	0.366

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	964.971
σ	0.011
min	964.965
max	964.989

*mean*	431.200
σ	0.447
min	431.000
max	432.000

*mean*	0.565
σ	0.040
min	0.517
max	0.609

name=cdr_enhanced_4k_loc.art

*mean*	885.898
σ	0.002
min	885.897
max	885.901

*mean*	437.000
σ	0.000
min	437.000
max	437.000

*mean*	0.517
σ	0.012
min	0.500
max	0.530

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.710
σ	0.002
min	7.709
max	7.713

*mean*	437.000
σ	0.000
min	437.000
max	437.000

*mean*	2.636
σ	0.092
min	2.482
max	2.976

name=record_render_large_syntax_err.art

*mean*	7.658
σ	0.002
min	7.657
max	7.661

*mean*	437.000
σ	0.000
min	437.000
max	437.000

*mean*	2.630
σ	0.105
min	2.448
max	3.214

name=record_render_success.art

*mean*	2.290
σ	0.002
min	2.289
max	2.293

*mean*	437.000
σ	0.000
min	437.000
max	437.000

*mean*	0.311
σ	0.010
min	0.295
max	0.361

name=record_render_syntax_err.art

*mean*	2.165
σ	0.002
min	2.164
max	2.168

*mean*	437.000
σ	0.000
min	437.000
max	437.000

*mean*	0.295
σ	0.008
min	0.280
max	0.322

Revision Creation

Factor

allocated MiB

peak allocated MiB

time_s

number of threads=8

revision count=1000

*mean*	12.133
σ	12.617
min	0.573
max	121.989

*mean*	461.440
σ	18.406
min	408.000
max	477.000

*mean*	0.027
σ	0.031
min	0.001
max	0.299

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	298.688
σ	1.066
min	298.285
max	301.717

*mean*	442.000
σ	14.832
min	417.000
max	468.000

*mean*	0.596
σ	0.022
min	0.557
max	0.636

Timed compile per phase

Factor

allocated MiB

peak allocated MiB

time (ms)

phase=buildDeclTree

*mean*	173.738
σ	0.000
min	173.738
max	173.738

*mean*	840.000
σ	0.000
min	840.000
max	840.000

*mean*	224.480
σ	22.520
min	196.703
max	254.829

phase=macro expansion

*mean*	6.133
σ	0.000
min	6.133
max	6.133

*mean*	840.000
σ	0.000
min	840.000
max	840.000

*mean*	6.360
σ	0.058
min	6.292
max	6.471

phase=parser

*mean*	1042.431
σ	0.000
min	1042.431
max	1042.431

*mean*	840.000
σ	0.000
min	840.000
max	840.000

*mean*	593.584
σ	3.158
min	588.644
max	596.630

phase=processProdDef

*mean*	2243.980
σ	0.000
min	2243.980
max	2243.980

*mean*	840.000
σ	0.000
min	840.000
max	840.000

*mean*	2643.178
σ	388.114
min	2085.529
max	3033.305

phase=renaming

*mean*	21.671
σ	0.000
min	21.671
max	21.671

*mean*	840.000
σ	0.000
min	840.000
max	840.000

*mean*	20.866
σ	0.263
min	20.555
max	21.216

phase=type checker

*mean*	989.752
σ	0.066
min	989.654
max	989.841

*mean*	840.000
σ	0.000
min	840.000
max	840.000

*mean*	647.939
σ	5.865
min	638.906
max	657.310

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	293.819
σ	0.038
min	293.765
max	293.857

*mean*	444.000
σ	0.000
min	444.000
max	444.000

*mean*	0.396
σ	0.005
min	0.390
max	0.402

iters=5

new-facts=1

prior-facts=6402

*mean*	1320.288
σ	0.143
min	1320.166
max	1320.529

*mean*	1091.000
σ	168.363
min	893.000
max	1322.000

*mean*	1.957
σ	0.106
min	1.852
max	2.123

iters=5

new-facts=6402

prior-facts=1

*mean*	1559.283
σ	2.968
min	1557.759
max	1564.580

*mean*	617.400
σ	93.160
min	500.000
max	730.000

*mean*	2.229
σ	0.178
min	2.082
max	2.489

iters=5

new-facts=6402

prior-facts=6402

*mean*	1882.340
σ	0.052
min	1882.274
max	1882.413

*mean*	1731.000
σ	176.675
min	1474.000
max	1890.000

*mean*	3.011
σ	0.177
min	2.872
max	3.318

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.748
σ	0.158
min	1.539
max	1.867

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	419.768
σ	518.097
min	160.715
max	1196.913

*mean*	101.750
σ	7.500
min	98.000
max	113.000

*mean*	446.000
σ	0.000
min	446.000
max	446.000

*mean*	0.526
σ	0.525
min	0.259
max	1.313

policies=20

*mean*	1607.469
σ	0.356
min	1607.229
max	1607.997

*mean*	980.000
σ	0.000
min	980.000
max	980.000

*mean*	450.250
σ	8.500
min	446.000
max	463.000

*mean*	2.592
σ	0.023
min	2.565
max	2.620

policies=200

*mean*	16083.374
σ	0.087
min	16083.244
max	16083.433

*mean*	9800.000
σ	0.000
min	9800.000
max	9800.000

*mean*	497.250
σ	3.775
min	493.000
max	502.000

*mean*	26.141
σ	0.066
min	26.063
max	26.224