Compare commits

AST compact size (buildDeclTree)

Factor

compact size MiB

phase=buildDeclTree

*mean*	0.203
σ	0.000
min	0.203
max	0.203

AST compact size (macro expansion)

Factor

compact size MiB

phase=macro expansion

*mean*	5.301
σ	0.000
min	5.301
max	5.301

AST compact size (parser)

Factor

compact size MiB

phase=parser

*mean*	5.176
σ	0.000
min	5.176
max	5.176

AST compact size (processProdDef Decls)

Factor

compact size MiB

phase=processProdDef Decls

*mean*	5.676
σ	0.000
min	5.676
max	5.676

AST compact size (processProdDef)

Factor

compact size MiB

phase=processProdDef

*mean*	446.883
σ	0.000
min	446.883
max	446.883

AST compact size (renaming)

Factor

compact size MiB

phase=renaming

*mean*	5.488
σ	0.000
min	5.488
max	5.488

AST compact size (type checker)

Factor

compact size MiB

phase=type checker

*mean*	6.645
σ	0.000
min	6.645
max	6.645

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.774
σ	0.363
min	54.626
max	55.806

*mean*	416.000
σ	0.000
min	416.000
max	416.000

*mean*	0.141
σ	0.005
min	0.136
max	0.149

cache=y

dps=1

iters=10

policies=100

*mean*	43.774
σ	0.005
min	43.767
max	43.783

*mean*	416.000
σ	0.000
min	416.000
max	416.000

*mean*	0.122
σ	0.004
min	0.115
max	0.130

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.617
σ	0.000
min	36.617
max	36.618

*mean*	4578.625
σ	2255.919
min	1486.000
max	7402.000

*mean*	12.921
σ	3.301
min	11.467
max	21.077

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.000
min	36.617
max	36.618

*mean*	4578.625
σ	2255.919
min	1486.000
max	7402.000

*mean*	13.416
σ	3.434
min	11.206
max	21.848

op=table_records(), no indexes

*mean*	41.948
σ	0.002
min	41.946
max	41.950

*mean*	7402.000
σ	0.000
min	7402.000
max	7402.000

*mean*	10.482
σ	0.198
min	10.166
max	10.797

op=table_records(), repeat

*mean*	41.933
σ	0.001
min	41.933
max	41.934

*mean*	4161.625
σ	1946.588
min	1486.000
max	7402.000

*mean*	11.236
σ	1.683
min	10.487
max	15.377

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.655
σ	0.137
min	27.606
max	27.993

*mean*	4161.625
σ	1946.588
min	1486.000
max	7402.000

*mean*	8.554
σ	1.442
min	7.255
max	12.003

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.406
σ	0.000
min	26.406
max	26.406

*mean*	4161.625
σ	1946.588
min	1486.000
max	7402.000

*mean*	6.099
σ	1.029
min	5.172
max	8.499

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.681
σ	0.003
min	25.680
max	25.688

*mean*	4578.625
σ	2255.919
min	1486.000
max	7402.000

*mean*	5.831
σ	0.907
min	5.288
max	8.055

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.984
σ	0.000
min	25.984
max	25.985

*mean*	4578.625
σ	2255.919
min	1486.000
max	7402.000

*mean*	5.718
σ	0.948
min	5.275
max	8.055

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	1021.627
σ	0.002
min	1021.625
max	1021.629

*mean*	7402.000
σ	0.000
min	7402.000
max	7402.000

*mean*	358.040
σ	45.194
min	338.225
max	469.744

op=load_product(), with indexes

*mean*	3495.878
σ	0.469
min	3495.713
max	3497.038

*mean*	3743.375
σ	2297.844
min	720.000
max	7402.000

*mean*	1597.743
σ	532.834
min	1368.438
max	2907.223

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense, minor warmup

*mean*	107.854
σ	0.000
min	107.854
max	107.855

*mean*	4396.625
σ	2227.492
min	1486.000
max	7402.000

*mean*	223.234
σ	250.077
min	123.604
max	840.639

op=column_set() on unindexed, dense, repeat

*mean*	62.082
σ	0.000
min	62.081
max	62.082

*mean*	4578.625
σ	2255.919
min	1486.000
max	7402.000

*mean*	217.381
σ	490.574
min	41.241
max	1431.475

op=vertical_lookup_list() repeated on unindexed missing Int

*mean*	40.948
σ	0.002
min	40.947
max	40.950

*mean*	7402.000
σ	0.000
min	7402.000
max	7402.000

*mean*	22.508
σ	2.178
min	21.027
max	27.094

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	71.308
σ	0.002
min	71.307
max	71.311

*mean*	7402.000
σ	0.000
min	7402.000
max	7402.000

*mean*	278.115
σ	629.663
min	54.369
max	1836.448

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	4646.851
σ	0.014
min	4646.845
max	4646.885

*mean*	4161.625
σ	1946.588
min	1486.000
max	7402.000

*mean*	3145.550
σ	1003.422
min	2458.133
max	5303.590

op=vertical_lookup_list() on indexed

*mean*	1973.851
σ	0.002
min	1973.849
max	1973.854

*mean*	7402.000
σ	0.000
min	7402.000
max	7402.000

*mean*	1080.163
σ	281.154
min	896.200
max	1679.545

op=vertical_lookup_list() on unindexed missing Int, minor warmup

*mean*	905.105
σ	0.002
min	905.102
max	905.108

*mean*	7402.000
σ	0.000
min	7402.000
max	7402.000

*mean*	416.044
σ	53.127
min	384.615
max	506.071

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	148.144
σ	0.001
min	148.144
max	148.148

*mean*	476.500
σ	1.604
min	475.000
max	478.000

*mean*	380.899
σ	9.824
min	364.296
max	392.429

op=pointedIndexFromKvs

rows=400000

*mean*	308.493
σ	0.001
min	308.493
max	308.497

*mean*	562.000
σ	0.000
min	562.000
max	562.000

*mean*	742.300
σ	50.829
min	641.789
max	817.509

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	963.969
σ	1.821
min	963.262
max	971.671

*mean*	1042.150
σ	305.144
min	584.000
max	1489.000

*mean*	1.269
σ	0.131
min	1.175
max	1.735

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.913
σ	0.020
min	0.903
max	0.949

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.305
σ	0.298
min	0.145
max	0.832

name=error_case.art

*mean*	2.340
σ	0.012
min	2.334
max	2.362

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.479
σ	0.321
min	0.323
max	1.053

name=heavy_item.art

*mean*	1.523
σ	0.002
min	1.521
max	1.525

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.219
σ	0.025
min	0.201
max	0.262

name=nested_use.art

*mean*	2.358
σ	0.002
min	2.357
max	2.361

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.338
σ	0.024
min	0.319
max	0.379

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	964.971
σ	0.011
min	964.965
max	964.989

*mean*	431.400
σ	0.894
min	431.000
max	433.000

*mean*	0.562
σ	0.069
min	0.440
max	0.609

name=cdr_enhanced_4k_loc.art

*mean*	885.898
σ	0.002
min	885.897
max	885.901

*mean*	439.000
σ	0.000
min	439.000
max	439.000

*mean*	0.510
σ	0.020
min	0.475
max	0.527

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.710
σ	0.002
min	7.709
max	7.713

*mean*	439.000
σ	0.000
min	439.000
max	439.000

*mean*	2.727
σ	0.116
min	2.484
max	3.484

name=record_render_large_syntax_err.art

*mean*	7.658
σ	0.002
min	7.657
max	7.661

*mean*	439.000
σ	0.000
min	439.000
max	439.000

*mean*	2.664
σ	0.131
min	2.441
max	3.549

name=record_render_success.art

*mean*	2.290
σ	0.002
min	2.289
max	2.293

*mean*	439.000
σ	0.000
min	439.000
max	439.000

*mean*	0.311
σ	0.009
min	0.298
max	0.357

name=record_render_syntax_err.art

*mean*	2.165
σ	0.002
min	2.164
max	2.168

*mean*	439.000
σ	0.000
min	439.000
max	439.000

*mean*	0.298
σ	0.011
min	0.280
max	0.360

Revision Creation

Factor

allocated MiB

peak allocated MiB

time_s

number of threads=8

revision count=1000

*mean*	11.639
σ	11.950
min	0.574
max	104.582

*mean*	468.517
σ	20.138
min	406.000
max	482.000

*mean*	0.027
σ	0.029
min	0.001
max	0.249

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	278.610
σ	1.018
min	278.125
max	281.490

*mean*	442.700
σ	17.269
min	415.000
max	466.000

*mean*	0.585
σ	0.011
min	0.572
max	0.606

Timed compile per phase

Factor

allocated MiB

peak allocated MiB

time (ms)

phase=buildDeclTree

*mean*	173.738
σ	0.000
min	173.738
max	173.738

*mean*	844.000
σ	0.000
min	844.000
max	844.000

*mean*	213.073
σ	29.721
min	166.932
max	256.166

phase=macro expansion

*mean*	6.130
σ	0.000
min	6.130
max	6.130

*mean*	843.375
σ	1.768
min	839.000
max	844.000

*mean*	9.578
σ	0.297
min	9.290
max	10.279

phase=parser

*mean*	1042.434
σ	0.000
min	1042.434
max	1042.434

*mean*	843.375
σ	1.768
min	839.000
max	844.000

*mean*	573.636
σ	48.794
min	456.106
max	601.065

phase=processProdDef

*mean*	2243.975
σ	0.000
min	2243.975
max	2243.975

*mean*	844.000
σ	0.000
min	844.000
max	844.000

*mean*	2844.532
σ	526.482
min	1817.612
max	3420.413

phase=renaming

*mean*	21.671
σ	0.000
min	21.671
max	21.671

*mean*	843.375
σ	1.768
min	839.000
max	844.000

*mean*	39.864
σ	0.444
min	39.136
max	40.377

phase=type checker

*mean*	989.752
σ	0.066
min	989.654
max	989.841

*mean*	843.375
σ	1.768
min	839.000
max	844.000

*mean*	704.950
σ	41.240
min	661.848
max	788.487

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	282.386
σ	0.037
min	282.337
max	282.428

*mean*	444.400
σ	0.548
min	444.000
max	445.000

*mean*	0.375
σ	0.001
min	0.374
max	0.376

iters=5

new-facts=1

prior-facts=6402

*mean*	1267.129
σ	0.099
min	1266.988
max	1267.265

*mean*	1090.000
σ	174.225
min	851.000
max	1296.000

*mean*	1.997
σ	0.179
min	1.802
max	2.191

iters=5

new-facts=6402

prior-facts=1

*mean*	1506.069
σ	2.951
min	1504.516
max	1511.332

*mean*	616.200
σ	78.158
min	496.000
max	704.000

*mean*	2.175
σ	0.217
min	2.049
max	2.561

iters=5

new-facts=6402

prior-facts=6402

*mean*	1829.105
σ	0.029
min	1829.061
max	1829.133

*mean*	1722.400
σ	208.775
min	1432.000
max	1916.000

*mean*	2.862
σ	0.104
min	2.769
max	3.022

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.733
σ	0.118
min	1.542
max	1.866

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	397.697
σ	518.051
min	138.669
max	1174.773

*mean*	97.750
σ	7.500
min	94.000
max	109.000

*mean*	444.000
σ	0.000
min	444.000
max	444.000

*mean*	0.497
σ	0.516
min	0.239
max	1.272

policies=20

*mean*	1386.825
σ	0.165
min	1386.712
max	1387.071

*mean*	940.000
σ	0.000
min	940.000
max	940.000

*mean*	444.000
σ	0.000
min	444.000
max	444.000

*mean*	2.319
σ	0.007
min	2.308
max	2.323

policies=200

*mean*	13876.840
σ	0.079
min	13876.748
max	13876.939

*mean*	9400.000
σ	0.000
min	9400.000
max	9400.000

*mean*	495.750
σ	6.076
min	489.000
max	503.000

*mean*	23.417
σ	0.122
min	23.303
max	23.543