Compare commits

AST compact size (buildDeclTree)

Factor

compact size MiB

phase=buildDeclTree

*mean*	0.203
σ	0.000
min	0.203
max	0.203

AST compact size (macro expansion)

Factor

compact size MiB

phase=macro expansion

*mean*	5.301
σ	0.000
min	5.301
max	5.301

AST compact size (parser)

Factor

compact size MiB

phase=parser

*mean*	5.176
σ	0.000
min	5.176
max	5.176

AST compact size (processProdDef Decls)

Factor

compact size MiB

phase=processProdDef Decls

*mean*	5.676
σ	0.000
min	5.676
max	5.676

AST compact size (processProdDef)

Factor

compact size MiB

phase=processProdDef

*mean*	446.883
σ	0.000
min	446.883
max	446.883

AST compact size (renaming)

Factor

compact size MiB

phase=renaming

*mean*	5.488
σ	0.000
min	5.488
max	5.488

AST compact size (type checker)

Factor

compact size MiB

phase=type checker

*mean*	6.645
σ	0.000
min	6.645
max	6.645

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.862
σ	0.360
min	54.721
max	55.886

*mean*	422.000
σ	0.000
min	422.000
max	422.000

*mean*	0.141
σ	0.004
min	0.137
max	0.148

cache=y

dps=1

iters=10

policies=100

*mean*	43.849
σ	0.006
min	43.840
max	43.863

*mean*	422.000
σ	0.000
min	422.000
max	422.000

*mean*	0.129
σ	0.006
min	0.122
max	0.141

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.617
σ	0.000
min	36.617
max	36.618

*mean*	4587.375
σ	2250.791
min	1486.000
max	7385.000

*mean*	155.465
σ	405.599
min	11.186
max	1159.260

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.000
min	36.617
max	36.618

*mean*	4587.375
σ	2250.791
min	1486.000
max	7385.000

*mean*	14.074
σ	4.646
min	10.753
max	24.456

op=table_records(), no indexes

*mean*	41.948
σ	0.002
min	41.946
max	41.950

*mean*	7385.000
σ	0.000
min	7385.000
max	7385.000

*mean*	10.412
σ	0.231
min	9.992
max	10.724

op=table_records(), repeat

*mean*	41.933
σ	0.000
min	41.933
max	41.934

*mean*	4176.250
σ	1946.608
min	1486.000
max	7385.000

*mean*	11.015
σ	1.777
min	10.162
max	15.387

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.655
σ	0.136
min	27.606
max	27.993

*mean*	4176.250
σ	1946.608
min	1486.000
max	7385.000

*mean*	8.490
σ	1.336
min	7.454
max	11.728

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.406
σ	0.000
min	26.406
max	26.406

*mean*	4176.250
σ	1946.608
min	1486.000
max	7385.000

*mean*	6.600
σ	0.959
min	5.948
max	8.933

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.681
σ	0.003
min	25.680
max	25.688

*mean*	4587.375
σ	2250.791
min	1486.000
max	7385.000

*mean*	6.016
σ	1.057
min	5.232
max	8.318

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.984
σ	0.000
min	25.984
max	25.985

*mean*	4587.375
σ	2250.791
min	1486.000
max	7385.000

*mean*	5.888
σ	1.014
min	5.220
max	8.112

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	1021.627
σ	0.002
min	1021.625
max	1021.629

*mean*	7385.000
σ	0.000
min	7385.000
max	7385.000

*mean*	359.992
σ	42.159
min	342.145
max	464.269

op=load_product(), with indexes

*mean*	3495.878
σ	0.468
min	3495.713
max	3497.038

*mean*	3754.125
σ	2300.484
min	719.000
max	7385.000

*mean*	1781.995
σ	675.063
min	1382.917
max	2964.024

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense, minor warmup

*mean*	107.854
σ	0.000
min	107.854
max	107.854

*mean*	4405.375
σ	2220.308
min	1486.000
max	7385.000

*mean*	290.432
σ	434.655
min	124.319
max	1365.144

op=column_set() on unindexed, dense, repeat

*mean*	62.081
σ	0.000
min	62.081
max	62.082

*mean*	4405.375
σ	2220.308
min	1486.000
max	7385.000

*mean*	44.025
σ	9.751
min	38.864
max	67.831

op=vertical_lookup_list() repeated on unindexed missing Int

*mean*	40.948
σ	0.002
min	40.947
max	40.950

*mean*	7385.000
σ	0.000
min	7385.000
max	7385.000

*mean*	21.640
σ	2.018
min	20.812
max	26.628

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	71.308
σ	0.002
min	71.307
max	71.311

*mean*	7385.000
σ	0.000
min	7385.000
max	7385.000

*mean*	285.714
σ	649.563
min	54.681
max	1893.297

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	4646.850
σ	0.014
min	4646.845
max	4646.884

*mean*	4176.250
σ	1946.608
min	1486.000
max	7385.000

*mean*	3294.435
σ	817.294
min	2500.883
max	4572.118

op=vertical_lookup_list() on indexed

*mean*	1973.851
σ	0.002
min	1973.849
max	1973.854

*mean*	7385.000
σ	0.000
min	7385.000
max	7385.000

*mean*	1074.612
σ	268.023
min	927.412
max	1708.754

op=vertical_lookup_list() on unindexed missing Int, minor warmup

*mean*	905.105
σ	0.002
min	905.102
max	905.108

*mean*	7385.000
σ	0.000
min	7385.000
max	7385.000

*mean*	406.756
σ	38.640
min	384.257
max	501.842

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	148.144
σ	0.001
min	148.144
max	148.148

*mean*	478.000
σ	0.000
min	478.000
max	478.000

*mean*	377.102
σ	31.219
min	317.477
max	414.436

op=pointedIndexFromKvs

rows=400000

*mean*	308.493
σ	0.001
min	308.493
max	308.497

*mean*	564.000
σ	0.000
min	564.000
max	564.000

*mean*	760.076
σ	61.814
min	642.954
max	827.070

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1024.564
σ	0.760
min	1024.095
max	1027.705

*mean*	1047.650
σ	307.505
min	570.000
max	1503.000

*mean*	1.373
σ	0.066
min	1.314
max	1.578

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.913
σ	0.020
min	0.903
max	0.949

*mean*	401.000
σ	0.000
min	401.000
max	401.000

*mean*	0.366
σ	0.431
min	0.149
max	1.134

name=error_case.art

*mean*	2.340
σ	0.012
min	2.334
max	2.362

*mean*	401.000
σ	0.000
min	401.000
max	401.000

*mean*	0.637
σ	0.074
min	0.573
max	0.762

name=heavy_item.art

*mean*	1.523
σ	0.002
min	1.521
max	1.525

*mean*	401.000
σ	0.000
min	401.000
max	401.000

*mean*	0.388
σ	0.029
min	0.371
max	0.440

name=nested_use.art

*mean*	2.358
σ	0.002
min	2.357
max	2.361

*mean*	401.000
σ	0.000
min	401.000
max	401.000

*mean*	0.597
σ	0.025
min	0.576
max	0.636

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	964.971
σ	0.011
min	964.965
max	964.989

*mean*	432.800
σ	3.033
min	430.000
max	436.000

*mean*	0.711
σ	0.014
min	0.694
max	0.725

name=cdr_enhanced_4k_loc.art

*mean*	885.898
σ	0.002
min	885.897
max	885.901

*mean*	436.000
σ	0.000
min	436.000
max	436.000

*mean*	0.480
σ	0.026
min	0.452
max	0.510

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.710
σ	0.002
min	7.709
max	7.713

*mean*	436.000
σ	0.000
min	436.000
max	436.000

*mean*	2.592
σ	0.091
min	2.441
max	2.866

name=record_render_large_syntax_err.art

*mean*	7.658
σ	0.002
min	7.657
max	7.661

*mean*	436.000
σ	0.000
min	436.000
max	436.000

*mean*	2.619
σ	0.102
min	2.493
max	3.019

name=record_render_success.art

*mean*	2.290
σ	0.002
min	2.289
max	2.293

*mean*	436.000
σ	0.000
min	436.000
max	436.000

*mean*	0.306
σ	0.009
min	0.293
max	0.376

name=record_render_syntax_err.art

*mean*	2.165
σ	0.002
min	2.164
max	2.168

*mean*	436.000
σ	0.000
min	436.000
max	436.000

*mean*	0.301
σ	0.013
min	0.287
max	0.360

Revision Creation

Factor

allocated MiB

peak allocated MiB

time_s

number of threads=8

revision count=1000

*mean*	11.629
σ	12.714
min	0.573
max	110.967

*mean*	455.334
σ	17.633
min	406.000
max	470.000

*mean*	0.027
σ	0.031
min	0.001
max	0.265

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	298.844
σ	1.046
min	298.387
max	301.816

*mean*	438.700
σ	16.255
min	413.000
max	464.000

*mean*	0.597
σ	0.031
min	0.550
max	0.657

Timed compile per phase

Factor

allocated MiB

peak allocated MiB

time (ms)

phase=buildDeclTree

*mean*	173.738
σ	0.000
min	173.738
max	173.738

*mean*	839.000
σ	0.000
min	839.000
max	839.000

*mean*	239.863
σ	18.280
min	198.231
max	252.826

phase=macro expansion

*mean*	6.130
σ	0.000
min	6.130
max	6.130

*mean*	839.000
σ	0.000
min	839.000
max	839.000

*mean*	8.995
σ	1.045
min	7.234
max	9.795

phase=parser

*mean*	1042.433
σ	0.000
min	1042.432
max	1042.433

*mean*	839.000
σ	0.000
min	839.000
max	839.000

*mean*	549.410
σ	88.765
min	389.931
max	602.770

phase=processProdDef

*mean*	2243.977
σ	0.000
min	2243.977
max	2243.977

*mean*	839.000
σ	0.000
min	839.000
max	839.000

*mean*	2611.599
σ	310.504
min	2138.213
max	3031.776

phase=renaming

*mean*	21.675
σ	0.000
min	21.675
max	21.675

*mean*	839.000
σ	0.000
min	839.000
max	839.000

*mean*	37.038
σ	6.577
min	26.177
max	41.004

phase=type checker

*mean*	989.752
σ	0.066
min	989.654
max	989.841

*mean*	839.000
σ	0.000
min	839.000
max	839.000

*mean*	664.502
σ	15.737
min	637.998
max	675.619

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	293.821
σ	0.037
min	293.768
max	293.859

*mean*	444.000
σ	0.000
min	444.000
max	444.000

*mean*	0.392
σ	0.008
min	0.387
max	0.406

iters=5

new-facts=1

prior-facts=6402

*mean*	1320.303
σ	0.094
min	1320.156
max	1320.403

*mean*	1089.400
σ	166.536
min	893.000
max	1317.000

*mean*	2.069
σ	0.203
min	1.844
max	2.297

iters=5

new-facts=6402

prior-facts=1

*mean*	1559.322
σ	2.957
min	1557.788
max	1564.602

*mean*	626.000
σ	87.684
min	495.000
max	728.000

*mean*	2.271
σ	0.150
min	2.176
max	2.534

iters=5

new-facts=6402

prior-facts=6402

*mean*	1882.339
σ	0.052
min	1882.278
max	1882.415

*mean*	1734.000
σ	177.255
min	1467.000
max	1884.000

*mean*	2.965
σ	0.118
min	2.863
max	3.150

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.700
σ	0.113
min	1.526
max	1.809

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	419.942
σ	518.105
min	160.885
max	1197.099

*mean*	101.750
σ	7.500
min	98.000
max	113.000

*mean*	447.000
σ	0.000
min	447.000
max	447.000

*mean*	0.525
σ	0.525
min	0.259
max	1.312

policies=20

*mean*	1609.181
σ	0.350
min	1608.939
max	1609.700

*mean*	980.000
σ	0.000
min	980.000
max	980.000

*mean*	450.000
σ	6.000
min	447.000
max	459.000

*mean*	2.584
σ	0.020
min	2.565
max	2.610

policies=200

*mean*	16100.660
σ	0.156
min	16100.503
max	16100.874

*mean*	9800.000
σ	0.000
min	9800.000
max	9800.000

*mean*	496.000
σ	3.742
min	491.000
max	500.000

*mean*	25.977
σ	0.140
min	25.871
max	26.176