Compare commits

AST compact size (buildDeclTree)

Factor

compact size MiB

phase=buildDeclTree

*mean*	0.203
σ	0.000
min	0.203
max	0.203

AST compact size (macro expansion)

Factor

compact size MiB

phase=macro expansion

*mean*	5.082
σ	0.000
min	5.082
max	5.082

AST compact size (parser)

Factor

compact size MiB

phase=parser

*mean*	4.988
σ	0.000
min	4.988
max	4.988

AST compact size (processProdDef Decls)

Factor

compact size MiB

phase=processProdDef Decls

*mean*	4.863
σ	0.000
min	4.863
max	4.863

AST compact size (processProdDef)

Factor

compact size MiB

phase=processProdDef

*mean*	446.102
σ	0.000
min	446.102
max	446.102

AST compact size (renaming)

Factor

compact size MiB

phase=renaming

*mean*	5.238
σ	0.000
min	5.238
max	5.238

AST compact size (type checker)

Factor

compact size MiB

phase=type checker

*mean*	6.395
σ	0.000
min	6.395
max	6.395

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	57.825
σ	0.361
min	57.686
max	58.852

*mean*	422.000
σ	0.000
min	422.000
max	422.000

*mean*	0.147
σ	0.005
min	0.138
max	0.155

cache=y

dps=1

iters=10

policies=100

*mean*	46.899
σ	0.006
min	46.889
max	46.912

*mean*	422.000
σ	0.000
min	422.000
max	422.000

*mean*	0.128
σ	0.005
min	0.122
max	0.137

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.606
σ	0.000
min	36.605
max	36.606

*mean*	4229.375
σ	2155.059
min	1222.000
max	6996.000

*mean*	12.261
σ	0.514
min	11.780
max	13.442

op=column_set() on indexed, repeat

*mean*	36.606
σ	0.000
min	36.605
max	36.606

*mean*	4229.375
σ	2155.059
min	1222.000
max	6996.000

*mean*	12.247
σ	0.663
min	11.207
max	12.811

op=table_records(), no indexes

*mean*	41.940
σ	0.002
min	41.939
max	41.943

*mean*	6996.000
σ	0.000
min	6996.000
max	6996.000

*mean*	11.124
σ	0.201
min	10.875
max	11.434

op=table_records(), repeat

*mean*	41.926
σ	0.001
min	41.925
max	41.929

*mean*	4229.375
σ	2155.059
min	1222.000
max	6996.000

*mean*	11.017
σ	0.293
min	10.780
max	11.683

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.634
σ	0.137
min	27.586
max	27.973

*mean*	4229.375
σ	2155.059
min	1222.000
max	6996.000

*mean*	8.560
σ	0.383
min	8.015
max	8.962

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.386
σ	0.000
min	26.386
max	26.386

*mean*	4229.375
σ	2155.059
min	1222.000
max	6996.000

*mean*	6.764
σ	0.194
min	6.527
max	6.977

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.664
σ	0.004
min	25.662
max	25.675

*mean*	4229.375
σ	2155.059
min	1222.000
max	6996.000

*mean*	5.779
σ	0.191
min	5.569
max	6.061

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.963
σ	0.000
min	25.963
max	25.964

*mean*	4229.375
σ	2155.059
min	1222.000
max	6996.000

*mean*	5.686
σ	0.215
min	5.310
max	5.998

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	1021.600
σ	0.002
min	1021.598
max	1021.602

*mean*	6996.000
σ	0.000
min	6996.000
max	6996.000

*mean*	348.288
σ	2.368
min	343.979
max	351.191

op=load_product(), with indexes

*mean*	3495.849
σ	0.460
min	3495.686
max	3496.988

*mean*	3479.125
σ	2112.292
min	640.000
max	6996.000

*mean*	1636.272
σ	540.251
min	1387.303
max	2932.621

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense, minor warmup

*mean*	107.842
σ	0.000
min	107.842
max	107.843

*mean*	4229.375
σ	2155.059
min	1222.000
max	6996.000

*mean*	129.985
σ	5.921
min	122.046
max	136.966

op=column_set() on unindexed, dense, repeat

*mean*	62.069
σ	0.001
min	62.066
max	62.070

*mean*	4229.375
σ	2155.059
min	1222.000
max	6996.000

*mean*	43.039
σ	1.201
min	41.465
max	45.140

op=vertical_lookup_list() repeated on unindexed missing Int

*mean*	40.928
σ	0.002
min	40.926
max	40.930

*mean*	6996.000
σ	0.000
min	6996.000
max	6996.000

*mean*	22.219
σ	1.110
min	21.644
max	24.942

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	71.295
σ	0.002
min	71.294
max	71.298

*mean*	6996.000
σ	0.000
min	6996.000
max	6996.000

*mean*	55.727
σ	0.624
min	54.798
max	56.877

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	4646.843
σ	0.013
min	4646.838
max	4646.876

*mean*	4229.375
σ	2155.059
min	1222.000
max	6996.000

*mean*	3535.271
σ	755.258
min	2492.800
max	4564.553

op=vertical_lookup_list() on indexed

*mean*	1973.831
σ	0.002
min	1973.829
max	1973.833

*mean*	6996.000
σ	0.000
min	6996.000
max	6996.000

*mean*	1096.668
σ	406.242
min	916.757
max	2083.339

op=vertical_lookup_list() on unindexed missing Int, minor warmup

*mean*	905.084
σ	0.002
min	905.082
max	905.088

*mean*	6996.000
σ	0.000
min	6996.000
max	6996.000

*mean*	403.718
σ	40.397
min	377.388
max	502.707

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	148.144
σ	0.001
min	148.144
max	148.148

*mean*	476.125
σ	0.354
min	476.000
max	477.000

*mean*	378.865
σ	49.881
min	300.659
max	431.572

op=pointedIndexFromKvs

rows=400000

*mean*	308.493
σ	0.001
min	308.493
max	308.497

*mean*	565.000
σ	0.000
min	565.000
max	565.000

*mean*	767.595
σ	69.476
min	636.556
max	871.886

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	976.915
σ	2.439
min	976.070
max	987.250

*mean*	1048.150
σ	317.287
min	559.000
max	1515.000

*mean*	1.273
σ	0.070
min	1.186
max	1.461

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.913
σ	0.020
min	0.903
max	0.949

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.391
σ	0.513
min	0.139
max	1.307

name=error_case.art

*mean*	2.347
σ	0.012
min	2.340
max	2.369

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.472
σ	0.330
min	0.312
max	1.062

name=heavy_item.art

*mean*	1.523
σ	0.002
min	1.522
max	1.526

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.217
σ	0.022
min	0.200
max	0.255

name=nested_use.art

*mean*	2.365
σ	0.002
min	2.364
max	2.368

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.327
σ	0.018
min	0.310
max	0.356

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	965.086
σ	0.009
min	965.081
max	965.103

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	0.580
σ	0.028
min	0.531
max	0.601

name=cdr_enhanced_4k_loc.art

*mean*	886.468
σ	0.002
min	886.467
max	886.470

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	0.473
σ	0.049
min	0.407
max	0.521

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.719
σ	0.002
min	7.718
max	7.722

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	1.942
σ	0.074
min	1.784
max	2.225

name=record_render_large_syntax_err.art

*mean*	7.668
σ	0.002
min	7.667
max	7.671

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	1.945
σ	0.073
min	1.827
max	2.267

name=record_render_success.art

*mean*	2.290
σ	0.002
min	2.290
max	2.294

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	0.302
σ	0.010
min	0.286
max	0.346

name=record_render_syntax_err.art

*mean*	2.166
σ	0.002
min	2.165
max	2.169

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	0.290
σ	0.020
min	0.274
max	0.464

Revision Creation

Factor

allocated MiB

peak allocated MiB

time_s

number of threads=8

revision count=1000

*mean*	11.899
σ	11.767
min	0.574
max	82.364

*mean*	459.185
σ	17.261
min	406.000
max	475.000

*mean*	0.027
σ	0.029
min	0.001
max	0.202

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	293.817
σ	1.033
min	293.404
max	296.751

*mean*	442.100
σ	17.438
min	416.000
max	463.000

*mean*	0.580
σ	0.041
min	0.519
max	0.639

Timed compile per phase

Factor

allocated MiB

peak allocated MiB

time (ms)

phase=buildDeclTree

*mean*	106.546
σ	0.000
min	106.546
max	106.546

*mean*	850.000
σ	0.000
min	850.000
max	850.000

*mean*	151.867
σ	11.126
min	138.646
max	164.381

phase=macro expansion

*mean*	5.897
σ	0.000
min	5.897
max	5.897

*mean*	850.000
σ	0.000
min	850.000
max	850.000

*mean*	7.542
σ	2.266
min	5.772
max	11.969

phase=parser

*mean*	1042.247
σ	0.000
min	1042.247
max	1042.247

*mean*	850.000
σ	0.000
min	850.000
max	850.000

*mean*	481.092
σ	139.005
min	366.686
max	721.727

phase=processProdDef

*mean*	2241.197
σ	0.000
min	2241.197
max	2241.197

*mean*	850.000
σ	0.000
min	850.000
max	850.000

*mean*	2837.584
σ	410.935
min	2007.692
max	3337.469

phase=renaming

*mean*	21.430
σ	0.000
min	21.430
max	21.430

*mean*	850.000
σ	0.000
min	850.000
max	850.000

*mean*	35.889
σ	9.431
min	20.084
max	47.178

phase=type checker

*mean*	958.462
σ	0.047
min	958.439
max	958.564

*mean*	850.000
σ	0.000
min	850.000
max	850.000

*mean*	678.276
σ	58.464
min	609.992
max	775.004

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	328.017
σ	0.037
min	327.966
max	328.055

*mean*	439.200
σ	3.701
min	433.000
max	442.000

*mean*	0.436
σ	0.008
min	0.423
max	0.445

iters=5

new-facts=1

prior-facts=6402

*mean*	1313.236
σ	0.137
min	1313.125
max	1313.471

*mean*	1072.000
σ	164.610
min	876.000
max	1279.000

*mean*	1.887
σ	0.053
min	1.827
max	1.934

iters=5

new-facts=6402

prior-facts=1

*mean*	1552.231
σ	3.032
min	1550.693
max	1557.647

*mean*	618.000
σ	85.029
min	519.000
max	732.000

*mean*	2.268
σ	0.135
min	2.135
max	2.442

iters=5

new-facts=6402

prior-facts=6402

*mean*	1875.222
σ	0.046
min	1875.165
max	1875.274

*mean*	1708.600
σ	265.396
min	1391.000
max	2078.000

*mean*	2.893
σ	0.084
min	2.821
max	3.034

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.628
σ	0.137
min	1.390
max	1.731

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	419.419
σ	508.919
min	164.957
max	1182.797

*mean*	101.250
σ	6.500
min	98.000
max	111.000

*mean*	429.000
σ	0.000
min	429.000
max	429.000

*mean*	0.531
σ	0.529
min	0.261
max	1.325

policies=20

*mean*	1649.816
σ	0.368
min	1649.591
max	1650.366

*mean*	980.000
σ	0.000
min	980.000
max	980.000

*mean*	448.000
σ	17.088
min	429.000
max	469.000

*mean*	2.654
σ	0.012
min	2.647
max	2.671

policies=200

*mean*	16506.095
σ	0.052
min	16506.040
max	16506.141

*mean*	9800.000
σ	0.000
min	9800.000
max	9800.000

*mean*	497.000
σ	6.481
min	490.000
max	505.000

*mean*	26.697
σ	0.149
min	26.566
max	26.834