Compare commits

AST compact size (buildDeclTree)

Factor

compact size MiB

phase=buildDeclTree

*mean*	0.203
σ	0.000
min	0.203
max	0.203

AST compact size (macro expansion)

Factor

compact size MiB

phase=macro expansion

*mean*	5.082
σ	0.000
min	5.082
max	5.082

AST compact size (parser)

Factor

compact size MiB

phase=parser

*mean*	4.988
σ	0.000
min	4.988
max	4.988

AST compact size (processProdDef Decls)

Factor

compact size MiB

phase=processProdDef Decls

*mean*	4.863
σ	0.000
min	4.863
max	4.863

AST compact size (processProdDef)

Factor

compact size MiB

phase=processProdDef

*mean*	446.102
σ	0.000
min	446.102
max	446.102

AST compact size (renaming)

Factor

compact size MiB

phase=renaming

*mean*	5.238
σ	0.000
min	5.238
max	5.238

AST compact size (type checker)

Factor

compact size MiB

phase=type checker

*mean*	6.395
σ	0.000
min	6.395
max	6.395

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	57.823
σ	0.360
min	57.679
max	58.846

*mean*	420.000
σ	0.000
min	420.000
max	420.000

*mean*	0.145
σ	0.005
min	0.137
max	0.151

cache=y

dps=1

iters=10

policies=100

*mean*	46.897
σ	0.003
min	46.890
max	46.900

*mean*	420.000
σ	0.000
min	420.000
max	420.000

*mean*	0.127
σ	0.005
min	0.122
max	0.136

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.605
σ	0.000
min	36.605
max	36.605

*mean*	4585.000
σ	2253.356
min	1487.000
max	7403.000

*mean*	13.357
σ	3.479
min	11.783
max	21.931

op=column_set() on indexed, repeat

*mean*	36.605
σ	0.000
min	36.605
max	36.605

*mean*	4585.000
σ	2253.356
min	1487.000
max	7403.000

*mean*	13.791
σ	3.029
min	11.953
max	21.227

op=table_records(), no indexes

*mean*	41.940
σ	0.002
min	41.938
max	41.942

*mean*	7403.000
σ	0.000
min	7403.000
max	7403.000

*mean*	11.149
σ	0.101
min	10.950
max	11.251

op=table_records(), repeat

*mean*	41.925
σ	0.001
min	41.924
max	41.926

*mean*	4170.625
σ	1944.792
min	1487.000
max	7403.000

*mean*	11.676
σ	1.929
min	10.551
max	16.409

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.634
σ	0.136
min	27.585
max	27.972

*mean*	4170.625
σ	1944.792
min	1487.000
max	7403.000

*mean*	9.064
σ	1.125
min	8.057
max	11.774

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.385
σ	0.000
min	26.385
max	26.385

*mean*	4170.625
σ	1944.792
min	1487.000
max	7403.000

*mean*	7.112
σ	0.742
min	6.524
max	8.880

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.663
σ	0.004
min	25.662
max	25.674

*mean*	4585.000
σ	2253.356
min	1487.000
max	7403.000

*mean*	6.359
σ	0.867
min	5.801
max	8.474

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.962
σ	0.000
min	25.962
max	25.964

*mean*	4585.000
σ	2253.356
min	1487.000
max	7403.000

*mean*	6.117
σ	0.467
min	5.742
max	7.219

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	1021.599
σ	0.002
min	1021.597
max	1021.602

*mean*	7403.000
σ	0.000
min	7403.000
max	7403.000

*mean*	358.937
σ	42.466
min	341.534
max	463.978

op=load_product(), with indexes

*mean*	3495.846
σ	0.455
min	3495.685
max	3496.972

*mean*	3749.625
σ	2297.750
min	720.000
max	7403.000

*mean*	1629.071
σ	554.957
min	1395.828
max	2995.343

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense, minor warmup

*mean*	107.842
σ	0.000
min	107.841
max	107.842

*mean*	4405.375
σ	2224.814
min	1487.000
max	7403.000

*mean*	191.950
σ	149.781
min	125.747
max	559.985

op=column_set() on unindexed, dense, repeat

*mean*	62.069
σ	0.001
min	62.065
max	62.070

*mean*	4585.000
σ	2253.356
min	1487.000
max	7403.000

*mean*	199.242
σ	441.668
min	40.436
max	1292.307

op=vertical_lookup_list() repeated on unindexed missing Int

*mean*	40.927
σ	0.002
min	40.926
max	40.930

*mean*	7403.000
σ	0.000
min	7403.000
max	7403.000

*mean*	21.971
σ	0.870
min	21.531
max	24.112

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	71.294
σ	0.002
min	71.293
max	71.297

*mean*	7403.000
σ	0.000
min	7403.000
max	7403.000

*mean*	256.484
σ	567.066
min	54.819
max	1659.898

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	4646.842
σ	0.013
min	4646.837
max	4646.875

*mean*	4170.625
σ	1944.792
min	1487.000
max	7403.000

*mean*	3137.073
σ	866.663
min	2499.310
max	4649.434

op=vertical_lookup_list() on indexed

*mean*	1973.830
σ	0.002
min	1973.829
max	1973.833

*mean*	7403.000
σ	0.000
min	7403.000
max	7403.000

*mean*	1038.864
σ	179.154
min	921.308
max	1425.097

op=vertical_lookup_list() on unindexed missing Int, minor warmup

*mean*	905.084
σ	0.002
min	905.082
max	905.087

*mean*	7403.000
σ	0.000
min	7403.000
max	7403.000

*mean*	391.008
σ	3.056
min	385.832
max	395.259

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	148.144
σ	0.001
min	148.144
max	148.148

*mean*	476.250
σ	0.707
min	476.000
max	478.000

*mean*	392.362
σ	37.781
min	321.491
max	445.785

op=pointedIndexFromKvs

rows=400000

*mean*	308.493
σ	0.001
min	308.493
max	308.497

*mean*	562.000
σ	0.000
min	562.000
max	562.000

*mean*	737.089
σ	52.314
min	632.334
max	784.998

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	976.914
σ	2.439
min	976.070
max	987.250

*mean*	1042.450
σ	319.636
min	562.000
max	1529.000

*mean*	1.270
σ	0.107
min	1.071
max	1.603

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.913
σ	0.020
min	0.903
max	0.949

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.396
σ	0.514
min	0.140
max	1.314

name=error_case.art

*mean*	2.346
σ	0.012
min	2.340
max	2.368

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.630
σ	0.255
min	0.349
max	1.047

name=heavy_item.art

*mean*	1.523
σ	0.002
min	1.522
max	1.526

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.378
σ	0.047
min	0.346
max	0.456

name=nested_use.art

*mean*	2.364
σ	0.002
min	2.363
max	2.367

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.597
σ	0.028
min	0.569
max	0.639

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	964.978
σ	0.009
min	964.973
max	964.995

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	0.691
σ	0.049
min	0.628
max	0.755

name=cdr_enhanced_4k_loc.art

*mean*	886.000
σ	0.002
min	885.999
max	886.003

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	0.501
σ	0.036
min	0.437
max	0.522

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.719
σ	0.002
min	7.718
max	7.722

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	1.997
σ	0.080
min	1.877
max	2.260

name=record_render_large_syntax_err.art

*mean*	7.667
σ	0.002
min	7.666
max	7.670

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	1.970
σ	0.075
min	1.803
max	2.199

name=record_render_success.art

*mean*	2.290
σ	0.002
min	2.290
max	2.294

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	0.303
σ	0.008
min	0.290
max	0.344

name=record_render_syntax_err.art

*mean*	2.166
σ	0.002
min	2.165
max	2.169

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	0.295
σ	0.021
min	0.275
max	0.451

Revision Creation

Factor

allocated MiB

peak allocated MiB

time_s

number of threads=8

revision count=1000

*mean*	11.790
σ	11.842
min	0.574
max	96.659

*mean*	464.957
σ	18.277
min	408.000
max	479.000

*mean*	0.027
σ	0.029
min	0.001
max	0.232

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	293.710
σ	1.057
min	293.237
max	296.709

*mean*	444.800
σ	15.505
min	425.000
max	464.000

*mean*	0.588
σ	0.012
min	0.567
max	0.601

Timed compile per phase

Factor

allocated MiB

peak allocated MiB

time (ms)

phase=buildDeclTree

*mean*	106.546
σ	0.000
min	106.546
max	106.546

*mean*	847.000
σ	0.000
min	847.000
max	847.000

*mean*	150.368
σ	8.637
min	139.240
max	161.584

phase=macro expansion

*mean*	5.894
σ	0.000
min	5.894
max	5.894

*mean*	847.000
σ	0.000
min	847.000
max	847.000

*mean*	6.867
σ	1.687
min	5.887
max	10.037

phase=parser

*mean*	1042.134
σ	0.001
min	1042.131
max	1042.134

*mean*	847.000
σ	0.000
min	847.000
max	847.000

*mean*	427.810
σ	95.549
min	375.481
max	598.516

phase=processProdDef

*mean*	2241.193
σ	0.000
min	2241.193
max	2241.194

*mean*	847.000
σ	0.000
min	847.000
max	847.000

*mean*	2798.595
σ	366.778
min	2343.910
max	3276.034

phase=renaming

*mean*	21.430
σ	0.001
min	21.430
max	21.433

*mean*	847.000
σ	0.000
min	847.000
max	847.000

*mean*	38.168
σ	4.022
min	30.770
max	42.246

phase=type checker

*mean*	958.466
σ	0.047
min	958.439
max	958.568

*mean*	847.000
σ	0.000
min	847.000
max	847.000

*mean*	693.129
σ	56.378
min	642.772
max	822.610

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	327.854
σ	0.037
min	327.803
max	327.891

*mean*	442.200
σ	4.919
min	434.000
max	447.000

*mean*	0.431
σ	0.008
min	0.424
max	0.445

iters=5

new-facts=1

prior-facts=6402

*mean*	1313.071
σ	0.128
min	1312.963
max	1313.289

*mean*	1095.200
σ	196.449
min	857.000
max	1351.000

*mean*	1.882
σ	0.037
min	1.824
max	1.916

iters=5

new-facts=6402

prior-facts=1

*mean*	1552.057
σ	3.069
min	1550.515
max	1557.541

*mean*	617.400
σ	88.856
min	495.000
max	735.000

*mean*	2.290
σ	0.274
min	2.086
max	2.760

iters=5

new-facts=6402

prior-facts=6402

*mean*	1875.077
σ	0.066
min	1875.023
max	1875.186

*mean*	1755.800
σ	198.114
min	1509.000
max	1947.000

*mean*	3.271
σ	0.347
min	2.869
max	3.773

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.556
σ	0.125
min	1.350
max	1.649

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	419.404
σ	508.891
min	164.955
max	1182.741

*mean*	101.250
σ	6.500
min	98.000
max	111.000

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	0.512
σ	0.475
min	0.268
max	1.224

policies=20

*mean*	1649.818
σ	0.369
min	1649.593
max	1650.369

*mean*	980.000
σ	0.000
min	980.000
max	980.000

*mean*	446.750
σ	11.057
min	434.000
max	461.000

*mean*	2.653
σ	0.010
min	2.642
max	2.665

policies=200

*mean*	16506.047
σ	0.080
min	16505.999
max	16506.167

*mean*	9800.000
σ	0.000
min	9800.000
max	9800.000

*mean*	495.250
σ	5.560
min	489.000
max	502.000

*mean*	26.750
σ	0.095
min	26.647
max	26.856