Compare commits

AST compact size (buildDeclTree)

Factor

compact size MiB

phase=buildDeclTree

*mean*	0.203
σ	0.000
min	0.203
max	0.203

AST compact size (macro expansion)

Factor

compact size MiB

phase=macro expansion

*mean*	5.301
σ	0.000
min	5.301
max	5.301

AST compact size (parser)

Factor

compact size MiB

phase=parser

*mean*	5.176
σ	0.000
min	5.176
max	5.176

AST compact size (processProdDef Decls)

Factor

compact size MiB

phase=processProdDef Decls

*mean*	5.676
σ	0.000
min	5.676
max	5.676

AST compact size (processProdDef)

Factor

compact size MiB

phase=processProdDef

*mean*	446.883
σ	0.000
min	446.883
max	446.883

AST compact size (renaming)

Factor

compact size MiB

phase=renaming

*mean*	5.488
σ	0.000
min	5.488
max	5.488

AST compact size (type checker)

Factor

compact size MiB

phase=type checker

*mean*	6.676
σ	0.000
min	6.676
max	6.676

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.775
σ	0.366
min	54.633
max	55.816

*mean*	416.000
σ	0.000
min	416.000
max	416.000

*mean*	0.141
σ	0.004
min	0.138
max	0.148

cache=y

dps=1

iters=10

policies=100

*mean*	43.773
σ	0.005
min	43.764
max	43.780

*mean*	416.000
σ	0.000
min	416.000
max	416.000

*mean*	0.124
σ	0.004
min	0.121
max	0.130

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.617
σ	0.000
min	36.617
max	36.618

*mean*	4592.750
σ	2248.965
min	1486.000
max	7382.000

*mean*	141.847
σ	366.461
min	11.858
max	1048.791

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.000
min	36.617
max	36.618

*mean*	4592.750
σ	2248.965
min	1486.000
max	7382.000

*mean*	13.571
σ	4.714
min	11.085
max	25.111

op=table_records(), no indexes

*mean*	41.948
σ	0.002
min	41.946
max	41.950

*mean*	7382.000
σ	0.000
min	7382.000
max	7382.000

*mean*	11.170
σ	0.243
min	10.851
max	11.575

op=table_records(), repeat

*mean*	41.933
σ	0.000
min	41.933
max	41.934

*mean*	4184.375
σ	1946.392
min	1486.000
max	7382.000

*mean*	11.684
σ	1.678
min	10.713
max	15.815

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.655
σ	0.136
min	27.606
max	27.993

*mean*	4184.375
σ	1946.392
min	1486.000
max	7382.000

*mean*	9.035
σ	1.333
min	8.099
max	12.251

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.406
σ	0.000
min	26.406
max	26.406

*mean*	4184.375
σ	1946.392
min	1486.000
max	7382.000

*mean*	6.671
σ	1.262
min	5.777
max	9.621

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.681
σ	0.003
min	25.680
max	25.688

*mean*	4592.750
σ	2248.965
min	1486.000
max	7382.000

*mean*	6.243
σ	0.996
min	5.826
max	8.699

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.984
σ	0.000
min	25.984
max	25.985

*mean*	4592.750
σ	2248.965
min	1486.000
max	7382.000

*mean*	6.190
σ	1.026
min	5.594
max	8.704

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	1021.627
σ	0.002
min	1021.625
max	1021.629

*mean*	7382.000
σ	0.000
min	7382.000
max	7382.000

*mean*	362.486
σ	41.765
min	344.999
max	465.771

op=load_product(), with indexes

*mean*	3495.878
σ	0.469
min	3495.713
max	3497.038

*mean*	3760.000
σ	2301.410
min	720.000
max	7382.000

*mean*	1776.557
σ	695.379
min	1399.742
max	3000.132

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense, minor warmup

*mean*	107.854
σ	0.000
min	107.854
max	107.855

*mean*	4412.000
σ	2217.923
min	1486.000
max	7382.000

*mean*	245.400
σ	317.196
min	124.008
max	1029.346

op=column_set() on unindexed, dense, repeat

*mean*	62.081
σ	0.000
min	62.081
max	62.082

*mean*	4412.000
σ	2217.923
min	1486.000
max	7382.000

*mean*	45.585
σ	6.381
min	41.117
max	60.866

op=vertical_lookup_list() repeated on unindexed missing Int

*mean*	40.947
σ	0.001
min	40.947
max	40.950

*mean*	7382.000
σ	0.000
min	7382.000
max	7382.000

*mean*	22.499
σ	1.150
min	21.704
max	25.130

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	71.308
σ	0.002
min	71.307
max	71.311

*mean*	7382.000
σ	0.000
min	7382.000
max	7382.000

*mean*	298.441
σ	684.341
min	55.493
max	1992.094

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	4646.850
σ	0.013
min	4646.845
max	4646.883

*mean*	4184.375
σ	1946.392
min	1486.000
max	7382.000

*mean*	3276.127
σ	778.527
min	2511.570
max	4539.401

op=vertical_lookup_list() on indexed

*mean*	1973.851
σ	0.002
min	1973.849
max	1973.854

*mean*	7382.000
σ	0.000
min	7382.000
max	7382.000

*mean*	1173.288
σ	501.344
min	938.623
max	2394.836

op=vertical_lookup_list() on unindexed missing Int, minor warmup

*mean*	905.104
σ	0.002
min	905.102
max	905.108

*mean*	7382.000
σ	0.000
min	7382.000
max	7382.000

*mean*	392.346
σ	3.365
min	386.920
max	396.768

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	148.144
σ	0.001
min	148.144
max	148.148

*mean*	476.875
σ	1.246
min	475.000
max	478.000

*mean*	376.077
σ	62.653
min	296.742
max	446.077

op=pointedIndexFromKvs

rows=400000

*mean*	308.493
σ	0.001
min	308.493
max	308.497

*mean*	564.000
σ	0.000
min	564.000
max	564.000

*mean*	779.351
σ	63.951
min	645.597
max	842.352

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	963.972
σ	1.821
min	963.264
max	971.675

*mean*	1030.000
σ	301.069
min	550.000
max	1457.000

*mean*	1.290
σ	0.121
min	1.192
max	1.677

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.913
σ	0.020
min	0.903
max	0.949

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.300
σ	0.305
min	0.136
max	0.840

name=error_case.art

*mean*	2.340
σ	0.012
min	2.334
max	2.362

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.475
σ	0.318
min	0.320
max	1.045

name=heavy_item.art

*mean*	1.523
σ	0.002
min	1.521
max	1.525

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.219
σ	0.024
min	0.201
max	0.259

name=nested_use.art

*mean*	2.358
σ	0.002
min	2.357
max	2.361

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.331
σ	0.012
min	0.323
max	0.352

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	964.971
σ	0.011
min	964.965
max	964.989

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	0.561
σ	0.051
min	0.483
max	0.615

name=cdr_enhanced_4k_loc.art

*mean*	885.898
σ	0.002
min	885.897
max	885.901

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	0.470
σ	0.051
min	0.394
max	0.521

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.710
σ	0.002
min	7.709
max	7.713

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	2.635
σ	0.087
min	2.455
max	2.862

name=record_render_large_syntax_err.art

*mean*	7.658
σ	0.002
min	7.657
max	7.661

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	2.603
σ	0.090
min	2.429
max	2.911

name=record_render_success.art

*mean*	2.290
σ	0.002
min	2.289
max	2.293

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	0.311
σ	0.010
min	0.294
max	0.367

name=record_render_syntax_err.art

*mean*	2.165
σ	0.002
min	2.164
max	2.168

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	0.298
σ	0.010
min	0.280
max	0.365

Revision Creation

Factor

allocated MiB

peak allocated MiB

time_s

number of threads=8

revision count=1000

*mean*	11.859
σ	11.788
min	0.718
max	88.744

*mean*	465.442
σ	18.870
min	407.000
max	481.000

*mean*	0.027
σ	0.029
min	0.001
max	0.203

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	278.614
σ	1.051
min	278.212
max	281.603

*mean*	445.500
σ	21.230
min	416.000
max	475.000

*mean*	0.582
σ	0.021
min	0.539
max	0.612

Timed compile per phase

Factor

allocated MiB

peak allocated MiB

time (ms)

phase=buildDeclTree

*mean*	173.738
σ	0.000
min	173.738
max	173.738

*mean*	864.000
σ	0.000
min	864.000
max	864.000

*mean*	233.430
σ	26.918
min	197.904
max	259.144

phase=macro expansion

*mean*	6.130
σ	0.001
min	6.130
max	6.133

*mean*	864.000
σ	0.000
min	864.000
max	864.000

*mean*	9.078
σ	1.165
min	6.336
max	9.710

phase=parser

*mean*	1042.435
σ	0.001
min	1042.432
max	1042.436

*mean*	864.000
σ	0.000
min	864.000
max	864.000

*mean*	551.548
σ	95.535
min	377.900
max	614.147

phase=processProdDef

*mean*	2243.976
σ	0.001
min	2243.976
max	2243.979

*mean*	864.000
σ	0.000
min	864.000
max	864.000

*mean*	2595.686
σ	521.480
min	1734.264
max	3247.753

phase=renaming

*mean*	21.671
σ	0.000
min	21.671
max	21.671

*mean*	864.000
σ	0.000
min	864.000
max	864.000

*mean*	35.966
σ	7.817
min	20.785
max	41.172

phase=type checker

*mean*	989.755
σ	0.066
min	989.654
max	989.845

*mean*	864.000
σ	0.000
min	864.000
max	864.000

*mean*	732.371
σ	86.308
min	670.303
max	873.506

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	282.394
σ	0.025
min	282.372
max	282.425

*mean*	442.000
σ	0.000
min	442.000
max	442.000

*mean*	0.377
σ	0.002
min	0.375
max	0.380

iters=5

new-facts=1

prior-facts=6402

*mean*	1267.112
σ	0.103
min	1267.001
max	1267.278

*mean*	1112.200
σ	170.973
min	896.000
max	1331.000

*mean*	1.989
σ	0.121
min	1.822
max	2.106

iters=5

new-facts=6402

prior-facts=1

*mean*	1506.111
σ	2.956
min	1504.606
max	1511.388

*mean*	628.200
σ	90.489
min	504.000
max	728.000

*mean*	2.303
σ	0.286
min	2.072
max	2.776

iters=5

new-facts=6402

prior-facts=6402

*mean*	1829.110
σ	0.070
min	1829.022
max	1829.206

*mean*	1765.600
σ	209.681
min	1490.000
max	1965.000

*mean*	3.051
σ	0.180
min	2.829
max	3.290

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.790
σ	0.118
min	1.581
max	1.855

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	397.698
σ	518.051
min	138.670
max	1174.774

*mean*	97.750
σ	7.500
min	94.000
max	109.000

*mean*	439.000
σ	0.000
min	439.000
max	439.000

*mean*	0.495
σ	0.507
min	0.240
max	1.255

policies=20

*mean*	1386.836
σ	0.159
min	1386.727
max	1387.072

*mean*	940.000
σ	0.000
min	940.000
max	940.000

*mean*	444.000
σ	5.774
min	439.000
max	449.000

*mean*	2.328
σ	0.015
min	2.309
max	2.345

policies=200

*mean*	13876.909
σ	0.101
min	13876.828
max	13877.055

*mean*	9400.000
σ	0.000
min	9400.000
max	9400.000

*mean*	494.250
σ	4.856
min	488.000
max	499.000

*mean*	23.625
σ	0.187
min	23.421
max	23.875