Compare commits

AST compact size (buildDeclTree)

Factor

compact size MiB

phase=buildDeclTree

*mean*	0.203
σ	0.000
min	0.203
max	0.203

AST compact size (macro expansion)

Factor

compact size MiB

phase=macro expansion

*mean*	5.301
σ	0.000
min	5.301
max	5.301

AST compact size (parser)

Factor

compact size MiB

phase=parser

*mean*	5.176
σ	0.000
min	5.176
max	5.176

AST compact size (processProdDef)

Factor

compact size MiB

phase=processProdDef

*mean*	558.664
σ	0.000
min	558.664
max	558.664

AST compact size (renaming)

Factor

compact size MiB

phase=renaming

*mean*	5.488
σ	0.000
min	5.488
max	5.488

AST compact size (type checker)

Factor

compact size MiB

phase=type checker

*mean*	6.645
σ	0.000
min	6.645
max	6.645

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.884
σ	0.358
min	54.745
max	55.900

*mean*	418.000
σ	0.000
min	418.000
max	418.000

*mean*	0.150
σ	0.012
min	0.137
max	0.171

cache=y

dps=1

iters=10

policies=100

*mean*	43.850
σ	0.006
min	43.839
max	43.859

*mean*	418.000
σ	0.000
min	418.000
max	418.000

*mean*	0.125
σ	0.004
min	0.119
max	0.132

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.002
min	36.616
max	36.620

*mean*	4040.250
σ	2008.418
min	1218.000
max	7152.000

*mean*	12.793
σ	0.395
min	12.225
max	13.297

op=column_set() on indexed, repeat

*mean*	36.618
σ	0.002
min	36.616
max	36.620

*mean*	4040.250
σ	2008.418
min	1218.000
max	7152.000

*mean*	12.958
σ	0.648
min	11.969
max	13.911

op=table_records(), no indexes

*mean*	41.930
σ	0.002
min	41.928
max	41.933

*mean*	7152.000
σ	0.000
min	7152.000
max	7152.000

*mean*	15.372
σ	0.238
min	15.096
max	15.659

op=table_records(), repeat

*mean*	41.929
σ	0.002
min	41.927
max	41.932

*mean*	4040.250
σ	2008.418
min	1218.000
max	7152.000

*mean*	14.197
σ	1.402
min	11.122
max	15.382

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.654
σ	0.136
min	27.604
max	27.991

*mean*	4040.250
σ	2008.418
min	1218.000
max	7152.000

*mean*	9.594
σ	0.840
min	8.555
max	10.876

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.401
σ	0.002
min	26.400
max	26.404

*mean*	4040.250
σ	2008.418
min	1218.000
max	7152.000

*mean*	7.239
σ	0.992
min	6.064
max	8.966

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.668
σ	0.004
min	25.665
max	25.678

*mean*	4040.250
σ	2008.418
min	1218.000
max	7152.000

*mean*	5.992
σ	0.186
min	5.710
max	6.330

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.970
σ	0.002
min	25.968
max	25.972

*mean*	4040.250
σ	2008.418
min	1218.000
max	7152.000

*mean*	5.676
σ	0.212
min	5.259
max	5.908

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	1021.613
σ	0.002
min	1021.612
max	1021.616

*mean*	7152.000
σ	0.000
min	7152.000
max	7152.000

*mean*	364.859
σ	52.614
min	343.671
max	494.967

op=load_product(), with indexes

*mean*	7917.793
σ	0.469
min	7917.625
max	7918.953

*mean*	3270.375
σ	1822.346
min	810.000
max	5615.000

*mean*	3710.327
σ	1183.376
min	3066.881
max	5937.336

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.077
σ	0.002
min	62.076
max	62.080

*mean*	4040.250
σ	2008.418
min	1218.000
max	7152.000

*mean*	84.054
σ	15.441
min	70.843
max	110.771

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.946
σ	0.002
min	40.945
max	40.950

*mean*	7152.000
σ	0.000
min	7152.000
max	7152.000

*mean*	62.249
σ	2.665
min	60.265
max	68.731

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.688
σ	0.002
min	66.686
max	66.691

*mean*	7152.000
σ	0.000
min	7152.000
max	7152.000

*mean*	99.090
σ	0.886
min	98.203
max	100.563

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	14217.171
σ	4.303
min	14215.576
max	14227.820

*mean*	4040.250
σ	2008.418
min	1218.000
max	7152.000

*mean*	8149.347
σ	1963.810
min	5987.614
max	10949.231

op=vertical_lookup_list() on indexed

*mean*	13159.109
σ	0.002
min	13159.106
max	13159.110

*mean*	7152.000
σ	0.000
min	7152.000
max	7152.000

*mean*	5404.678
σ	1022.914
min	4970.429
max	7909.653

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.559
σ	0.001
min	172.558
max	172.562

*mean*	473.875
σ	0.354
min	473.000
max	474.000

*mean*	377.892
σ	26.721
min	314.178
max	392.297

op=pointedIndexFromKvs

rows=400000

*mean*	357.322
σ	0.001
min	357.321
max	357.325

*mean*	559.000
σ	0.000
min	559.000
max	559.000

*mean*	756.426
σ	55.129
min	627.558
max	800.294

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1024.297
σ	0.759
min	1023.823
max	1027.436

*mean*	1057.950
σ	315.525
min	562.000
max	1527.000

*mean*	1.575
σ	0.102
min	1.471
max	1.879

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.913
σ	0.020
min	0.903
max	0.949

*mean*	401.000
σ	0.000
min	401.000
max	401.000

*mean*	0.383
σ	0.466
min	0.137
max	1.213

name=error_case.art

*mean*	2.339
σ	0.012
min	2.333
max	2.361

*mean*	401.000
σ	0.000
min	401.000
max	401.000

*mean*	0.436
σ	0.205
min	0.330
max	0.801

name=heavy_item.art

*mean*	1.522
σ	0.002
min	1.521
max	1.525

*mean*	401.000
σ	0.000
min	401.000
max	401.000

*mean*	0.220
σ	0.027
min	0.198
max	0.267

name=nested_use.art

*mean*	2.357
σ	0.002
min	2.356
max	2.360

*mean*	401.000
σ	0.000
min	401.000
max	401.000

*mean*	0.338
σ	0.017
min	0.324
max	0.367

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	964.840
σ	0.011
min	964.835
max	964.859

*mean*	432.800
σ	3.033
min	430.000
max	436.000

*mean*	0.569
σ	0.047
min	0.500
max	0.611

name=cdr_enhanced_4k_loc.art

*mean*	885.820
σ	0.002
min	885.819
max	885.823

*mean*	436.000
σ	0.000
min	436.000
max	436.000

*mean*	0.509
σ	0.022
min	0.471
max	0.528

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.709
σ	0.002
min	7.708
max	7.712

*mean*	436.000
σ	0.000
min	436.000
max	436.000

*mean*	2.583
σ	0.078
min	2.451
max	2.909

name=record_render_large_syntax_err.art

*mean*	7.657
σ	0.002
min	7.656
max	7.660

*mean*	436.000
σ	0.000
min	436.000
max	436.000

*mean*	2.591
σ	0.093
min	2.460
max	2.967

name=record_render_success.art

*mean*	2.289
σ	0.002
min	2.289
max	2.293

*mean*	436.000
σ	0.000
min	436.000
max	436.000

*mean*	0.308
σ	0.009
min	0.294
max	0.367

name=record_render_syntax_err.art

*mean*	2.165
σ	0.002
min	2.164
max	2.168

*mean*	436.000
σ	0.000
min	436.000
max	436.000

*mean*	0.295
σ	0.007
min	0.282
max	0.340

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	298.795
σ	1.024
min	298.397
max	301.707

*mean*	442.100
σ	18.616
min	414.000
max	467.000

*mean*	0.604
σ	0.025
min	0.537
max	0.627

Timed compile per phase

Factor

allocated MiB

peak allocated MiB

time (ms)

phase=buildDeclTree

*mean*	236.678
σ	0.000
min	236.678
max	236.678

*mean*	1064.000
σ	33.941
min	980.000
max	1076.000

*mean*	203.471
σ	4.278
min	196.938
max	209.895

phase=macro expansion

*mean*	6.130
σ	0.000
min	6.130
max	6.130

*mean*	1064.000
σ	33.941
min	980.000
max	1076.000

*mean*	8.089
σ	1.752
min	6.301
max	9.943

phase=parser

*mean*	1042.366
σ	0.001
min	1042.363
max	1042.366

*mean*	1064.000
σ	33.941
min	980.000
max	1076.000

*mean*	469.394
σ	66.386
min	375.290
max	556.135

phase=processProdDef

*mean*	4850.765
σ	0.000
min	4850.765
max	4850.765

*mean*	1076.000
σ	0.000
min	1076.000
max	1076.000

*mean*	4707.662
σ	570.686
min	3628.820
max	5346.820

phase=renaming

*mean*	21.671
σ	0.000
min	21.671
max	21.671

*mean*	1064.000
σ	33.941
min	980.000
max	1076.000

*mean*	33.314
σ	10.320
min	20.768
max	41.574

phase=type checker

*mean*	990.453
σ	0.072
min	990.344
max	990.567

*mean*	1064.000
σ	33.941
min	980.000
max	1076.000

*mean*	691.032
σ	63.096
min	642.971
max	837.793

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	293.821
σ	0.038
min	293.768
max	293.860

*mean*	443.000
σ	0.000
min	443.000
max	443.000

*mean*	0.393
σ	0.001
min	0.392
max	0.395

iters=5

new-facts=1

prior-facts=6402

*mean*	1320.220
σ	0.031
min	1320.172
max	1320.248

*mean*	1067.800
σ	165.835
min	844.000
max	1270.000

*mean*	2.304
σ	0.176
min	2.173
max	2.611

iters=5

new-facts=6402

prior-facts=1

*mean*	1560.607
σ	6.245
min	1557.592
max	1571.773

*mean*	619.800
σ	82.606
min	495.000
max	717.000

*mean*	2.309
σ	0.258
min	2.149
max	2.766

iters=5

new-facts=6402

prior-facts=6402

*mean*	1882.174
σ	0.057
min	1882.109
max	1882.254

*mean*	1702.000
σ	258.831
min	1399.000
max	2062.000

*mean*	2.915
σ	0.075
min	2.862
max	3.043

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.692
σ	0.068
min	1.600
max	1.781

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	452.082
σ	582.725
min	160.715
max	1326.170

*mean*	102.250
σ	8.500
min	98.000
max	115.000

*mean*	441.000
σ	0.000
min	441.000
max	441.000

*mean*	0.542
σ	0.534
min	0.274
max	1.343

policies=20

*mean*	1607.516
σ	0.420
min	1607.234
max	1608.140

*mean*	980.000
σ	0.000
min	980.000
max	980.000

*mean*	445.500
σ	5.196
min	441.000
max	450.000

*mean*	2.694
σ	0.017
min	2.676
max	2.709

policies=200

*mean*	16083.488
σ	0.112
min	16083.367
max	16083.639

*mean*	9800.000
σ	0.000
min	9800.000
max	9800.000

*mean*	497.500
σ	5.686
min	491.000
max	504.000

*mean*	27.244
σ	0.067
min	27.181
max	27.336