Compare commits

AST compact size (buildDeclTree)

Factor

compact size MiB

phase=buildDeclTree

*mean*	0.203
σ	0.000
min	0.203
max	0.203

AST compact size (macro expansion)

Factor

compact size MiB

phase=macro expansion

*mean*	5.301
σ	0.000
min	5.301
max	5.301

AST compact size (parser)

Factor

compact size MiB

phase=parser

*mean*	5.176
σ	0.000
min	5.176
max	5.176

AST compact size (processProdDef)

Factor

compact size MiB

phase=processProdDef

*mean*	558.633
σ	0.000
min	558.633
max	558.633

AST compact size (renaming)

Factor

compact size MiB

phase=renaming

*mean*	5.488
σ	0.000
min	5.488
max	5.488

AST compact size (type checker)

Factor

compact size MiB

phase=type checker

*mean*	6.645
σ	0.000
min	6.645
max	6.645

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.678
σ	0.357
min	54.540
max	55.694

*mean*	419.700
σ	0.483
min	419.000
max	420.000

*mean*	0.141
σ	0.004
min	0.138
max	0.150

cache=y

dps=1

iters=10

policies=100

*mean*	43.704
σ	0.005
min	43.697
max	43.712

*mean*	420.000
σ	0.000
min	420.000
max	420.000

*mean*	0.120
σ	0.005
min	0.115
max	0.128

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.002
min	36.616
max	36.620

*mean*	3888.250
σ	1859.353
min	1275.000
max	6184.000

*mean*	12.964
σ	1.683
min	11.996
max	17.003

op=column_set() on indexed, repeat

*mean*	36.618
σ	0.002
min	36.616
max	36.620

*mean*	3888.250
σ	1859.353
min	1275.000
max	6184.000

*mean*	12.711
σ	1.598
min	11.584
max	16.328

op=table_records(), no indexes

*mean*	41.930
σ	0.002
min	41.928
max	41.932

*mean*	6184.000
σ	0.000
min	6184.000
max	6184.000

*mean*	14.609
σ	0.459
min	13.569
max	15.019

op=table_records(), repeat

*mean*	41.928
σ	0.001
min	41.928
max	41.932

*mean*	3740.750
σ	1832.735
min	1275.000
max	6184.000

*mean*	13.182
σ	1.891
min	10.737
max	14.926

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.654
σ	0.136
min	27.604
max	27.991

*mean*	3740.750
σ	1832.735
min	1275.000
max	6184.000

*mean*	9.040
σ	0.401
min	8.443
max	9.471

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.401
σ	0.002
min	26.400
max	26.404

*mean*	3740.750
σ	1832.735
min	1275.000
max	6184.000

*mean*	6.454
σ	0.531
min	5.612
max	7.345

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.669
σ	0.003
min	25.666
max	25.674

*mean*	3888.250
σ	1859.353
min	1275.000
max	6184.000

*mean*	5.811
σ	0.513
min	5.550
max	7.068

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.970
σ	0.002
min	25.968
max	25.974

*mean*	3888.250
σ	1859.353
min	1275.000
max	6184.000

*mean*	5.690
σ	0.557
min	5.399
max	7.058

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.604
σ	0.002
min	2524.602
max	2524.606

*mean*	6184.000
σ	0.000
min	6184.000
max	6184.000

*mean*	1294.855
σ	459.751
min	1044.601
max	2138.295

op=load_product(), with indexes

*mean*	7878.102
σ	0.469
min	7877.935
max	7879.264

*mean*	3245.500
σ	1849.392
min	810.000
max	6184.000

*mean*	3737.353
σ	1067.426
min	3076.842
max	5867.247

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.078
σ	0.002
min	62.076
max	62.081

*mean*	3888.250
σ	1859.353
min	1275.000
max	6184.000

*mean*	168.441
σ	252.228
min	71.503
max	792.251

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.946
σ	0.002
min	40.945
max	40.949

*mean*	6184.000
σ	0.000
min	6184.000
max	6184.000

*mean*	63.699
σ	4.305
min	59.991
max	69.821

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.687
σ	0.002
min	66.686
max	66.690

*mean*	6184.000
σ	0.000
min	6184.000
max	6184.000

*mean*	99.566
σ	1.355
min	98.124
max	102.155

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11849.155
σ	4.304
min	11847.561
max	11859.806

*mean*	3740.750
σ	1832.735
min	1275.000
max	6184.000

*mean*	6108.118
σ	1279.945
min	5021.330
max	8119.223

op=vertical_lookup_list() on indexed

*mean*	10791.094
σ	0.002
min	10791.091
max	10791.096

*mean*	6184.000
σ	0.000
min	6184.000
max	6184.000

*mean*	5154.926
σ	1504.153
min	4070.893
max	7223.848

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.559
σ	0.001
min	172.558
max	172.562

*mean*	477.000
σ	0.000
min	477.000
max	477.000

*mean*	384.657
σ	16.644
min	346.514
max	395.758

op=pointedIndexFromKvs

rows=400000

*mean*	357.322
σ	0.001
min	357.321
max	357.325

*mean*	562.000
σ	0.000
min	562.000
max	562.000

*mean*	765.388
σ	27.376
min	717.078
max	800.914

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1024.325
σ	0.759
min	1023.850
max	1027.464

*mean*	1049.800
σ	312.114
min	592.000
max	1511.000

*mean*	1.567
σ	0.080
min	1.487
max	1.769

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.913
σ	0.020
min	0.903
max	0.949

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.412
σ	0.534
min	0.142
max	1.365

name=error_case.art

*mean*	2.339
σ	0.012
min	2.333
max	2.361

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.519
σ	0.409
min	0.323
max	1.251

name=heavy_item.art

*mean*	1.522
σ	0.002
min	1.521
max	1.525

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.221
σ	0.019
min	0.207
max	0.254

name=nested_use.art

*mean*	2.357
σ	0.002
min	2.356
max	2.360

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.351
σ	0.024
min	0.324
max	0.388

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	964.840
σ	0.011
min	964.835
max	964.859

*mean*	435.600
σ	5.079
min	431.000
max	441.000

*mean*	0.583
σ	0.039
min	0.517
max	0.615

name=cdr_enhanced_4k_loc.art

*mean*	885.820
σ	0.002
min	885.819
max	885.823

*mean*	441.000
σ	0.000
min	441.000
max	441.000

*mean*	0.448
σ	0.043
min	0.391
max	0.493

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.709
σ	0.002
min	7.708
max	7.712

*mean*	441.000
σ	0.000
min	441.000
max	441.000

*mean*	1.988
σ	0.137
min	1.846
max	2.848

name=record_render_large_syntax_err.art

*mean*	7.657
σ	0.002
min	7.656
max	7.660

*mean*	441.000
σ	0.000
min	441.000
max	441.000

*mean*	1.924
σ	0.097
min	1.744
max	2.214

name=record_render_success.art

*mean*	2.289
σ	0.002
min	2.289
max	2.293

*mean*	441.000
σ	0.000
min	441.000
max	441.000

*mean*	0.308
σ	0.008
min	0.296
max	0.359

name=record_render_syntax_err.art

*mean*	2.165
σ	0.002
min	2.164
max	2.168

*mean*	441.000
σ	0.000
min	441.000
max	441.000

*mean*	0.297
σ	0.016
min	0.281
max	0.418

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	298.881
σ	0.989
min	298.498
max	301.686

*mean*	442.900
σ	17.966
min	416.000
max	468.000

*mean*	0.592
σ	0.029
min	0.554
max	0.638

Timed compile per phase

Factor

allocated MiB

peak allocated MiB

time (ms)

phase=buildDeclTree

*mean*	236.678
σ	0.000
min	236.678
max	236.678

*mean*	1708.875
σ	6.010
min	1694.000
max	1711.000

*mean*	213.642
σ	2.278
min	209.992
max	216.254

phase=macro expansion

*mean*	6.130
σ	0.000
min	6.130
max	6.130

*mean*	1708.875
σ	6.010
min	1694.000
max	1711.000

*mean*	10.934
σ	1.566
min	9.428
max	12.878

phase=parser

*mean*	1042.368
σ	0.000
min	1042.367
max	1042.368

*mean*	1708.875
σ	6.010
min	1694.000
max	1711.000

*mean*	648.884
σ	66.400
min	574.465
max	730.800

phase=processProdDef

*mean*	4753.275
σ	0.000
min	4753.275
max	4753.276

*mean*	1711.000
σ	0.000
min	1711.000
max	1711.000

*mean*	4345.510
σ	774.319
min	2985.050
max	5525.498

phase=renaming

*mean*	21.671
σ	0.000
min	21.671
max	21.671

*mean*	1708.875
σ	6.010
min	1694.000
max	1711.000

*mean*	43.627
σ	5.325
min	34.986
max	50.165

phase=type checker

*mean*	990.453
σ	0.071
min	990.348
max	990.567

*mean*	1708.875
σ	6.010
min	1694.000
max	1711.000

*mean*	795.044
σ	75.125
min	688.621
max	898.546

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	293.917
σ	0.038
min	293.863
max	293.957

*mean*	445.000
σ	0.000
min	445.000
max	445.000

*mean*	0.396
σ	0.005
min	0.392
max	0.405

iters=5

new-facts=1

prior-facts=6402

*mean*	1320.296
σ	0.030
min	1320.266
max	1320.330

*mean*	1110.200
σ	187.716
min	890.000
max	1372.000

*mean*	2.276
σ	0.117
min	2.163
max	2.442

iters=5

new-facts=6402

prior-facts=1

*mean*	1559.466
σ	3.357
min	1557.816
max	1565.465

*mean*	629.400
σ	92.738
min	504.000
max	735.000

*mean*	2.383
σ	0.181
min	2.179
max	2.547

iters=5

new-facts=6402

prior-facts=6402

*mean*	1882.262
σ	0.058
min	1882.182
max	1882.337

*mean*	1760.400
σ	208.064
min	1505.000
max	1963.000

*mean*	3.121
σ	0.228
min	2.872
max	3.464

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.833
σ	0.139
min	1.620
max	1.987

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	452.410
σ	583.278
min	160.769
max	1327.326

*mean*	102.250
σ	8.500
min	98.000
max	115.000

*mean*	444.000
σ	0.000
min	444.000
max	444.000

*mean*	0.543
σ	0.546
min	0.269
max	1.362

policies=20

*mean*	1608.031
σ	0.418
min	1607.742
max	1608.650

*mean*	980.000
σ	0.000
min	980.000
max	980.000

*mean*	452.000
σ	10.832
min	444.000
max	468.000

*mean*	2.703
σ	0.013
min	2.691
max	2.721

policies=200

*mean*	16088.586
σ	0.074
min	16088.512
max	16088.685

*mean*	9800.000
σ	0.000
min	9800.000
max	9800.000

*mean*	497.250
σ	4.573
min	492.000
max	503.000

*mean*	27.315
σ	0.141
min	27.194
max	27.514