Compare commits

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.613
σ	0.349
min	54.484
max	55.607

*mean*	417.000
σ	0.000
min	417.000
max	417.000

*mean*	0.141
σ	0.005
min	0.138
max	0.150

cache=y

dps=1

iters=10

policies=100

*mean*	43.793
σ	0.006
min	43.784
max	43.801

*mean*	417.000
σ	0.000
min	417.000
max	417.000

*mean*	0.122
σ	0.007
min	0.115
max	0.134

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.002
min	36.615
max	36.620

*mean*	4153.000
σ	1902.409
min	1554.000
max	7310.000

*mean*	12.945
σ	0.267
min	12.634
max	13.504

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.002
min	36.616
max	36.619

*mean*	4153.000
σ	1902.409
min	1554.000
max	7310.000

*mean*	13.029
σ	0.492
min	12.122
max	13.424

op=table_records(), no indexes

*mean*	41.932
σ	0.001
min	41.928
max	41.933

*mean*	7310.000
σ	0.000
min	7310.000
max	7310.000

*mean*	15.145
σ	0.773
min	13.639
max	16.077

op=table_records(), repeat

*mean*	41.928
σ	0.002
min	41.927
max	41.932

*mean*	4153.000
σ	1902.409
min	1554.000
max	7310.000

*mean*	13.104
σ	1.917
min	10.652
max	15.422

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.653
σ	0.137
min	27.603
max	27.991

*mean*	4153.000
σ	1902.409
min	1554.000
max	7310.000

*mean*	8.960
σ	0.302
min	8.391
max	9.309

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.400
σ	0.002
min	26.399
max	26.403

*mean*	4153.000
σ	1902.409
min	1554.000
max	7310.000

*mean*	6.893
σ	0.260
min	6.518
max	7.189

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.666
σ	0.002
min	25.664
max	25.668

*mean*	4153.000
σ	1902.409
min	1554.000
max	7310.000

*mean*	5.968
σ	0.154
min	5.734
max	6.183

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.968
σ	0.002
min	25.967
max	25.972

*mean*	4153.000
σ	1902.409
min	1554.000
max	7310.000

*mean*	5.783
σ	0.069
min	5.675
max	5.884

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.606
σ	0.000
min	2524.606
max	2524.607

*mean*	7310.000
σ	0.000
min	7310.000
max	7310.000

*mean*	1210.396
σ	424.220
min	1029.268
max	2245.921

op=load_product(), with indexes

*mean*	8744.722
σ	0.469
min	8744.553
max	8745.883

*mean*	3573.375
σ	1797.717
min	1043.000
max	5799.000

*mean*	4725.997
σ	1411.009
min	3498.198
max	6744.147

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.078
σ	0.002
min	62.076
max	62.081

*mean*	4153.000
σ	1902.409
min	1554.000
max	7310.000

*mean*	83.153
σ	10.401
min	72.044
max	98.404

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.944
σ	0.001
min	40.944
max	40.945

*mean*	7310.000
σ	0.000
min	7310.000
max	7310.000

*mean*	106.476
σ	4.997
min	95.666
max	110.386

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.686
σ	0.000
min	66.685
max	66.687

*mean*	7310.000
σ	0.000
min	7310.000
max	7310.000

*mean*	163.614
σ	8.221
min	144.976
max	169.499

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11656.836
σ	4.324
min	11655.305
max	11667.538

*mean*	4153.000
σ	1902.409
min	1554.000
max	7310.000

*mean*	6585.081
σ	1268.146
min	4853.971
max	8093.291

op=vertical_lookup_list() on indexed

*mean*	11560.065
σ	0.001
min	11560.065
max	11560.066

*mean*	7310.000
σ	0.000
min	7310.000
max	7310.000

*mean*	5118.822
σ	935.727
min	4343.426
max	6414.586

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.559
σ	0.001
min	172.558
max	172.562

*mean*	477.000
σ	0.000
min	477.000
max	477.000

*mean*	376.345
σ	21.180
min	346.588
max	395.631

op=pointedIndexFromKvs

rows=400000

*mean*	357.322
σ	0.001
min	357.321
max	357.325

*mean*	560.000
σ	0.000
min	560.000
max	560.000

*mean*	761.535
σ	27.733
min	718.466
max	785.943

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1008.189
σ	0.760
min	1007.713
max	1011.330

*mean*	1042.750
σ	310.358
min	570.000
max	1498.000

*mean*	1.526
σ	0.049
min	1.473
max	1.641

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.891
σ	0.020
min	0.881
max	0.928

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.396
σ	0.524
min	0.134
max	1.332

name=error_case.art

*mean*	2.338
σ	0.012
min	2.332
max	2.359

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.479
σ	0.321
min	0.324
max	1.053

name=heavy_item.art

*mean*	1.522
σ	0.002
min	1.520
max	1.524

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.216
σ	0.023
min	0.201
max	0.257

name=nested_use.art

*mean*	2.355
σ	0.002
min	2.355
max	2.358

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.324
σ	0.018
min	0.309
max	0.352

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	963.908
σ	0.011
min	963.902
max	963.926

*mean*	432.400
σ	2.510
min	430.000
max	435.000

*mean*	0.564
σ	0.031
min	0.511
max	0.589

name=cdr_enhanced_4k_loc.art

*mean*	884.884
σ	0.002
min	884.883
max	884.886

*mean*	435.000
σ	0.000
min	435.000
max	435.000

*mean*	0.496
σ	0.018
min	0.467
max	0.513

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.706
σ	0.002
min	7.705
max	7.709

*mean*	435.000
σ	0.000
min	435.000
max	435.000

*mean*	1.970
σ	0.069
min	1.864
max	2.220

name=record_render_large_syntax_err.art

*mean*	7.655
σ	0.002
min	7.654
max	7.658

*mean*	435.000
σ	0.000
min	435.000
max	435.000

*mean*	2.427
σ	0.262
min	1.882
max	2.831

name=record_render_success.art

*mean*	2.288
σ	0.002
min	2.287
max	2.291

*mean*	435.000
σ	0.000
min	435.000
max	435.000

*mean*	0.317
σ	0.068
min	0.288
max	0.808

name=record_render_syntax_err.art

*mean*	2.163
σ	0.002
min	2.163
max	2.166

*mean*	435.000
σ	0.000
min	435.000
max	435.000

*mean*	0.291
σ	0.009
min	0.274
max	0.339

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	297.697
σ	1.025
min	297.274
max	300.611

*mean*	445.300
σ	18.361
min	418.000
max	467.000

*mean*	0.611
σ	0.013
min	0.582
max	0.628

Timed compile per phase

Factor

allocated MiB

peak allocated MiB

time (ms)

phase=buildDeclTree

*mean*	222.011
σ	0.000
min	222.011
max	222.011

*mean*	1650.375
σ	105.951
min	1500.000
max	1744.000

*mean*	204.751
σ	2.970
min	200.414
max	207.952

phase=macro expansion

*mean*	6.133
σ	0.000
min	6.133
max	6.133

*mean*	1650.375
σ	105.951
min	1500.000
max	1744.000

*mean*	11.914
σ	1.267
min	9.472
max	13.152

phase=parser

*mean*	1041.159
σ	0.000
min	1041.158
max	1041.159

*mean*	1650.375
σ	105.951
min	1500.000
max	1744.000

*mean*	704.632
σ	76.248
min	557.574
max	831.310

phase=processProdDef

*mean*	6169.660
σ	0.001
min	6169.659
max	6169.661

*mean*	1680.875
σ	90.468
min	1523.000
max	1744.000

*mean*	5592.525
σ	1254.229
min	4243.380
max	7629.528

phase=renaming

*mean*	21.667
σ	0.000
min	21.667
max	21.667

*mean*	1650.375
σ	105.951
min	1500.000
max	1744.000

*mean*	45.370
σ	5.340
min	34.496
max	51.283

phase=type checker

*mean*	958.670
σ	0.066
min	958.573
max	958.760

*mean*	1650.375
σ	105.951
min	1500.000
max	1744.000

*mean*	812.468
σ	85.686
min	679.716
max	912.430

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	292.594
σ	0.032
min	292.554
max	292.632

*mean*	445.000
σ	0.000
min	445.000
max	445.000

*mean*	0.399
σ	0.001
min	0.397
max	0.400

iters=5

new-facts=1

prior-facts=6402

*mean*	1302.690
σ	0.081
min	1302.579
max	1302.798

*mean*	1074.400
σ	209.477
min	827.000
max	1346.000

*mean*	2.042
σ	0.115
min	1.914
max	2.171

iters=5

new-facts=6402

prior-facts=1

*mean*	1545.749
σ	4.038
min	1543.744
max	1552.965

*mean*	621.200
σ	82.989
min	493.000
max	699.000

*mean*	2.425
σ	0.305
min	2.132
max	2.859

iters=5

new-facts=6402

prior-facts=6402

*mean*	1864.658
σ	0.054
min	1864.596
max	1864.715

*mean*	1733.200
σ	181.668
min	1487.000
max	1968.000

*mean*	2.870
σ	0.074
min	2.746
max	2.937

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.797
σ	0.152
min	1.544
max	1.916

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	447.003
σ	579.108
min	157.445
max	1315.666

*mean*	92.000
σ	8.000
min	88.000
max	104.000

*mean*	443.000
σ	0.000
min	443.000
max	443.000

*mean*	0.511
σ	0.495
min	0.261
max	1.253

policies=20

*mean*	1574.784
σ	0.324
min	1574.555
max	1575.261

*mean*	880.000
σ	0.000
min	880.000
max	880.000

*mean*	448.250
σ	9.179
min	443.000
max	462.000

*mean*	2.606
σ	0.012
min	2.592
max	2.621

policies=200

*mean*	15755.906
σ	0.131
min	15755.807
max	15756.095

*mean*	8800.000
σ	0.000
min	8800.000
max	8800.000

*mean*	496.500
σ	5.196
min	491.000
max	503.000

*mean*	26.447
σ	0.185
min	26.257
max	26.615