Compare commits

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.580
σ	0.344
min	54.450
max	55.559

*mean*	418.000
σ	0.000
min	418.000
max	418.000

*mean*	0.137
σ	0.005
min	0.132
max	0.143

cache=y

dps=1

iters=10

policies=100

*mean*	43.705
σ	0.007
min	43.693
max	43.718

*mean*	418.000
σ	0.000
min	418.000
max	418.000

*mean*	0.124
σ	0.006
min	0.119
max	0.136

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.002
min	36.616
max	36.620

*mean*	4152.875
σ	1900.335
min	1555.000
max	7305.000

*mean*	12.507
σ	0.313
min	12.102
max	13.083

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.002
min	36.616
max	36.620

*mean*	4152.875
σ	1900.335
min	1555.000
max	7305.000

*mean*	12.535
σ	0.600
min	11.526
max	13.032

op=table_records(), no indexes

*mean*	41.932
σ	0.001
min	41.929
max	41.933

*mean*	7305.000
σ	0.000
min	7305.000
max	7305.000

*mean*	15.074
σ	0.550
min	13.813
max	15.459

op=table_records(), repeat

*mean*	41.928
σ	0.002
min	41.927
max	41.931

*mean*	4152.875
σ	1900.335
min	1555.000
max	7305.000

*mean*	12.656
σ	1.756
min	10.888
max	14.951

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.653
σ	0.136
min	27.603
max	27.990

*mean*	4152.875
σ	1900.335
min	1555.000
max	7305.000

*mean*	8.830
σ	0.329
min	8.366
max	9.299

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.400
σ	0.002
min	26.399
max	26.403

*mean*	4152.875
σ	1900.335
min	1555.000
max	7305.000

*mean*	6.671
σ	0.135
min	6.468
max	6.840

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.666
σ	0.002
min	25.664
max	25.668

*mean*	4152.875
σ	1900.335
min	1555.000
max	7305.000

*mean*	5.888
σ	0.266
min	5.541
max	6.288

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.968
σ	0.002
min	25.967
max	25.972

*mean*	4152.875
σ	1900.335
min	1555.000
max	7305.000

*mean*	5.630
σ	0.243
min	5.317
max	5.963

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.606
σ	0.000
min	2524.606
max	2524.606

*mean*	7305.000
σ	0.000
min	7305.000
max	7305.000

*mean*	1092.816
σ	132.936
min	1040.401
max	1421.550

op=load_product(), with indexes

*mean*	8744.721
σ	0.469
min	8744.553
max	8745.882

*mean*	3573.125
σ	1796.105
min	1045.000
max	5794.000

*mean*	4604.293
σ	1462.966
min	3510.439
max	7034.448

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.078
σ	0.002
min	62.076
max	62.081

*mean*	4152.875
σ	1900.335
min	1555.000
max	7305.000

*mean*	81.690
σ	12.015
min	70.661
max	100.539

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.944
σ	0.001
min	40.944
max	40.945

*mean*	7305.000
σ	0.000
min	7305.000
max	7305.000

*mean*	107.245
σ	5.550
min	95.727
max	113.355

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.686
σ	0.000
min	66.685
max	66.687

*mean*	7305.000
σ	0.000
min	7305.000
max	7305.000

*mean*	162.833
σ	9.602
min	140.465
max	170.468

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11656.836
σ	4.324
min	11655.305
max	11667.538

*mean*	4152.875
σ	1900.335
min	1555.000
max	7305.000

*mean*	6412.178
σ	1286.597
min	4893.022
max	8188.520

op=vertical_lookup_list() on indexed

*mean*	11560.065
σ	0.001
min	11560.065
max	11560.066

*mean*	7305.000
σ	0.000
min	7305.000
max	7305.000

*mean*	5396.924
σ	1363.455
min	4377.847
max	7591.553

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.559
σ	0.001
min	172.558
max	172.562

*mean*	477.000
σ	0.000
min	477.000
max	477.000

*mean*	375.140
σ	21.242
min	342.788
max	392.874

op=pointedIndexFromKvs

rows=400000

*mean*	357.322
σ	0.001
min	357.321
max	357.325

*mean*	560.250
σ	1.035
min	559.000
max	561.000

*mean*	779.761
σ	24.784
min	754.450
max	835.608

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1008.499
σ	0.760
min	1008.028
max	1011.642

*mean*	1053.250
σ	322.675
min	536.000
max	1564.000

*mean*	1.564
σ	0.090
min	1.480
max	1.854

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.913
σ	0.020
min	0.903
max	0.949

*mean*	401.000
σ	0.000
min	401.000
max	401.000

*mean*	0.501
σ	0.514
min	0.244
max	1.418

name=error_case.art

*mean*	2.339
σ	0.012
min	2.333
max	2.361

*mean*	401.000
σ	0.000
min	401.000
max	401.000

*mean*	0.738
σ	0.327
min	0.562
max	1.322

name=heavy_item.art

*mean*	1.522
σ	0.002
min	1.521
max	1.525

*mean*	401.000
σ	0.000
min	401.000
max	401.000

*mean*	0.388
σ	0.041
min	0.354
max	0.459

name=nested_use.art

*mean*	2.357
σ	0.002
min	2.356
max	2.360

*mean*	401.000
σ	0.000
min	401.000
max	401.000

*mean*	0.610
σ	0.051
min	0.565
max	0.691

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	964.741
σ	0.011
min	964.736
max	964.760

*mean*	436.000
σ	6.595
min	430.000
max	443.000

*mean*	0.738
σ	0.015
min	0.725
max	0.758

name=cdr_enhanced_4k_loc.art

*mean*	885.814
σ	0.002
min	885.812
max	885.816

*mean*	443.000
σ	0.000
min	443.000
max	443.000

*mean*	0.633
σ	0.031
min	0.581
max	0.660

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.708
σ	0.002
min	7.707
max	7.711

*mean*	443.000
σ	0.000
min	443.000
max	443.000

*mean*	2.776
σ	0.070
min	2.645
max	3.033

name=record_render_large_syntax_err.art

*mean*	7.656
σ	0.002
min	7.655
max	7.659

*mean*	443.000
σ	0.000
min	443.000
max	443.000

*mean*	2.775
σ	0.091
min	2.632
max	3.155

name=record_render_success.art

*mean*	2.289
σ	0.002
min	2.288
max	2.292

*mean*	443.000
σ	0.000
min	443.000
max	443.000

*mean*	0.536
σ	0.037
min	0.497
max	0.831

name=record_render_syntax_err.art

*mean*	2.165
σ	0.002
min	2.164
max	2.168

*mean*	443.000
σ	0.000
min	443.000
max	443.000

*mean*	0.506
σ	0.018
min	0.474
max	0.602

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	298.000
σ	1.013
min	297.583
max	300.880

*mean*	446.800
σ	17.800
min	422.000
max	472.000

*mean*	0.596
σ	0.033
min	0.549
max	0.658

Timed compile per phase

Factor

allocated MiB

peak allocated MiB

time (ms)

phase=buildDeclTree

*mean*	222.008
σ	0.000
min	222.008
max	222.008

*mean*	1747.250
σ	3.240
min	1742.000
max	1749.000

*mean*	202.941
σ	3.252
min	196.898
max	206.424

phase=macro expansion

*mean*	6.130
σ	0.000
min	6.130
max	6.130

*mean*	1747.250
σ	3.240
min	1742.000
max	1749.000

*mean*	8.412
σ	2.465
min	6.181
max	12.633

phase=parser

*mean*	1042.098
σ	0.000
min	1042.098
max	1042.099

*mean*	1747.250
σ	3.240
min	1742.000
max	1749.000

*mean*	636.431
σ	107.458
min	423.782
max	728.667

phase=processProdDef

*mean*	6169.659
σ	0.001
min	6169.659
max	6169.660

*mean*	1748.125
σ	2.475
min	1742.000
max	1749.000

*mean*	5385.186
σ	1577.509
min	3594.344
max	7917.900

phase=renaming

*mean*	21.670
σ	0.000
min	21.670
max	21.670

*mean*	1747.250
σ	3.240
min	1742.000
max	1749.000

*mean*	27.700
σ	9.413
min	20.425
max	47.404

phase=type checker

*mean*	958.457
σ	0.066
min	958.360
max	958.547

*mean*	1747.250
σ	3.240
min	1742.000
max	1749.000

*mean*	675.407
σ	64.177
min	627.914
max	780.863

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	293.687
σ	0.037
min	293.635
max	293.726

*mean*	445.000
σ	0.000
min	445.000
max	445.000

*mean*	0.399
σ	0.001
min	0.398
max	0.401

iters=5

new-facts=1

prior-facts=6402

*mean*	1303.776
σ	0.076
min	1303.697
max	1303.872

*mean*	1083.000
σ	222.849
min	827.000
max	1375.000

*mean*	2.040
σ	0.293
min	1.751
max	2.492

iters=5

new-facts=6402

prior-facts=1

*mean*	1546.805
σ	4.011
min	1544.789
max	1553.974

*mean*	621.400
σ	82.428
min	495.000
max	699.000

*mean*	2.230
σ	0.112
min	2.124
max	2.359

iters=5

new-facts=6402

prior-facts=6402

*mean*	1865.818
σ	0.048
min	1865.764
max	1865.894

*mean*	1711.200
σ	168.787
min	1499.000
max	1941.000

*mean*	2.882
σ	0.124
min	2.683
max	2.994

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.758
σ	0.122
min	1.637
max	1.921

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	450.089
σ	579.265
min	160.452
max	1318.986

*mean*	102.250
σ	8.500
min	98.000
max	115.000

*mean*	442.000
σ	0.000
min	442.000
max	442.000

*mean*	0.535
σ	0.535
min	0.265
max	1.337

policies=20

*mean*	1604.884
σ	0.401
min	1604.611
max	1605.477

*mean*	980.000
σ	0.000
min	980.000
max	980.000

*mean*	445.000
σ	2.000
min	442.000
max	446.000

*mean*	2.670
σ	0.008
min	2.659
max	2.676

policies=200

*mean*	16057.310
σ	0.185
min	16057.100
max	16057.547

*mean*	9800.000
σ	0.000
min	9800.000
max	9800.000

*mean*	493.750
σ	4.031
min	489.000
max	498.000

*mean*	27.168
σ	0.222
min	26.988
max	27.484