Compare commits

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.578
σ	0.348
min	54.448
max	55.568

*mean*	418.000
σ	0.000
min	418.000
max	418.000

*mean*	0.142
σ	0.006
min	0.132
max	0.151

cache=y

dps=1

iters=10

policies=100

*mean*	43.707
σ	0.007
min	43.701
max	43.720

*mean*	418.000
σ	0.000
min	418.000
max	418.000

*mean*	0.125
σ	0.005
min	0.120
max	0.132

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.002
min	36.615
max	36.620

*mean*	4151.375
σ	1896.895
min	1556.000
max	7294.000

*mean*	12.457
σ	0.260
min	12.206
max	12.961

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.002
min	36.616
max	36.620

*mean*	4151.375
σ	1896.895
min	1556.000
max	7294.000

*mean*	12.669
σ	0.669
min	11.416
max	13.504

op=table_records(), no indexes

*mean*	41.932
σ	0.001
min	41.929
max	41.933

*mean*	7294.000
σ	0.000
min	7294.000
max	7294.000

*mean*	14.724
σ	0.596
min	13.359
max	15.137

op=table_records(), repeat

*mean*	41.928
σ	0.002
min	41.927
max	41.931

*mean*	4151.375
σ	1896.895
min	1556.000
max	7294.000

*mean*	12.709
σ	1.688
min	10.612
max	14.878

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.653
σ	0.136
min	27.603
max	27.990

*mean*	4151.375
σ	1896.895
min	1556.000
max	7294.000

*mean*	8.536
σ	0.370
min	8.204
max	9.250

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.400
σ	0.002
min	26.399
max	26.403

*mean*	4151.375
σ	1896.895
min	1556.000
max	7294.000

*mean*	6.378
σ	0.222
min	6.025
max	6.697

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.666
σ	0.002
min	25.665
max	25.668

*mean*	4151.375
σ	1896.895
min	1556.000
max	7294.000

*mean*	5.618
σ	0.231
min	5.370
max	6.145

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.968
σ	0.002
min	25.967
max	25.972

*mean*	4151.375
σ	1896.895
min	1556.000
max	7294.000

*mean*	5.438
σ	0.090
min	5.277
max	5.569

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.606
σ	0.000
min	2524.606
max	2524.606

*mean*	7294.000
σ	0.000
min	7294.000
max	7294.000

*mean*	1334.709
σ	502.897
min	1046.576
max	2492.547

op=load_product(), with indexes

*mean*	8744.721
σ	0.469
min	8744.553
max	8745.882

*mean*	3572.750
σ	1795.050
min	1045.000
max	5792.000

*mean*	4920.247
σ	1780.232
min	3569.051
max	7569.648

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.078
σ	0.002
min	62.076
max	62.081

*mean*	4151.375
σ	1896.895
min	1556.000
max	7294.000

*mean*	86.472
σ	11.588
min	73.165
max	99.915

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.944
σ	0.001
min	40.944
max	40.945

*mean*	7294.000
σ	0.000
min	7294.000
max	7294.000

*mean*	106.018
σ	5.030
min	96.341
max	110.710

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.686
σ	0.000
min	66.685
max	66.687

*mean*	7294.000
σ	0.000
min	7294.000
max	7294.000

*mean*	167.035
σ	9.570
min	144.738
max	172.646

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11656.836
σ	4.324
min	11655.305
max	11667.538

*mean*	4151.375
σ	1896.895
min	1556.000
max	7294.000

*mean*	6658.780
σ	1125.471
min	4965.345
max	8253.531

op=vertical_lookup_list() on indexed

*mean*	11560.065
σ	0.001
min	11560.064
max	11560.066

*mean*	7294.000
σ	0.000
min	7294.000
max	7294.000

*mean*	5368.276
σ	1245.522
min	4438.656
max	7767.923

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.559
σ	0.001
min	172.558
max	172.562

*mean*	477.000
σ	0.000
min	477.000
max	477.000

*mean*	389.840
σ	6.604
min	374.553
max	396.242

op=pointedIndexFromKvs

rows=400000

*mean*	357.322
σ	0.001
min	357.321
max	357.325

*mean*	560.000
σ	0.000
min	560.000
max	560.000

*mean*	741.432
σ	57.726
min	649.174
max	792.729

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1008.500
σ	0.760
min	1008.025
max	1011.642

*mean*	1044.250
σ	300.108
min	561.000
max	1447.000

*mean*	1.533
σ	0.067
min	1.480
max	1.759

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.913
σ	0.020
min	0.903
max	0.949

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.403
σ	0.512
min	0.143
max	1.316

name=error_case.art

*mean*	2.339
σ	0.012
min	2.333
max	2.361

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.480
σ	0.327
min	0.323
max	1.064

name=heavy_item.art

*mean*	1.522
σ	0.002
min	1.521
max	1.525

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.222
σ	0.023
min	0.208
max	0.262

name=nested_use.art

*mean*	2.357
σ	0.002
min	2.356
max	2.360

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.333
σ	0.017
min	0.322
max	0.363

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	964.741
σ	0.011
min	964.736
max	964.760

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	0.525
σ	0.068
min	0.441
max	0.595

name=cdr_enhanced_4k_loc.art

*mean*	885.814
σ	0.002
min	885.812
max	885.816

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	0.469
σ	0.031
min	0.432
max	0.506

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.708
σ	0.002
min	7.707
max	7.711

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	1.993
σ	0.076
min	1.844
max	2.304

name=record_render_large_syntax_err.art

*mean*	7.656
σ	0.002
min	7.655
max	7.659

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	1.871
σ	0.090
min	1.742
max	2.174

name=record_render_success.art

*mean*	2.289
σ	0.002
min	2.288
max	2.292

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	0.312
σ	0.009
min	0.296
max	0.361

name=record_render_syntax_err.art

*mean*	2.165
σ	0.002
min	2.164
max	2.168

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	0.297
σ	0.008
min	0.284
max	0.334

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	298.067
σ	1.009
min	297.659
max	300.936

*mean*	444.300
σ	19.067
min	418.000
max	471.000

*mean*	0.618
σ	0.014
min	0.602
max	0.654

Timed compile per phase

Factor

allocated MiB

peak allocated MiB

time (ms)

phase=buildDeclTree

*mean*	222.008
σ	0.000
min	222.008
max	222.008

*mean*	1732.000
σ	27.775
min	1687.000
max	1747.000

*mean*	207.603
σ	3.207
min	202.557
max	212.420

phase=macro expansion

*mean*	6.130
σ	0.000
min	6.130
max	6.130

*mean*	1732.000
σ	27.775
min	1687.000
max	1747.000

*mean*	9.619
σ	1.459
min	6.277
max	11.433

phase=parser

*mean*	1042.095
σ	0.000
min	1042.095
max	1042.096

*mean*	1732.000
σ	27.775
min	1687.000
max	1747.000

*mean*	709.105
σ	82.309
min	572.660
max	835.220

phase=processProdDef

*mean*	6169.662
σ	0.001
min	6169.661
max	6169.662

*mean*	1739.500
σ	21.213
min	1687.000
max	1747.000

*mean*	5768.756
σ	1797.327
min	3635.055
max	7984.478

phase=renaming

*mean*	21.667
σ	0.000
min	21.667
max	21.667

*mean*	1732.000
σ	27.775
min	1687.000
max	1747.000

*mean*	30.236
σ	4.058
min	20.484
max	32.784

phase=type checker

*mean*	958.461
σ	0.066
min	958.363
max	958.551

*mean*	1732.000
σ	27.775
min	1687.000
max	1747.000

*mean*	675.913
σ	34.765
min	643.877
max	731.346

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	293.381
σ	0.035
min	293.330
max	293.418

*mean*	444.000
σ	0.000
min	444.000
max	444.000

*mean*	0.404
σ	0.006
min	0.399
max	0.414

iters=5

new-facts=1

prior-facts=6402

*mean*	1303.439
σ	0.062
min	1303.344
max	1303.503

*mean*	1114.000
σ	185.958
min	893.000
max	1367.000

*mean*	1.996
σ	0.115
min	1.894
max	2.131

iters=5

new-facts=6402

prior-facts=1

*mean*	1546.578
σ	4.049
min	1544.679
max	1553.819

*mean*	622.000
σ	89.224
min	505.000
max	727.000

*mean*	2.536
σ	0.368
min	2.102
max	3.057

iters=5

new-facts=6402

prior-facts=6402

*mean*	1865.470
σ	0.080
min	1865.392
max	1865.600

*mean*	1741.800
σ	217.442
min	1453.000
max	1947.000

*mean*	3.298
σ	0.361
min	2.887
max	3.667

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.757
σ	0.101
min	1.661
max	1.889

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	447.982
σ	579.239
min	158.362
max	1316.841

*mean*	96.250
σ	8.500
min	92.000
max	109.000

*mean*	443.000
σ	0.000
min	443.000
max	443.000

*mean*	0.543
σ	0.551
min	0.263
max	1.370

policies=20

*mean*	1583.937
σ	0.357
min	1583.687
max	1584.465

*mean*	920.000
σ	0.000
min	920.000
max	920.000

*mean*	445.250
σ	1.500
min	443.000
max	446.000

*mean*	2.648
σ	0.012
min	2.632
max	2.658

policies=200

*mean*	15847.311
σ	0.139
min	15847.188
max	15847.496

*mean*	9200.000
σ	0.000
min	9200.000
max	9200.000

*mean*	495.250
σ	4.031
min	491.000
max	500.000

*mean*	26.722
σ	0.123
min	26.558
max	26.854