Compare commits

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.581
σ	0.344
min	54.450
max	55.558

*mean*	419.000
σ	0.000
min	419.000
max	419.000

*mean*	0.138
σ	0.006
min	0.131
max	0.148

cache=y

dps=1

iters=10

policies=100

*mean*	43.705
σ	0.006
min	43.696
max	43.714

*mean*	419.000
σ	0.000
min	419.000
max	419.000

*mean*	0.120
σ	0.005
min	0.114
max	0.129

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.002
min	36.615
max	36.620

*mean*	4153.125
σ	1898.089
min	1555.000
max	7295.000

*mean*	13.025
σ	0.291
min	12.544
max	13.540

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.002
min	36.615
max	36.620

*mean*	4153.125
σ	1898.089
min	1555.000
max	7295.000

*mean*	12.503
σ	0.720
min	11.856
max	13.518

op=table_records(), no indexes

*mean*	41.932
σ	0.001
min	41.929
max	41.933

*mean*	7295.000
σ	0.000
min	7295.000
max	7295.000

*mean*	15.260
σ	0.521
min	14.054
max	15.838

op=table_records(), repeat

*mean*	41.928
σ	0.002
min	41.927
max	41.932

*mean*	4153.125
σ	1898.089
min	1555.000
max	7295.000

*mean*	13.156
σ	1.604
min	11.453
max	15.692

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.653
σ	0.136
min	27.603
max	27.990

*mean*	4153.125
σ	1898.089
min	1555.000
max	7295.000

*mean*	8.923
σ	0.482
min	8.182
max	9.802

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.400
σ	0.002
min	26.399
max	26.403

*mean*	4153.125
σ	1898.089
min	1555.000
max	7295.000

*mean*	6.943
σ	0.162
min	6.687
max	7.179

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.666
σ	0.002
min	25.665
max	25.668

*mean*	4153.125
σ	1898.089
min	1555.000
max	7295.000

*mean*	6.014
σ	0.115
min	5.883
max	6.193

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.968
σ	0.002
min	25.967
max	25.972

*mean*	4153.125
σ	1898.089
min	1555.000
max	7295.000

*mean*	5.750
σ	0.139
min	5.459
max	5.945

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.606
σ	0.000
min	2524.606
max	2524.606

*mean*	7295.000
σ	0.000
min	7295.000
max	7295.000

*mean*	1085.551
σ	107.220
min	1038.804
max	1350.603

op=load_product(), with indexes

*mean*	8744.721
σ	0.469
min	8744.553
max	8745.882

*mean*	3573.250
σ	1796.250
min	1044.000
max	5792.000

*mean*	5082.055
σ	1699.492
min	3541.123
max	7247.743

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.078
σ	0.002
min	62.076
max	62.081

*mean*	4153.125
σ	1898.089
min	1555.000
max	7295.000

*mean*	83.335
σ	11.817
min	71.072
max	99.619

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.944
σ	0.001
min	40.943
max	40.945

*mean*	7295.000
σ	0.000
min	7295.000
max	7295.000

*mean*	105.500
σ	3.576
min	99.235
max	108.658

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.686
σ	0.000
min	66.685
max	66.687

*mean*	7295.000
σ	0.000
min	7295.000
max	7295.000

*mean*	162.154
σ	6.973
min	145.993
max	165.920

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11656.836
σ	4.324
min	11655.305
max	11667.538

*mean*	4153.125
σ	1898.089
min	1555.000
max	7295.000

*mean*	6504.172
σ	1228.389
min	4949.530
max	8063.137

op=vertical_lookup_list() on indexed

*mean*	11560.065
σ	0.001
min	11560.064
max	11560.066

*mean*	7295.000
σ	0.000
min	7295.000
max	7295.000

*mean*	5516.292
σ	1150.439
min	4418.126
max	7439.052

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.559
σ	0.001
min	172.558
max	172.562

*mean*	478.000
σ	0.000
min	478.000
max	478.000

*mean*	378.646
σ	36.739
min	299.230
max	400.493

op=pointedIndexFromKvs

rows=400000

*mean*	357.322
σ	0.001
min	357.321
max	357.325

*mean*	562.000
σ	0.000
min	562.000
max	562.000

*mean*	759.046
σ	47.765
min	657.749
max	800.456

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1008.501
σ	0.760
min	1008.026
max	1011.642

*mean*	1048.750
σ	313.971
min	574.000
max	1512.000

*mean*	1.546
σ	0.081
min	1.481
max	1.759

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.913
σ	0.020
min	0.903
max	0.949

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.379
σ	0.476
min	0.140
max	1.228

name=error_case.art

*mean*	2.339
σ	0.012
min	2.333
max	2.361

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.482
σ	0.321
min	0.334
max	1.057

name=heavy_item.art

*mean*	1.522
σ	0.002
min	1.521
max	1.525

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.225
σ	0.029
min	0.202
max	0.274

name=nested_use.art

*mean*	2.357
σ	0.002
min	2.356
max	2.360

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.341
σ	0.018
min	0.328
max	0.371

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	964.741
σ	0.011
min	964.736
max	964.760

*mean*	431.800
σ	1.789
min	431.000
max	435.000

*mean*	0.587
σ	0.013
min	0.573
max	0.602

name=cdr_enhanced_4k_loc.art

*mean*	885.814
σ	0.002
min	885.812
max	885.816

*mean*	443.000
σ	0.000
min	443.000
max	443.000

*mean*	0.481
σ	0.038
min	0.432
max	0.524

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.708
σ	0.002
min	7.707
max	7.711

*mean*	443.000
σ	0.000
min	443.000
max	443.000

*mean*	2.420
σ	0.289
min	1.866
max	2.815

name=record_render_large_syntax_err.art

*mean*	7.656
σ	0.002
min	7.655
max	7.659

*mean*	443.000
σ	0.000
min	443.000
max	443.000

*mean*	2.577
σ	0.076
min	2.452
max	2.855

name=record_render_success.art

*mean*	2.289
σ	0.002
min	2.288
max	2.292

*mean*	443.000
σ	0.000
min	443.000
max	443.000

*mean*	0.300
σ	0.008
min	0.288
max	0.353

name=record_render_syntax_err.art

*mean*	2.165
σ	0.002
min	2.164
max	2.168

*mean*	443.000
σ	0.000
min	443.000
max	443.000

*mean*	0.287
σ	0.008
min	0.276
max	0.329

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	297.955
σ	0.997
min	297.565
max	300.787

*mean*	442.700
σ	14.072
min	418.000
max	463.000

*mean*	0.604
σ	0.025
min	0.565
max	0.652

Timed compile per phase

Factor

allocated MiB

peak allocated MiB

time (ms)

phase=buildDeclTree

*mean*	222.008
σ	0.000
min	222.008
max	222.008

*mean*	1746.000
σ	0.000
min	1746.000
max	1746.000

*mean*	206.235
σ	2.972
min	200.138
max	209.406

phase=macro expansion

*mean*	6.130
σ	0.000
min	6.130
max	6.130

*mean*	1746.000
σ	0.000
min	1746.000
max	1746.000

*mean*	9.459
σ	1.730
min	6.138
max	12.584

phase=parser

*mean*	1042.099
σ	0.000
min	1042.099
max	1042.099

*mean*	1746.000
σ	0.000
min	1746.000
max	1746.000

*mean*	636.738
σ	78.590
min	488.004
max	720.083

phase=processProdDef

*mean*	6169.661
σ	0.001
min	6169.660
max	6169.662

*mean*	1746.000
σ	0.000
min	1746.000
max	1746.000

*mean*	5748.596
σ	1285.008
min	4027.879
max	7063.710

phase=renaming

*mean*	21.667
σ	0.000
min	21.667
max	21.667

*mean*	1746.000
σ	0.000
min	1746.000
max	1746.000

*mean*	39.833
σ	5.665
min	29.282
max	47.022

phase=type checker

*mean*	958.461
σ	0.066
min	958.363
max	958.551

*mean*	1746.000
σ	0.000
min	1746.000
max	1746.000

*mean*	696.960
σ	73.695
min	627.735
max	869.294

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	293.686
σ	0.038
min	293.633
max	293.726

*mean*	447.000
σ	0.000
min	447.000
max	447.000

*mean*	0.397
σ	0.001
min	0.396
max	0.399

iters=5

new-facts=1

prior-facts=6402

*mean*	1303.794
σ	0.059
min	1303.727
max	1303.875

*mean*	1087.400
σ	179.539
min	877.000
max	1306.000

*mean*	2.038
σ	0.210
min	1.818
max	2.291

iters=5

new-facts=6402

prior-facts=1

*mean*	1546.816
σ	4.019
min	1544.810
max	1553.998

*mean*	633.800
σ	68.656
min	539.000
max	721.000

*mean*	2.235
σ	0.156
min	2.128
max	2.503

iters=5

new-facts=6402

prior-facts=6402

*mean*	1865.808
σ	0.055
min	1865.747
max	1865.896

*mean*	1727.800
σ	179.441
min	1473.000
max	1894.000

*mean*	3.082
σ	0.334
min	2.882
max	3.676

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.693
σ	0.158
min	1.479
max	1.851

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	450.090
σ	579.264
min	160.455
max	1318.986

*mean*	102.250
σ	8.500
min	98.000
max	115.000

*mean*	443.000
σ	0.000
min	443.000
max	443.000

*mean*	0.537
σ	0.542
min	0.264
max	1.350

policies=20

*mean*	1604.893
σ	0.406
min	1604.610
max	1605.493

*mean*	980.000
σ	0.000
min	980.000
max	980.000

*mean*	445.250
σ	1.500
min	443.000
max	446.000

*mean*	2.675
σ	0.012
min	2.662
max	2.691

policies=200

*mean*	16057.314
σ	0.121
min	16057.248
max	16057.495

*mean*	9800.000
σ	0.000
min	9800.000
max	9800.000

*mean*	493.750
σ	4.031
min	489.000
max	498.000

*mean*	27.001
σ	0.099
min	26.885
max	27.094