Compare commits

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.582
σ	0.344
min	54.446
max	55.561

*mean*	417.000
σ	0.000
min	417.000
max	417.000

*mean*	0.142
σ	0.005
min	0.136
max	0.148

cache=y

dps=1

iters=10

policies=100

*mean*	43.706
σ	0.007
min	43.694
max	43.715

*mean*	417.000
σ	0.000
min	417.000
max	417.000

*mean*	0.124
σ	0.005
min	0.116
max	0.131

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.002
min	36.615
max	36.620

*mean*	4157.000
σ	1905.941
min	1557.000
max	7327.000

*mean*	13.052
σ	0.363
min	12.546
max	13.501

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.002
min	36.616
max	36.620

*mean*	4157.000
σ	1905.941
min	1557.000
max	7327.000

*mean*	13.142
σ	0.467
min	12.060
max	13.617

op=table_records(), no indexes

*mean*	41.932
σ	0.001
min	41.929
max	41.933

*mean*	7327.000
σ	0.000
min	7327.000
max	7327.000

*mean*	15.115
σ	0.870
min	13.146
max	16.063

op=table_records(), repeat

*mean*	41.928
σ	0.002
min	41.927
max	41.931

*mean*	4157.000
σ	1905.941
min	1557.000
max	7327.000

*mean*	12.891
σ	1.956
min	10.750
max	15.434

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.653
σ	0.136
min	27.603
max	27.990

*mean*	4157.000
σ	1905.941
min	1557.000
max	7327.000

*mean*	8.847
σ	0.205
min	8.499
max	9.148

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.400
σ	0.002
min	26.399
max	26.403

*mean*	4157.000
σ	1905.941
min	1557.000
max	7327.000

*mean*	6.875
σ	0.160
min	6.543
max	7.031

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.666
σ	0.002
min	25.665
max	25.668

*mean*	4157.000
σ	1905.941
min	1557.000
max	7327.000

*mean*	5.982
σ	0.088
min	5.844
max	6.105

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.968
σ	0.002
min	25.967
max	25.972

*mean*	4157.000
σ	1905.941
min	1557.000
max	7327.000

*mean*	5.797
σ	0.077
min	5.712
max	5.916

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.606
σ	0.000
min	2524.606
max	2524.607

*mean*	7327.000
σ	0.000
min	7327.000
max	7327.000

*mean*	1052.265
σ	7.085
min	1044.648
max	1061.193

op=load_product(), with indexes

*mean*	8744.721
σ	0.469
min	8744.553
max	8745.883

*mean*	3579.000
σ	1801.876
min	1044.000
max	5815.000

*mean*	5089.308
σ	1730.891
min	3520.844
max	7486.136

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.078
σ	0.002
min	62.076
max	62.081

*mean*	4157.000
σ	1905.941
min	1557.000
max	7327.000

*mean*	82.064
σ	10.484
min	70.994
max	98.157

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.944
σ	0.001
min	40.944
max	40.945

*mean*	7327.000
σ	0.000
min	7327.000
max	7327.000

*mean*	104.485
σ	7.627
min	87.389
max	110.793

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.686
σ	0.000
min	66.685
max	66.687

*mean*	7327.000
σ	0.000
min	7327.000
max	7327.000

*mean*	158.939
σ	13.019
min	127.982
max	168.029

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11656.836
σ	4.324
min	11655.305
max	11667.538

*mean*	4157.000
σ	1905.941
min	1557.000
max	7327.000

*mean*	6850.319
σ	1156.323
min	4944.775
max	8211.521

op=vertical_lookup_list() on indexed

*mean*	11560.065
σ	0.000
min	11560.065
max	11560.066

*mean*	7327.000
σ	0.000
min	7327.000
max	7327.000

*mean*	6015.323
σ	1752.435
min	4418.261
max	8946.577

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.559
σ	0.001
min	172.558
max	172.562

*mean*	478.000
σ	0.000
min	478.000
max	478.000

*mean*	378.239
σ	21.468
min	343.501
max	398.182

op=pointedIndexFromKvs

rows=400000

*mean*	357.322
σ	0.001
min	357.321
max	357.325

*mean*	560.000
σ	0.000
min	560.000
max	560.000

*mean*	749.936
σ	56.196
min	642.623
max	794.834

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1008.501
σ	0.759
min	1008.028
max	1011.642

*mean*	1054.050
σ	322.592
min	538.000
max	1565.000

*mean*	1.551
σ	0.084
min	1.391
max	1.808

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.913
σ	0.020
min	0.903
max	0.949

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.312
σ	0.323
min	0.144
max	0.886

name=error_case.art

*mean*	2.339
σ	0.012
min	2.333
max	2.361

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.481
σ	0.339
min	0.318
max	1.088

name=heavy_item.art

*mean*	1.522
σ	0.002
min	1.521
max	1.525

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.218
σ	0.023
min	0.197
max	0.256

name=nested_use.art

*mean*	2.357
σ	0.002
min	2.356
max	2.360

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.336
σ	0.014
min	0.323
max	0.358

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	964.741
σ	0.011
min	964.736
max	964.760

*mean*	436.600
σ	6.066
min	431.000
max	443.000

*mean*	0.587
σ	0.031
min	0.537
max	0.614

name=cdr_enhanced_4k_loc.art

*mean*	885.814
σ	0.002
min	885.812
max	885.816

*mean*	443.000
σ	0.000
min	443.000
max	443.000

*mean*	0.499
σ	0.032
min	0.452
max	0.526

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.708
σ	0.002
min	7.707
max	7.711

*mean*	443.000
σ	0.000
min	443.000
max	443.000

*mean*	2.602
σ	0.095
min	2.437
max	2.930

name=record_render_large_syntax_err.art

*mean*	7.656
σ	0.002
min	7.655
max	7.659

*mean*	443.000
σ	0.000
min	443.000
max	443.000

*mean*	2.599
σ	0.098
min	2.453
max	3.184

name=record_render_success.art

*mean*	2.289
σ	0.002
min	2.288
max	2.292

*mean*	443.000
σ	0.000
min	443.000
max	443.000

*mean*	0.301
σ	0.016
min	0.287
max	0.430

name=record_render_syntax_err.art

*mean*	2.165
σ	0.002
min	2.164
max	2.168

*mean*	443.000
σ	0.000
min	443.000
max	443.000

*mean*	0.298
σ	0.051
min	0.273
max	0.718

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	298.051
σ	0.958
min	297.673
max	300.771

*mean*	440.200
σ	16.923
min	414.000
max	466.000

*mean*	0.613
σ	0.016
min	0.592
max	0.651

Timed compile per phase

Factor

allocated MiB

peak allocated MiB

time (ms)

phase=buildDeclTree

*mean*	222.008
σ	0.000
min	222.008
max	222.008

*mean*	1744.000
σ	0.000
min	1744.000
max	1744.000

*mean*	206.840
σ	2.065
min	204.028
max	209.421

phase=macro expansion

*mean*	6.130
σ	0.000
min	6.130
max	6.130

*mean*	1744.000
σ	0.000
min	1744.000
max	1744.000

*mean*	10.759
σ	2.254
min	6.359
max	12.879

phase=parser

*mean*	1042.100
σ	0.001
min	1042.097
max	1042.101

*mean*	1744.000
σ	0.000
min	1744.000
max	1744.000

*mean*	671.737
σ	111.503
min	498.450
max	842.111

phase=processProdDef

*mean*	6169.660
σ	0.001
min	6169.659
max	6169.661

*mean*	1744.000
σ	0.000
min	1744.000
max	1744.000

*mean*	5333.555
σ	1087.727
min	4114.454
max	7288.640

phase=renaming

*mean*	21.667
σ	0.001
min	21.667
max	21.670

*mean*	1744.000
σ	0.000
min	1744.000
max	1744.000

*mean*	40.085
σ	10.712
min	20.465
max	52.492

phase=type checker

*mean*	958.460
σ	0.066
min	958.360
max	958.551

*mean*	1744.000
σ	0.000
min	1744.000
max	1744.000

*mean*	792.560
σ	114.963
min	644.039
max	897.981

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	293.688
σ	0.037
min	293.634
max	293.726

*mean*	447.000
σ	0.000
min	447.000
max	447.000

*mean*	0.399
σ	0.001
min	0.398
max	0.399

iters=5

new-facts=1

prior-facts=6402

*mean*	1303.758
σ	0.047
min	1303.714
max	1303.809

*mean*	1118.400
σ	185.303
min	896.000
max	1368.000

*mean*	1.975
σ	0.124
min	1.871
max	2.123

iters=5

new-facts=6402

prior-facts=1

*mean*	1546.870
σ	4.029
min	1544.925
max	1554.073

*mean*	624.800
σ	89.497
min	508.000
max	731.000

*mean*	2.429
σ	0.322
min	2.137
max	2.860

iters=5

new-facts=6402

prior-facts=6402

*mean*	1865.832
σ	0.090
min	1865.728
max	1865.950

*mean*	1745.400
σ	216.362
min	1457.000
max	1949.000

*mean*	3.218
σ	0.354
min	2.869
max	3.627

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.857
σ	0.115
min	1.659
max	1.930

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	450.089
σ	579.264
min	160.453
max	1318.985

*mean*	102.250
σ	8.500
min	98.000
max	115.000

*mean*	440.000
σ	0.000
min	440.000
max	440.000

*mean*	0.514
σ	0.500
min	0.263
max	1.264

policies=20

*mean*	1604.894
σ	0.413
min	1604.613
max	1605.505

*mean*	980.000
σ	0.000
min	980.000
max	980.000

*mean*	446.500
σ	7.506
min	440.000
max	453.000

*mean*	2.697
σ	0.033
min	2.671
max	2.745

policies=200

*mean*	16057.235
σ	0.140
min	16057.043
max	16057.361

*mean*	9800.000
σ	0.000
min	9800.000
max	9800.000

*mean*	493.000
σ	4.082
min	490.000
max	499.000

*mean*	27.096
σ	0.213
min	26.858
max	27.364