Compare commits

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.577
σ	0.347
min	54.445
max	55.565

*mean*	421.700
σ	0.483
min	421.000
max	422.000

*mean*	0.139
σ	0.004
min	0.136
max	0.148

cache=y

dps=1

iters=10

policies=100

*mean*	43.706
σ	0.006
min	43.696
max	43.714

*mean*	422.000
σ	0.000
min	422.000
max	422.000

*mean*	0.123
σ	0.004
min	0.119
max	0.131

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.002
min	36.615
max	36.620

*mean*	4152.625
σ	1899.266
min	1555.000
max	7299.000

*mean*	12.827
σ	0.317
min	12.370
max	13.142

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.002
min	36.615
max	36.620

*mean*	4152.625
σ	1899.266
min	1555.000
max	7299.000

*mean*	12.876
σ	0.553
min	11.977
max	13.358

op=table_records(), no indexes

*mean*	41.932
σ	0.001
min	41.928
max	41.933

*mean*	7299.000
σ	0.000
min	7299.000
max	7299.000

*mean*	15.074
σ	0.520
min	13.928
max	15.518

op=table_records(), repeat

*mean*	41.928
σ	0.002
min	41.927
max	41.931

*mean*	4152.625
σ	1899.266
min	1555.000
max	7299.000

*mean*	13.049
σ	1.741
min	10.824
max	15.246

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.653
σ	0.136
min	27.603
max	27.990

*mean*	4152.625
σ	1899.266
min	1555.000
max	7299.000

*mean*	8.868
σ	0.251
min	8.538
max	9.232

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.400
σ	0.002
min	26.399
max	26.403

*mean*	4152.625
σ	1899.266
min	1555.000
max	7299.000

*mean*	7.092
σ	0.117
min	6.926
max	7.308

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.666
σ	0.002
min	25.664
max	25.669

*mean*	4152.625
σ	1899.266
min	1555.000
max	7299.000

*mean*	6.031
σ	0.098
min	5.855
max	6.110

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.968
σ	0.002
min	25.967
max	25.972

*mean*	4152.625
σ	1899.266
min	1555.000
max	7299.000

*mean*	5.796
σ	0.131
min	5.494
max	5.901

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.606
σ	0.000
min	2524.606
max	2524.606

*mean*	7299.000
σ	0.000
min	7299.000
max	7299.000

*mean*	1347.080
σ	520.314
min	1034.297
max	2505.054

op=load_product(), with indexes

*mean*	8744.721
σ	0.469
min	8744.553
max	8745.882

*mean*	3572.625
σ	1796.619
min	1044.000
max	5794.000

*mean*	4802.804
σ	1732.919
min	3521.351
max	7298.759

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.078
σ	0.002
min	62.076
max	62.081

*mean*	4152.625
σ	1899.266
min	1555.000
max	7299.000

*mean*	79.335
σ	8.656
min	71.221
max	96.673

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.944
σ	0.001
min	40.944
max	40.945

*mean*	7299.000
σ	0.000
min	7299.000
max	7299.000

*mean*	108.099
σ	5.051
min	97.825
max	113.967

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.686
σ	0.000
min	66.685
max	66.687

*mean*	7299.000
σ	0.000
min	7299.000
max	7299.000

*mean*	162.570
σ	9.303
min	140.561
max	168.300

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11656.836
σ	4.324
min	11655.305
max	11667.538

*mean*	4152.625
σ	1899.266
min	1555.000
max	7299.000

*mean*	6336.052
σ	1046.646
min	4914.557
max	7946.727

op=vertical_lookup_list() on indexed

*mean*	11560.065
σ	0.001
min	11560.065
max	11560.066

*mean*	7299.000
σ	0.000
min	7299.000
max	7299.000

*mean*	5696.282
σ	1410.872
min	4350.773
max	7696.693

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.559
σ	0.001
min	172.558
max	172.562

*mean*	477.000
σ	0.000
min	477.000
max	477.000

*mean*	369.373
σ	21.865
min	346.324
max	394.333

op=pointedIndexFromKvs

rows=400000

*mean*	357.322
σ	0.001
min	357.321
max	357.325

*mean*	562.000
σ	0.000
min	562.000
max	562.000

*mean*	772.701
σ	21.411
min	738.020
max	804.688

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1008.503
σ	0.760
min	1008.026
max	1011.642

*mean*	1045.700
σ	299.799
min	563.000
max	1448.000

*mean*	1.512
σ	0.073
min	1.375
max	1.734

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.913
σ	0.020
min	0.903
max	0.949

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.404
σ	0.530
min	0.149
max	1.351

name=error_case.art

*mean*	2.339
σ	0.012
min	2.333
max	2.361

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.476
σ	0.321
min	0.320
max	1.049

name=heavy_item.art

*mean*	1.522
σ	0.002
min	1.521
max	1.525

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.220
σ	0.024
min	0.200
max	0.262

name=nested_use.art

*mean*	2.357
σ	0.002
min	2.356
max	2.360

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.336
σ	0.020
min	0.316
max	0.365

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	964.741
σ	0.011
min	964.736
max	964.760

*mean*	436.000
σ	2.236
min	432.000
max	437.000

*mean*	0.549
σ	0.052
min	0.477
max	0.603

name=cdr_enhanced_4k_loc.art

*mean*	885.814
σ	0.002
min	885.812
max	885.816

*mean*	442.000
σ	0.000
min	442.000
max	442.000

*mean*	0.483
σ	0.045
min	0.429
max	0.526

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.708
σ	0.002
min	7.707
max	7.711

*mean*	442.000
σ	0.000
min	442.000
max	442.000

*mean*	2.463
σ	0.329
min	1.855
max	2.920

name=record_render_large_syntax_err.art

*mean*	7.656
σ	0.002
min	7.655
max	7.659

*mean*	442.000
σ	0.000
min	442.000
max	442.000

*mean*	2.586
σ	0.093
min	2.409
max	2.946

name=record_render_success.art

*mean*	2.289
σ	0.002
min	2.288
max	2.292

*mean*	442.000
σ	0.000
min	442.000
max	442.000

*mean*	0.304
σ	0.012
min	0.287
max	0.392

name=record_render_syntax_err.art

*mean*	2.165
σ	0.002
min	2.164
max	2.168

*mean*	442.000
σ	0.000
min	442.000
max	442.000

*mean*	0.289
σ	0.007
min	0.273
max	0.322

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	298.118
σ	0.937
min	297.704
max	300.769

*mean*	442.400
σ	19.495
min	413.000
max	470.000

*mean*	0.606
σ	0.026
min	0.567
max	0.658

Timed compile per phase

Factor

allocated MiB

peak allocated MiB

time (ms)

phase=buildDeclTree

*mean*	222.011
σ	0.000
min	222.011
max	222.011

*mean*	1719.375
σ	37.921
min	1658.000
max	1744.000

*mean*	200.469
σ	1.672
min	197.974
max	203.223

phase=macro expansion

*mean*	6.133
σ	0.000
min	6.133
max	6.133

*mean*	1719.375
σ	37.921
min	1658.000
max	1744.000

*mean*	11.194
σ	1.505
min	9.445
max	12.957

phase=parser

*mean*	1042.096
σ	0.000
min	1042.095
max	1042.096

*mean*	1719.375
σ	37.921
min	1658.000
max	1744.000

*mean*	731.900
σ	81.705
min	585.595
max	841.385

phase=processProdDef

*mean*	6169.660
σ	0.000
min	6169.660
max	6169.661

*mean*	1730.125
σ	29.230
min	1658.000
max	1744.000

*mean*	5642.802
σ	1549.206
min	4067.617
max	8072.624

phase=renaming

*mean*	21.667
σ	0.000
min	21.667
max	21.667

*mean*	1719.375
σ	37.921
min	1658.000
max	1744.000

*mean*	38.698
σ	8.011
min	31.426
max	47.915

phase=type checker

*mean*	958.457
σ	0.066
min	958.360
max	958.547

*mean*	1719.375
σ	37.921
min	1658.000
max	1744.000

*mean*	772.661
σ	127.001
min	632.371
max	955.104

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	293.379
σ	0.037
min	293.330
max	293.418

*mean*	446.000
σ	0.000
min	446.000
max	446.000

*mean*	0.404
σ	0.006
min	0.399
max	0.411

iters=5

new-facts=1

prior-facts=6402

*mean*	1303.448
σ	0.068
min	1303.350
max	1303.530

*mean*	1062.200
σ	167.362
min	840.000
max	1270.000

*mean*	1.944
σ	0.204
min	1.770
max	2.186

iters=5

new-facts=6402

prior-facts=1

*mean*	1546.507
σ	4.012
min	1544.526
max	1553.678

*mean*	612.000
σ	73.304
min	497.000
max	690.000

*mean*	2.259
σ	0.122
min	2.154
max	2.432

iters=5

new-facts=6402

prior-facts=6402

*mean*	1865.442
σ	0.045
min	1865.398
max	1865.499

*mean*	1709.600
σ	252.569
min	1414.000
max	2063.000

*mean*	2.935
σ	0.170
min	2.708
max	3.164

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.755
σ	0.087
min	1.638
max	1.833

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	447.980
σ	579.239
min	158.360
max	1316.839

*mean*	96.250
σ	8.500
min	92.000
max	109.000

*mean*	443.000
σ	0.000
min	443.000
max	443.000

*mean*	0.538
σ	0.548
min	0.262
max	1.360

policies=20

*mean*	1583.924
σ	0.372
min	1583.668
max	1584.476

*mean*	920.000
σ	0.000
min	920.000
max	920.000

*mean*	445.250
σ	1.500
min	443.000
max	446.000

*mean*	2.663
σ	0.044
min	2.622
max	2.716

policies=200

*mean*	15847.279
σ	0.178
min	15847.119
max	15847.511

*mean*	9200.000
σ	0.000
min	9200.000
max	9200.000

*mean*	497.250
σ	4.787
min	492.000
max	503.000

*mean*	26.628
σ	0.131
min	26.481
max	26.776