Compare commits

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.617
σ	0.351
min	54.483
max	55.615

*mean*	422.000
σ	0.000
min	422.000
max	422.000

*mean*	0.141
σ	0.005
min	0.133
max	0.150

cache=y

dps=1

iters=10

policies=100

*mean*	43.785
σ	0.005
min	43.780
max	43.797

*mean*	422.000
σ	0.000
min	422.000
max	422.000

*mean*	0.123
σ	0.005
min	0.117
max	0.130

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.003
min	36.615
max	36.623

*mean*	4106.000
σ	1568.293
min	1986.000
max	6044.000

*mean*	12.682
σ	0.112
min	12.567
max	12.862

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.002
min	36.615
max	36.619

*mean*	4106.000
σ	1568.293
min	1986.000
max	6044.000

*mean*	12.288
σ	0.757
min	11.328
max	13.104

op=table_records(), no indexes

*mean*	41.928
σ	0.000
min	41.928
max	41.929

*mean*	6044.000
σ	0.000
min	6044.000
max	6044.000

*mean*	13.197
σ	1.259
min	10.798
max	15.008

op=table_records(), repeat

*mean*	41.928
σ	0.002
min	41.927
max	41.931

*mean*	4106.000
σ	1568.293
min	1986.000
max	6044.000

*mean*	11.624
σ	1.199
min	10.321
max	13.492

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.605
σ	0.002
min	27.603
max	27.607

*mean*	4106.000
σ	1568.293
min	1986.000
max	6044.000

*mean*	8.379
σ	0.331
min	7.935
max	8.794

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.400
σ	0.002
min	26.399
max	26.403

*mean*	4106.000
σ	1568.293
min	1986.000
max	6044.000

*mean*	6.293
σ	0.416
min	5.475
max	6.696

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.666
σ	0.002
min	25.664
max	25.669

*mean*	4106.000
σ	1568.293
min	1986.000
max	6044.000

*mean*	5.411
σ	0.105
min	5.280
max	5.516

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.968
σ	0.002
min	25.967
max	25.971

*mean*	4106.000
σ	1568.293
min	1986.000
max	6044.000

*mean*	5.292
σ	0.069
min	5.201
max	5.378

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.593
σ	0.000
min	2524.593
max	2524.594

*mean*	6044.000
σ	0.000
min	6044.000
max	6044.000

*mean*	1503.444
σ	709.339
min	1049.668
max	2723.055

op=load_product(), with indexes

*mean*	8744.559
σ	0.033
min	8744.544
max	8744.641

*mean*	3824.250
σ	1647.417
min	1986.000
max	6044.000

*mean*	4676.671
σ	1527.413
min	3560.093
max	7561.809

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.078
σ	0.002
min	62.075
max	62.080

*mean*	4106.000
σ	1568.293
min	1986.000
max	6044.000

*mean*	82.307
σ	11.236
min	70.846
max	102.160

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.944
σ	0.001
min	40.944
max	40.945

*mean*	6044.000
σ	0.000
min	6044.000
max	6044.000

*mean*	98.404
σ	7.662
min	85.383
max	107.305

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.686
σ	0.000
min	66.685
max	66.687

*mean*	6044.000
σ	0.000
min	6044.000
max	6044.000

*mean*	231.026
σ	240.865
min	124.619
max	826.283

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11656.833
σ	4.318
min	11655.305
max	11667.521

*mean*	4106.000
σ	1568.293
min	1986.000
max	6044.000

*mean*	6462.090
σ	1267.528
min	4974.365
max	8069.273

op=vertical_lookup_list() on indexed

*mean*	11560.069
σ	0.002
min	11560.066
max	11560.073

*mean*	6044.000
σ	0.000
min	6044.000
max	6044.000

*mean*	6644.959
σ	1156.728
min	4476.862
max	8372.973

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.582
σ	0.025
min	172.558
max	172.623

*mean*	1986.000
σ	0.000
min	1986.000
max	1986.000

*mean*	346.741
σ	56.111
min	264.659
max	409.948

op=pointedIndexFromKvs

rows=400000

*mean*	357.367
σ	0.044
min	357.321
max	357.429

*mean*	1986.000
σ	0.000
min	1986.000
max	1986.000

*mean*	801.620
σ	22.042
min	761.712
max	828.304

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1008.184
σ	0.883
min	1007.698
max	1011.841

*mean*	1041.800
σ	304.737
min	549.000
max	1470.000

*mean*	1.570
σ	0.133
min	1.469
max	2.056

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.883
σ	0.002
min	0.881
max	0.886

*mean*	1470.000
σ	0.000
min	1470.000
max	1470.000

*mean*	0.420
σ	0.149
min	0.332
max	0.683

name=error_case.art

*mean*	2.333
σ	0.003
min	2.332
max	2.337

*mean*	1470.000
σ	0.000
min	1470.000
max	1470.000

*mean*	0.874
σ	0.089
min	0.811
max	1.027

name=heavy_item.art

*mean*	1.521
σ	0.002
min	1.520
max	1.524

*mean*	1470.000
σ	0.000
min	1470.000
max	1470.000

*mean*	0.537
σ	0.049
min	0.485
max	0.617

name=nested_use.art

*mean*	2.355
σ	0.002
min	2.355
max	2.358

*mean*	1470.000
σ	0.000
min	1470.000
max	1470.000

*mean*	0.840
σ	0.050
min	0.798
max	0.924

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	963.541
σ	0.032
min	963.523
max	963.597

*mean*	1470.000
σ	0.000
min	1470.000
max	1470.000

*mean*	0.832
σ	0.030
min	0.794
max	0.866

name=cdr_enhanced_4k_loc.art

*mean*	884.854
σ	0.007
min	884.847
max	884.862

*mean*	1470.000
σ	0.000
min	1470.000
max	1470.000

*mean*	0.737
σ	0.013
min	0.714
max	0.746

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.706
σ	0.002
min	7.705
max	7.713

*mean*	1470.000
σ	0.000
min	1470.000
max	1470.000

*mean*	3.523
σ	0.073
min	3.378
max	3.816

name=record_render_large_syntax_err.art

*mean*	7.655
σ	0.002
min	7.654
max	7.658

*mean*	1470.000
σ	0.000
min	1470.000
max	1470.000

*mean*	3.515
σ	0.079
min	3.362
max	3.796

name=record_render_success.art

*mean*	2.288
σ	0.002
min	2.287
max	2.291

*mean*	1470.000
σ	0.000
min	1470.000
max	1470.000

*mean*	0.736
σ	0.018
min	0.702
max	0.833

name=record_render_syntax_err.art

*mean*	2.163
σ	0.002
min	2.163
max	2.166

*mean*	1470.000
σ	0.000
min	1470.000
max	1470.000

*mean*	0.699
σ	0.028
min	0.534
max	0.790

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	297.482
σ	0.189
min	297.365
max	297.999

*mean*	1986.000
σ	0.000
min	1986.000
max	1986.000

*mean*	0.546
σ	0.029
min	0.514
max	0.588

Timed compile per phase

Factor

allocated MiB

peak allocated MiB

time (ms)

phase=buildDeclTree

*mean*	221.996
σ	0.000
min	221.996
max	221.997

*mean*	1593.875
σ	25.809
min	1530.000
max	1603.000

*mean*	206.529
σ	1.894
min	203.885
max	209.219

phase=macro expansion

*mean*	6.127
σ	0.000
min	6.127
max	6.127

*mean*	1593.875
σ	25.809
min	1530.000
max	1603.000

*mean*	9.386
σ	2.947
min	6.222
max	12.797

phase=parser

*mean*	1041.086
σ	0.000
min	1041.086
max	1041.086

*mean*	1593.875
σ	25.809
min	1530.000
max	1603.000

*mean*	547.870
σ	164.544
min	377.428
max	737.697

phase=processProdDef

*mean*	6169.661
σ	0.001
min	6169.660
max	6169.662

*mean*	1603.000
σ	0.000
min	1603.000
max	1603.000

*mean*	6431.711
σ	1263.773
min	4233.418
max	7551.705

phase=renaming

*mean*	21.666
σ	0.000
min	21.666
max	21.666

*mean*	1593.875
σ	25.809
min	1530.000
max	1603.000

*mean*	35.104
σ	12.795
min	20.439
max	49.130

phase=type checker

*mean*	958.669
σ	0.055
min	958.583
max	958.739

*mean*	1593.875
σ	25.809
min	1530.000
max	1603.000

*mean*	745.190
σ	75.370
min	642.081
max	878.974

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	289.766
σ	0.036
min	289.722
max	289.810

*mean*	1603.000
σ	0.000
min	1603.000
max	1603.000

*mean*	0.397
σ	0.014
min	0.386
max	0.415

iters=5

new-facts=1

prior-facts=6402

*mean*	1299.591
σ	0.079
min	1299.501
max	1299.709

*mean*	1603.000
σ	0.000
min	1603.000
max	1603.000

*mean*	2.011
σ	0.115
min	1.878
max	2.194

iters=5

new-facts=6402

prior-facts=1

*mean*	1542.618
σ	3.985
min	1540.667
max	1549.742

*mean*	1603.000
σ	0.000
min	1603.000
max	1603.000

*mean*	2.174
σ	0.111
min	2.002
max	2.275

iters=5

new-facts=6402

prior-facts=6402

*mean*	1861.657
σ	0.068
min	1861.582
max	1861.738

*mean*	1797.600
σ	187.596
min	1603.000
max	1986.000

*mean*	3.296
σ	0.389
min	2.901
max	3.709

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.848
σ	0.156
min	1.592
max	2.014

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	446.186
σ	577.140
min	157.613
max	1311.895

*mean*	96.250
σ	8.500
min	92.000
max	109.000

*mean*	1603.000
σ	0.000
min	1603.000
max	1603.000

*mean*	0.540
σ	0.556
min	0.262
max	1.374

policies=20

*mean*	1576.427
σ	0.361
min	1576.182
max	1576.963

*mean*	920.000
σ	0.000
min	920.000
max	920.000

*mean*	1603.000
σ	0.000
min	1603.000
max	1603.000

*mean*	2.632
σ	0.012
min	2.616
max	2.642

policies=200

*mean*	15772.325
σ	0.133
min	15772.183
max	15772.504

*mean*	9200.000
σ	0.000
min	9200.000
max	9200.000

*mean*	1603.000
σ	0.000
min	1603.000
max	1603.000

*mean*	26.590
σ	0.133
min	26.492
max	26.776