Compare commits

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.620
σ	0.351
min	54.482
max	55.618

*mean*	417.000
σ	0.000
min	417.000
max	417.000

*mean*	0.139
σ	0.005
min	0.131
max	0.148

cache=y

dps=1

iters=10

policies=100

*mean*	43.790
σ	0.006
min	43.780
max	43.801

*mean*	417.000
σ	0.000
min	417.000
max	417.000

*mean*	0.123
σ	0.004
min	0.120
max	0.131

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.002
min	36.615
max	36.619

*mean*	4151.500
σ	1899.928
min	1556.000
max	7308.000

*mean*	12.885
σ	0.396
min	12.564
max	13.737

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.002
min	36.616
max	36.620

*mean*	4151.500
σ	1899.928
min	1556.000
max	7308.000

*mean*	13.263
σ	0.170
min	13.013
max	13.549

op=table_records(), no indexes

*mean*	41.932
σ	0.001
min	41.929
max	41.933

*mean*	7308.000
σ	0.000
min	7308.000
max	7308.000

*mean*	15.293
σ	0.778
min	13.467
max	16.107

op=table_records(), repeat

*mean*	41.928
σ	0.002
min	41.927
max	41.932

*mean*	4151.500
σ	1899.928
min	1556.000
max	7308.000

*mean*	12.879
σ	1.992
min	10.607
max	15.418

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.653
σ	0.137
min	27.603
max	27.991

*mean*	4151.500
σ	1899.928
min	1556.000
max	7308.000

*mean*	9.005
σ	0.369
min	8.339
max	9.462

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.400
σ	0.002
min	26.399
max	26.403

*mean*	4151.500
σ	1899.928
min	1556.000
max	7308.000

*mean*	6.791
σ	0.258
min	6.545
max	7.199

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.666
σ	0.002
min	25.664
max	25.668

*mean*	4151.500
σ	1899.928
min	1556.000
max	7308.000

*mean*	6.113
σ	0.071
min	6.023
max	6.267

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.968
σ	0.002
min	25.967
max	25.972

*mean*	4151.500
σ	1899.928
min	1556.000
max	7308.000

*mean*	5.943
σ	0.100
min	5.759
max	6.064

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.606
σ	0.000
min	2524.606
max	2524.607

*mean*	7308.000
σ	0.000
min	7308.000
max	7308.000

*mean*	1074.163
σ	79.829
min	1038.209
max	1271.360

op=load_product(), with indexes

*mean*	8744.722
σ	0.469
min	8744.554
max	8745.883

*mean*	3572.125
σ	1795.120
min	1045.000
max	5794.000

*mean*	4765.926
σ	1547.463
min	3510.791
max	7651.891

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.078
σ	0.002
min	62.076
max	62.081

*mean*	4151.500
σ	1899.928
min	1556.000
max	7308.000

*mean*	80.700
σ	10.092
min	70.790
max	96.206

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.944
σ	0.001
min	40.944
max	40.945

*mean*	7308.000
σ	0.000
min	7308.000
max	7308.000

*mean*	106.545
σ	5.465
min	95.223
max	109.958

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.686
σ	0.000
min	66.685
max	66.687

*mean*	7308.000
σ	0.000
min	7308.000
max	7308.000

*mean*	162.658
σ	10.523
min	138.708
max	169.079

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11656.836
σ	4.324
min	11655.305
max	11667.538

*mean*	4151.500
σ	1899.928
min	1556.000
max	7308.000

*mean*	5952.929
σ	1154.680
min	4860.638
max	7783.369

op=vertical_lookup_list() on indexed

*mean*	11560.065
σ	0.001
min	11560.064
max	11560.066

*mean*	7308.000
σ	0.000
min	7308.000
max	7308.000

*mean*	4999.931
σ	1075.482
min	4318.653
max	7252.455

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.559
σ	0.001
min	172.558
max	172.562

*mean*	477.000
σ	0.000
min	477.000
max	477.000

*mean*	359.073
σ	29.149
min	305.669
max	390.731

op=pointedIndexFromKvs

rows=400000

*mean*	357.322
σ	0.001
min	357.321
max	357.325

*mean*	558.500
σ	0.926
min	558.000
max	560.000

*mean*	720.753
σ	77.727
min	592.601
max	793.325

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1008.374
σ	0.760
min	1007.899
max	1011.515

*mean*	1058.200
σ	315.401
min	562.000
max	1528.000

*mean*	1.549
σ	0.069
min	1.492
max	1.768

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.891
σ	0.020
min	0.881
max	0.928

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.414
σ	0.513
min	0.147
max	1.325

name=error_case.art

*mean*	2.338
σ	0.012
min	2.332
max	2.359

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.475
σ	0.315
min	0.326
max	1.038

name=heavy_item.art

*mean*	1.522
σ	0.002
min	1.520
max	1.524

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.215
σ	0.020
min	0.197
max	0.249

name=nested_use.art

*mean*	2.355
σ	0.002
min	2.355
max	2.358

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.329
σ	0.019
min	0.317
max	0.363

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	963.908
σ	0.011
min	963.902
max	963.926

*mean*	434.800
σ	1.643
min	432.000
max	436.000

*mean*	0.554
σ	0.057
min	0.458
max	0.599

name=cdr_enhanced_4k_loc.art

*mean*	884.884
σ	0.002
min	884.883
max	884.886

*mean*	436.000
σ	0.000
min	436.000
max	436.000

*mean*	0.426
σ	0.030
min	0.382
max	0.455

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.706
σ	0.002
min	7.705
max	7.709

*mean*	436.000
σ	0.000
min	436.000
max	436.000

*mean*	2.569
σ	0.093
min	2.417
max	2.878

name=record_render_large_syntax_err.art

*mean*	7.655
σ	0.002
min	7.654
max	7.658

*mean*	436.000
σ	0.000
min	436.000
max	436.000

*mean*	2.585
σ	0.072
min	2.469
max	2.861

name=record_render_success.art

*mean*	2.288
σ	0.002
min	2.287
max	2.291

*mean*	436.000
σ	0.000
min	436.000
max	436.000

*mean*	0.307
σ	0.009
min	0.291
max	0.357

name=record_render_syntax_err.art

*mean*	2.163
σ	0.002
min	2.163
max	2.166

*mean*	436.000
σ	0.000
min	436.000
max	436.000

*mean*	0.290
σ	0.007
min	0.277
max	0.325

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	297.984
σ	1.037
min	297.564
max	300.931

*mean*	442.400
σ	15.299
min	418.000
max	465.000

*mean*	0.611
σ	0.015
min	0.576
max	0.632

Timed compile per phase

Factor

allocated MiB

peak allocated MiB

time (ms)

phase=buildDeclTree

*mean*	222.011
σ	0.000
min	222.011
max	222.011

*mean*	1722.875
σ	57.734
min	1580.000
max	1745.000

*mean*	212.785
σ	1.825
min	210.011
max	215.585

phase=macro expansion

*mean*	6.133
σ	0.000
min	6.133
max	6.133

*mean*	1722.875
σ	57.734
min	1580.000
max	1745.000

*mean*	11.410
σ	1.556
min	9.342
max	12.793

phase=parser

*mean*	1041.159
σ	0.000
min	1041.158
max	1041.159

*mean*	1722.875
σ	57.734
min	1580.000
max	1745.000

*mean*	675.953
σ	91.778
min	556.182
max	821.918

phase=processProdDef

*mean*	6169.660
σ	0.001
min	6169.659
max	6169.661

*mean*	1743.500
σ	0.926
min	1743.000
max	1745.000

*mean*	5136.620
σ	1120.668
min	4011.745
max	6821.502

phase=renaming

*mean*	21.667
σ	0.000
min	21.667
max	21.667

*mean*	1722.875
σ	57.734
min	1580.000
max	1745.000

*mean*	43.669
σ	6.514
min	30.792
max	50.589

phase=type checker

*mean*	958.670
σ	0.066
min	958.573
max	958.760

*mean*	1722.875
σ	57.734
min	1580.000
max	1745.000

*mean*	787.076
σ	85.034
min	668.644
max	882.981

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	292.774
σ	0.034
min	292.726
max	292.811

*mean*	445.000
σ	0.000
min	445.000
max	445.000

*mean*	0.396
σ	0.002
min	0.394
max	0.399

iters=5

new-facts=1

prior-facts=6402

*mean*	1302.866
σ	0.087
min	1302.716
max	1302.942

*mean*	1099.200
σ	187.656
min	840.000
max	1322.000

*mean*	2.017
σ	0.212
min	1.760
max	2.233

iters=5

new-facts=6402

prior-facts=1

*mean*	1545.907
σ	4.026
min	1543.915
max	1553.102

*mean*	612.400
σ	77.394
min	493.000
max	699.000

*mean*	2.274
σ	0.217
min	2.136
max	2.659

iters=5

new-facts=6402

prior-facts=6402

*mean*	1864.844
σ	0.026
min	1864.801
max	1864.870

*mean*	1726.000
σ	191.340
min	1461.000
max	1905.000

*mean*	2.967
σ	0.112
min	2.852
max	3.131

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.785
σ	0.102
min	1.676
max	1.928

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	447.754
σ	579.111
min	158.197
max	1316.420

*mean*	96.250
σ	8.500
min	92.000
max	109.000

*mean*	444.000
σ	0.000
min	444.000
max	444.000

*mean*	0.537
σ	0.549
min	0.260
max	1.361

policies=20

*mean*	1582.281
σ	0.358
min	1582.032
max	1582.810

*mean*	920.000
σ	0.000
min	920.000
max	920.000

*mean*	448.000
σ	4.619
min	444.000
max	452.000

*mean*	2.630
σ	0.059
min	2.592
max	2.717

policies=200

*mean*	15830.687
σ	0.146
min	15830.528
max	15830.874

*mean*	9200.000
σ	0.000
min	9200.000
max	9200.000

*mean*	496.250
σ	4.113
min	491.000
max	501.000

*mean*	26.525
σ	0.121
min	26.416
max	26.643