Compare commits

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.574
σ	0.349
min	54.435
max	55.567

*mean*	418.700
σ	0.483
min	418.000
max	419.000

*mean*	0.138
σ	0.006
min	0.132
max	0.148

cache=y

dps=1

iters=10

policies=100

*mean*	43.706
σ	0.008
min	43.692
max	43.719

*mean*	419.000
σ	0.000
min	419.000
max	419.000

*mean*	0.125
σ	0.005
min	0.120
max	0.134

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.002
min	36.616
max	36.620

*mean*	4157.625
σ	1901.110
min	1559.000
max	7320.000

*mean*	13.077
σ	0.349
min	12.764
max	13.675

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.002
min	36.615
max	36.620

*mean*	4157.625
σ	1901.110
min	1559.000
max	7320.000

*mean*	13.071
σ	0.641
min	12.113
max	14.075

op=table_records(), no indexes

*mean*	41.932
σ	0.001
min	41.928
max	41.933

*mean*	7320.000
σ	0.000
min	7320.000
max	7320.000

*mean*	15.023
σ	0.857
min	13.025
max	15.622

op=table_records(), repeat

*mean*	41.929
σ	0.002
min	41.927
max	41.931

*mean*	4157.625
σ	1901.110
min	1559.000
max	7320.000

*mean*	12.771
σ	1.950
min	10.714
max	15.304

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.653
σ	0.136
min	27.603
max	27.990

*mean*	4157.625
σ	1901.110
min	1559.000
max	7320.000

*mean*	8.947
σ	0.470
min	8.362
max	9.730

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.400
σ	0.002
min	26.399
max	26.403

*mean*	4157.625
σ	1901.110
min	1559.000
max	7320.000

*mean*	6.550
σ	0.292
min	6.049
max	7.012

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.666
σ	0.002
min	25.664
max	25.668

*mean*	4157.625
σ	1901.110
min	1559.000
max	7320.000

*mean*	6.085
σ	0.179
min	5.805
max	6.323

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.968
σ	0.002
min	25.967
max	25.972

*mean*	4157.625
σ	1901.110
min	1559.000
max	7320.000

*mean*	5.703
σ	0.212
min	5.302
max	5.901

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.606
σ	0.000
min	2524.606
max	2524.606

*mean*	7320.000
σ	0.000
min	7320.000
max	7320.000

*mean*	1039.718
σ	10.215
min	1029.025
max	1061.281

op=load_product(), with indexes

*mean*	8744.721
σ	0.469
min	8744.553
max	8745.882

*mean*	3579.875
σ	1799.826
min	1044.000
max	5815.000

*mean*	4973.980
σ	1608.518
min	3489.860
max	7034.149

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.078
σ	0.002
min	62.076
max	62.080

*mean*	4157.625
σ	1901.110
min	1559.000
max	7320.000

*mean*	82.796
σ	9.303
min	72.394
max	96.882

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.944
σ	0.001
min	40.944
max	40.945

*mean*	7320.000
σ	0.000
min	7320.000
max	7320.000

*mean*	105.096
σ	5.644
min	95.528
max	111.899

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.686
σ	0.000
min	66.685
max	66.687

*mean*	7320.000
σ	0.000
min	7320.000
max	7320.000

*mean*	160.958
σ	9.480
min	140.166
max	166.715

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11656.836
σ	4.324
min	11655.305
max	11667.538

*mean*	4157.625
σ	1901.110
min	1559.000
max	7320.000

*mean*	6380.491
σ	1111.807
min	4946.797
max	7829.537

op=vertical_lookup_list() on indexed

*mean*	11560.065
σ	0.001
min	11560.065
max	11560.066

*mean*	7320.000
σ	0.000
min	7320.000
max	7320.000

*mean*	5736.437
σ	1849.422
min	4334.288
max	8756.636

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.559
σ	0.001
min	172.558
max	172.562

*mean*	476.000
σ	0.000
min	476.000
max	476.000

*mean*	382.063
σ	16.796
min	354.256
max	395.579

op=pointedIndexFromKvs

rows=400000

*mean*	357.322
σ	0.001
min	357.321
max	357.325

*mean*	560.250
σ	0.463
min	560.000
max	561.000

*mean*	730.291
σ	47.209
min	649.466
max	778.509

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1008.502
σ	0.759
min	1008.025
max	1011.641

*mean*	1047.600
σ	313.277
min	573.000
max	1510.000

*mean*	1.535
σ	0.096
min	1.358
max	1.759

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.913
σ	0.020
min	0.903
max	0.949

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.396
σ	0.507
min	0.145
max	1.301

name=error_case.art

*mean*	2.339
σ	0.012
min	2.333
max	2.361

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.547
σ	0.305
min	0.338
max	1.061

name=heavy_item.art

*mean*	1.522
σ	0.002
min	1.521
max	1.525

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.218
σ	0.022
min	0.203
max	0.257

name=nested_use.art

*mean*	2.357
σ	0.002
min	2.356
max	2.360

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.338
σ	0.019
min	0.325
max	0.370

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	964.741
σ	0.011
min	964.736
max	964.760

*mean*	429.000
σ	0.000
min	429.000
max	429.000

*mean*	0.579
σ	0.032
min	0.530
max	0.603

name=cdr_enhanced_4k_loc.art

*mean*	885.814
σ	0.002
min	885.812
max	885.816

*mean*	429.000
σ	0.000
min	429.000
max	429.000

*mean*	0.464
σ	0.055
min	0.397
max	0.528

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.708
σ	0.002
min	7.707
max	7.711

*mean*	429.000
σ	0.000
min	429.000
max	429.000

*mean*	2.119
σ	0.332
min	1.806
max	2.910

name=record_render_large_syntax_err.art

*mean*	7.656
σ	0.002
min	7.655
max	7.659

*mean*	429.000
σ	0.000
min	429.000
max	429.000

*mean*	1.963
σ	0.071
min	1.847
max	2.212

name=record_render_success.art

*mean*	2.289
σ	0.002
min	2.288
max	2.292

*mean*	429.000
σ	0.000
min	429.000
max	429.000

*mean*	0.307
σ	0.009
min	0.291
max	0.359

name=record_render_syntax_err.art

*mean*	2.165
σ	0.002
min	2.164
max	2.168

*mean*	429.000
σ	0.000
min	429.000
max	429.000

*mean*	0.292
σ	0.008
min	0.277
max	0.334

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	298.125
σ	1.042
min	297.720
max	301.089

*mean*	441.700
σ	16.479
min	418.000
max	470.000

*mean*	0.610
σ	0.026
min	0.548
max	0.642

Timed compile per phase

Factor

allocated MiB

peak allocated MiB

time (ms)

phase=buildDeclTree

*mean*	222.008
σ	0.000
min	222.008
max	222.008

*mean*	1745.000
σ	0.000
min	1745.000
max	1745.000

*mean*	207.950
σ	0.982
min	206.745
max	209.234

phase=macro expansion

*mean*	6.130
σ	0.000
min	6.130
max	6.130

*mean*	1745.000
σ	0.000
min	1745.000
max	1745.000

*mean*	10.909
σ	2.164
min	6.405
max	12.694

phase=parser

*mean*	1042.099
σ	0.000
min	1042.099
max	1042.100

*mean*	1745.000
σ	0.000
min	1745.000
max	1745.000

*mean*	649.182
σ	113.973
min	427.211
max	734.295

phase=processProdDef

*mean*	6169.659
σ	0.000
min	6169.658
max	6169.659

*mean*	1745.000
σ	0.000
min	1745.000
max	1745.000

*mean*	5324.935
σ	1397.072
min	3589.852
max	7550.032

phase=renaming

*mean*	21.671
σ	0.000
min	21.671
max	21.671

*mean*	1745.000
σ	0.000
min	1745.000
max	1745.000

*mean*	39.058
σ	10.367
min	20.725
max	48.311

phase=type checker

*mean*	958.457
σ	0.066
min	958.360
max	958.547

*mean*	1745.000
σ	0.000
min	1745.000
max	1745.000

*mean*	743.614
σ	73.813
min	630.717
max	831.806

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	293.381
σ	0.034
min	293.333
max	293.418

*mean*	445.000
σ	0.000
min	445.000
max	445.000

*mean*	0.405
σ	0.007
min	0.399
max	0.413

iters=5

new-facts=1

prior-facts=6402

*mean*	1303.464
σ	0.081
min	1303.328
max	1303.537

*mean*	1100.000
σ	195.388
min	893.000
max	1366.000

*mean*	2.046
σ	0.098
min	1.946
max	2.173

iters=5

new-facts=6402

prior-facts=1

*mean*	1546.551
σ	3.998
min	1544.599
max	1553.697

*mean*	621.400
σ	92.254
min	494.000
max	738.000

*mean*	2.376
σ	0.190
min	2.174
max	2.558

iters=5

new-facts=6402

prior-facts=6402

*mean*	1865.439
σ	0.043
min	1865.390
max	1865.489

*mean*	1712.000
σ	164.918
min	1502.000
max	1939.000

*mean*	2.905
σ	0.060
min	2.814
max	2.962

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.762
σ	0.122
min	1.636
max	1.920

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	447.982
σ	579.239
min	158.358
max	1316.840

*mean*	96.250
σ	8.500
min	92.000
max	109.000

*mean*	444.000
σ	0.000
min	444.000
max	444.000

*mean*	0.461
σ	0.391
min	0.263
max	1.048

policies=20

*mean*	1583.934
σ	0.361
min	1583.680
max	1584.467

*mean*	920.000
σ	0.000
min	920.000
max	920.000

*mean*	446.250
σ	1.500
min	444.000
max	447.000

*mean*	2.643
σ	0.013
min	2.634
max	2.663

policies=200

*mean*	15847.312
σ	0.119
min	15847.218
max	15847.480

*mean*	9200.000
σ	0.000
min	9200.000
max	9200.000

*mean*	497.000
σ	4.546
min	492.000
max	503.000

*mean*	26.778
σ	0.148
min	26.572
max	26.912