Compare commits

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.577
σ	0.347
min	54.445
max	55.565

*mean*	418.000
σ	0.000
min	418.000
max	418.000

*mean*	0.140
σ	0.004
min	0.134
max	0.148

cache=y

dps=1

iters=10

policies=100

*mean*	43.706
σ	0.006
min	43.700
max	43.722

*mean*	418.000
σ	0.000
min	418.000
max	418.000

*mean*	0.123
σ	0.005
min	0.118
max	0.133

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.002
min	36.615
max	36.619

*mean*	4148.625
σ	1892.617
min	1557.000
max	7277.000

*mean*	12.730
σ	0.172
min	12.449
max	12.876

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.002
min	36.616
max	36.620

*mean*	4148.625
σ	1892.617
min	1557.000
max	7277.000

*mean*	13.008
σ	0.435
min	12.216
max	13.357

op=table_records(), no indexes

*mean*	41.932
σ	0.001
min	41.929
max	41.933

*mean*	7277.000
σ	0.000
min	7277.000
max	7277.000

*mean*	15.357
σ	0.475
min	14.376
max	15.703

op=table_records(), repeat

*mean*	41.928
σ	0.002
min	41.927
max	41.932

*mean*	4148.625
σ	1892.617
min	1557.000
max	7277.000

*mean*	13.445
σ	1.913
min	10.936
max	15.817

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.653
σ	0.136
min	27.603
max	27.990

*mean*	4148.625
σ	1892.617
min	1557.000
max	7277.000

*mean*	9.187
σ	0.453
min	8.585
max	9.809

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.400
σ	0.002
min	26.399
max	26.403

*mean*	4148.625
σ	1892.617
min	1557.000
max	7277.000

*mean*	6.661
σ	0.275
min	6.235
max	7.024

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.666
σ	0.002
min	25.665
max	25.668

*mean*	4148.625
σ	1892.617
min	1557.000
max	7277.000

*mean*	6.064
σ	0.143
min	5.834
max	6.260

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.968
σ	0.002
min	25.967
max	25.972

*mean*	4148.625
σ	1892.617
min	1557.000
max	7277.000

*mean*	5.587
σ	0.237
min	5.213
max	5.900

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.606
σ	0.000
min	2524.606
max	2524.606

*mean*	7277.000
σ	0.000
min	7277.000
max	7277.000

*mean*	1499.971
σ	856.793
min	1035.794
max	3502.681

op=load_product(), with indexes

*mean*	8744.721
σ	0.469
min	8744.553
max	8745.882

*mean*	3570.875
σ	1792.666
min	1044.000
max	5784.000

*mean*	4844.482
σ	1462.811
min	3528.970
max	7128.268

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.078
σ	0.002
min	62.076
max	62.081

*mean*	4148.625
σ	1892.617
min	1557.000
max	7277.000

*mean*	86.364
σ	14.128
min	71.659
max	105.597

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.944
σ	0.001
min	40.944
max	40.945

*mean*	7277.000
σ	0.000
min	7277.000
max	7277.000

*mean*	108.301
σ	3.206
min	102.332
max	112.593

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.686
σ	0.000
min	66.685
max	66.687

*mean*	7277.000
σ	0.000
min	7277.000
max	7277.000

*mean*	163.903
σ	4.843
min	154.741
max	169.347

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11656.836
σ	4.325
min	11655.305
max	11667.539

*mean*	4148.625
σ	1892.617
min	1557.000
max	7277.000

*mean*	6243.392
σ	1174.474
min	4891.584
max	7782.498

op=vertical_lookup_list() on indexed

*mean*	11560.065
σ	0.001
min	11560.064
max	11560.066

*mean*	7277.000
σ	0.000
min	7277.000
max	7277.000

*mean*	5699.885
σ	1640.593
min	4402.921
max	7746.388

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.559
σ	0.001
min	172.558
max	172.562

*mean*	477.000
σ	0.000
min	477.000
max	477.000

*mean*	386.324
σ	15.512
min	349.103
max	396.694

op=pointedIndexFromKvs

rows=400000

*mean*	357.322
σ	0.001
min	357.321
max	357.325

*mean*	559.250
σ	1.035
min	558.000
max	560.000

*mean*	746.299
σ	59.103
min	646.144
max	781.845

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1008.500
σ	0.760
min	1008.025
max	1011.641

*mean*	1044.650
σ	299.892
min	561.000
max	1447.000

*mean*	1.530
σ	0.076
min	1.451
max	1.759

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.913
σ	0.020
min	0.903
max	0.949

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.300
σ	0.293
min	0.135
max	0.820

name=error_case.art

*mean*	2.339
σ	0.012
min	2.333
max	2.361

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.507
σ	0.303
min	0.326
max	1.035

name=heavy_item.art

*mean*	1.522
σ	0.002
min	1.521
max	1.525

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.217
σ	0.025
min	0.202
max	0.260

name=nested_use.art

*mean*	2.357
σ	0.002
min	2.356
max	2.360

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.329
σ	0.021
min	0.311
max	0.366

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	964.741
σ	0.011
min	964.736
max	964.760

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	0.544
σ	0.047
min	0.492
max	0.606

name=cdr_enhanced_4k_loc.art

*mean*	885.814
σ	0.002
min	885.812
max	885.816

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	0.484
σ	0.037
min	0.450
max	0.524

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.708
σ	0.002
min	7.707
max	7.711

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	2.624
σ	0.086
min	2.459
max	2.816

name=record_render_large_syntax_err.art

*mean*	7.656
σ	0.002
min	7.655
max	7.659

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	2.582
σ	0.075
min	2.423
max	2.841

name=record_render_success.art

*mean*	2.289
σ	0.002
min	2.288
max	2.292

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	0.303
σ	0.009
min	0.287
max	0.358

name=record_render_syntax_err.art

*mean*	2.165
σ	0.002
min	2.164
max	2.168

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	0.291
σ	0.008
min	0.277
max	0.328

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	297.994
σ	1.051
min	297.553
max	300.979

*mean*	442.800
σ	16.956
min	418.000
max	464.000

*mean*	0.600
σ	0.024
min	0.564
max	0.627

Timed compile per phase

Factor

allocated MiB

peak allocated MiB

time (ms)

phase=buildDeclTree

*mean*	222.008
σ	0.000
min	222.008
max	222.008

*mean*	1743.000
σ	0.000
min	1743.000
max	1743.000

*mean*	205.536
σ	1.573
min	203.080
max	208.198

phase=macro expansion

*mean*	6.130
σ	0.000
min	6.130
max	6.130

*mean*	1743.000
σ	0.000
min	1743.000
max	1743.000

*mean*	13.274
σ	1.287
min	12.517
max	15.527

phase=parser

*mean*	1042.099
σ	0.000
min	1042.099
max	1042.099

*mean*	1743.000
σ	0.000
min	1743.000
max	1743.000

*mean*	752.202
σ	54.682
min	701.596
max	841.477

phase=processProdDef

*mean*	6169.661
σ	0.000
min	6169.660
max	6169.661

*mean*	1743.000
σ	0.000
min	1743.000
max	1743.000

*mean*	4986.519
σ	886.977
min	3969.543
max	6867.514

phase=renaming

*mean*	21.667
σ	0.000
min	21.667
max	21.667

*mean*	1743.000
σ	0.000
min	1743.000
max	1743.000

*mean*	49.580
σ	3.751
min	47.212
max	55.779

phase=type checker

*mean*	958.461
σ	0.066
min	958.363
max	958.551

*mean*	1743.000
σ	0.000
min	1743.000
max	1743.000

*mean*	854.912
σ	60.447
min	752.360
max	913.479

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	293.379
σ	0.036
min	293.329
max	293.417

*mean*	445.000
σ	0.000
min	445.000
max	445.000

*mean*	0.407
σ	0.008
min	0.398
max	0.415

iters=5

new-facts=1

prior-facts=6402

*mean*	1303.479
σ	0.094
min	1303.319
max	1303.552

*mean*	1100.200
σ	190.774
min	839.000
max	1330.000

*mean*	2.063
σ	0.239
min	1.783
max	2.319

iters=5

new-facts=6402

prior-facts=1

*mean*	1546.517
σ	4.028
min	1544.547
max	1553.716

*mean*	618.000
σ	80.215
min	497.000
max	712.000

*mean*	2.295
σ	0.204
min	2.160
max	2.651

iters=5

new-facts=6402

prior-facts=6402

*mean*	1865.447
σ	0.044
min	1865.389
max	1865.493

*mean*	1726.600
σ	169.677
min	1479.000
max	1877.000

*mean*	2.990
σ	0.312
min	2.639
max	3.494

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.736
σ	0.120
min	1.544
max	1.836

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	447.981
σ	579.240
min	158.358
max	1316.841

*mean*	96.250
σ	8.500
min	92.000
max	109.000

*mean*	440.000
σ	0.000
min	440.000
max	440.000

*mean*	0.524
σ	0.524
min	0.261
max	1.310

policies=20

*mean*	1583.935
σ	0.357
min	1583.689
max	1584.464

*mean*	920.000
σ	0.000
min	920.000
max	920.000

*mean*	446.000
σ	6.928
min	440.000
max	452.000

*mean*	2.631
σ	0.014
min	2.613
max	2.646

policies=200

*mean*	15847.253
σ	0.067
min	15847.161
max	15847.317

*mean*	9200.000
σ	0.000
min	9200.000
max	9200.000

*mean*	493.750
σ	3.862
min	490.000
max	499.000

*mean*	26.651
σ	0.112
min	26.492
max	26.746