04248c4309f28e4c15a1b9ef8b1d77a6aeacb0ae

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.623
σ	0.349
min	54.493
max	55.615

*mean*	417.000
σ	0.000
min	417.000
max	417.000

*mean*	0.140
σ	0.007
min	0.131
max	0.153

cache=y

dps=1

iters=10

policies=100

*mean*	43.788
σ	0.006
min	43.783
max	43.801

*mean*	417.000
σ	0.000
min	417.000
max	417.000

*mean*	0.124
σ	0.005
min	0.119
max	0.133

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.002
min	36.615
max	36.619

*mean*	4152.750
σ	1899.844
min	1555.000
max	7301.000

*mean*	12.828
σ	0.239
min	12.451
max	13.176

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.002
min	36.616
max	36.620

*mean*	4152.750
σ	1899.844
min	1555.000
max	7301.000

*mean*	12.934
σ	0.469
min	11.935
max	13.422

op=table_records(), no indexes

*mean*	41.932
σ	0.001
min	41.929
max	41.933

*mean*	7301.000
σ	0.000
min	7301.000
max	7301.000

*mean*	15.213
σ	0.551
min	14.045
max	15.755

op=table_records(), repeat

*mean*	41.929
σ	0.002
min	41.927
max	41.931

*mean*	4152.750
σ	1899.844
min	1555.000
max	7301.000

*mean*	13.339
σ	1.664
min	11.130
max	15.304

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.653
σ	0.136
min	27.603
max	27.990

*mean*	4152.750
σ	1899.844
min	1555.000
max	7301.000

*mean*	8.779
σ	0.310
min	8.233
max	9.111

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.400
σ	0.002
min	26.399
max	26.403

*mean*	4152.750
σ	1899.844
min	1555.000
max	7301.000

*mean*	6.843
σ	0.135
min	6.662
max	7.021

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.666
σ	0.002
min	25.664
max	25.668

*mean*	4152.750
σ	1899.844
min	1555.000
max	7301.000

*mean*	6.101
σ	0.144
min	5.993
max	6.365

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.968
σ	0.002
min	25.967
max	25.972

*mean*	4152.750
σ	1899.844
min	1555.000
max	7301.000

*mean*	5.848
σ	0.123
min	5.707
max	6.055

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.606
σ	0.000
min	2524.606
max	2524.607

*mean*	7301.000
σ	0.000
min	7301.000
max	7301.000

*mean*	1088.703
σ	111.185
min	1038.573
max	1363.365

op=load_product(), with indexes

*mean*	8744.722
σ	0.469
min	8744.553
max	8745.884

*mean*	3573.500
σ	1795.513
min	1047.000
max	5794.000

*mean*	5034.659
σ	1674.662
min	3531.703
max	7309.869

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.078
σ	0.002
min	62.076
max	62.081

*mean*	4152.750
σ	1899.844
min	1555.000
max	7301.000

*mean*	82.088
σ	11.948
min	70.807
max	96.530

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.944
σ	0.001
min	40.944
max	40.945

*mean*	7301.000
σ	0.000
min	7301.000
max	7301.000

*mean*	107.374
σ	4.881
min	98.301
max	112.991

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.686
σ	0.000
min	66.685
max	66.687

*mean*	7301.000
σ	0.000
min	7301.000
max	7301.000

*mean*	162.455
σ	8.313
min	144.345
max	169.290

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11656.836
σ	4.324
min	11655.305
max	11667.538

*mean*	4152.750
σ	1899.844
min	1555.000
max	7301.000

*mean*	6466.646
σ	1201.159
min	4908.023
max	8066.787

op=vertical_lookup_list() on indexed

*mean*	11560.065
σ	0.001
min	11560.064
max	11560.066

*mean*	7301.000
σ	0.000
min	7301.000
max	7301.000

*mean*	5453.556
σ	1391.793
min	4409.388
max	7630.770

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.559
σ	0.001
min	172.558
max	172.562

*mean*	478.000
σ	0.000
min	478.000
max	478.000

*mean*	381.371
σ	3.871
min	373.902
max	386.095

op=pointedIndexFromKvs

rows=400000

*mean*	357.322
σ	0.001
min	357.321
max	357.325

*mean*	560.000
σ	0.000
min	560.000
max	560.000

*mean*	754.197
σ	26.378
min	709.576
max	772.877

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1008.374
σ	0.760
min	1007.899
max	1011.517

*mean*	1047.450
σ	313.068
min	573.000
max	1509.000

*mean*	1.553
σ	0.084
min	1.467
max	1.762

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.913
σ	0.020
min	0.903
max	0.949

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.488
σ	0.424
min	0.257
max	1.243

name=error_case.art

*mean*	2.339
σ	0.012
min	2.333
max	2.361

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.838
σ	0.490
min	0.587
max	1.713

name=heavy_item.art

*mean*	1.522
σ	0.002
min	1.521
max	1.525

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.388
σ	0.047
min	0.355
max	0.466

name=nested_use.art

*mean*	2.357
σ	0.002
min	2.356
max	2.360

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.593
σ	0.022
min	0.568
max	0.622

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	964.741
σ	0.011
min	964.736
max	964.760

*mean*	435.200
σ	4.550
min	431.000
max	440.000

*mean*	0.630
σ	0.064
min	0.590
max	0.742

name=cdr_enhanced_4k_loc.art

*mean*	885.814
σ	0.002
min	885.812
max	885.816

*mean*	440.000
σ	0.000
min	440.000
max	440.000

*mean*	0.510
σ	0.018
min	0.480
max	0.525

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.708
σ	0.002
min	7.707
max	7.711

*mean*	440.000
σ	0.000
min	440.000
max	440.000

*mean*	2.613
σ	0.089
min	2.419
max	2.876

name=record_render_large_syntax_err.art

*mean*	7.656
σ	0.002
min	7.655
max	7.659

*mean*	440.000
σ	0.000
min	440.000
max	440.000

*mean*	2.586
σ	0.082
min	2.436
max	2.851

name=record_render_success.art

*mean*	2.289
σ	0.002
min	2.288
max	2.292

*mean*	440.000
σ	0.000
min	440.000
max	440.000

*mean*	0.305
σ	0.009
min	0.289
max	0.349

name=record_render_syntax_err.art

*mean*	2.165
σ	0.002
min	2.164
max	2.168

*mean*	440.000
σ	0.000
min	440.000
max	440.000

*mean*	0.291
σ	0.008
min	0.278
max	0.332

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	297.971
σ	0.990
min	297.570
max	300.785

*mean*	444.900
σ	15.920
min	419.000
max	467.000

*mean*	0.611
σ	0.009
min	0.598
max	0.623

Timed compile per phase

Factor

allocated MiB

peak allocated MiB

time (ms)

phase=buildDeclTree

*mean*	222.008
σ	0.000
min	222.008
max	222.008

*mean*	1664.000
σ	0.000
min	1664.000
max	1664.000

*mean*	207.247
σ	2.986
min	204.218
max	213.904

phase=macro expansion

*mean*	6.130
σ	0.000
min	6.130
max	6.130

*mean*	1664.000
σ	0.000
min	1664.000
max	1664.000

*mean*	10.005
σ	1.601
min	8.119
max	12.626

phase=parser

*mean*	1042.097
σ	0.000
min	1042.097
max	1042.097

*mean*	1664.000
σ	0.000
min	1664.000
max	1664.000

*mean*	621.850
σ	95.494
min	427.054
max	730.939

phase=processProdDef

*mean*	6169.660
σ	0.001
min	6169.660
max	6169.661

*mean*	1664.000
σ	0.000
min	1664.000
max	1664.000

*mean*	6483.477
σ	853.886
min	4508.846
max	7253.841

phase=renaming

*mean*	21.667
σ	0.000
min	21.667
max	21.667

*mean*	1664.000
σ	0.000
min	1664.000
max	1664.000

*mean*	42.758
σ	6.652
min	30.625
max	50.453

phase=type checker

*mean*	958.540
σ	0.066
min	958.443
max	958.630

*mean*	1664.000
σ	0.000
min	1664.000
max	1664.000

*mean*	731.154
σ	78.023
min	640.582
max	885.113

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	293.090
σ	0.043
min	293.027
max	293.124

*mean*	441.400
σ	0.548
min	441.000
max	442.000

*mean*	0.398
σ	0.007
min	0.390
max	0.404

iters=5

new-facts=1

prior-facts=6402

*mean*	1303.155
σ	0.114
min	1303.031
max	1303.287

*mean*	1097.000
σ	189.610
min	836.000
max	1324.000

*mean*	2.010
σ	0.333
min	1.815
max	2.599

iters=5

new-facts=6402

prior-facts=1

*mean*	1546.192
σ	4.035
min	1544.142
max	1553.402

*mean*	616.200
σ	81.214
min	493.000
max	711.000

*mean*	2.239
σ	0.227
min	2.088
max	2.638

iters=5

new-facts=6402

prior-facts=6402

*mean*	1865.164
σ	0.077
min	1865.072
max	1865.276

*mean*	1729.200
σ	176.022
min	1470.000
max	1882.000

*mean*	3.041
σ	0.192
min	2.886
max	3.374

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.636
σ	0.048
min	1.569
max	1.686

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	447.817
σ	579.237
min	158.195
max	1316.672

*mean*	96.250
σ	8.500
min	92.000
max	109.000

*mean*	443.000
σ	0.000
min	443.000
max	443.000

*mean*	0.522
σ	0.519
min	0.262
max	1.300

policies=20

*mean*	1582.285
σ	0.349
min	1582.041
max	1582.802

*mean*	920.000
σ	0.000
min	920.000
max	920.000

*mean*	446.000
σ	2.000
min	443.000
max	447.000

*mean*	2.624
σ	0.001
min	2.623
max	2.625

policies=200

*mean*	15830.791
σ	0.175
min	15830.642
max	15831.028

*mean*	9200.000
σ	0.000
min	9200.000
max	9200.000

*mean*	496.000
σ	4.690
min	490.000
max	501.000

*mean*	26.469
σ	0.135
min	26.334
max	26.615