78b3571e0a2b879dd307549db0d868ed07b415bc

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.578
σ	0.351
min	54.438
max	55.576

*mean*	418.000
σ	0.000
min	418.000
max	418.000

*mean*	0.141
σ	0.004
min	0.137
max	0.149

cache=y

dps=1

iters=10

policies=100

*mean*	43.707
σ	0.006
min	43.697
max	43.719

*mean*	418.000
σ	0.000
min	418.000
max	418.000

*mean*	0.123
σ	0.004
min	0.119
max	0.131

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.002
min	36.616
max	36.620

*mean*	4150.500
σ	1897.164
min	1556.000
max	7296.000

*mean*	12.855
σ	0.358
min	12.427
max	13.477

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.002
min	36.616
max	36.620

*mean*	4150.500
σ	1897.164
min	1556.000
max	7296.000

*mean*	13.258
σ	0.176
min	13.102
max	13.538

op=table_records(), no indexes

*mean*	41.932
σ	0.001
min	41.929
max	41.933

*mean*	7296.000
σ	0.000
min	7296.000
max	7296.000

*mean*	15.215
σ	0.626
min	13.899
max	16.123

op=table_records(), repeat

*mean*	41.928
σ	0.002
min	41.927
max	41.931

*mean*	4150.500
σ	1897.164
min	1556.000
max	7296.000

*mean*	12.742
σ	1.307
min	11.027
max	14.344

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.653
σ	0.136
min	27.603
max	27.990

*mean*	4150.500
σ	1897.164
min	1556.000
max	7296.000

*mean*	9.151
σ	0.256
min	8.771
max	9.499

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.400
σ	0.002
min	26.399
max	26.403

*mean*	4150.500
σ	1897.164
min	1556.000
max	7296.000

*mean*	7.194
σ	0.139
min	6.998
max	7.369

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.666
σ	0.002
min	25.664
max	25.668

*mean*	4150.500
σ	1897.164
min	1556.000
max	7296.000

*mean*	5.976
σ	0.144
min	5.821
max	6.191

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.968
σ	0.002
min	25.967
max	25.972

*mean*	4150.500
σ	1897.164
min	1556.000
max	7296.000

*mean*	5.799
σ	0.020
min	5.772
max	5.821

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.606
σ	0.001
min	2524.606
max	2524.607

*mean*	7296.000
σ	0.000
min	7296.000
max	7296.000

*mean*	1381.993
σ	622.934
min	1047.739
max	2838.598

op=load_product(), with indexes

*mean*	8744.721
σ	0.469
min	8744.553
max	8745.882

*mean*	3571.250
σ	1794.095
min	1044.000
max	5789.000

*mean*	4970.707
σ	1691.767
min	3506.737
max	7344.470

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.078
σ	0.002
min	62.076
max	62.081

*mean*	4150.500
σ	1897.164
min	1556.000
max	7296.000

*mean*	86.936
σ	11.717
min	71.450
max	98.913

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.944
σ	0.001
min	40.944
max	40.945

*mean*	7296.000
σ	0.000
min	7296.000
max	7296.000

*mean*	108.686
σ	5.322
min	99.940
max	114.708

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.686
σ	0.000
min	66.685
max	66.687

*mean*	7296.000
σ	0.000
min	7296.000
max	7296.000

*mean*	164.384
σ	7.963
min	146.199
max	169.597

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11656.836
σ	4.324
min	11655.305
max	11667.538

*mean*	4150.500
σ	1897.164
min	1556.000
max	7296.000

*mean*	6565.871
σ	1380.926
min	4935.487
max	8099.149

op=vertical_lookup_list() on indexed

*mean*	11560.065
σ	0.001
min	11560.064
max	11560.066

*mean*	7296.000
σ	0.000
min	7296.000
max	7296.000

*mean*	5941.697
σ	1587.643
min	4376.746
max	7783.826

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.559
σ	0.001
min	172.558
max	172.562

*mean*	477.000
σ	0.000
min	477.000
max	477.000

*mean*	386.770
σ	6.345
min	375.015
max	393.799

op=pointedIndexFromKvs

rows=400000

*mean*	357.322
σ	0.001
min	357.321
max	357.325

*mean*	562.000
σ	0.000
min	562.000
max	562.000

*mean*	767.443
σ	16.600
min	750.858
max	801.596

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1008.500
σ	0.760
min	1008.025
max	1011.641

*mean*	1055.750
σ	315.020
min	562.000
max	1525.000

*mean*	1.586
σ	0.136
min	1.483
max	2.083

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.913
σ	0.020
min	0.903
max	0.949

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.314
σ	0.301
min	0.148
max	0.848

name=error_case.art

*mean*	2.339
σ	0.012
min	2.333
max	2.361

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.479
σ	0.320
min	0.332
max	1.051

name=heavy_item.art

*mean*	1.522
σ	0.002
min	1.521
max	1.525

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.221
σ	0.021
min	0.206
max	0.257

name=nested_use.art

*mean*	2.357
σ	0.002
min	2.356
max	2.360

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.333
σ	0.014
min	0.319
max	0.355

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	964.741
σ	0.011
min	964.736
max	964.760

*mean*	434.600
σ	4.099
min	431.000
max	439.000

*mean*	0.562
σ	0.045
min	0.500
max	0.619

name=cdr_enhanced_4k_loc.art

*mean*	885.814
σ	0.002
min	885.812
max	885.816

*mean*	441.000
σ	0.000
min	441.000
max	441.000

*mean*	0.506
σ	0.032
min	0.451
max	0.529

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.708
σ	0.002
min	7.707
max	7.711

*mean*	441.000
σ	0.000
min	441.000
max	441.000

*mean*	2.671
σ	0.084
min	2.430
max	2.863

name=record_render_large_syntax_err.art

*mean*	7.656
σ	0.002
min	7.655
max	7.659

*mean*	441.000
σ	0.000
min	441.000
max	441.000

*mean*	2.606
σ	0.085
min	2.423
max	2.820

name=record_render_success.art

*mean*	2.289
σ	0.002
min	2.288
max	2.292

*mean*	441.000
σ	0.000
min	441.000
max	441.000

*mean*	0.309
σ	0.008
min	0.293
max	0.367

name=record_render_syntax_err.art

*mean*	2.165
σ	0.002
min	2.164
max	2.168

*mean*	441.000
σ	0.000
min	441.000
max	441.000

*mean*	0.298
σ	0.038
min	0.279
max	0.663

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	298.133
σ	1.070
min	297.595
max	301.147

*mean*	444.000
σ	16.990
min	418.000
max	466.000

*mean*	0.594
σ	0.032
min	0.546
max	0.636

Timed compile per phase

Factor

allocated MiB

peak allocated MiB

time (ms)

phase=buildDeclTree

*mean*	222.008
σ	0.000
min	222.008
max	222.008

*mean*	1748.000
σ	0.000
min	1748.000
max	1748.000

*mean*	213.716
σ	20.644
min	204.502
max	264.574

phase=macro expansion

*mean*	6.130
σ	0.000
min	6.130
max	6.130

*mean*	1748.000
σ	0.000
min	1748.000
max	1748.000

*mean*	9.369
σ	1.263
min	6.277
max	9.986

phase=parser

*mean*	1042.102
σ	0.000
min	1042.102
max	1042.103

*mean*	1748.000
σ	0.000
min	1748.000
max	1748.000

*mean*	673.065
σ	74.565
min	558.336
max	729.749

phase=processProdDef

*mean*	6169.658
σ	0.001
min	6169.657
max	6169.659

*mean*	1748.000
σ	0.000
min	1748.000
max	1748.000

*mean*	5656.363
σ	1548.582
min	3602.552
max	7876.933

phase=renaming

*mean*	21.667
σ	0.000
min	21.667
max	21.667

*mean*	1748.000
σ	0.000
min	1748.000
max	1748.000

*mean*	30.907
σ	5.192
min	20.913
max	40.109

phase=type checker

*mean*	958.461
σ	0.066
min	958.363
max	958.551

*mean*	1748.000
σ	0.000
min	1748.000
max	1748.000

*mean*	689.971
σ	103.297
min	630.922
max	927.869

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	293.690
σ	0.043
min	293.633
max	293.738

*mean*	444.000
σ	0.000
min	444.000
max	444.000

*mean*	0.405
σ	0.009
min	0.401
max	0.421

iters=5

new-facts=1

prior-facts=6402

*mean*	1303.774
σ	0.074
min	1303.654
max	1303.854

*mean*	1084.400
σ	228.264
min	818.000
max	1384.000

*mean*	2.057
σ	0.135
min	1.903
max	2.173

iters=5

new-facts=6402

prior-facts=1

*mean*	1546.835
σ	4.043
min	1544.824
max	1554.061

*mean*	623.000
σ	92.655
min	494.000
max	736.000

*mean*	2.335
σ	0.188
min	2.183
max	2.652

iters=5

new-facts=6402

prior-facts=6402

*mean*	1865.779
σ	0.067
min	1865.709
max	1865.884

*mean*	1704.400
σ	162.646
min	1523.000
max	1942.000

*mean*	3.007
σ	0.189
min	2.873
max	3.326

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.716
σ	0.186
min	1.506
max	1.954

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	447.980
σ	579.242
min	158.356
max	1316.843

*mean*	96.250
σ	8.500
min	92.000
max	109.000

*mean*	442.000
σ	0.000
min	442.000
max	442.000

*mean*	0.540
σ	0.539
min	0.268
max	1.347

policies=20

*mean*	1583.911
σ	0.362
min	1583.657
max	1584.445

*mean*	920.000
σ	0.000
min	920.000
max	920.000

*mean*	445.000
σ	2.000
min	442.000
max	446.000

*mean*	2.635
σ	0.012
min	2.622
max	2.651

policies=200

*mean*	15847.139
σ	0.138
min	15847.025
max	15847.340

*mean*	9200.000
σ	0.000
min	9200.000
max	9200.000

*mean*	496.000
σ	4.163
min	491.000
max	501.000

*mean*	26.787
σ	0.229
min	26.603
max	27.084