2119912f489f535eb0e1699c9975a682a21e41e1

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.580
σ	0.342
min	54.449
max	55.554

*mean*	416.000
σ	0.000
min	416.000
max	416.000

*mean*	0.141
σ	0.005
min	0.136
max	0.149

cache=y

dps=1

iters=10

policies=100

*mean*	43.705
σ	0.006
min	43.697
max	43.717

*mean*	416.000
σ	0.000
min	416.000
max	416.000

*mean*	0.124
σ	0.004
min	0.119
max	0.131

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.617
σ	0.002
min	36.616
max	36.619

*mean*	3889.125
σ	1858.804
min	1277.000
max	6182.000

*mean*	13.439
σ	1.686
min	12.517
max	17.496

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.002
min	36.616
max	36.620

*mean*	3889.125
σ	1858.804
min	1277.000
max	6182.000

*mean*	13.809
σ	1.723
min	12.402
max	17.897

op=table_records(), no indexes

*mean*	41.929
σ	0.002
min	41.928
max	41.932

*mean*	6182.000
σ	0.000
min	6182.000
max	6182.000

*mean*	15.284
σ	0.362
min	14.594
max	15.871

op=table_records(), repeat

*mean*	41.928
σ	0.000
min	41.927
max	41.928

*mean*	3740.625
σ	1831.938
min	1277.000
max	6182.000

*mean*	14.188
σ	1.533
min	11.350
max	15.743

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.653
σ	0.136
min	27.603
max	27.990

*mean*	3740.625
σ	1831.938
min	1277.000
max	6182.000

*mean*	9.083
σ	0.332
min	8.659
max	9.570

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.401
σ	0.002
min	26.399
max	26.403

*mean*	3740.625
σ	1831.938
min	1277.000
max	6182.000

*mean*	6.668
σ	0.171
min	6.452
max	6.914

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.667
σ	0.002
min	25.664
max	25.669

*mean*	3889.125
σ	1858.804
min	1277.000
max	6182.000

*mean*	6.177
σ	0.560
min	5.846
max	7.545

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.969
σ	0.002
min	25.967
max	25.972

*mean*	3889.125
σ	1858.804
min	1277.000
max	6182.000

*mean*	6.075
σ	0.607
min	5.661
max	7.432

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.604
σ	0.002
min	2524.602
max	2524.607

*mean*	6182.000
σ	0.000
min	6182.000
max	6182.000

*mean*	1296.718
σ	453.782
min	1044.222
max	2186.916

op=load_product(), with indexes

*mean*	7878.102
σ	0.469
min	7877.935
max	7879.263

*mean*	3245.750
σ	1850.406
min	814.000
max	6182.000

*mean*	3858.062
σ	1129.857
min	3161.480
max	5765.359

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.078
σ	0.002
min	62.076
max	62.081

*mean*	3889.125
σ	1858.804
min	1277.000
max	6182.000

*mean*	196.724
σ	325.316
min	71.195
max	1001.441

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.945
σ	0.002
min	40.944
max	40.948

*mean*	6182.000
σ	0.000
min	6182.000
max	6182.000

*mean*	64.480
σ	4.264
min	61.039
max	71.815

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.687
σ	0.002
min	66.685
max	66.689

*mean*	6182.000
σ	0.000
min	6182.000
max	6182.000

*mean*	100.189
σ	2.179
min	98.709
max	105.228

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11849.092
σ	4.324
min	11847.561
max	11859.793

*mean*	3740.625
σ	1831.938
min	1277.000
max	6182.000

*mean*	6355.169
σ	1306.037
min	5125.165
max	8289.701

op=vertical_lookup_list() on indexed

*mean*	10791.093
σ	0.002
min	10791.091
max	10791.095

*mean*	6182.000
σ	0.000
min	6182.000
max	6182.000

*mean*	5239.024
σ	1511.985
min	4132.334
max	7302.613

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.559
σ	0.001
min	172.558
max	172.562

*mean*	478.000
σ	0.000
min	478.000
max	478.000

*mean*	380.745
σ	34.995
min	294.349
max	397.139

op=pointedIndexFromKvs

rows=400000

*mean*	357.322
σ	0.001
min	357.321
max	357.325

*mean*	557.000
σ	0.000
min	557.000
max	557.000

*mean*	759.387
σ	47.642
min	660.455
max	827.425

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1008.503
σ	0.759
min	1008.026
max	1011.642

*mean*	1044.850
σ	297.880
min	583.000
max	1445.000

*mean*	1.512
σ	0.064
min	1.348
max	1.640

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.913
σ	0.020
min	0.903
max	0.949

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.299
σ	0.297
min	0.136
max	0.825

name=error_case.art

*mean*	2.339
σ	0.012
min	2.333
max	2.361

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.480
σ	0.330
min	0.321
max	1.070

name=heavy_item.art

*mean*	1.522
σ	0.002
min	1.521
max	1.525

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.222
σ	0.020
min	0.207
max	0.257

name=nested_use.art

*mean*	2.357
σ	0.002
min	2.356
max	2.360

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.335
σ	0.019
min	0.318
max	0.366

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	964.741
σ	0.011
min	964.736
max	964.760

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	0.538
σ	0.040
min	0.491
max	0.588

name=cdr_enhanced_4k_loc.art

*mean*	885.814
σ	0.002
min	885.812
max	885.816

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	0.477
σ	0.046
min	0.410
max	0.518

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.708
σ	0.002
min	7.707
max	7.711

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	1.979
σ	0.088
min	1.818
max	2.293

name=record_render_large_syntax_err.art

*mean*	7.656
σ	0.002
min	7.655
max	7.659

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	2.587
σ	0.215
min	1.953
max	3.341

name=record_render_success.art

*mean*	2.289
σ	0.002
min	2.288
max	2.292

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	0.309
σ	0.029
min	0.289
max	0.548

name=record_render_syntax_err.art

*mean*	2.165
σ	0.002
min	2.164
max	2.168

*mean*	431.000
σ	0.000
min	431.000
max	431.000

*mean*	0.289
σ	0.007
min	0.278
max	0.330

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	298.074
σ	1.051
min	297.634
max	301.058

*mean*	441.900
σ	16.107
min	418.000
max	471.000

*mean*	0.615
σ	0.018
min	0.584
max	0.638

Timed compile per phase

Factor

allocated MiB

peak allocated MiB

time (ms)

phase=buildDeclTree

*mean*	222.008
σ	0.000
min	222.008
max	222.008

*mean*	1008.000
σ	0.535
min	1007.000
max	1009.000

*mean*	207.099
σ	2.934
min	202.383
max	211.489

phase=macro expansion

*mean*	6.130
σ	0.000
min	6.130
max	6.130

*mean*	1008.000
σ	0.535
min	1007.000
max	1009.000

*mean*	10.242
σ	2.790
min	6.310
max	12.827

phase=parser

*mean*	1042.100
σ	0.001
min	1042.097
max	1042.101

*mean*	1008.000
σ	0.535
min	1007.000
max	1009.000

*mean*	663.285
σ	69.493
min	596.480
max	732.319

phase=processProdDef

*mean*	4753.372
σ	0.001
min	4753.371
max	4753.373

*mean*	1008.250
σ	0.463
min	1008.000
max	1009.000

*mean*	4625.825
σ	746.429
min	3687.306
max	5519.603

phase=renaming

*mean*	21.667
σ	0.001
min	21.667
max	21.670

*mean*	1008.000
σ	0.535
min	1007.000
max	1009.000

*mean*	38.910
σ	11.886
min	20.198
max	48.279

phase=type checker

*mean*	958.460
σ	0.066
min	958.360
max	958.551

*mean*	1008.000
σ	0.535
min	1007.000
max	1009.000

*mean*	780.039
σ	114.748
min	638.788
max	908.846

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	293.688
σ	0.038
min	293.635
max	293.727

*mean*	442.800
σ	1.095
min	442.000
max	444.000

*mean*	0.403
σ	0.010
min	0.396
max	0.420

iters=5

new-facts=1

prior-facts=6402

*mean*	1303.845
σ	0.045
min	1303.781
max	1303.897

*mean*	1095.800
σ	187.314
min	837.000
max	1320.000

*mean*	2.190
σ	0.269
min	1.836
max	2.593

iters=5

new-facts=6402

prior-facts=1

*mean*	1546.510
σ	3.358
min	1544.801
max	1552.509

*mean*	617.800
σ	81.778
min	494.000
max	713.000

*mean*	2.273
σ	0.215
min	2.135
max	2.650

iters=5

new-facts=6402

prior-facts=6402

*mean*	1865.813
σ	0.061
min	1865.734
max	1865.899

*mean*	1735.800
σ	192.404
min	1465.000
max	1913.000

*mean*	3.056
σ	0.318
min	2.810
max	3.606

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.735
σ	0.123
min	1.616
max	1.888

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	449.519
σ	578.120
min	160.457
max	1316.700

*mean*	102.250
σ	8.500
min	98.000
max	115.000

*mean*	444.000
σ	0.000
min	444.000
max	444.000

*mean*	0.545
σ	0.555
min	0.265
max	1.379

policies=20

*mean*	1604.906
σ	0.407
min	1604.626
max	1605.508

*mean*	980.000
σ	0.000
min	980.000
max	980.000

*mean*	449.000
σ	5.774
min	444.000
max	454.000

*mean*	2.680
σ	0.019
min	2.655
max	2.700

policies=200

*mean*	16057.319
σ	0.130
min	16057.228
max	16057.509

*mean*	9800.000
σ	0.000
min	9800.000
max	9800.000

*mean*	498.750
σ	4.349
min	493.000
max	503.000

*mean*	27.183
σ	0.176
min	26.982
max	27.409