15fa9a162264d3a67e9a70ddb2ef029885573369

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.620
σ	0.349
min	54.488
max	55.613

*mean*	417.400
σ	0.966
min	416.000
max	418.000

*mean*	0.140
σ	0.004
min	0.137
max	0.149

cache=y

dps=1

iters=10

policies=100

*mean*	43.788
σ	0.006
min	43.782
max	43.803

*mean*	418.000
σ	0.000
min	418.000
max	418.000

*mean*	0.120
σ	0.004
min	0.115
max	0.128

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.002
min	36.615
max	36.620

*mean*	4158.000
σ	1907.005
min	1556.000
max	7327.000

*mean*	12.958
σ	0.209
min	12.671
max	13.272

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.002
min	36.616
max	36.619

*mean*	4158.000
σ	1907.005
min	1556.000
max	7327.000

*mean*	13.113
σ	0.702
min	11.825
max	13.760

op=table_records(), no indexes

*mean*	41.931
σ	0.001
min	41.928
max	41.932

*mean*	7327.000
σ	0.000
min	7327.000
max	7327.000

*mean*	15.111
σ	0.731
min	13.471
max	15.671

op=table_records(), repeat

*mean*	41.928
σ	0.002
min	41.927
max	41.931

*mean*	4158.000
σ	1907.005
min	1556.000
max	7327.000

*mean*	13.129
σ	1.776
min	11.051
max	15.497

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.653
σ	0.137
min	27.603
max	27.991

*mean*	4158.000
σ	1907.005
min	1556.000
max	7327.000

*mean*	8.803
σ	0.347
min	8.366
max	9.233

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.400
σ	0.002
min	26.399
max	26.403

*mean*	4158.000
σ	1907.005
min	1556.000
max	7327.000

*mean*	6.596
σ	0.282
min	6.160
max	7.060

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.666
σ	0.002
min	25.664
max	25.668

*mean*	4158.000
σ	1907.005
min	1556.000
max	7327.000

*mean*	6.002
σ	0.141
min	5.786
max	6.285

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.968
σ	0.002
min	25.967
max	25.972

*mean*	4158.000
σ	1907.005
min	1556.000
max	7327.000

*mean*	5.849
σ	0.131
min	5.693
max	6.075

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.606
σ	0.000
min	2524.606
max	2524.607

*mean*	7327.000
σ	0.000
min	7327.000
max	7327.000

*mean*	1045.589
σ	8.197
min	1031.738
max	1058.166

op=load_product(), with indexes

*mean*	8744.721
σ	0.469
min	8744.553
max	8745.883

*mean*	3578.875
σ	1802.314
min	1044.000
max	5814.000

*mean*	4862.380
σ	1599.823
min	3506.945
max	7292.848

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.078
σ	0.002
min	62.076
max	62.081

*mean*	4158.000
σ	1907.005
min	1556.000
max	7327.000

*mean*	82.223
σ	9.554
min	71.154
max	94.087

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.944
σ	0.001
min	40.944
max	40.945

*mean*	7327.000
σ	0.000
min	7327.000
max	7327.000

*mean*	106.018
σ	5.479
min	95.838
max	110.725

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.686
σ	0.000
min	66.685
max	66.686

*mean*	7327.000
σ	0.000
min	7327.000
max	7327.000

*mean*	162.944
σ	9.768
min	141.202
max	170.256

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11656.836
σ	4.324
min	11655.305
max	11667.537

*mean*	4158.000
σ	1907.005
min	1556.000
max	7327.000

*mean*	6536.872
σ	1144.153
min	4919.776
max	7931.299

op=vertical_lookup_list() on indexed

*mean*	11560.065
σ	0.000
min	11560.065
max	11560.066

*mean*	7327.000
σ	0.000
min	7327.000
max	7327.000

*mean*	6039.306
σ	1623.067
min	4396.194
max	7888.122

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.559
σ	0.001
min	172.558
max	172.562

*mean*	477.000
σ	0.000
min	477.000
max	477.000

*mean*	381.075
σ	20.255
min	350.967
max	400.212

op=pointedIndexFromKvs

rows=400000

*mean*	357.322
σ	0.001
min	357.321
max	357.325

*mean*	561.000
σ	0.000
min	561.000
max	561.000

*mean*	763.979
σ	39.144
min	682.141
max	808.292

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1008.375
σ	0.758
min	1007.902
max	1011.511

*mean*	1041.450
σ	306.998
min	572.000
max	1491.000

*mean*	1.543
σ	0.080
min	1.460
max	1.753

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.891
σ	0.020
min	0.881
max	0.928

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.290
σ	0.290
min	0.137
max	0.804

name=error_case.art

*mean*	2.338
σ	0.012
min	2.332
max	2.359

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.475
σ	0.320
min	0.323
max	1.048

name=heavy_item.art

*mean*	1.522
σ	0.002
min	1.520
max	1.524

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.219
σ	0.026
min	0.198
max	0.264

name=nested_use.art

*mean*	2.355
σ	0.002
min	2.355
max	2.358

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.335
σ	0.022
min	0.319
max	0.374

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	963.908
σ	0.011
min	963.902
max	963.926

*mean*	434.400
σ	1.342
min	432.000
max	435.000

*mean*	0.584
σ	0.016
min	0.564
max	0.603

name=cdr_enhanced_4k_loc.art

*mean*	884.884
σ	0.002
min	884.883
max	884.886

*mean*	435.000
σ	0.000
min	435.000
max	435.000

*mean*	0.477
σ	0.024
min	0.456
max	0.510

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.706
σ	0.002
min	7.705
max	7.709

*mean*	435.000
σ	0.000
min	435.000
max	435.000

*mean*	1.939
σ	0.061
min	1.825
max	2.205

name=record_render_large_syntax_err.art

*mean*	7.655
σ	0.002
min	7.654
max	7.658

*mean*	435.000
σ	0.000
min	435.000
max	435.000

*mean*	1.932
σ	0.058
min	1.818
max	2.164

name=record_render_success.art

*mean*	2.288
σ	0.002
min	2.287
max	2.291

*mean*	435.000
σ	0.000
min	435.000
max	435.000

*mean*	0.311
σ	0.045
min	0.289
max	0.748

name=record_render_syntax_err.art

*mean*	2.163
σ	0.002
min	2.163
max	2.166

*mean*	435.000
σ	0.000
min	435.000
max	435.000

*mean*	0.295
σ	0.010
min	0.277
max	0.366

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	297.994
σ	0.969
min	297.604
max	300.749

*mean*	446.900
σ	17.323
min	426.000
max	472.000

*mean*	0.607
σ	0.019
min	0.575
max	0.639

Timed compile per phase

Factor

allocated MiB

peak allocated MiB

time (ms)

phase=buildDeclTree

*mean*	222.011
σ	0.000
min	222.011
max	222.011

*mean*	1537.750
σ	87.330
min	1496.000
max	1739.000

*mean*	204.385
σ	1.257
min	202.762
max	206.946

phase=macro expansion

*mean*	6.133
σ	0.000
min	6.133
max	6.133

*mean*	1537.750
σ	87.330
min	1496.000
max	1739.000

*mean*	11.974
σ	1.218
min	9.440
max	12.733

phase=parser

*mean*	1041.158
σ	0.000
min	1041.158
max	1041.159

*mean*	1537.750
σ	87.330
min	1496.000
max	1739.000

*mean*	700.220
σ	85.831
min	568.835
max	836.824

phase=processProdDef

*mean*	6169.660
σ	0.001
min	6169.659
max	6169.661

*mean*	1568.125
σ	110.041
min	1496.000
max	1739.000

*mean*	5486.753
σ	819.825
min	4424.083
max	6585.186

phase=renaming

*mean*	21.667
σ	0.000
min	21.667
max	21.667

*mean*	1537.750
σ	87.330
min	1496.000
max	1739.000

*mean*	45.216
σ	5.198
min	35.115
max	50.982

phase=type checker

*mean*	958.670
σ	0.066
min	958.573
max	958.760

*mean*	1537.750
σ	87.330
min	1496.000
max	1739.000

*mean*	805.753
σ	86.660
min	660.557
max	887.176

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	292.774
σ	0.034
min	292.726
max	292.811

*mean*	445.000
σ	0.000
min	445.000
max	445.000

*mean*	0.402
σ	0.006
min	0.399
max	0.413

iters=5

new-facts=1

prior-facts=6402

*mean*	1302.873
σ	0.079
min	1302.744
max	1302.936

*mean*	1074.200
σ	184.193
min	841.000
max	1317.000

*mean*	2.017
σ	0.181
min	1.828
max	2.226

iters=5

new-facts=6402

prior-facts=1

*mean*	1545.905
σ	4.023
min	1543.925
max	1553.094

*mean*	611.800
σ	74.244
min	495.000
max	690.000

*mean*	2.246
σ	0.158
min	2.066
max	2.502

iters=5

new-facts=6402

prior-facts=6402

*mean*	1864.835
σ	0.040
min	1864.786
max	1864.879

*mean*	1714.200
σ	252.850
min	1421.000
max	2068.000

*mean*	2.948
σ	0.092
min	2.876
max	3.064

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.849
σ	0.100
min	1.690
max	1.948

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	447.754
σ	579.110
min	158.197
max	1316.419

*mean*	96.250
σ	8.500
min	92.000
max	109.000

*mean*	443.000
σ	0.000
min	443.000
max	443.000

*mean*	0.540
σ	0.551
min	0.262
max	1.366

policies=20

*mean*	1582.269
σ	0.342
min	1582.026
max	1582.774

*mean*	920.000
σ	0.000
min	920.000
max	920.000

*mean*	446.500
σ	4.041
min	443.000
max	450.000

*mean*	2.632
σ	0.015
min	2.620
max	2.653

policies=200

*mean*	15830.723
σ	0.194
min	15830.566
max	15831.005

*mean*	9200.000
σ	0.000
min	9200.000
max	9200.000

*mean*	495.000
σ	3.916
min	491.000
max	500.000

*mean*	26.672
σ	0.151
min	26.493
max	26.814