Compare commits

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.619
σ	0.349
min	54.487
max	55.613

*mean*	416.000
σ	0.000
min	416.000
max	416.000

*mean*	0.141
σ	0.004
min	0.137
max	0.149

cache=y

dps=1

iters=10

policies=100

*mean*	43.788
σ	0.007
min	43.780
max	43.802

*mean*	416.000
σ	0.000
min	416.000
max	416.000

*mean*	0.124
σ	0.004
min	0.119
max	0.132

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.002
min	36.615
max	36.620

*mean*	4158.250
σ	1906.875
min	1555.000
max	7327.000

*mean*	12.760
σ	0.174
min	12.484
max	13.060

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.002
min	36.615
max	36.620

*mean*	4158.250
σ	1906.875
min	1555.000
max	7327.000

*mean*	12.596
σ	0.616
min	11.721
max	13.421

op=table_records(), no indexes

*mean*	41.932
σ	0.001
min	41.928
max	41.933

*mean*	7327.000
σ	0.000
min	7327.000
max	7327.000

*mean*	15.174
σ	0.762
min	13.360
max	15.698

op=table_records(), repeat

*mean*	41.929
σ	0.002
min	41.927
max	41.931

*mean*	4158.250
σ	1906.875
min	1555.000
max	7327.000

*mean*	12.752
σ	1.862
min	10.625
max	15.369

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.653
σ	0.136
min	27.603
max	27.990

*mean*	4158.250
σ	1906.875
min	1555.000
max	7327.000

*mean*	8.964
σ	0.478
min	8.356
max	9.729

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.400
σ	0.002
min	26.399
max	26.403

*mean*	4158.250
σ	1906.875
min	1555.000
max	7327.000

*mean*	6.459
σ	0.319
min	5.964
max	6.901

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.666
σ	0.002
min	25.665
max	25.668

*mean*	4158.250
σ	1906.875
min	1555.000
max	7327.000

*mean*	5.988
σ	0.164
min	5.781
max	6.250

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.968
σ	0.002
min	25.967
max	25.972

*mean*	4158.250
σ	1906.875
min	1555.000
max	7327.000

*mean*	5.606
σ	0.189
min	5.390
max	5.804

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.606
σ	0.000
min	2524.606
max	2524.607

*mean*	7327.000
σ	0.000
min	7327.000
max	7327.000

*mean*	1047.485
σ	7.636
min	1037.555
max	1060.683

op=load_product(), with indexes

*mean*	8744.722
σ	0.469
min	8744.554
max	8745.883

*mean*	3579.500
σ	1803.098
min	1045.000
max	5818.000

*mean*	5026.786
σ	1756.665
min	3531.051
max	7596.579

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.078
σ	0.002
min	62.076
max	62.081

*mean*	4158.250
σ	1906.875
min	1555.000
max	7327.000

*mean*	79.314
σ	8.592
min	70.793
max	95.244

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.944
σ	0.001
min	40.944
max	40.945

*mean*	7327.000
σ	0.000
min	7327.000
max	7327.000

*mean*	105.835
σ	4.943
min	97.447
max	111.482

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.686
σ	0.000
min	66.685
max	66.687

*mean*	7327.000
σ	0.000
min	7327.000
max	7327.000

*mean*	161.165
σ	8.238
min	143.014
max	167.208

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11656.836
σ	4.324
min	11655.305
max	11667.538

*mean*	4158.250
σ	1906.875
min	1555.000
max	7327.000

*mean*	6392.809
σ	1182.085
min	4911.949
max	8161.601

op=vertical_lookup_list() on indexed

*mean*	11560.065
σ	0.000
min	11560.065
max	11560.066

*mean*	7327.000
σ	0.000
min	7327.000
max	7327.000

*mean*	5843.006
σ	1503.606
min	4414.882
max	7994.700

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.559
σ	0.001
min	172.558
max	172.562

*mean*	478.000
σ	0.000
min	478.000
max	478.000

*mean*	359.061
σ	28.914
min	308.227
max	392.848

op=pointedIndexFromKvs

rows=400000

*mean*	357.322
σ	0.001
min	357.321
max	357.325

*mean*	562.000
σ	0.000
min	562.000
max	562.000

*mean*	777.486
σ	18.232
min	746.006
max	801.318

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1008.375
σ	0.760
min	1007.900
max	1011.517

*mean*	1043.300
σ	310.724
min	571.000
max	1501.000

*mean*	1.533
σ	0.069
min	1.468
max	1.729

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.891
σ	0.020
min	0.881
max	0.928

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.305
σ	0.288
min	0.142
max	0.818

name=error_case.art

*mean*	2.338
σ	0.012
min	2.332
max	2.359

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.478
σ	0.327
min	0.324
max	1.063

name=heavy_item.art

*mean*	1.522
σ	0.002
min	1.520
max	1.524

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.219
σ	0.027
min	0.195
max	0.264

name=nested_use.art

*mean*	2.355
σ	0.002
min	2.355
max	2.358

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.337
σ	0.014
min	0.326
max	0.357

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	963.908
σ	0.011
min	963.902
max	963.926

*mean*	434.400
σ	1.342
min	432.000
max	435.000

*mean*	0.560
σ	0.032
min	0.531
max	0.609

name=cdr_enhanced_4k_loc.art

*mean*	884.884
σ	0.002
min	884.883
max	884.886

*mean*	435.000
σ	0.000
min	435.000
max	435.000

*mean*	0.465
σ	0.019
min	0.435
max	0.485

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.706
σ	0.002
min	7.705
max	7.709

*mean*	435.000
σ	0.000
min	435.000
max	435.000

*mean*	2.587
σ	0.071
min	2.452
max	2.811

name=record_render_large_syntax_err.art

*mean*	7.655
σ	0.002
min	7.654
max	7.658

*mean*	435.000
σ	0.000
min	435.000
max	435.000

*mean*	2.572
σ	0.067
min	2.462
max	2.895

name=record_render_success.art

*mean*	2.288
σ	0.002
min	2.287
max	2.291

*mean*	435.000
σ	0.000
min	435.000
max	435.000

*mean*	0.306
σ	0.008
min	0.291
max	0.363

name=record_render_syntax_err.art

*mean*	2.163
σ	0.002
min	2.163
max	2.166

*mean*	435.000
σ	0.000
min	435.000
max	435.000

*mean*	0.294
σ	0.007
min	0.281
max	0.328

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	298.008
σ	1.020
min	297.640
max	300.909

*mean*	444.300
σ	15.370
min	418.000
max	465.000

*mean*	0.607
σ	0.021
min	0.564
max	0.635

Timed compile per phase

Factor

allocated MiB

peak allocated MiB

time (ms)

phase=buildDeclTree

*mean*	222.008
σ	0.000
min	222.008
max	222.008

*mean*	1677.750
σ	21.920
min	1670.000
max	1732.000

*mean*	204.450
σ	1.216
min	202.846
max	205.771

phase=macro expansion

*mean*	6.130
σ	0.000
min	6.130
max	6.130

*mean*	1677.750
σ	21.920
min	1670.000
max	1732.000

*mean*	11.375
σ	2.335
min	6.239
max	12.620

phase=parser

*mean*	1041.162
σ	0.000
min	1041.162
max	1041.163

*mean*	1677.750
σ	21.920
min	1670.000
max	1732.000

*mean*	680.900
σ	123.634
min	419.256
max	827.162

phase=processProdDef

*mean*	6169.656
σ	0.001
min	6169.655
max	6169.656

*mean*	1685.500
σ	28.700
min	1670.000
max	1732.000

*mean*	5303.460
σ	988.859
min	3266.101
max	6672.384

phase=renaming

*mean*	21.667
σ	0.000
min	21.667
max	21.667

*mean*	1677.750
σ	21.920
min	1670.000
max	1732.000

*mean*	43.554
σ	9.801
min	20.222
max	48.516

phase=type checker

*mean*	958.537
σ	0.066
min	958.439
max	958.626

*mean*	1677.750
σ	21.920
min	1670.000
max	1732.000

*mean*	794.112
σ	102.271
min	630.226
max	887.514

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	292.775
σ	0.034
min	292.727
max	292.811

*mean*	445.000
σ	0.000
min	445.000
max	445.000

*mean*	0.404
σ	0.007
min	0.397
max	0.416

iters=5

new-facts=1

prior-facts=6402

*mean*	1302.857
σ	0.073
min	1302.744
max	1302.930

*mean*	1089.600
σ	171.960
min	891.000
max	1322.000

*mean*	2.054
σ	0.176
min	1.855
max	2.215

iters=5

new-facts=6402

prior-facts=1

*mean*	1545.927
σ	4.046
min	1543.979
max	1553.159

*mean*	632.600
σ	89.687
min	494.000
max	726.000

*mean*	2.351
σ	0.272
min	2.147
max	2.812

iters=5

new-facts=6402

prior-facts=6402

*mean*	1864.836
σ	0.048
min	1864.771
max	1864.883

*mean*	1730.800
σ	177.026
min	1485.000
max	1897.000

*mean*	3.071
σ	0.195
min	2.927
max	3.411

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.766
σ	0.178
min	1.512
max	1.959

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	447.738
σ	579.076
min	158.199
max	1316.353

*mean*	96.250
σ	8.500
min	92.000
max	109.000

*mean*	447.000
σ	0.000
min	447.000
max	447.000

*mean*	0.541
σ	0.554
min	0.263
max	1.373

policies=20

*mean*	1582.289
σ	0.354
min	1582.043
max	1582.812

*mean*	920.000
σ	0.000
min	920.000
max	920.000

*mean*	448.500
σ	1.732
min	447.000
max	450.000

*mean*	2.631
σ	0.013
min	2.612
max	2.638

policies=200

*mean*	15830.811
σ	0.201
min	15830.690
max	15831.110

*mean*	9200.000
σ	0.000
min	9200.000
max	9200.000

*mean*	497.000
σ	4.163
min	492.000
max	502.000

*mean*	26.691
σ	0.184
min	26.492
max	26.857