Compare commits

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.618
σ	0.348
min	54.485
max	55.606

*mean*	415.000
σ	0.000
min	415.000
max	415.000

*mean*	0.138
σ	0.004
min	0.133
max	0.144

cache=y

dps=1

iters=10

policies=100

*mean*	43.789
σ	0.006
min	43.781
max	43.800

*mean*	415.000
σ	0.000
min	415.000
max	415.000

*mean*	0.126
σ	0.008
min	0.120
max	0.145

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.002
min	36.616
max	36.620

*mean*	4273.500
σ	1863.580
min	2064.000
max	7542.000

*mean*	12.184
σ	0.357
min	11.549
max	12.710

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.003
min	36.615
max	36.623

*mean*	4273.500
σ	1863.580
min	2064.000
max	7542.000

*mean*	11.541
σ	0.182
min	11.240
max	11.788

op=table_records(), no indexes

*mean*	41.928
σ	0.000
min	41.928
max	41.929

*mean*	7542.000
σ	0.000
min	7542.000
max	7542.000

*mean*	13.932
σ	1.086
min	12.364
max	15.006

op=table_records(), repeat

*mean*	41.928
σ	0.002
min	41.927
max	41.932

*mean*	4211.625
σ	1910.832
min	2064.000
max	7542.000

*mean*	12.600
σ	1.807
min	10.133
max	14.796

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.605
σ	0.002
min	27.603
max	27.607

*mean*	4211.625
σ	1910.832
min	2064.000
max	7542.000

*mean*	8.530
σ	0.755
min	7.943
max	10.350

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.401
σ	0.002
min	26.399
max	26.403

*mean*	4273.500
σ	1863.580
min	2064.000
max	7542.000

*mean*	6.864
σ	1.041
min	6.225
max	8.892

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.666
σ	0.002
min	25.664
max	25.670

*mean*	4273.500
σ	1863.580
min	2064.000
max	7542.000

*mean*	5.278
σ	0.159
min	5.048
max	5.539

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.968
σ	0.002
min	25.967
max	25.971

*mean*	4273.500
σ	1863.580
min	2064.000
max	7542.000

*mean*	5.133
σ	0.124
min	4.941
max	5.336

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.603
σ	0.000
min	2524.602
max	2524.603

*mean*	7542.000
σ	0.000
min	7542.000
max	7542.000

*mean*	1052.803
σ	6.960
min	1042.198
max	1063.032

op=load_product(), with indexes

*mean*	8744.567
σ	0.033
min	8744.554
max	8744.648

*mean*	3806.375
σ	1581.738
min	2064.000
max	5943.000

*mean*	4676.795
σ	1559.309
min	3548.215
max	7362.878

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.077
σ	0.002
min	62.076
max	62.080

*mean*	4273.500
σ	1863.580
min	2064.000
max	7542.000

*mean*	81.513
σ	8.884
min	70.706
max	92.902

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.944
σ	0.001
min	40.944
max	40.945

*mean*	7542.000
σ	0.000
min	7542.000
max	7542.000

*mean*	229.750
σ	365.659
min	83.969
max	1134.488

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.686
σ	0.000
min	66.685
max	66.686

*mean*	7542.000
σ	0.000
min	7542.000
max	7542.000

*mean*	150.841
σ	15.124
min	131.021
max	167.656

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11656.833
σ	4.317
min	11655.305
max	11667.517

*mean*	4211.625
σ	1910.832
min	2064.000
max	7542.000

*mean*	6271.329
σ	1041.663
min	4975.414
max	7718.404

op=vertical_lookup_list() on indexed

*mean*	11560.069
σ	0.002
min	11560.066
max	11560.073

*mean*	7542.000
σ	0.000
min	7542.000
max	7542.000

*mean*	5289.506
σ	1167.152
min	4389.402
max	7194.511

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.592
σ	0.030
min	172.558
max	172.640

*mean*	2064.000
σ	0.000
min	2064.000
max	2064.000

*mean*	363.686
σ	45.384
min	325.346
max	462.438

op=pointedIndexFromKvs

rows=400000

*mean*	357.366
σ	0.041
min	357.321
max	357.415

*mean*	2064.000
σ	0.000
min	2064.000
max	2064.000

*mean*	785.590
σ	24.339
min	728.985
max	802.552

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1008.482
σ	0.881
min	1007.980
max	1012.131

*mean*	1037.650
σ	297.707
min	544.000
max	1439.000

*mean*	1.509
σ	0.105
min	1.333
max	1.749

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.883
σ	0.002
min	0.881
max	0.886

*mean*	1439.000
σ	0.000
min	1439.000
max	1439.000

*mean*	0.409
σ	0.108
min	0.342
max	0.600

name=error_case.art

*mean*	2.333
σ	0.003
min	2.332
max	2.337

*mean*	1439.000
σ	0.000
min	1439.000
max	1439.000

*mean*	0.876
σ	0.090
min	0.820
max	1.035

name=heavy_item.art

*mean*	1.521
σ	0.002
min	1.520
max	1.524

*mean*	1439.000
σ	0.000
min	1439.000
max	1439.000

*mean*	0.548
σ	0.058
min	0.489
max	0.643

name=nested_use.art

*mean*	2.355
σ	0.002
min	2.355
max	2.358

*mean*	1439.000
σ	0.000
min	1439.000
max	1439.000

*mean*	0.855
σ	0.032
min	0.821
max	0.909

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	963.922
σ	0.025
min	963.902
max	963.964

*mean*	1439.000
σ	0.000
min	1439.000
max	1439.000

*mean*	0.818
σ	0.028
min	0.780
max	0.849

name=cdr_enhanced_4k_loc.art

*mean*	884.889
σ	0.007
min	884.883
max	884.897

*mean*	1439.000
σ	0.000
min	1439.000
max	1439.000

*mean*	0.705
σ	0.061
min	0.600
max	0.748

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.706
σ	0.002
min	7.705
max	7.712

*mean*	1439.000
σ	0.000
min	1439.000
max	1439.000

*mean*	4.243
σ	0.079
min	4.123
max	4.540

name=record_render_large_syntax_err.art

*mean*	7.655
σ	0.002
min	7.654
max	7.658

*mean*	1439.000
σ	0.000
min	1439.000
max	1439.000

*mean*	4.241
σ	0.086
min	4.107
max	4.507

name=record_render_success.art

*mean*	2.288
σ	0.002
min	2.287
max	2.291

*mean*	1439.000
σ	0.000
min	1439.000
max	1439.000

*mean*	0.747
σ	0.018
min	0.714
max	0.863

name=record_render_syntax_err.art

*mean*	2.163
σ	0.002
min	2.163
max	2.166

*mean*	1439.000
σ	0.000
min	1439.000
max	1439.000

*mean*	0.711
σ	0.019
min	0.636
max	0.790

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	297.770
σ	0.240
min	297.559
max	298.407

*mean*	2064.000
σ	0.000
min	2064.000
max	2064.000

*mean*	0.584
σ	0.034
min	0.517
max	0.616

Timed compile per phase

Factor

allocated MiB

peak allocated MiB

time (ms)

phase=buildDeclTree

*mean*	222.008
σ	0.000
min	222.008
max	222.008

*mean*	1567.250
σ	112.412
min	1439.000
max	1666.000

*mean*	204.708
σ	2.903
min	201.590
max	210.501

phase=macro expansion

*mean*	6.130
σ	0.000
min	6.130
max	6.130

*mean*	1567.250
σ	112.412
min	1439.000
max	1666.000

*mean*	11.856
σ	1.229
min	9.319
max	12.661

phase=parser

*mean*	1041.162
σ	0.000
min	1041.162
max	1041.163

*mean*	1567.250
σ	112.412
min	1439.000
max	1666.000

*mean*	681.668
σ	68.985
min	562.755
max	724.676

phase=processProdDef

*mean*	6169.658
σ	0.001
min	6169.657
max	6169.659

*mean*	1595.625
σ	103.729
min	1439.000
max	1666.000

*mean*	6191.009
σ	1244.773
min	4232.426
max	7385.710

phase=renaming

*mean*	21.667
σ	0.000
min	21.667
max	21.667

*mean*	1567.250
σ	112.412
min	1439.000
max	1666.000

*mean*	44.158
σ	4.958
min	34.384
max	48.104

phase=type checker

*mean*	958.690
σ	0.055
min	958.604
max	958.760

*mean*	1567.250
σ	112.412
min	1439.000
max	1666.000

*mean*	840.504
σ	82.890
min	660.245
max	929.465

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	292.989
σ	0.038
min	292.937
max	293.028

*mean*	1666.000
σ	0.000
min	1666.000
max	1666.000

*mean*	0.400
σ	0.008
min	0.390
max	0.406

iters=5

new-facts=1

prior-facts=6402

*mean*	1302.843
σ	0.119
min	1302.731
max	1303.042

*mean*	1666.000
σ	0.000
min	1666.000
max	1666.000

*mean*	1.932
σ	0.192
min	1.811
max	2.260

iters=5

new-facts=6402

prior-facts=1

*mean*	1545.861
σ	4.031
min	1543.847
max	1553.066

*mean*	1666.000
σ	0.000
min	1666.000
max	1666.000

*mean*	2.267
σ	0.171
min	2.126
max	2.505

iters=5

new-facts=6402

prior-facts=6402

*mean*	1864.852
σ	0.048
min	1864.808
max	1864.913

*mean*	1795.600
σ	170.324
min	1666.000
max	2064.000

*mean*	2.882
σ	0.117
min	2.702
max	2.999

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.737
σ	0.172
min	1.487
max	1.932

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	446.793
σ	577.189
min	158.196
max	1312.576

*mean*	96.250
σ	8.500
min	92.000
max	109.000

*mean*	1666.000
σ	0.000
min	1666.000
max	1666.000

*mean*	0.491
σ	0.443
min	0.269
max	1.156

policies=20

*mean*	1582.260
σ	0.354
min	1582.017
max	1582.786

*mean*	920.000
σ	0.000
min	920.000
max	920.000

*mean*	1666.000
σ	0.000
min	1666.000
max	1666.000

*mean*	2.629
σ	0.019
min	2.613
max	2.656

policies=200

*mean*	15830.827
σ	0.055
min	15830.766
max	15830.897

*mean*	9200.000
σ	0.000
min	9200.000
max	9200.000

*mean*	1666.000
σ	0.000
min	1666.000
max	1666.000

*mean*	26.572
σ	0.165
min	26.367
max	26.753