Compare commits

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.616
σ	0.348
min	54.487
max	55.606

*mean*	413.000
σ	0.000
min	413.000
max	413.000

*mean*	0.140
σ	0.005
min	0.135
max	0.147

cache=y

dps=1

iters=10

policies=100

*mean*	43.785
σ	0.006
min	43.780
max	43.797

*mean*	413.000
σ	0.000
min	413.000
max	413.000

*mean*	0.125
σ	0.004
min	0.122
max	0.132

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.002
min	36.615
max	36.620

*mean*	4266.375
σ	1875.815
min	1997.000
max	7546.000

*mean*	12.404
σ	0.177
min	12.115
max	12.689

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.002
min	36.616
max	36.620

*mean*	4266.375
σ	1875.815
min	1997.000
max	7546.000

*mean*	12.692
σ	0.491
min	11.520
max	13.058

op=table_records(), no indexes

*mean*	41.931
σ	0.001
min	41.929
max	41.932

*mean*	7546.000
σ	0.000
min	7546.000
max	7546.000

*mean*	13.619
σ	1.064
min	11.890
max	14.816

op=table_records(), repeat

*mean*	41.929
σ	0.002
min	41.927
max	41.931

*mean*	4266.375
σ	1875.815
min	1997.000
max	7546.000

*mean*	12.016
σ	1.939
min	10.091
max	15.281

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.605
σ	0.003
min	27.603
max	27.611

*mean*	4266.375
σ	1875.815
min	1997.000
max	7546.000

*mean*	8.712
σ	1.291
min	7.765
max	11.793

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.400
σ	0.002
min	26.399
max	26.403

*mean*	4266.375
σ	1875.815
min	1997.000
max	7546.000

*mean*	6.782
σ	1.212
min	5.836
max	9.717

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.666
σ	0.002
min	25.664
max	25.668

*mean*	4266.375
σ	1875.815
min	1997.000
max	7546.000

*mean*	5.427
σ	0.099
min	5.247
max	5.536

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.968
σ	0.002
min	25.967
max	25.972

*mean*	4266.375
σ	1875.815
min	1997.000
max	7546.000

*mean*	5.193
σ	0.047
min	5.131
max	5.285

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.597
σ	0.000
min	2524.597
max	2524.598

*mean*	7546.000
σ	0.000
min	7546.000
max	7546.000

*mean*	1038.277
σ	6.055
min	1029.062
max	1046.979

op=load_product(), with indexes

*mean*	8744.559
σ	0.033
min	8744.545
max	8744.640

*mean*	3791.250
σ	1601.681
min	1997.000
max	5942.000

*mean*	4662.638
σ	1553.069
min	3534.152
max	7321.962

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.077
σ	0.002
min	62.075
max	62.080

*mean*	4266.375
σ	1875.815
min	1997.000
max	7546.000

*mean*	86.651
σ	17.744
min	71.350
max	126.502

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.944
σ	0.001
min	40.944
max	40.945

*mean*	7546.000
σ	0.000
min	7546.000
max	7546.000

*mean*	243.845
σ	409.890
min	84.518
max	1258.052

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.686
σ	0.000
min	66.685
max	66.686

*mean*	7546.000
σ	0.000
min	7546.000
max	7546.000

*mean*	150.096
σ	14.656
min	133.423
max	167.905

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11656.833
σ	4.317
min	11655.305
max	11667.517

*mean*	4266.375
σ	1875.815
min	1997.000
max	7546.000

*mean*	6453.352
σ	1290.190
min	4930.253
max	8223.904

op=vertical_lookup_list() on indexed

*mean*	11560.065
σ	0.001
min	11560.064
max	11560.066

*mean*	7546.000
σ	0.000
min	7546.000
max	7546.000

*mean*	5379.304
σ	1303.791
min	4377.242
max	7386.108

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.587
σ	0.025
min	172.558
max	172.624

*mean*	1997.000
σ	0.000
min	1997.000
max	1997.000

*mean*	358.348
σ	55.205
min	268.178
max	454.440

op=pointedIndexFromKvs

rows=400000

*mean*	357.371
σ	0.048
min	357.321
max	357.424

*mean*	1997.000
σ	0.000
min	1997.000
max	1997.000

*mean*	767.217
σ	28.322
min	723.150
max	800.830

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1008.196
σ	0.965
min	1007.707
max	1012.223

*mean*	1040.350
σ	306.002
min	548.000
max	1469.000

*mean*	1.585
σ	0.137
min	1.475
max	2.076

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.883
σ	0.002
min	0.881
max	0.886

*mean*	1469.000
σ	0.000
min	1469.000
max	1469.000

*mean*	0.413
σ	0.114
min	0.336
max	0.613

name=error_case.art

*mean*	2.333
σ	0.003
min	2.332
max	2.337

*mean*	1469.000
σ	0.000
min	1469.000
max	1469.000

*mean*	0.898
σ	0.090
min	0.832
max	1.056

name=heavy_item.art

*mean*	1.521
σ	0.002
min	1.520
max	1.524

*mean*	1469.000
σ	0.000
min	1469.000
max	1469.000

*mean*	0.550
σ	0.047
min	0.518
max	0.632

name=nested_use.art

*mean*	2.355
σ	0.002
min	2.355
max	2.358

*mean*	1469.000
σ	0.000
min	1469.000
max	1469.000

*mean*	0.858
σ	0.035
min	0.832
max	0.917

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	963.541
σ	0.032
min	963.523
max	963.598

*mean*	1469.000
σ	0.000
min	1469.000
max	1469.000

*mean*	0.822
σ	0.059
min	0.736
max	0.864

name=cdr_enhanced_4k_loc.art

*mean*	884.854
σ	0.006
min	884.847
max	884.861

*mean*	1469.000
σ	0.000
min	1469.000
max	1469.000

*mean*	0.734
σ	0.016
min	0.706
max	0.744

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.706
σ	0.002
min	7.705
max	7.711

*mean*	1469.000
σ	0.000
min	1469.000
max	1469.000

*mean*	4.274
σ	0.106
min	4.084
max	4.666

name=record_render_large_syntax_err.art

*mean*	7.655
σ	0.002
min	7.654
max	7.658

*mean*	1469.000
σ	0.000
min	1469.000
max	1469.000

*mean*	4.219
σ	0.073
min	4.101
max	4.528

name=record_render_success.art

*mean*	2.288
σ	0.002
min	2.287
max	2.291

*mean*	1469.000
σ	0.000
min	1469.000
max	1469.000

*mean*	0.758
σ	0.016
min	0.731
max	0.875

name=record_render_syntax_err.art

*mean*	2.163
σ	0.002
min	2.163
max	2.166

*mean*	1469.000
σ	0.000
min	1469.000
max	1469.000

*mean*	0.721
σ	0.011
min	0.697
max	0.765

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	297.850
σ	0.224
min	297.630
max	298.376

*mean*	1997.000
σ	0.000
min	1997.000
max	1997.000

*mean*	0.569
σ	0.019
min	0.546
max	0.595

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	290.033
σ	0.038
min	289.988
max	290.077

*mean*	1469.000
σ	0.000
min	1469.000
max	1469.000

*mean*	0.389
σ	0.002
min	0.386
max	0.391

iters=5

new-facts=1

prior-facts=6402

*mean*	1299.948
σ	0.105
min	1299.796
max	1300.080

*mean*	1469.000
σ	0.000
min	1469.000
max	1469.000

*mean*	2.314
σ	0.187
min	2.162
max	2.638

iters=5

new-facts=6402

prior-facts=1

*mean*	1542.918
σ	4.022
min	1540.924
max	1550.108

*mean*	1469.000
σ	0.000
min	1469.000
max	1469.000

*mean*	2.311
σ	0.195
min	2.137
max	2.604

iters=5

new-facts=6402

prior-facts=6402

*mean*	1861.893
σ	0.062
min	1861.810
max	1861.962

*mean*	1715.600
σ	194.149
min	1541.000
max	1997.000

*mean*	2.915
σ	0.065
min	2.860
max	3.022

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.839
σ	0.090
min	1.763
max	1.985

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	446.746
σ	577.197
min	158.147
max	1312.542

*mean*	96.250
σ	8.500
min	92.000
max	109.000

*mean*	1469.000
σ	0.000
min	1469.000
max	1469.000

*mean*	0.547
σ	0.550
min	0.269
max	1.371

policies=20

*mean*	1581.755
σ	0.368
min	1581.501
max	1582.301

*mean*	920.000
σ	0.000
min	920.000
max	920.000

*mean*	1469.000
σ	0.000
min	1469.000
max	1469.000

*mean*	2.649
σ	0.005
min	2.643
max	2.655

policies=200

*mean*	15825.521
σ	0.115
min	15825.416
max	15825.672

*mean*	9200.000
σ	0.000
min	9200.000
max	9200.000

*mean*	1469.000
σ	0.000
min	1469.000
max	1469.000

*mean*	26.710
σ	0.062
min	26.622
max	26.757