Compare commits

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.616
σ	0.350
min	54.480
max	55.612

*mean*	416.000
σ	0.000
min	416.000
max	416.000

*mean*	0.139
σ	0.004
min	0.133
max	0.145

cache=y

dps=1

iters=10

policies=100

*mean*	43.785
σ	0.006
min	43.779
max	43.797

*mean*	416.000
σ	0.000
min	416.000
max	416.000

*mean*	0.122
σ	0.004
min	0.119
max	0.129

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.002
min	36.615
max	36.620

*mean*	4103.125
σ	1568.741
min	1972.000
max	6038.000

*mean*	12.451
σ	0.389
min	11.862
max	13.092

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.002
min	36.615
max	36.619

*mean*	4103.125
σ	1568.741
min	1972.000
max	6038.000

*mean*	12.745
σ	0.484
min	11.677
max	13.177

op=table_records(), no indexes

*mean*	41.932
σ	0.000
min	41.932
max	41.932

*mean*	6038.000
σ	0.000
min	6038.000
max	6038.000

*mean*	13.142
σ	1.236
min	10.590
max	14.654

op=table_records(), repeat

*mean*	41.929
σ	0.003
min	41.927
max	41.935

*mean*	4103.125
σ	1568.741
min	1972.000
max	6038.000

*mean*	11.973
σ	1.493
min	10.201
max	13.767

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.605
σ	0.002
min	27.603
max	27.609

*mean*	4103.125
σ	1568.741
min	1972.000
max	6038.000

*mean*	8.426
σ	0.356
min	8.018
max	8.874

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.400
σ	0.002
min	26.399
max	26.403

*mean*	4103.125
σ	1568.741
min	1972.000
max	6038.000

*mean*	6.518
σ	0.183
min	6.191
max	6.789

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.666
σ	0.002
min	25.665
max	25.668

*mean*	4103.125
σ	1568.741
min	1972.000
max	6038.000

*mean*	5.498
σ	0.094
min	5.303
max	5.630

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.968
σ	0.002
min	25.967
max	25.971

*mean*	4103.125
σ	1568.741
min	1972.000
max	6038.000

*mean*	5.369
σ	0.091
min	5.279
max	5.569

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.597
σ	0.000
min	2524.597
max	2524.598

*mean*	6038.000
σ	0.000
min	6038.000
max	6038.000

*mean*	1527.045
σ	790.115
min	1034.219
max	3084.406

op=load_product(), with indexes

*mean*	8744.558
σ	0.033
min	8744.544
max	8744.640

*mean*	3820.250
σ	1649.005
min	1972.000
max	6038.000

*mean*	4364.415
σ	1402.928
min	3526.320
max	7342.726

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.078
σ	0.002
min	62.076
max	62.080

*mean*	4103.125
σ	1568.741
min	1972.000
max	6038.000

*mean*	81.305
σ	10.923
min	70.309
max	96.959

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.944
σ	0.001
min	40.944
max	40.945

*mean*	6038.000
σ	0.000
min	6038.000
max	6038.000

*mean*	96.003
σ	11.243
min	74.099
max	108.465

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.686
σ	0.000
min	66.686
max	66.687

*mean*	6038.000
σ	0.000
min	6038.000
max	6038.000

*mean*	219.998
σ	221.864
min	110.048
max	767.539

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11656.833
σ	4.317
min	11655.305
max	11667.517

*mean*	4103.125
σ	1568.741
min	1972.000
max	6038.000

*mean*	6084.511
σ	1321.863
min	4909.019
max	8289.012

op=vertical_lookup_list() on indexed

*mean*	11560.065
σ	0.000
min	11560.065
max	11560.066

*mean*	6038.000
σ	0.000
min	6038.000
max	6038.000

*mean*	6543.081
σ	1478.538
min	4394.615
max	8269.748

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.587
σ	0.022
min	172.558
max	172.614

*mean*	1972.000
σ	0.000
min	1972.000
max	1972.000

*mean*	372.189
σ	28.792
min	329.210
max	415.936

op=pointedIndexFromKvs

rows=400000

*mean*	357.371
σ	0.047
min	357.321
max	357.427

*mean*	1972.000
σ	0.000
min	1972.000
max	1972.000

*mean*	730.855
σ	57.986
min	615.714
max	787.210

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1008.186
σ	0.876
min	1007.686
max	1011.809

*mean*	1043.600
σ	296.626
min	546.000
max	1448.000

*mean*	1.533
σ	0.071
min	1.466
max	1.770

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.883
σ	0.002
min	0.881
max	0.886

*mean*	1448.000
σ	0.000
min	1448.000
max	1448.000

*mean*	0.420
σ	0.144
min	0.333
max	0.676

name=error_case.art

*mean*	2.333
σ	0.003
min	2.332
max	2.337

*mean*	1448.000
σ	0.000
min	1448.000
max	1448.000

*mean*	0.893
σ	0.090
min	0.827
max	1.051

name=heavy_item.art

*mean*	1.521
σ	0.002
min	1.520
max	1.524

*mean*	1448.000
σ	0.000
min	1448.000
max	1448.000

*mean*	0.550
σ	0.050
min	0.519
max	0.637

name=nested_use.art

*mean*	2.355
σ	0.002
min	2.355
max	2.358

*mean*	1448.000
σ	0.000
min	1448.000
max	1448.000

*mean*	0.846
σ	0.043
min	0.809
max	0.918

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	963.543
σ	0.025
min	963.523
max	963.585

*mean*	1448.000
σ	0.000
min	1448.000
max	1448.000

*mean*	0.813
σ	0.041
min	0.766
max	0.864

name=cdr_enhanced_4k_loc.art

*mean*	884.854
σ	0.006
min	884.847
max	884.861

*mean*	1448.000
σ	0.000
min	1448.000
max	1448.000

*mean*	0.701
σ	0.040
min	0.661
max	0.745

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.706
σ	0.002
min	7.705
max	7.711

*mean*	1448.000
σ	0.000
min	1448.000
max	1448.000

*mean*	4.257
σ	0.078
min	4.140
max	4.636

name=record_render_large_syntax_err.art

*mean*	7.655
σ	0.002
min	7.654
max	7.661

*mean*	1448.000
σ	0.000
min	1448.000
max	1448.000

*mean*	4.275
σ	0.081
min	4.109
max	4.535

name=record_render_success.art

*mean*	2.288
σ	0.002
min	2.287
max	2.291

*mean*	1448.000
σ	0.000
min	1448.000
max	1448.000

*mean*	0.670
σ	0.106
min	0.518
max	0.845

name=record_render_syntax_err.art

*mean*	2.163
σ	0.002
min	2.163
max	2.166

*mean*	1448.000
σ	0.000
min	1448.000
max	1448.000

*mean*	0.514
σ	0.034
min	0.489
max	0.777

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	297.427
σ	0.221
min	297.304
max	298.049

*mean*	1972.000
σ	0.000
min	1972.000
max	1972.000

*mean*	0.570
σ	0.035
min	0.519
max	0.609

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	289.772
σ	0.037
min	289.722
max	289.807

*mean*	1448.000
σ	0.000
min	1448.000
max	1448.000

*mean*	0.397
σ	0.002
min	0.394
max	0.401

iters=5

new-facts=1

prior-facts=6402

*mean*	1299.637
σ	0.061
min	1299.576
max	1299.703

*mean*	1448.000
σ	0.000
min	1448.000
max	1448.000

*mean*	2.051
σ	0.059
min	1.987
max	2.123

iters=5

new-facts=6402

prior-facts=1

*mean*	1542.616
σ	4.015
min	1540.614
max	1549.792

*mean*	1448.000
σ	0.000
min	1448.000
max	1448.000

*mean*	2.295
σ	0.196
min	2.121
max	2.610

iters=5

new-facts=6402

prior-facts=6402

*mean*	1861.626
σ	0.074
min	1861.515
max	1861.692

*mean*	1719.400
σ	171.157
min	1526.000
max	1972.000

*mean*	2.963
σ	0.159
min	2.825
max	3.194

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.758
σ	0.126
min	1.576
max	1.894

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	446.185
σ	577.140
min	157.614
max	1311.895

*mean*	96.250
σ	8.500
min	92.000
max	109.000

*mean*	1448.000
σ	0.000
min	1448.000
max	1448.000

*mean*	0.558
σ	0.594
min	0.260
max	1.449

policies=20

*mean*	1576.413
σ	0.352
min	1576.177
max	1576.937

*mean*	920.000
σ	0.000
min	920.000
max	920.000

*mean*	1448.000
σ	0.000
min	1448.000
max	1448.000

*mean*	2.626
σ	0.014
min	2.614
max	2.645

policies=200

*mean*	15772.227
σ	0.094
min	15772.136
max	15772.353

*mean*	9200.000
σ	0.000
min	9200.000
max	9200.000

*mean*	1448.000
σ	0.000
min	1448.000
max	1448.000

*mean*	26.523
σ	0.082
min	26.410
max	26.589