Compare commits

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.618
σ	0.349
min	54.483
max	55.610

*mean*	418.000
σ	0.000
min	418.000
max	418.000

*mean*	0.140
σ	0.004
min	0.136
max	0.148

cache=y

dps=1

iters=10

policies=100

*mean*	43.787
σ	0.006
min	43.781
max	43.802

*mean*	418.000
σ	0.000
min	418.000
max	418.000

*mean*	0.126
σ	0.007
min	0.120
max	0.141

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.002
min	36.615
max	36.620

*mean*	4113.000
σ	1558.341
min	2048.000
max	6046.000

*mean*	12.660
σ	0.375
min	12.230
max	13.474

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.002
min	36.616
max	36.620

*mean*	4113.000
σ	1558.341
min	2048.000
max	6046.000

*mean*	12.778
σ	0.505
min	11.580
max	13.142

op=table_records(), no indexes

*mean*	41.928
σ	0.000
min	41.928
max	41.929

*mean*	6046.000
σ	0.000
min	6046.000
max	6046.000

*mean*	13.791
σ	0.764
min	12.661
max	14.852

op=table_records(), repeat

*mean*	41.928
σ	0.002
min	41.927
max	41.931

*mean*	4113.000
σ	1558.341
min	2048.000
max	6046.000

*mean*	12.359
σ	1.994
min	10.319
max	14.820

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.605
σ	0.002
min	27.603
max	27.607

*mean*	4113.000
σ	1558.341
min	2048.000
max	6046.000

*mean*	8.439
σ	0.377
min	7.858
max	9.004

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.401
σ	0.002
min	26.399
max	26.403

*mean*	4113.000
σ	1558.341
min	2048.000
max	6046.000

*mean*	6.383
σ	0.286
min	5.999
max	6.708

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.666
σ	0.002
min	25.664
max	25.670

*mean*	4113.000
σ	1558.341
min	2048.000
max	6046.000

*mean*	5.455
σ	0.108
min	5.256
max	5.590

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.968
σ	0.002
min	25.967
max	25.971

*mean*	4113.000
σ	1558.341
min	2048.000
max	6046.000

*mean*	5.360
σ	0.104
min	5.165
max	5.504

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.593
σ	0.000
min	2524.593
max	2524.594

*mean*	6046.000
σ	0.000
min	6046.000
max	6046.000

*mean*	1409.068
σ	510.854
min	1069.472
max	2364.313

op=load_product(), with indexes

*mean*	8744.558
σ	0.032
min	8744.544
max	8744.638

*mean*	3839.375
σ	1628.910
min	2048.000
max	6046.000

*mean*	4718.304
σ	1295.176
min	3574.236
max	6854.145

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.078
σ	0.002
min	62.076
max	62.080

*mean*	4113.000
σ	1558.341
min	2048.000
max	6046.000

*mean*	81.592
σ	11.386
min	71.574
max	99.830

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.944
σ	0.001
min	40.944
max	40.947

*mean*	6046.000
σ	0.000
min	6046.000
max	6046.000

*mean*	97.489
σ	9.082
min	80.983
max	108.683

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.686
σ	0.000
min	66.685
max	66.687

*mean*	6046.000
σ	0.000
min	6046.000
max	6046.000

*mean*	231.001
σ	244.189
min	121.482
max	834.399

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11656.833
σ	4.318
min	11655.305
max	11667.521

*mean*	4113.000
σ	1558.341
min	2048.000
max	6046.000

*mean*	6593.037
σ	1391.714
min	4964.143
max	8133.782

op=vertical_lookup_list() on indexed

*mean*	11560.069
σ	0.001
min	11560.067
max	11560.069

*mean*	6046.000
σ	0.000
min	6046.000
max	6046.000

*mean*	6892.719
σ	1277.688
min	4445.750
max	8404.133

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.581
σ	0.025
min	172.560
max	172.624

*mean*	2048.000
σ	0.000
min	2048.000
max	2048.000

*mean*	328.990
σ	69.508
min	245.788
max	401.168

op=pointedIndexFromKvs

rows=400000

*mean*	357.374
σ	0.038
min	357.321
max	357.418

*mean*	2048.000
σ	0.000
min	2048.000
max	2048.000

*mean*	712.372
σ	86.833
min	629.575
max	826.909

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1008.184
σ	0.885
min	1007.698
max	1011.854

*mean*	1039.550
σ	303.818
min	548.000
max	1466.000

*mean*	1.557
σ	0.091
min	1.428
max	1.790

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.883
σ	0.002
min	0.881
max	0.886

*mean*	1466.000
σ	0.000
min	1466.000
max	1466.000

*mean*	0.415
σ	0.118
min	0.340
max	0.623

name=error_case.art

*mean*	2.333
σ	0.003
min	2.332
max	2.337

*mean*	1466.000
σ	0.000
min	1466.000
max	1466.000

*mean*	0.887
σ	0.091
min	0.821
max	1.043

name=heavy_item.art

*mean*	1.521
σ	0.002
min	1.520
max	1.524

*mean*	1466.000
σ	0.000
min	1466.000
max	1466.000

*mean*	0.548
σ	0.047
min	0.502
max	0.620

name=nested_use.art

*mean*	2.355
σ	0.002
min	2.355
max	2.358

*mean*	1466.000
σ	0.000
min	1466.000
max	1466.000

*mean*	0.851
σ	0.045
min	0.821
max	0.929

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	963.543
σ	0.024
min	963.523
max	963.581

*mean*	1466.000
σ	0.000
min	1466.000
max	1466.000

*mean*	0.845
σ	0.014
min	0.826
max	0.858

name=cdr_enhanced_4k_loc.art

*mean*	884.853
σ	0.005
min	884.847
max	884.858

*mean*	1466.000
σ	0.000
min	1466.000
max	1466.000

*mean*	0.681
σ	0.074
min	0.600
max	0.750

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.706
σ	0.002
min	7.705
max	7.712

*mean*	1466.000
σ	0.000
min	1466.000
max	1466.000

*mean*	4.275
σ	0.097
min	4.137
max	4.590

name=record_render_large_syntax_err.art

*mean*	7.655
σ	0.002
min	7.654
max	7.658

*mean*	1466.000
σ	0.000
min	1466.000
max	1466.000

*mean*	4.361
σ	0.151
min	4.178
max	5.494

name=record_render_success.art

*mean*	2.288
σ	0.002
min	2.287
max	2.291

*mean*	1466.000
σ	0.000
min	1466.000
max	1466.000

*mean*	0.753
σ	0.055
min	0.544
max	0.929

name=record_render_syntax_err.art

*mean*	2.163
σ	0.002
min	2.163
max	2.166

*mean*	1466.000
σ	0.000
min	1466.000
max	1466.000

*mean*	0.595
σ	0.096
min	0.498
max	0.801

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	297.331
σ	0.206
min	297.171
max	297.902

*mean*	2048.000
σ	0.000
min	2048.000
max	2048.000

*mean*	0.577
σ	0.033
min	0.513
max	0.612

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	289.768
σ	0.034
min	289.721
max	289.803

*mean*	1466.000
σ	0.000
min	1466.000
max	1466.000

*mean*	0.391
σ	0.006
min	0.387
max	0.401

iters=5

new-facts=1

prior-facts=6402

*mean*	1299.667
σ	0.110
min	1299.557
max	1299.832

*mean*	1466.000
σ	0.000
min	1466.000
max	1466.000

*mean*	2.051
σ	0.057
min	2.005
max	2.140

iters=5

new-facts=6402

prior-facts=1

*mean*	1542.611
σ	4.013
min	1540.601
max	1549.781

*mean*	1466.000
σ	0.000
min	1466.000
max	1466.000

*mean*	2.255
σ	0.120
min	2.147
max	2.392

iters=5

new-facts=6402

prior-facts=6402

*mean*	1861.633
σ	0.061
min	1861.545
max	1861.698

*mean*	1724.600
σ	234.344
min	1466.000
max	2048.000

*mean*	2.937
σ	0.096
min	2.818
max	3.057

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.707
σ	0.120
min	1.594
max	1.878

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	446.185
σ	577.140
min	157.614
max	1311.895

*mean*	96.250
σ	8.500
min	92.000
max	109.000

*mean*	1466.000
σ	0.000
min	1466.000
max	1466.000

*mean*	0.550
σ	0.570
min	0.263
max	1.405

policies=20

*mean*	1576.409
σ	0.344
min	1576.175
max	1576.920

*mean*	920.000
σ	0.000
min	920.000
max	920.000

*mean*	1466.000
σ	0.000
min	1466.000
max	1466.000

*mean*	2.616
σ	0.008
min	2.607
max	2.626

policies=200

*mean*	15772.311
σ	0.102
min	15772.234
max	15772.461

*mean*	9200.000
σ	0.000
min	9200.000
max	9200.000

*mean*	1466.000
σ	0.000
min	1466.000
max	1466.000

*mean*	26.551
σ	0.050
min	26.498
max	26.618