Compare commits

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.616-54.031=0.585
σ	0.349-0.372=-0.023
min	54.480-53.888=0.592
max	55.608-55.088=0.520

*mean*	416.000-417.000=-1.000
σ	0.000
min	416.000-417.000=-1.000
max	416.000-417.000=-1.000

*mean*	0.140-0.139=0.001
σ	0.004-0.005=-0.001
min	0.133-0.132=0.001
max	0.147-0.147=0.000

cache=y

dps=1

iters=10

policies=100

*mean*	43.785-43.384=0.402
σ	0.007-0.006=0.001
min	43.777-43.372=0.405
max	43.800-43.394=0.407

*mean*	416.000-417.000=-1.000
σ	0.000
min	416.000-417.000=-1.000
max	416.000-417.000=-1.000

*mean*	0.123-0.122=0.001
σ	0.003-0.005=-0.001
min	0.120-0.114=0.005
max	0.129-0.129=0.000

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.002
min	36.615
max	36.620

*mean*	4272.875
σ	1862.436
min	2062.000
max	7537.000

*mean*	12.903
σ	1.731
min	11.967
max	17.136

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.002
min	36.615
max	36.620

*mean*	4272.875
σ	1862.436
min	2062.000
max	7537.000

*mean*	13.081
σ	1.661
min	11.498
max	16.989

op=table_records(), no indexes

*mean*	41.928
σ	0.000
min	41.928
max	41.929

*mean*	7537.000
σ	0.000
min	7537.000
max	7537.000

*mean*	14.231
σ	1.076
min	12.864
max	15.572

op=table_records(), repeat

*mean*	41.928
σ	0.002
min	41.927
max	41.932

*mean*	4272.875
σ	1862.436
min	2062.000
max	7537.000

*mean*	12.553
σ	2.343
min	10.218
max	16.140

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.605
σ	0.002
min	27.603
max	27.607

*mean*	4272.875
σ	1862.436
min	2062.000
max	7537.000

*mean*	8.873
σ	1.459
min	7.982
max	12.362

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.400
σ	0.002
min	26.399
max	26.403

*mean*	4272.875
σ	1862.436
min	2062.000
max	7537.000

*mean*	6.669
σ	1.098
min	5.986
max	9.345

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.666
σ	0.002
min	25.664
max	25.670

*mean*	4272.875
σ	1862.436
min	2062.000
max	7537.000

*mean*	5.658
σ	0.428
min	5.253
max	6.658

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.968
σ	0.002
min	25.967
max	25.971

*mean*	4272.875
σ	1862.436
min	2062.000
max	7537.000

*mean*	5.393
σ	0.368
min	5.106
max	6.275

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.593
σ	0.000
min	2524.593
max	2524.594

*mean*	7537.000
σ	0.000
min	7537.000
max	7537.000

*mean*	1033.666
σ	6.433
min	1022.695
max	1042.130

op=load_product(), with indexes

*mean*	8744.558
σ	0.032
min	8744.545
max	8744.639

*mean*	3807.125
σ	1580.606
min	2062.000
max	5941.000

*mean*	4671.407
σ	1511.933
min	3553.461
max	7255.917

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.078
σ	0.002
min	62.076
max	62.080

*mean*	4272.875
σ	1862.436
min	2062.000
max	7537.000

*mean*	86.679
σ	15.460
min	70.912
max	116.595

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.944
σ	0.001
min	40.944
max	40.945

*mean*	7537.000
σ	0.000
min	7537.000
max	7537.000

*mean*	240.805
σ	401.059
min	82.882
max	1233.165

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.686
σ	0.000
min	66.685
max	66.687

*mean*	7537.000
σ	0.000
min	7537.000
max	7537.000

*mean*	149.999
σ	15.032
min	131.077
max	166.684

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11656.833
σ	4.318
min	11655.305
max	11667.521

*mean*	4272.875
σ	1862.436
min	2062.000
max	7537.000

*mean*	6136.134
σ	1076.017
min	4986.460
max	8025.004

op=vertical_lookup_list() on indexed

*mean*	11560.068
σ	0.001
min	11560.066
max	11560.069

*mean*	7537.000
σ	0.000
min	7537.000
max	7537.000

*mean*	5599.557
σ	1458.898
min	4450.100
max	7651.042

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.587
σ	0.024
min	172.561
max	172.619

*mean*	2062.000
σ	0.000
min	2062.000
max	2062.000

*mean*	368.709
σ	44.257
min	325.095
max	466.693

op=pointedIndexFromKvs

rows=400000

*mean*	357.368
σ	0.048
min	357.321
max	357.438

*mean*	2062.000
σ	0.000
min	2062.000
max	2062.000

*mean*	786.134
σ	26.528
min	732.310
max	820.088

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1008.188-1006.325=1.863
σ	0.860-0.912=-0.052
min	1007.682-1005.860=1.822
max	1011.733-1010.113=1.620

*mean*	1040.050-1057.750=-17.700
σ	304.365-303.545=0.820
min	548.000-603.000=-55.000
max	1468.000-1456.000=12.000

*mean*	1.546-1.542=0.004
σ	0.132-0.106=0.026
min	1.449-1.332=0.117
max	2.008-1.760=0.248

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.884-0.883=0.001
σ	0.003-0.002=0.000
min	0.881
max	0.887-0.886=0.001

*mean*	1468.000-1456.000=12.000
σ	0.000
min	1468.000-1456.000=12.000
max	1468.000-1456.000=12.000

*mean*	0.462-0.413=0.050
σ	0.111-0.130=-0.019
min	0.352-0.334=0.018
max	0.627-0.642=-0.015

name=error_case.art

*mean*	2.333
σ	0.003
min	2.332
max	2.337

*mean*	1468.000-1456.000=12.000
σ	0.000
min	1468.000-1456.000=12.000
max	1468.000-1456.000=12.000

*mean*	0.891-0.887=0.005
σ	0.103-0.084=0.018
min	0.823-0.827=-0.004
max	1.071-1.029=0.042

name=heavy_item.art

*mean*	1.521
σ	0.002
min	1.520
max	1.524

*mean*	1468.000-1456.000=12.000
σ	0.000
min	1468.000-1456.000=12.000
max	1468.000-1456.000=12.000

*mean*	0.551-0.539=0.012
σ	0.047-0.040=0.007
min	0.519-0.507=0.011
max	0.631-0.608=0.023

name=nested_use.art

*mean*	2.355
σ	0.002
min	2.355
max	2.358

*mean*	1468.000-1456.000=12.000
σ	0.000
min	1468.000-1456.000=12.000
max	1468.000-1456.000=12.000

*mean*	0.849-0.843=0.006
σ	0.039-0.036=0.003
min	0.813-0.813=-0.000
max	0.914-0.906=0.009

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	963.541-963.541=0.000
σ	0.022-0.028=-0.006
min	963.523
max	963.576-963.589=-0.014

*mean*	1468.000-1456.000=12.000
σ	0.000
min	1468.000-1456.000=12.000
max	1468.000-1456.000=12.000

*mean*	0.836-0.826=0.010
σ	0.026-0.038=-0.013
min	0.809-0.777=0.033
max	0.866-0.866=0.000

name=cdr_enhanced_4k_loc.art

*mean*	884.853-884.853=0.000
σ	0.007-0.006=0.001
min	884.847
max	884.864-884.861=0.003

*mean*	1468.000-1456.000=12.000
σ	0.000
min	1468.000-1456.000=12.000
max	1468.000-1456.000=12.000

*mean*	0.734-0.721=0.014
σ	0.023-0.031=-0.008
min	0.694-0.672=0.022
max	0.747-0.746=0.001

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.706-7.706=0.000
σ	0.002-0.002=0.000
min	7.705
max	7.712-7.709=0.002

*mean*	1468.000-1456.000=12.000
σ	0.000
min	1468.000-1456.000=12.000
max	1468.000-1456.000=12.000

*mean*	4.296-3.549=0.747
σ	0.090-0.098=-0.009
min	4.111-3.403=0.708
max	4.552-3.942=0.609

name=record_render_large_syntax_err.art

*mean*	7.655
σ	0.002
min	7.654
max	7.658

*mean*	1468.000-1456.000=12.000
σ	0.000
min	1468.000-1456.000=12.000
max	1468.000-1456.000=12.000

*mean*	4.269-3.510=0.759
σ	0.091-0.071=0.020
min	4.136-3.342=0.794
max	4.611-3.778=0.834

name=record_render_success.art

*mean*	2.288
σ	0.002
min	2.287
max	2.291

*mean*	1468.000-1456.000=12.000
σ	0.000
min	1468.000-1456.000=12.000
max	1468.000-1456.000=12.000

*mean*	0.742-0.751=-0.010
σ	0.050-0.017=0.033
min	0.529-0.715=-0.187
max	0.861-0.855=0.006

name=record_render_syntax_err.art

*mean*	2.163
σ	0.002
min	2.163
max	2.166

*mean*	1468.000-1456.000=12.000
σ	0.000
min	1468.000-1456.000=12.000
max	1468.000-1456.000=12.000

*mean*	0.714-0.712=0.002
σ	0.017-0.019=-0.002
min	0.678-0.618=0.060
max	0.793-0.781=0.012

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	297.639-295.504=2.134
σ	0.206-0.264=-0.058
min	297.453-295.281=2.172
max	298.201-296.226=1.975

*mean*	2062.000-1893.000=169.000
σ	0.000
min	2062.000-1893.000=169.000
max	2062.000-1893.000=169.000

*mean*	0.551-0.576=-0.025
σ	0.032-0.022=0.010
min	0.506-0.536=-0.029
max	0.596-0.602=-0.006

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	289.776-285.251=4.525
σ	0.033-0.041=-0.008
min	289.733-285.198=4.535
max	289.810-285.291=4.519

*mean*	1468.000-1456.000=12.000
σ	0.000
min	1468.000-1456.000=12.000
max	1468.000-1456.000=12.000

*mean*	0.410-0.398=0.012
σ	0.013-0.009=0.004
min	0.398-0.386=0.012
max	0.429-0.409=0.020

iters=5

new-facts=1

prior-facts=6402

*mean*	1299.682-1295.190=4.492
σ	0.096-0.099=-0.003
min	1299.584-1295.081=4.504
max	1299.814-1295.316=4.498

*mean*	1468.000-1456.000=12.000
σ	0.000
min	1468.000-1456.000=12.000
max	1468.000-1456.000=12.000

*mean*	2.070-1.914=0.156
σ	0.083-0.092=-0.009
min	1.985-1.815=0.169
max	2.188-2.013=0.175

iters=5

new-facts=6402

prior-facts=1

*mean*	1542.630-1538.109=4.521
σ	4.055-4.018=0.038
min	1540.629-1536.113=4.516
max	1549.877-1545.291=4.586

*mean*	1468.000-1456.000=12.000
σ	0.000
min	1468.000-1456.000=12.000
max	1468.000-1456.000=12.000

*mean*	2.320-2.152=0.167
σ	0.187-0.166=0.020
min	2.167-2.044=0.123
max	2.636-2.447=0.189

iters=5

new-facts=6402

prior-facts=6402

*mean*	1861.629-1857.109=4.520
σ	0.057-0.056=0.001
min	1861.549-1857.053=4.496
max	1861.697-1857.187=4.510

*mean*	1727.800-1744.000=-16.200
σ	239.368-169.083=70.286
min	1468.000-1496.000=-28.000
max	2062.000-1893.000=169.000

*mean*	2.939-3.047=-0.108
σ	0.088-0.232=-0.144
min	2.852-2.850=0.002
max	3.055-3.438=-0.383

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.721-1.810=-0.089
σ	0.126-0.045=0.081
min	1.556-1.754=-0.198
max	1.859-1.863=-0.004

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	446.185-443.611=2.574
σ	577.139-577.065=0.074
min	157.614-155.076=2.538
max	1311.894-1309.209=2.685

*mean*	96.250
σ	8.500
min	92.000
max	109.000

*mean*	1468.000-1456.000=12.000
σ	0.000
min	1468.000-1456.000=12.000
max	1468.000-1456.000=12.000

*mean*	0.549-0.534=0.016
σ	0.577-0.552=0.025
min	0.259-0.254=0.005
max	1.414-1.362=0.052

policies=20

*mean*	1576.405-1551.040=25.365
σ	0.337-0.318=0.018
min	1576.173-1550.820=25.353
max	1576.904-1551.512=25.392

*mean*	920.000
σ	0.000
min	920.000
max	920.000

*mean*	1468.000-1456.000=12.000
σ	0.000
min	1468.000-1456.000=12.000
max	1468.000-1456.000=12.000

*mean*	2.606-2.575=0.031
σ	0.010-0.023=-0.013
min	2.592-2.552=0.040
max	2.613-2.598=0.015

policies=200

*mean*	15772.229-15518.548=253.681
σ	0.085-0.068=0.017
min	15772.173-15518.485=253.688
max	15772.356-15518.632=253.724

*mean*	9200.000
σ	0.000
min	9200.000
max	9200.000

*mean*	1468.000-1456.000=12.000
σ	0.000
min	1468.000-1456.000=12.000
max	1468.000-1456.000=12.000

*mean*	26.353-26.119=0.234
σ	0.027-0.046=-0.019
min	26.329-26.070=0.258
max	26.384-26.173=0.211