Compare commits

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.678
σ	0.357
min	54.541
max	55.694

*mean*	413.000
σ	0.000
min	413.000
max	413.000

*mean*	0.141
σ	0.005
min	0.133
max	0.149

cache=y

dps=1

iters=10

policies=100

*mean*	43.705
σ	0.006
min	43.695
max	43.717

*mean*	413.000
σ	0.000
min	413.000
max	413.000

*mean*	0.123
σ	0.005
min	0.115
max	0.132

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.002
min	36.616
max	36.620

*mean*	4158.125
σ	1903.573
min	1556.000
max	7323.000

*mean*	12.318
σ	0.312
min	11.811
max	12.745

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.002
min	36.616
max	36.620

*mean*	4158.125
σ	1903.573
min	1556.000
max	7323.000

*mean*	12.151
σ	0.546
min	11.372
max	12.755

op=table_records(), no indexes

*mean*	41.932
σ	0.001
min	41.929
max	41.933

*mean*	7323.000
σ	0.000
min	7323.000
max	7323.000

*mean*	14.400
σ	0.868
min	12.371
max	15.039

op=table_records(), repeat

*mean*	41.929
σ	0.002
min	41.927
max	41.932

*mean*	4158.125
σ	1903.573
min	1556.000
max	7323.000

*mean*	11.923
σ	1.553
min	10.385
max	13.929

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.654
σ	0.136
min	27.604
max	27.991

*mean*	4158.125
σ	1903.573
min	1556.000
max	7323.000

*mean*	8.498
σ	0.269
min	8.174
max	8.935

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.401
σ	0.002
min	26.400
max	26.404

*mean*	4158.125
σ	1903.573
min	1556.000
max	7323.000

*mean*	6.679
σ	0.113
min	6.556
max	6.906

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.668
σ	0.003
min	25.666
max	25.674

*mean*	4158.125
σ	1903.573
min	1556.000
max	7323.000

*mean*	5.554
σ	0.121
min	5.319
max	5.755

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.970
σ	0.002
min	25.968
max	25.974

*mean*	4158.125
σ	1903.573
min	1556.000
max	7323.000

*mean*	5.421
σ	0.115
min	5.324
max	5.668

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.606
σ	0.000
min	2524.606
max	2524.607

*mean*	7323.000
σ	0.000
min	7323.000
max	7323.000

*mean*	1044.691
σ	6.207
min	1037.452
max	1055.411

op=load_product(), with indexes

*mean*	8744.721
σ	0.469
min	8744.553
max	8745.883

*mean*	3580.250
σ	1800.837
min	1043.000
max	5816.000

*mean*	4471.077
σ	1270.738
min	3513.130
max	6723.327

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.078
σ	0.002
min	62.076
max	62.081

*mean*	4158.125
σ	1903.573
min	1556.000
max	7323.000

*mean*	83.246
σ	12.103
min	70.052
max	99.722

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.945
σ	0.001
min	40.945
max	40.946

*mean*	7323.000
σ	0.000
min	7323.000
max	7323.000

*mean*	104.506
σ	6.331
min	91.837
max	111.869

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.686
σ	0.000
min	66.686
max	66.687

*mean*	7323.000
σ	0.000
min	7323.000
max	7323.000

*mean*	161.318
σ	8.820
min	141.194
max	166.810

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11656.901
σ	4.304
min	11655.306
max	11667.551

*mean*	4158.125
σ	1903.573
min	1556.000
max	7323.000

*mean*	6215.023
σ	1000.097
min	4925.550
max	7852.180

op=vertical_lookup_list() on indexed

*mean*	11560.066
σ	0.001
min	11560.065
max	11560.067

*mean*	7323.000
σ	0.000
min	7323.000
max	7323.000

*mean*	5708.425
σ	1828.558
min	4375.544
max	8897.483

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.559
σ	0.001
min	172.558
max	172.562

*mean*	476.000
σ	0.000
min	476.000
max	476.000

*mean*	373.446
σ	16.233
min	346.216
max	385.151

op=pointedIndexFromKvs

rows=400000

*mean*	357.322
σ	0.001
min	357.321
max	357.325

*mean*	561.000
σ	0.000
min	561.000
max	561.000

*mean*	723.740
σ	43.448
min	644.374
max	774.242

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1024.327
σ	0.759
min	1023.852
max	1027.465

*mean*	1038.000
σ	300.918
min	562.000
max	1460.000

*mean*	1.543
σ	0.078
min	1.362
max	1.662

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.913
σ	0.020
min	0.903
max	0.949

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.396
σ	0.520
min	0.145
max	1.325

name=error_case.art

*mean*	2.339
σ	0.012
min	2.333
max	2.361

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.473
σ	0.324
min	0.318
max	1.052

name=heavy_item.art

*mean*	1.522
σ	0.002
min	1.521
max	1.525

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.224
σ	0.025
min	0.206
max	0.266

name=nested_use.art

*mean*	2.357
σ	0.002
min	2.356
max	2.360

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.327
σ	0.018
min	0.315
max	0.359

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	964.840
σ	0.011
min	964.835
max	964.859

*mean*	431.600
σ	1.342
min	431.000
max	434.000

*mean*	0.533
σ	0.061
min	0.472
max	0.613

name=cdr_enhanced_4k_loc.art

*mean*	885.820
σ	0.002
min	885.819
max	885.823

*mean*	442.000
σ	0.000
min	442.000
max	442.000

*mean*	0.501
σ	0.014
min	0.490
max	0.522

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.709
σ	0.002
min	7.708
max	7.712

*mean*	442.000
σ	0.000
min	442.000
max	442.000

*mean*	2.394
σ	0.340
min	1.864
max	2.910

name=record_render_large_syntax_err.art

*mean*	7.657
σ	0.002
min	7.656
max	7.660

*mean*	442.000
σ	0.000
min	442.000
max	442.000

*mean*	2.561
σ	0.073
min	2.439
max	2.855

name=record_render_success.art

*mean*	2.289
σ	0.002
min	2.289
max	2.293

*mean*	442.000
σ	0.000
min	442.000
max	442.000

*mean*	0.306
σ	0.009
min	0.292
max	0.366

name=record_render_syntax_err.art

*mean*	2.165
σ	0.002
min	2.164
max	2.168

*mean*	442.000
σ	0.000
min	442.000
max	442.000

*mean*	0.291
σ	0.011
min	0.277
max	0.362

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	298.825
σ	0.984
min	298.394
max	301.620

*mean*	442.700
σ	16.042
min	418.000
max	469.000

*mean*	0.602
σ	0.019
min	0.574
max	0.637

Timed compile per phase

Factor

allocated MiB

peak allocated MiB

time (ms)

phase=buildDeclTree

*mean*	239.532
σ	0.000
min	239.532
max	239.532

*mean*	1721.250
σ	34.158
min	1680.000
max	1746.000

*mean*	217.737
σ	1.642
min	215.658
max	220.470

phase=macro expansion

*mean*	6.130
σ	0.000
min	6.130
max	6.130

*mean*	1721.250
σ	34.158
min	1680.000
max	1746.000

*mean*	11.013
σ	2.423
min	7.442
max	12.831

phase=parser

*mean*	1042.365
σ	0.001
min	1042.362
max	1042.365

*mean*	1721.250
σ	34.158
min	1680.000
max	1746.000

*mean*	674.423
σ	116.300
min	421.162
max	779.405

phase=processProdDef

*mean*	6169.660
σ	0.001
min	6169.660
max	6169.661

*mean*	1729.500
σ	30.552
min	1680.000
max	1746.000

*mean*	5256.300
σ	1114.927
min	4077.434
max	7266.871

phase=renaming

*mean*	21.672
σ	0.001
min	21.671
max	21.675

*mean*	1721.250
σ	34.158
min	1680.000
max	1746.000

*mean*	41.471
σ	9.572
min	26.670
max	48.229

phase=type checker

*mean*	990.445
σ	0.066
min	990.344
max	990.536

*mean*	1721.250
σ	34.158
min	1680.000
max	1746.000

*mean*	789.311
σ	90.612
min	656.056
max	914.000

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	293.916
σ	0.040
min	293.862
max	293.958

*mean*	441.400
σ	3.286
min	439.000
max	445.000

*mean*	0.400
σ	0.001
min	0.400
max	0.402

iters=5

new-facts=1

prior-facts=6402

*mean*	1320.240
σ	0.073
min	1320.182
max	1320.320

*mean*	1070.200
σ	167.610
min	844.000
max	1273.000

*mean*	2.049
σ	0.275
min	1.824
max	2.491

iters=5

new-facts=6402

prior-facts=1

*mean*	1559.730
σ	4.067
min	1557.704
max	1566.998

*mean*	620.000
σ	83.066
min	494.000
max	717.000

*mean*	2.247
σ	0.133
min	2.149
max	2.479

iters=5

new-facts=6402

prior-facts=6402

*mean*	1882.271
σ	0.055
min	1882.209
max	1882.352

*mean*	1697.400
σ	244.231
min	1397.000
max	2021.000

*mean*	2.889
σ	0.057
min	2.828
max	2.979

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.720
σ	0.128
min	1.575
max	1.862

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	453.537
σ	585.528
min	160.770
max	1331.829

*mean*	102.250
σ	8.500
min	98.000
max	115.000

*mean*	443.000
σ	0.000
min	443.000
max	443.000

*mean*	0.542
σ	0.541
min	0.269
max	1.354

policies=20

*mean*	1608.038
σ	0.406
min	1607.758
max	1608.638

*mean*	980.000
σ	0.000
min	980.000
max	980.000

*mean*	450.250
σ	10.595
min	443.000
max	466.000

*mean*	2.702
σ	0.031
min	2.670
max	2.735

policies=200

*mean*	16088.503
σ	0.194
min	16088.351
max	16088.782

*mean*	9800.000
σ	0.000
min	9800.000
max	9800.000

*mean*	498.000
σ	3.367
min	494.000
max	502.000

*mean*	27.356
σ	0.267
min	27.107
max	27.701