Compare commits

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.622
σ	0.351
min	54.485
max	55.619

*mean*	414.700
σ	0.483
min	414.000
max	415.000

*mean*	0.136
σ	0.006
min	0.130
max	0.148

cache=y

dps=1

iters=10

policies=100

*mean*	43.787
σ	0.006
min	43.780
max	43.797

*mean*	415.000
σ	0.000
min	415.000
max	415.000

*mean*	0.123
σ	0.003
min	0.120
max	0.127

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.002
min	36.615
max	36.620

*mean*	4090.625
σ	1588.067
min	1885.000
max	6041.000

*mean*	12.450
σ	0.369
min	11.974
max	13.006

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.002
min	36.615
max	36.619

*mean*	4090.625
σ	1588.067
min	1885.000
max	6041.000

*mean*	11.844
σ	0.489
min	11.352
max	12.889

op=table_records(), no indexes

*mean*	41.928
σ	0.000
min	41.928
max	41.929

*mean*	6041.000
σ	0.000
min	6041.000
max	6041.000

*mean*	12.915
σ	1.137
min	10.775
max	14.504

op=table_records(), repeat

*mean*	41.928
σ	0.002
min	41.927
max	41.931

*mean*	4090.625
σ	1588.067
min	1885.000
max	6041.000

*mean*	12.334
σ	1.858
min	10.209
max	14.803

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.605
σ	0.002
min	27.603
max	27.607

*mean*	4090.625
σ	1588.067
min	1885.000
max	6041.000

*mean*	8.389
σ	0.236
min	8.073
max	8.759

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.400
σ	0.002
min	26.399
max	26.403

*mean*	4090.625
σ	1588.067
min	1885.000
max	6041.000

*mean*	6.730
σ	0.628
min	6.378
max	8.261

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.666
σ	0.002
min	25.664
max	25.670

*mean*	4090.625
σ	1588.067
min	1885.000
max	6041.000

*mean*	5.478
σ	0.170
min	5.196
max	5.698

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.968
σ	0.002
min	25.967
max	25.971

*mean*	4090.625
σ	1588.067
min	1885.000
max	6041.000

*mean*	5.329
σ	0.115
min	5.149
max	5.505

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.603
σ	0.000
min	2524.603
max	2524.603

*mean*	6041.000
σ	0.000
min	6041.000
max	6041.000

*mean*	1549.611
σ	815.326
min	1038.177
max	2960.081

op=load_product(), with indexes

*mean*	8744.568
σ	0.033
min	8744.554
max	8744.649

*mean*	3796.500
σ	1679.342
min	1885.000
max	6041.000

*mean*	4322.684
σ	1152.561
min	3544.448
max	6847.340

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.078
σ	0.002
min	62.076
max	62.080

*mean*	4090.625
σ	1588.067
min	1885.000
max	6041.000

*mean*	81.756
σ	9.916
min	71.042
max	97.483

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.944
σ	0.001
min	40.944
max	40.948

*mean*	6041.000
σ	0.000
min	6041.000
max	6041.000

*mean*	95.031
σ	12.809
min	72.923
max	107.742

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.686
σ	0.000
min	66.685
max	66.687

*mean*	6041.000
σ	0.000
min	6041.000
max	6041.000

*mean*	223.793
σ	229.374
min	107.880
max	789.677

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11656.833
σ	4.318
min	11655.305
max	11667.521

*mean*	4090.625
σ	1588.067
min	1885.000
max	6041.000

*mean*	6205.297
σ	1074.537
min	4965.943
max	7905.260

op=vertical_lookup_list() on indexed

*mean*	11560.069
σ	0.001
min	11560.066
max	11560.069

*mean*	6041.000
σ	0.000
min	6041.000
max	6041.000

*mean*	6440.426
σ	1338.257
min	4412.655
max	7795.668

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.582
σ	0.024
min	172.558
max	172.622

*mean*	1885.000
σ	0.000
min	1885.000
max	1885.000

*mean*	344.694
σ	51.157
min	265.941
max	400.672

op=pointedIndexFromKvs

rows=400000

*mean*	357.361
σ	0.039
min	357.321
max	357.404

*mean*	1885.000
σ	0.000
min	1885.000
max	1885.000

*mean*	779.648
σ	14.400
min	755.706
max	805.684

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1008.478
σ	0.874
min	1007.979
max	1012.097

*mean*	1039.700
σ	306.330
min	546.000
max	1468.000

*mean*	1.533
σ	0.131
min	1.434
max	2.017

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.883
σ	0.002
min	0.881
max	0.886

*mean*	1468.000
σ	0.000
min	1468.000
max	1468.000

*mean*	0.442
σ	0.136
min	0.363
max	0.682

name=error_case.art

*mean*	2.333
σ	0.003
min	2.332
max	2.337

*mean*	1468.000
σ	0.000
min	1468.000
max	1468.000

*mean*	0.905
σ	0.087
min	0.857
max	1.058

name=heavy_item.art

*mean*	1.521
σ	0.002
min	1.520
max	1.524

*mean*	1468.000
σ	0.000
min	1468.000
max	1468.000

*mean*	0.561
σ	0.057
min	0.514
max	0.659

name=nested_use.art

*mean*	2.357
σ	0.002
min	2.355
max	2.360

*mean*	1468.000
σ	0.000
min	1468.000
max	1468.000

*mean*	0.884
σ	0.030
min	0.851
max	0.932

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	963.921
σ	0.027
min	963.904
max	963.968

*mean*	1468.000
σ	0.000
min	1468.000
max	1468.000

*mean*	0.825
σ	0.031
min	0.781
max	0.855

name=cdr_enhanced_4k_loc.art

*mean*	884.889
σ	0.005
min	884.883
max	884.895

*mean*	1468.000
σ	0.000
min	1468.000
max	1468.000

*mean*	0.727
σ	0.049
min	0.639
max	0.751

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.706
σ	0.002
min	7.705
max	7.712

*mean*	1468.000
σ	0.000
min	1468.000
max	1468.000

*mean*	4.316
σ	0.113
min	4.157
max	4.819

name=record_render_large_syntax_err.art

*mean*	7.655
σ	0.002
min	7.654
max	7.658

*mean*	1468.000
σ	0.000
min	1468.000
max	1468.000

*mean*	4.311
σ	0.087
min	4.156
max	4.626

name=record_render_success.art

*mean*	2.288
σ	0.002
min	2.287
max	2.291

*mean*	1468.000
σ	0.000
min	1468.000
max	1468.000

*mean*	0.764
σ	0.024
min	0.651
max	0.882

name=record_render_syntax_err.art

*mean*	2.163
σ	0.002
min	2.163
max	2.166

*mean*	1468.000
σ	0.000
min	1468.000
max	1468.000

*mean*	0.722
σ	0.034
min	0.522
max	0.919

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	297.733
σ	0.241
min	297.534
max	298.390

*mean*	1885.000
σ	0.000
min	1885.000
max	1885.000

*mean*	0.604
σ	0.039
min	0.546
max	0.684

Timed compile per phase

Factor

allocated MiB

peak allocated MiB

time (ms)

phase=buildDeclTree

*mean*	222.011
σ	0.000
min	222.011
max	222.011

*mean*	1770.375
σ	92.014
min	1589.000
max	1819.000

*mean*	206.848
σ	16.842
min	194.005
max	247.612

phase=macro expansion

*mean*	6.133
σ	0.000
min	6.133
max	6.133

*mean*	1770.375
σ	92.014
min	1589.000
max	1819.000

*mean*	11.116
σ	2.780
min	6.369
max	15.471

phase=parser

*mean*	1041.161
σ	0.000
min	1041.160
max	1041.161

*mean*	1770.375
σ	92.014
min	1589.000
max	1819.000

*mean*	676.301
σ	98.843
min	572.707
max	847.233

phase=processProdDef

*mean*	6169.658
σ	0.001
min	6169.657
max	6169.659

*mean*	1799.125
σ	56.215
min	1660.000
max	1819.000

*mean*	5570.487
σ	1761.847
min	3257.544
max	7529.329

phase=renaming

*mean*	21.667
σ	0.000
min	21.667
max	21.667

*mean*	1770.375
σ	92.014
min	1589.000
max	1819.000

*mean*	41.662
σ	10.819
min	20.469
max	55.948

phase=type checker

*mean*	958.690
σ	0.055
min	958.604
max	958.760

*mean*	1770.375
σ	92.014
min	1589.000
max	1819.000

*mean*	791.195
σ	89.624
min	658.232
max	889.702

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	292.935
σ	0.051
min	292.859
max	292.995

*mean*	1819.000
σ	0.000
min	1819.000
max	1819.000

*mean*	0.400
σ	0.006
min	0.394
max	0.408

iters=5

new-facts=1

prior-facts=6402

*mean*	1302.857
σ	0.046
min	1302.806
max	1302.928

*mean*	1819.000
σ	0.000
min	1819.000
max	1819.000

*mean*	2.104
σ	0.129
min	1.939
max	2.270

iters=5

new-facts=6402

prior-facts=1

*mean*	1545.963
σ	4.018
min	1544.021
max	1553.146

*mean*	1819.000
σ	0.000
min	1819.000
max	1819.000

*mean*	2.317
σ	0.232
min	2.068
max	2.563

iters=5

new-facts=6402

prior-facts=6402

*mean*	1864.851
σ	0.064
min	1864.787
max	1864.930

*mean*	1845.400
σ	36.150
min	1819.000
max	1885.000

*mean*	2.951
σ	0.055
min	2.873
max	2.994

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.799
σ	0.137
min	1.579
max	1.914

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	447.277
σ	577.191
min	158.674
max	1313.063

*mean*	98.250
σ	8.500
min	94.000
max	111.000

*mean*	1819.000
σ	0.000
min	1819.000
max	1819.000

*mean*	0.504
σ	0.473
min	0.264
max	1.213

policies=20

*mean*	1587.080
σ	0.372
min	1586.821
max	1587.631

*mean*	940.000
σ	0.000
min	940.000
max	940.000

*mean*	1819.000
σ	0.000
min	1819.000
max	1819.000

*mean*	2.643
σ	0.008
min	2.634
max	2.652

policies=200

*mean*	15879.081
σ	0.133
min	15878.970
max	15879.273

*mean*	9400.000
σ	0.000
min	9400.000
max	9400.000

*mean*	1819.000
σ	0.000
min	1819.000
max	1819.000

*mean*	26.738
σ	0.183
min	26.544
max	26.912