Compare commits

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.619
σ	0.350
min	54.487
max	55.615

*mean*	419.000
σ	0.000
min	419.000
max	419.000

*mean*	0.138
σ	0.005
min	0.129
max	0.143

cache=y

dps=1

iters=10

policies=100

*mean*	43.788
σ	0.007
min	43.776
max	43.802

*mean*	419.000
σ	0.000
min	419.000
max	419.000

*mean*	0.122
σ	0.004
min	0.119
max	0.128

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.002
min	36.616
max	36.620

*mean*	4096.875
σ	1588.373
min	1892.000
max	6052.000

*mean*	12.176
σ	0.418
min	11.678
max	12.680

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.002
min	36.616
max	36.620

*mean*	4096.875
σ	1588.373
min	1892.000
max	6052.000

*mean*	12.174
σ	0.612
min	11.083
max	12.841

op=table_records(), no indexes

*mean*	41.932
σ	0.001
min	41.928
max	41.933

*mean*	6052.000
σ	0.000
min	6052.000
max	6052.000

*mean*	13.046
σ	1.433
min	10.580
max	14.966

op=table_records(), repeat

*mean*	41.929
σ	0.002
min	41.927
max	41.931

*mean*	4096.875
σ	1588.373
min	1892.000
max	6052.000

*mean*	12.121
σ	1.945
min	10.333
max	14.439

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.605
σ	0.002
min	27.603
max	27.607

*mean*	4096.875
σ	1588.373
min	1892.000
max	6052.000

*mean*	8.218
σ	0.526
min	7.669
max	9.014

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.400
σ	0.002
min	26.399
max	26.403

*mean*	4096.875
σ	1588.373
min	1892.000
max	6052.000

*mean*	6.112
σ	0.160
min	5.841
max	6.287

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.666
σ	0.002
min	25.665
max	25.668

*mean*	4096.875
σ	1588.373
min	1892.000
max	6052.000

*mean*	5.335
σ	0.128
min	5.176
max	5.562

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.969
σ	0.002
min	25.967
max	25.972

*mean*	4096.875
σ	1588.373
min	1892.000
max	6052.000

*mean*	5.137
σ	0.190
min	4.822
max	5.365

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.607
σ	0.001
min	2524.606
max	2524.610

*mean*	6052.000
σ	0.000
min	6052.000
max	6052.000

*mean*	1490.345
σ	667.183
min	1057.456
max	2609.165

op=load_product(), with indexes

*mean*	8744.567
σ	0.033
min	8744.553
max	8744.649

*mean*	3803.375
σ	1680.399
min	1892.000
max	6052.000

*mean*	4690.623
σ	1536.296
min	3535.330
max	7201.545

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.077
σ	0.002
min	62.075
max	62.080

*mean*	4096.875
σ	1588.373
min	1892.000
max	6052.000

*mean*	80.036
σ	7.861
min	70.016
max	89.369

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.944
σ	0.001
min	40.944
max	40.945

*mean*	6052.000
σ	0.000
min	6052.000
max	6052.000

*mean*	94.840
σ	13.943
min	68.115
max	107.803

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.686
σ	0.000
min	66.685
max	66.687

*mean*	6052.000
σ	0.000
min	6052.000
max	6052.000

*mean*	221.531
σ	227.065
min	101.769
max	781.224

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11656.833
σ	4.317
min	11655.305
max	11667.516

*mean*	4096.875
σ	1588.373
min	1892.000
max	6052.000

*mean*	6119.093
σ	1378.408
min	4927.606
max	8062.646

op=vertical_lookup_list() on indexed

*mean*	11560.065
σ	0.001
min	11560.065
max	11560.067

*mean*	6052.000
σ	0.000
min	6052.000
max	6052.000

*mean*	6499.679
σ	1374.280
min	4433.692
max	8035.871

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.585
σ	0.024
min	172.558
max	172.625

*mean*	1892.000
σ	0.000
min	1892.000
max	1892.000

*mean*	355.954
σ	43.599
min	264.404
max	413.778

op=pointedIndexFromKvs

rows=400000

*mean*	357.362
σ	0.037
min	357.321
max	357.405

*mean*	1892.000
σ	0.000
min	1892.000
max	1892.000

*mean*	751.261
σ	70.827
min	588.392
max	806.193

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1008.474
σ	0.928
min	1008.010
max	1012.341

*mean*	1047.850
σ	302.066
min	560.000
max	1473.000

*mean*	1.521
σ	0.108
min	1.439
max	1.873

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.884
σ	0.002
min	0.881
max	0.886

*mean*	1473.000
σ	0.000
min	1473.000
max	1473.000

*mean*	0.438
σ	0.104
min	0.360
max	0.601

name=error_case.art

*mean*	2.333
σ	0.003
min	2.332
max	2.337

*mean*	1473.000
σ	0.000
min	1473.000
max	1473.000

*mean*	0.893
σ	0.106
min	0.822
max	1.079

name=heavy_item.art

*mean*	1.521
σ	0.002
min	1.520
max	1.524

*mean*	1473.000
σ	0.000
min	1473.000
max	1473.000

*mean*	0.542
σ	0.046
min	0.491
max	0.610

name=nested_use.art

*mean*	2.355
σ	0.002
min	2.355
max	2.358

*mean*	1473.000
σ	0.000
min	1473.000
max	1473.000

*mean*	0.856
σ	0.044
min	0.809
max	0.927

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	963.919
σ	0.027
min	963.902
max	963.966

*mean*	1473.000
σ	0.000
min	1473.000
max	1473.000

*mean*	0.819
σ	0.044
min	0.785
max	0.869

name=cdr_enhanced_4k_loc.art

*mean*	884.889
σ	0.007
min	884.883
max	884.898

*mean*	1473.000
σ	0.000
min	1473.000
max	1473.000

*mean*	0.730
σ	0.020
min	0.697
max	0.743

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.706
σ	0.002
min	7.705
max	7.712

*mean*	1473.000
σ	0.000
min	1473.000
max	1473.000

*mean*	3.526
σ	0.086
min	3.379
max	3.820

name=record_render_large_syntax_err.art

*mean*	7.655
σ	0.002
min	7.654
max	7.658

*mean*	1473.000
σ	0.000
min	1473.000
max	1473.000

*mean*	3.510
σ	0.080
min	3.387
max	3.794

name=record_render_success.art

*mean*	2.288
σ	0.002
min	2.287
max	2.291

*mean*	1473.000
σ	0.000
min	1473.000
max	1473.000

*mean*	0.745
σ	0.017
min	0.706
max	0.841

name=record_render_syntax_err.art

*mean*	2.163
σ	0.002
min	2.163
max	2.166

*mean*	1473.000
σ	0.000
min	1473.000
max	1473.000

*mean*	0.713
σ	0.018
min	0.682
max	0.794

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	297.675
σ	0.257
min	297.452
max	298.356

*mean*	1892.000
σ	0.000
min	1892.000
max	1892.000

*mean*	0.606
σ	0.031
min	0.550
max	0.668

Timed compile per phase

Factor

allocated MiB

peak allocated MiB

time (ms)

phase=buildDeclTree

*mean*	222.008
σ	0.000
min	222.008
max	222.008

*mean*	1573.375
σ	47.746
min	1473.000
max	1598.000

*mean*	207.049
σ	1.886
min	204.958
max	210.416

phase=macro expansion

*mean*	6.130
σ	0.000
min	6.130
max	6.130

*mean*	1573.375
σ	47.746
min	1473.000
max	1598.000

*mean*	9.929
σ	2.590
min	6.267
max	12.518

phase=parser

*mean*	1041.159
σ	0.000
min	1041.159
max	1041.160

*mean*	1573.375
σ	47.746
min	1473.000
max	1598.000

*mean*	586.347
σ	143.152
min	381.576
max	729.388

phase=processProdDef

*mean*	6169.661
σ	0.002
min	6169.660
max	6169.665

*mean*	1589.000
σ	25.456
min	1526.000
max	1598.000

*mean*	6438.334
σ	987.384
min	4417.175
max	7242.761

phase=renaming

*mean*	21.667
σ	0.000
min	21.667
max	21.667

*mean*	1573.375
σ	47.746
min	1473.000
max	1598.000

*mean*	37.775
σ	11.677
min	20.566
max	48.908

phase=type checker

*mean*	958.693
σ	0.055
min	958.607
max	958.764

*mean*	1573.375
σ	47.746
min	1473.000
max	1598.000

*mean*	797.373
σ	116.422
min	670.479
max	1056.207

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	292.991
σ	0.032
min	292.951
max	293.026

*mean*	1598.000
σ	0.000
min	1598.000
max	1598.000

*mean*	0.398
σ	0.007
min	0.390
max	0.405

iters=5

new-facts=1

prior-facts=6402

*mean*	1302.838
σ	0.122
min	1302.736
max	1303.045

*mean*	1598.000
σ	0.000
min	1598.000
max	1598.000

*mean*	1.999
σ	0.210
min	1.813
max	2.328

iters=5

new-facts=6402

prior-facts=1

*mean*	1545.887
σ	4.021
min	1543.922
max	1553.074

*mean*	1598.000
σ	0.000
min	1598.000
max	1598.000

*mean*	2.317
σ	0.155
min	2.136
max	2.554

iters=5

new-facts=6402

prior-facts=6402

*mean*	1864.855
σ	0.054
min	1864.795
max	1864.923

*mean*	1758.800
σ	133.198
min	1598.000
max	1892.000

*mean*	3.010
σ	0.102
min	2.903
max	3.147

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.815
σ	0.056
min	1.762
max	1.889

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	446.795
σ	577.189
min	158.197
max	1312.578

*mean*	96.250
σ	8.500
min	92.000
max	109.000

*mean*	1598.000
σ	0.000
min	1598.000
max	1598.000

*mean*	0.469
σ	0.389
min	0.273
max	1.053

policies=20

*mean*	1582.298
σ	0.394
min	1582.034
max	1582.884

*mean*	920.000
σ	0.000
min	920.000
max	920.000

*mean*	1598.000
σ	0.000
min	1598.000
max	1598.000

*mean*	2.700
σ	0.011
min	2.686
max	2.710

policies=200

*mean*	15830.844
σ	0.131
min	15830.767
max	15831.040

*mean*	9200.000
σ	0.000
min	9200.000
max	9200.000

*mean*	1598.000
σ	0.000
min	1598.000
max	1598.000

*mean*	26.571
σ	0.164
min	26.431
max	26.780