270d4a778cdb10982db804beaa6a8871cab85a5c

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.624
σ	0.351
min	54.488
max	55.622

*mean*	418.000
σ	0.000
min	418.000
max	418.000

*mean*	0.141
σ	0.005
min	0.137
max	0.150

cache=y

dps=1

iters=10

policies=100

*mean*	43.788
σ	0.006
min	43.779
max	43.800

*mean*	418.000
σ	0.000
min	418.000
max	418.000

*mean*	0.124
σ	0.004
min	0.120
max	0.132

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.002
min	36.615
max	36.620

*mean*	4154.250
σ	1901.291
min	1555.000
max	7309.000

*mean*	12.764
σ	0.168
min	12.578
max	13.046

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.002
min	36.615
max	36.620

*mean*	4154.250
σ	1901.291
min	1555.000
max	7309.000

*mean*	12.858
σ	0.650
min	11.773
max	13.731

op=table_records(), no indexes

*mean*	41.932
σ	0.001
min	41.928
max	41.933

*mean*	7309.000
σ	0.000
min	7309.000
max	7309.000

*mean*	15.181
σ	0.848
min	13.332
max	16.081

op=table_records(), repeat

*mean*	41.928
σ	0.002
min	41.927
max	41.932

*mean*	4154.250
σ	1901.291
min	1555.000
max	7309.000

*mean*	13.189
σ	1.849
min	10.991
max	15.545

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.653
σ	0.136
min	27.603
max	27.990

*mean*	4154.250
σ	1901.291
min	1555.000
max	7309.000

*mean*	8.829
σ	0.324
min	8.511
max	9.322

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.400
σ	0.002
min	26.399
max	26.403

*mean*	4154.250
σ	1901.291
min	1555.000
max	7309.000

*mean*	6.732
σ	0.167
min	6.527
max	6.977

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.666
σ	0.002
min	25.665
max	25.668

*mean*	4154.250
σ	1901.291
min	1555.000
max	7309.000

*mean*	6.093
σ	0.079
min	5.926
max	6.194

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.968
σ	0.002
min	25.967
max	25.972

*mean*	4154.250
σ	1901.291
min	1555.000
max	7309.000

*mean*	5.869
σ	0.120
min	5.709
max	6.044

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.606
σ	0.000
min	2524.606
max	2524.607

*mean*	7309.000
σ	0.000
min	7309.000
max	7309.000

*mean*	1102.924
σ	141.182
min	1046.856
max	1452.134

op=load_product(), with indexes

*mean*	8744.722
σ	0.469
min	8744.554
max	8745.883

*mean*	3574.000
σ	1796.394
min	1045.000
max	5796.000

*mean*	4902.107
σ	1671.659
min	3538.374
max	7511.587

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.078
σ	0.002
min	62.076
max	62.081

*mean*	4154.250
σ	1901.291
min	1555.000
max	7309.000

*mean*	83.908
σ	11.635
min	70.403
max	101.519

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.944
σ	0.001
min	40.944
max	40.945

*mean*	7309.000
σ	0.000
min	7309.000
max	7309.000

*mean*	105.515
σ	7.829
min	87.899
max	113.599

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.686
σ	0.000
min	66.685
max	66.687

*mean*	7309.000
σ	0.000
min	7309.000
max	7309.000

*mean*	161.700
σ	10.751
min	135.865
max	168.380

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11656.836
σ	4.324
min	11655.305
max	11667.538

*mean*	4154.250
σ	1901.291
min	1555.000
max	7309.000

*mean*	6627.849
σ	1248.222
min	4910.894
max	8050.286

op=vertical_lookup_list() on indexed

*mean*	11560.065
σ	0.001
min	11560.064
max	11560.066

*mean*	7309.000
σ	0.000
min	7309.000
max	7309.000

*mean*	5668.623
σ	1303.795
min	4398.199
max	7645.388

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.559
σ	0.001
min	172.558
max	172.562

*mean*	478.000
σ	0.000
min	478.000
max	478.000

*mean*	380.716
σ	34.165
min	303.834
max	403.032

op=pointedIndexFromKvs

rows=400000

*mean*	357.322
σ	0.001
min	357.321
max	357.325

*mean*	560.000
σ	0.000
min	560.000
max	560.000

*mean*	752.798
σ	60.530
min	639.054
max	806.078

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1008.372
σ	0.760
min	1007.900
max	1011.517

*mean*	1042.850
σ	299.541
min	562.000
max	1444.000

*mean*	1.574
σ	0.146
min	1.415
max	2.096

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.891
σ	0.020
min	0.881
max	0.928

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.292
σ	0.290
min	0.134
max	0.806

name=error_case.art

*mean*	2.338
σ	0.012
min	2.332
max	2.359

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.482
σ	0.330
min	0.327
max	1.071

name=heavy_item.art

*mean*	1.522
σ	0.002
min	1.520
max	1.524

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.218
σ	0.024
min	0.200
max	0.258

name=nested_use.art

*mean*	2.355
σ	0.002
min	2.355
max	2.358

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.332
σ	0.016
min	0.320
max	0.360

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	963.908
σ	0.011
min	963.902
max	963.926

*mean*	433.600
σ	4.336
min	431.000
max	441.000

*mean*	0.552
σ	0.018
min	0.533
max	0.571

name=cdr_enhanced_4k_loc.art

*mean*	884.884
σ	0.002
min	884.883
max	884.886

*mean*	441.000
σ	0.000
min	441.000
max	441.000

*mean*	0.473
σ	0.056
min	0.399
max	0.532

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.706
σ	0.002
min	7.705
max	7.709

*mean*	441.000
σ	0.000
min	441.000
max	441.000

*mean*	2.609
σ	0.090
min	2.457
max	2.901

name=record_render_large_syntax_err.art

*mean*	7.655
σ	0.002
min	7.654
max	7.658

*mean*	441.000
σ	0.000
min	441.000
max	441.000

*mean*	2.579
σ	0.065
min	2.471
max	2.843

name=record_render_success.art

*mean*	2.288
σ	0.002
min	2.287
max	2.291

*mean*	441.000
σ	0.000
min	441.000
max	441.000

*mean*	0.304
σ	0.008
min	0.292
max	0.352

name=record_render_syntax_err.art

*mean*	2.163
σ	0.002
min	2.163
max	2.166

*mean*	441.000
σ	0.000
min	441.000
max	441.000

*mean*	0.291
σ	0.008
min	0.276
max	0.333

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	298.068
σ	0.962
min	297.708
max	300.802

*mean*	442.400
σ	15.543
min	418.000
max	465.000

*mean*	0.608
σ	0.008
min	0.590
max	0.615

Timed compile per phase

Factor

allocated MiB

peak allocated MiB

time (ms)

phase=buildDeclTree

*mean*	222.008
σ	0.000
min	222.008
max	222.008

*mean*	1696.750
σ	127.981
min	1499.000
max	1785.000

*mean*	202.679
σ	1.621
min	201.015
max	205.494

phase=macro expansion

*mean*	6.130
σ	0.000
min	6.130
max	6.130

*mean*	1696.750
σ	127.981
min	1499.000
max	1785.000

*mean*	11.702
σ	1.377
min	9.468
max	12.899

phase=parser

*mean*	1041.166
σ	0.000
min	1041.165
max	1041.166

*mean*	1696.750
σ	127.981
min	1499.000
max	1785.000

*mean*	677.919
σ	65.015
min	567.807
max	727.862

phase=processProdDef

*mean*	6169.657
σ	0.000
min	6169.657
max	6169.658

*mean*	1732.500
σ	102.199
min	1516.000
max	1785.000

*mean*	4762.602
σ	775.905
min	3341.607
max	5763.584

phase=renaming

*mean*	21.667
σ	0.000
min	21.667
max	21.667

*mean*	1696.750
σ	127.981
min	1499.000
max	1785.000

*mean*	42.958
σ	6.635
min	31.568
max	47.730

phase=type checker

*mean*	958.540
σ	0.066
min	958.442
max	958.630

*mean*	1696.750
σ	127.981
min	1499.000
max	1785.000

*mean*	812.754
σ	81.026
min	664.975
max	889.205

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	292.773
σ	0.035
min	292.724
max	292.809

*mean*	447.000
σ	0.000
min	447.000
max	447.000

*mean*	0.402
σ	0.007
min	0.396
max	0.410

iters=5

new-facts=1

prior-facts=6402

*mean*	1302.888
σ	0.068
min	1302.780
max	1302.959

*mean*	1090.000
σ	171.764
min	891.000
max	1322.000

*mean*	2.114
σ	0.159
min	1.834
max	2.220

iters=5

new-facts=6402

prior-facts=1

*mean*	1545.941
σ	4.048
min	1543.979
max	1553.177

*mean*	626.800
σ	88.970
min	506.000
max	728.000

*mean*	2.432
σ	0.323
min	2.130
max	2.914

iters=5

new-facts=6402

prior-facts=6402

*mean*	1864.833
σ	0.041
min	1864.778
max	1864.881

*mean*	1731.200
σ	176.695
min	1486.000
max	1897.000

*mean*	3.096
σ	0.314
min	2.896
max	3.652

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.736
σ	0.255
min	1.284
max	1.892

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	448.219
σ	579.085
min	158.673
max	1316.847

*mean*	98.250
σ	8.500
min	94.000
max	111.000

*mean*	443.000
σ	0.000
min	443.000
max	443.000

*mean*	0.533
σ	0.535
min	0.263
max	1.335

policies=20

*mean*	1587.066
σ	0.355
min	1586.820
max	1587.592

*mean*	940.000
σ	0.000
min	940.000
max	940.000

*mean*	445.500
σ	2.887
min	443.000
max	448.000

*mean*	2.631
σ	0.023
min	2.601
max	2.656

policies=200

*mean*	15878.991
σ	0.190
min	15878.836
max	15879.269

*mean*	9400.000
σ	0.000
min	9400.000
max	9400.000

*mean*	495.250
σ	2.500
min	492.000
max	498.000

*mean*	26.704
σ	0.116
min	26.577
max	26.832