Compare commits

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.624
σ	0.347
min	54.498
max	55.610

*mean*	421.000
σ	0.000
min	421.000
max	421.000

*mean*	0.142
σ	0.004
min	0.138
max	0.148

cache=y

dps=1

iters=10

policies=100

*mean*	43.787
σ	0.006
min	43.778
max	43.800

*mean*	421.000
σ	0.000
min	421.000
max	421.000

*mean*	0.124
σ	0.004
min	0.119
max	0.131

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.002
min	36.615
max	36.620

*mean*	4158.000
σ	1905.566
min	1552.000
max	7324.000

*mean*	12.251
σ	0.185
min	12.020
max	12.540

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.002
min	36.616
max	36.620

*mean*	4158.000
σ	1905.566
min	1552.000
max	7324.000

*mean*	12.641
σ	0.385
min	11.713
max	12.927

op=table_records(), no indexes

*mean*	41.931
σ	0.001
min	41.929
max	41.933

*mean*	7324.000
σ	0.000
min	7324.000
max	7324.000

*mean*	14.499
σ	0.931
min	12.345
max	15.232

op=table_records(), repeat

*mean*	41.928
σ	0.002
min	41.927
max	41.931

*mean*	4158.000
σ	1905.566
min	1552.000
max	7324.000

*mean*	12.242
σ	2.021
min	10.345
max	15.060

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.653
σ	0.137
min	27.603
max	27.991

*mean*	4158.000
σ	1905.566
min	1552.000
max	7324.000

*mean*	8.221
σ	0.332
min	7.761
max	8.729

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.400
σ	0.002
min	26.399
max	26.403

*mean*	4158.000
σ	1905.566
min	1552.000
max	7324.000

*mean*	6.309
σ	0.262
min	6.027
max	6.813

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.666
σ	0.002
min	25.664
max	25.668

*mean*	4158.000
σ	1905.566
min	1552.000
max	7324.000

*mean*	5.555
σ	0.114
min	5.341
max	5.740

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.968
σ	0.002
min	25.967
max	25.972

*mean*	4158.000
σ	1905.566
min	1552.000
max	7324.000

*mean*	5.288
σ	0.079
min	5.168
max	5.405

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.606
σ	0.000
min	2524.606
max	2524.607

*mean*	7324.000
σ	0.000
min	7324.000
max	7324.000

*mean*	1053.289
σ	8.230
min	1043.213
max	1065.892

op=load_product(), with indexes

*mean*	8744.722
σ	0.470
min	8744.553
max	8745.884

*mean*	3581.250
σ	1802.758
min	1045.000
max	5820.000

*mean*	4802.266
σ	1644.423
min	3540.417
max	7478.458

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.078
σ	0.002
min	62.076
max	62.081

*mean*	4158.000
σ	1905.566
min	1552.000
max	7324.000

*mean*	75.006
σ	2.897
min	70.923
max	79.286

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.944
σ	0.001
min	40.944
max	40.945

*mean*	7324.000
σ	0.000
min	7324.000
max	7324.000

*mean*	105.059
σ	7.692
min	88.677
max	113.994

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.686
σ	0.000
min	66.685
max	66.686

*mean*	7324.000
σ	0.000
min	7324.000
max	7324.000

*mean*	160.644
σ	10.802
min	135.401
max	167.160

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11656.836
σ	4.324
min	11655.305
max	11667.538

*mean*	4158.000
σ	1905.566
min	1552.000
max	7324.000

*mean*	6349.264
σ	1075.007
min	4970.616
max	8133.541

op=vertical_lookup_list() on indexed

*mean*	11560.065
σ	0.001
min	11560.064
max	11560.066

*mean*	7324.000
σ	0.000
min	7324.000
max	7324.000

*mean*	5518.952
σ	1637.852
min	4359.610
max	9009.182

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.559
σ	0.001
min	172.558
max	172.562

*mean*	477.000
σ	0.000
min	477.000
max	477.000

*mean*	380.626
σ	18.953
min	349.681
max	395.539

op=pointedIndexFromKvs

rows=400000

*mean*	357.322
σ	0.001
min	357.321
max	357.325

*mean*	560.625
σ	0.518
min	560.000
max	561.000

*mean*	772.203
σ	24.103
min	717.001
max	793.951

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1008.376
σ	0.760
min	1007.900
max	1011.517

*mean*	1035.250
σ	297.613
min	576.000
max	1465.000

*mean*	1.511
σ	0.080
min	1.396
max	1.743

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.891
σ	0.020
min	0.881
max	0.928

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.426
σ	0.568
min	0.142
max	1.439

name=error_case.art

*mean*	2.338
σ	0.012
min	2.332
max	2.359

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.493
σ	0.337
min	0.329
max	1.096

name=heavy_item.art

*mean*	1.522
σ	0.002
min	1.520
max	1.524

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.222
σ	0.025
min	0.208
max	0.267

name=nested_use.art

*mean*	2.355
σ	0.002
min	2.355
max	2.358

*mean*	402.000
σ	0.000
min	402.000
max	402.000

*mean*	0.331
σ	0.018
min	0.316
max	0.361

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	963.908
σ	0.011
min	963.902
max	963.926

*mean*	432.400
σ	2.510
min	430.000
max	435.000

*mean*	0.526
σ	0.065
min	0.444
max	0.617

name=cdr_enhanced_4k_loc.art

*mean*	884.884
σ	0.002
min	884.883
max	884.886

*mean*	436.000
σ	0.000
min	436.000
max	436.000

*mean*	0.468
σ	0.043
min	0.419
max	0.519

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.706
σ	0.002
min	7.705
max	7.709

*mean*	436.000
σ	0.000
min	436.000
max	436.000

*mean*	2.638
σ	0.116
min	2.470
max	3.085

name=record_render_large_syntax_err.art

*mean*	7.655
σ	0.002
min	7.654
max	7.658

*mean*	436.000
σ	0.000
min	436.000
max	436.000

*mean*	2.608
σ	0.100
min	2.454
max	3.112

name=record_render_success.art

*mean*	2.288
σ	0.002
min	2.287
max	2.291

*mean*	436.000
σ	0.000
min	436.000
max	436.000

*mean*	0.306
σ	0.009
min	0.291
max	0.362

name=record_render_syntax_err.art

*mean*	2.163
σ	0.002
min	2.163
max	2.166

*mean*	436.000
σ	0.000
min	436.000
max	436.000

*mean*	0.297
σ	0.027
min	0.278
max	0.543

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	297.800
σ	0.997
min	297.419
max	300.635

*mean*	440.900
σ	15.631
min	416.000
max	463.000

*mean*	0.606
σ	0.017
min	0.576
max	0.627

Timed compile per phase

Factor

allocated MiB

peak allocated MiB

time (ms)

phase=buildDeclTree

*mean*	222.011
σ	0.000
min	222.011
max	222.011

*mean*	1780.125
σ	22.274
min	1725.000
max	1788.000

*mean*	204.577
σ	2.330
min	201.585
max	209.134

phase=macro expansion

*mean*	6.133
σ	0.000
min	6.133
max	6.133

*mean*	1780.125
σ	22.274
min	1725.000
max	1788.000

*mean*	11.912
σ	1.238
min	9.336
max	12.693

phase=parser

*mean*	1041.161
σ	0.000
min	1041.160
max	1041.161

*mean*	1780.125
σ	22.274
min	1725.000
max	1788.000

*mean*	694.987
σ	46.433
min	589.630
max	724.327

phase=processProdDef

*mean*	6169.658
σ	0.001
min	6169.657
max	6169.659

*mean*	1788.000
σ	0.000
min	1788.000
max	1788.000

*mean*	4391.421
σ	1127.040
min	3127.077
max	6853.679

phase=renaming

*mean*	21.667
σ	0.000
min	21.667
max	21.667

*mean*	1780.125
σ	22.274
min	1725.000
max	1788.000

*mean*	44.828
σ	4.866
min	34.680
max	47.706

phase=type checker

*mean*	958.670
σ	0.066
min	958.573
max	958.760

*mean*	1780.125
σ	22.274
min	1725.000
max	1788.000

*mean*	793.650
σ	73.676
min	664.846
max	876.501

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	292.774
σ	0.041
min	292.720
max	292.817

*mean*	442.200
σ	1.643
min	441.000
max	444.000

*mean*	0.408
σ	0.008
min	0.401
max	0.420

iters=5

new-facts=1

prior-facts=6402

*mean*	1302.916
σ	0.047
min	1302.845
max	1302.971

*mean*	1072.600
σ	171.468
min	834.000
max	1283.000

*mean*	2.148
σ	0.208
min	1.846
max	2.429

iters=5

new-facts=6402

prior-facts=1

*mean*	1545.908
σ	4.031
min	1543.911
max	1553.113

*mean*	616.000
σ	77.330
min	498.000
max	705.000

*mean*	2.291
σ	0.167
min	2.162
max	2.574

iters=5

new-facts=6402

prior-facts=6402

*mean*	1864.826
σ	0.036
min	1864.779
max	1864.870

*mean*	1709.400
σ	230.553
min	1449.000
max	2025.000

*mean*	2.919
σ	0.046
min	2.870
max	2.977

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.718
σ	0.128
min	1.557
max	1.886

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	448.239
σ	579.120
min	158.678
max	1316.919

*mean*	98.250
σ	8.500
min	94.000
max	111.000

*mean*	443.000
σ	0.000
min	443.000
max	443.000

*mean*	0.536
σ	0.539
min	0.263
max	1.344

policies=20

*mean*	1587.089
σ	0.369
min	1586.836
max	1587.636

*mean*	940.000
σ	0.000
min	940.000
max	940.000

*mean*	447.000
σ	4.619
min	443.000
max	451.000

*mean*	2.650
σ	0.011
min	2.638
max	2.666

policies=200

*mean*	15878.994
σ	0.166
min	15878.765
max	15879.146

*mean*	9400.000
σ	0.000
min	9400.000
max	9400.000

*mean*	500.500
σ	5.802
min	493.000
max	506.000

*mean*	26.873
σ	0.142
min	26.773
max	27.083