Compare commits

Aggregation: measureAggregations

Factor

allocated MiB

peak allocated MiB

time_s

cache=n

dps=1

iters=10

policies=100

*mean*	54.616-70.375=-15.759
σ	0.350-0.058=0.292
min	54.483-70.339=-15.856
max	55.610-70.536=-14.926

*mean*	414.000-417.000=-3.000
σ	0.000
min	414.000-417.000=-3.000
max	414.000-417.000=-3.000

*mean*	0.136-0.160=-0.024
σ	0.006-0.002=0.003
min	0.130-0.157=-0.027
max	0.145-0.164=-0.019

cache=y

dps=1

iters=10

policies=100

*mean*	43.786-21.142=22.644
σ	0.008-0.003=0.005
min	43.777-21.139=22.638
max	43.803-21.147=22.656

*mean*	414.000-417.000=-3.000
σ	0.000
min	414.000-417.000=-3.000
max	414.000-417.000=-3.000

*mean*	0.122-0.061=0.060
σ	0.005-0.003=0.002
min	0.114-0.059=0.055
max	0.129-0.070=0.059

CSV - indexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on indexed

*mean*	36.618
σ	0.002
min	36.615
max	36.620

*mean*	4250.625
σ	1894.699
min	1884.000
max	7539.000

*mean*	12.549
σ	0.265
min	12.095
max	13.015

op=column_set() on indexed, repeat

*mean*	36.617
σ	0.002
min	36.615
max	36.620

*mean*	4250.625
σ	1894.699
min	1884.000
max	7539.000

*mean*	12.539
σ	0.684
min	11.498
max	13.303

op=table_records(), no indexes

*mean*	41.928
σ	0.000
min	41.928
max	41.929

*mean*	7539.000
σ	0.000
min	7539.000
max	7539.000

*mean*	13.833
σ	1.001
min	12.667
max	15.253

op=table_records(), repeat

*mean*	41.928
σ	0.002
min	41.927
max	41.931

*mean*	4250.625
σ	1894.699
min	1884.000
max	7539.000

*mean*	12.552
σ	1.780
min	10.188
max	14.965

op=vertical_lookup_list() on indexed, after table_records()

*mean*	27.605
σ	0.002
min	27.603
max	27.607

*mean*	4250.625
σ	1894.699
min	1884.000
max	7539.000

*mean*	8.870
σ	1.014
min	8.056
max	10.539

op=vertical_lookup_list() on indexed, after table_records(), repeat

*mean*	26.400
σ	0.002
min	26.399
max	26.403

*mean*	4250.625
σ	1894.699
min	1884.000
max	7539.000

*mean*	6.811
σ	1.002
min	5.911
max	8.429

op=vertical_lookup_row_list() on 2 indexed

*mean*	25.666
σ	0.002
min	25.664
max	25.670

*mean*	4250.625
σ	1894.699
min	1884.000
max	7539.000

*mean*	5.521
σ	0.150
min	5.309
max	5.758

op=vertical_lookup_row_list() on 3 (1 unindexed)

*mean*	25.968
σ	0.002
min	25.967
max	25.971

*mean*	4250.625
σ	1894.699
min	1884.000
max	7539.000

*mean*	5.420
σ	0.123
min	5.319
max	5.658

CSV - loading a lazy table

Factor

allocated MiB

peak allocated MiB

time (ms)

op=load_product(), no indexes

*mean*	2524.594
σ	0.001
min	2524.594
max	2524.598

*mean*	7539.000
σ	0.000
min	7539.000
max	7539.000

*mean*	1058.527
σ	7.762
min	1049.860
max	1072.308

op=load_product(), with indexes

*mean*	8744.559
σ	0.033
min	8744.544
max	8744.640

*mean*	3759.750
σ	1638.957
min	1884.000
max	5939.000

*mean*	4684.269
σ	1621.620
min	3551.965
max	7814.220

CSV - unindexed operations

Factor

allocated MiB

peak allocated MiB

time (ms)

op=column_set() on unindexed, dense

*mean*	62.078
σ	0.002
min	62.076
max	62.080

*mean*	4250.625
σ	1894.699
min	1884.000
max	7539.000

*mean*	87.906
σ	12.325
min	70.343
max	100.030

op=vertical_lookup_list() on unindexed missing Int

*mean*	40.944
σ	0.001
min	40.944
max	40.945

*mean*	7539.000
σ	0.000
min	7539.000
max	7539.000

*mean*	249.750
σ	419.694
min	88.562
max	1288.325

op=vertical_lookup_row_list() on unindexed small unique Int

*mean*	66.686
σ	0.000
min	66.685
max	66.686

*mean*	7539.000
σ	0.000
min	7539.000
max	7539.000

*mean*	150.290
σ	14.623
min	126.440
max	167.088

CSV - warmup

Factor

allocated MiB

peak allocated MiB

time (ms)

op=table_records()

*mean*	11656.833
σ	4.318
min	11655.305
max	11667.520

*mean*	4250.625
σ	1894.699
min	1884.000
max	7539.000

*mean*	6541.240
σ	1137.262
min	4908.641
max	7992.148

op=vertical_lookup_list() on indexed

*mean*	11560.068
σ	0.001
min	11560.066
max	11560.069

*mean*	7539.000
σ	0.000
min	7539.000
max	7539.000

*mean*	5507.632
σ	1371.417
min	4392.043
max	7283.253

CSV internal benchmark: pointedIndexFromKvs

Factor

allocated MiB

peak allocated MiB

time (ms)

op=pointedIndexFromKvs

rows=200000

*mean*	172.586
σ	0.022
min	172.558
max	172.613

*mean*	1884.000
σ	0.000
min	1884.000
max	1884.000

*mean*	369.721
σ	21.995
min	345.388
max	415.562

op=pointedIndexFromKvs

rows=400000

*mean*	357.362
σ	0.043
min	357.321
max	357.405

*mean*	1884.000
σ	0.000
min	1884.000
max	1884.000

*mean*	791.520
σ	13.369
min	766.556
max	808.795

Marine Hull: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

datapoints=1

iterations=20

*mean*	1008.186-1752.199=-744.013
σ	0.878-0.362=0.517
min	1007.684-1751.628=-743.944
max	1011.822-1752.780=-740.958

*mean*	1049.900-1664.300=-614.400
σ	314.091-625.500=-311.410
min	576.000-685.000=-109.000
max	1514.000-2749.000=-1235.000

*mean*	1.551-2.813=-1.262
σ	0.078-0.194=-0.116
min	1.474-2.277=-0.803
max	1.757-3.031=-1.274

Parser: Comma Sep

Factor

allocated MiB

peak allocated MiB

time (ms)

name=ambiguous_item.art

*mean*	0.883
σ	0.002
min	0.881
max	0.886

*mean*	1514.000
σ	0.000
min	1514.000
max	1514.000

*mean*	0.438
σ	0.175
min	0.336
max	0.750

name=error_case.art

*mean*	2.333
σ	0.003
min	2.332
max	2.337

*mean*	1514.000
σ	0.000
min	1514.000
max	1514.000

*mean*	0.913
σ	0.187
min	0.809
max	1.245

name=heavy_item.art

*mean*	1.521
σ	0.002
min	1.520
max	1.524

*mean*	1514.000
σ	0.000
min	1514.000
max	1514.000

*mean*	0.532
σ	0.051
min	0.492
max	0.621

name=nested_use.art

*mean*	2.355
σ	0.002
min	2.355
max	2.358

*mean*	1514.000
σ	0.000
min	1514.000
max	1514.000

*mean*	0.831
σ	0.034
min	0.807
max	0.891

Parser: Real World

Factor

allocated MiB

peak allocated MiB

time (sec)

name=aon_gpf25_7k_loc.art

*mean*	963.552
σ	0.039
min	963.523
max	963.620

*mean*	1514.000
σ	0.000
min	1514.000
max	1514.000

*mean*	0.845
σ	0.028
min	0.811
max	0.877

name=cdr_enhanced_4k_loc.art

*mean*	884.853
σ	0.005
min	884.847
max	884.860

*mean*	1514.000
σ	0.000
min	1514.000
max	1514.000

*mean*	0.736
σ	0.016
min	0.707
max	0.746

Parser: Record Parsing

Factor

allocated MiB

peak allocated MiB

time (ms)

name=record_render_large_success.art

*mean*	7.706
σ	0.002
min	7.705
max	7.710

*mean*	1514.000
σ	0.000
min	1514.000
max	1514.000

*mean*	4.263
σ	0.077
min	4.115
max	4.509

name=record_render_large_syntax_err.art

*mean*	7.655
σ	0.002
min	7.654
max	7.658

*mean*	1514.000
σ	0.000
min	1514.000
max	1514.000

*mean*	4.268
σ	0.110
min	4.089
max	4.930

name=record_render_success.art

*mean*	2.288
σ	0.002
min	2.287
max	2.291

*mean*	1514.000
σ	0.000
min	1514.000
max	1514.000

*mean*	0.740
σ	0.018
min	0.716
max	0.856

name=record_render_syntax_err.art

*mean*	2.163
σ	0.002
min	2.163
max	2.166

*mean*	1514.000
σ	0.000
min	1514.000
max	1514.000

*mean*	0.708
σ	0.014
min	0.671
max	0.766

SoV import

Factor

allocated MiB

peak allocated MiB

time_s

iters=10

rows=1000

*mean*	297.509
σ	0.211
min	297.334
max	298.082

*mean*	1884.000
σ	0.000
min	1884.000
max	1884.000

*mean*	0.593
σ	0.030
min	0.519
max	0.641

Workflow: transactPolicy

Factor

allocated MiB

peak allocated MiB

time

iters=5

new-facts=1

prior-facts=1

*mean*	289.774-269.907=19.867
σ	0.035-0.007=0.028
min	289.733-269.896=19.836
max	289.813-269.915=19.898

*mean*	1514.000-2749.000=-1235.000
σ	0.000
min	1514.000-2749.000=-1235.000
max	1514.000-2749.000=-1235.000

*mean*	0.402-0.374=0.028
σ	0.009-0.005=0.004
min	0.394-0.370=0.024
max	0.413-0.379=0.034

iters=5

new-facts=1

prior-facts=6402

*mean*	1299.646-1930.393=-630.747
σ	0.078-0.006=0.072
min	1299.547-1930.385=-630.838
max	1299.733-1930.399=-630.666

*mean*	1514.000-2749.000=-1235.000
σ	0.000
min	1514.000-2749.000=-1235.000
max	1514.000-2749.000=-1235.000

*mean*	2.058-2.526=-0.468
σ	0.060-0.124=-0.064
min	1.981-2.356=-0.375
max	2.122-2.658=-0.536

iters=5

new-facts=6402

prior-facts=1

*mean*	1542.612-4750.853=-3208.241
σ	4.067-0.816=3.250
min	1540.608-4750.339=-3209.731
max	1549.879-4752.304=-3202.426

*mean*	1514.000-2749.000=-1235.000
σ	0.000
min	1514.000-2749.000=-1235.000
max	1514.000-2749.000=-1235.000

*mean*	2.237-8.500=-6.263
σ	0.185-0.534=-0.349
min	2.100-7.614=-5.515
max	2.555-8.873=-6.318

iters=5

new-facts=6402

prior-facts=6402

*mean*	1861.625-4941.262=-3079.637
σ	0.080-0.125=-0.045
min	1861.505-4941.072=-3079.568
max	1861.707-4941.423=-3079.716

*mean*	1735.000-3024.600=-1289.600
σ	157.839-249.937=-92.098
min	1514.000-2749.000=-1235.000
max	1884.000-3362.000=-1478.000

*mean*	3.097-8.504=-5.407
σ	0.237-0.106=0.131
min	2.827-8.368=-5.541
max	3.454-8.628=-5.173

newProductH/cdr_auton/broker

Factor

time_s

iterations=5

*mean*	1.580-1.052=0.528
σ	0.259-0.124=0.134
min	1.306-0.942=0.365
max	1.833-1.246=0.588

policy addition benchmark

Factor

allocated MiB

db queries

peak allocated MiB

time

policies=2

*mean*	446.147-465.912=-19.765
σ	577.063-575.770=1.293
min	157.615-178.020=-20.405
max	1311.741-1329.567=-17.826

*mean*	96.250-81.750=14.500
σ	8.500-7.500=1.000
min	92.000-78.000=14.000
max	109.000-93.000=16.000

*mean*	1514.000-2749.000=-1235.000
σ	0.000
min	1514.000-2749.000=-1235.000
max	1514.000-2749.000=-1235.000

*mean*	0.543-0.567=-0.024
σ	0.559-0.561=-0.001
min	0.261-0.283=-0.022
max	1.382-1.408=-0.026

policies=20

*mean*	1576.417-1780.434=-204.017
σ	0.344-0.347=-0.002
min	1576.184-1780.202=-204.018
max	1576.929-1780.949=-204.020

*mean*	920.000-780.000=140.000
σ	0.000
min	920.000-780.000=140.000
max	920.000-780.000=140.000

*mean*	1514.000-2749.000=-1235.000
σ	0.000
min	1514.000-2749.000=-1235.000
max	1514.000-2749.000=-1235.000

*mean*	2.614-2.766=-0.152
σ	0.005-0.021=-0.016
min	2.609-2.746=-0.136
max	2.621-2.794=-0.174

policies=200

*mean*	15772.278-17811.233=-2038.955
σ	0.104-0.525=-0.421
min	15772.210-17810.803=-2038.593
max	15772.431-17811.996=-2039.565

*mean*	9200.000-7800.000=1400.000
σ	0.000
min	9200.000-7800.000=1400.000
max	9200.000-7800.000=1400.000

*mean*	1514.000-2749.000=-1235.000
σ	0.000
min	1514.000-2749.000=-1235.000
max	1514.000-2749.000=-1235.000

*mean*	26.387-27.773=-1.386
σ	0.026-0.159=-0.133
min	26.359-27.659=-1.301
max	26.421-28.008=-1.587