ccc1ca075747b9522634d88176d8c5330fcc3370

Home / Branches / marcelkalveram/exp-1444-implement-supertable-e2e-tests-advanced / ccc1ca075747b9522634d88176d8c5330fcc3370

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.579
σ0.349
min54.448
max55.573
mean421.000
σ0.000
min421.000
max421.000
mean0.149
σ0.012
min0.131
max0.166
cache=y
dps=1
iters=10
policies=100
mean43.706
σ0.006
min43.695
max43.715
mean421.000
σ0.000
min421.000
max421.000
mean0.123
σ0.005
min0.119
max0.134

CSV - indexed operations

Factorallocated MiBpeak allocated MiBtime (ms)
op=column_set() on indexed
mean36.618
σ0.002
min36.615
max36.620
mean4153.250
σ1900.491
min1553.000
max7304.000
mean12.889
σ0.223
min12.512
max13.217
op=column_set() on indexed, repeat
mean36.617
σ0.002
min36.616
max36.620
mean4153.250
σ1900.491
min1553.000
max7304.000
mean13.093
σ0.373
min12.259
max13.410
op=table_records(), no indexes
mean41.932
σ0.001
min41.928
max41.933
mean7304.000
σ0.000
min7304.000
max7304.000
mean15.034
σ0.719
min13.357
max15.660
op=table_records(), repeat
mean41.928
σ0.002
min41.927
max41.931
mean4153.250
σ1900.491
min1553.000
max7304.000
mean12.926
σ1.665
min10.766
max15.100
op=vertical_lookup_list() on indexed, after table_records()
mean27.653
σ0.136
min27.603
max27.990
mean4153.250
σ1900.491
min1553.000
max7304.000
mean8.829
σ0.224
min8.531
max9.107
op=vertical_lookup_list() on indexed, after table_records(), repeat
mean26.400
σ0.002
min26.399
max26.403
mean4153.250
σ1900.491
min1553.000
max7304.000
mean6.970
σ0.130
min6.755
max7.124
op=vertical_lookup_row_list() on 2 indexed
mean25.666
σ0.002
min25.665
max25.668
mean4153.250
σ1900.491
min1553.000
max7304.000
mean6.007
σ0.110
min5.875
max6.224
op=vertical_lookup_row_list() on 3 (1 unindexed)
mean25.968
σ0.002
min25.967
max25.972
mean4153.250
σ1900.491
min1553.000
max7304.000
mean5.777
σ0.070
min5.678
max5.889

CSV - loading a lazy table

Factorallocated MiBpeak allocated MiBtime (ms)
op=load_product(), no indexes
mean2524.606
σ0.000
min2524.606
max2524.607
mean7304.000
σ0.000
min7304.000
max7304.000
mean1073.047
σ94.525
min1034.331
max1306.688
op=load_product(), with indexes
mean8744.722
σ0.469
min8744.553
max8745.883
mean3573.500
σ1795.854
min1047.000
max5794.000
mean4946.950
σ1640.693
min3533.367
max7297.896

CSV - unindexed operations

Factorallocated MiBpeak allocated MiBtime (ms)
op=column_set() on unindexed, dense
mean62.078
σ0.002
min62.076
max62.081
mean4153.250
σ1900.491
min1553.000
max7304.000
mean78.569
σ7.687
min70.648
max94.784
op=vertical_lookup_list() on unindexed missing Int
mean40.944
σ0.001
min40.944
max40.945
mean7304.000
σ0.000
min7304.000
max7304.000
mean107.315
σ4.725
min98.382
max114.193
op=vertical_lookup_row_list() on unindexed small unique Int
mean66.686
σ0.000
min66.685
max66.687
mean7304.000
σ0.000
min7304.000
max7304.000
mean162.639
σ7.707
min144.378
max167.418

CSV - warmup

Factorallocated MiBpeak allocated MiBtime (ms)
op=table_records()
mean11656.836
σ4.324
min11655.305
max11667.538
mean4153.250
σ1900.491
min1553.000
max7304.000
mean6742.110
σ1241.533
min4918.854
max8288.731
op=vertical_lookup_list() on indexed
mean11560.065
σ0.001
min11560.064
max11560.066
mean7304.000
σ0.000
min7304.000
max7304.000
mean5437.851
σ1378.969
min4380.614
max7603.258

CSV internal benchmark: pointedIndexFromKvs

Factorallocated MiBpeak allocated MiBtime (ms)
op=pointedIndexFromKvs
rows=200000
mean172.559
σ0.001
min172.558
max172.562
mean477.000
σ0.000
min477.000
max477.000
mean369.392
σ35.799
min302.140
max395.456
op=pointedIndexFromKvs
rows=400000
mean357.322
σ0.001
min357.321
max357.325
mean560.000
σ0.000
min560.000
max560.000
mean781.726
σ26.938
min726.306
max808.460

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1008.499
σ0.760
min1008.024
max1011.641
mean1044.450
σ310.859
min572.000
max1502.000
mean1.526
σ0.078
min1.424
max1.762

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.913
σ0.020
min0.903
max0.949
mean402.000
σ0.000
min402.000
max402.000
mean0.394
σ0.503
min0.137
max1.290
name=error_case.art
mean2.339
σ0.012
min2.333
max2.361
mean402.000
σ0.000
min402.000
max402.000
mean0.472
σ0.322
min0.319
max1.048
name=heavy_item.art
mean1.522
σ0.002
min1.521
max1.525
mean402.000
σ0.000
min402.000
max402.000
mean0.218
σ0.021
min0.201
max0.253
name=nested_use.art
mean2.357
σ0.002
min2.356
max2.360
mean402.000
σ0.000
min402.000
max402.000
mean0.339
σ0.025
min0.315
max0.373

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.741
σ0.011
min964.736
max964.760
mean433.200
σ2.588
min431.000
max436.000
mean0.583
σ0.032
min0.528
max0.613
name=cdr_enhanced_4k_loc.art
mean885.814
σ0.002
min885.812
max885.816
mean436.000
σ0.000
min436.000
max436.000
mean0.478
σ0.064
min0.374
max0.527

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.708
σ0.002
min7.707
max7.711
mean436.000
σ0.000
min436.000
max436.000
mean2.660
σ0.101
min2.479
max3.091
name=record_render_large_syntax_err.art
mean7.656
σ0.002
min7.655
max7.659
mean436.000
σ0.000
min436.000
max436.000
mean2.590
σ0.083
min2.457
max2.917
name=record_render_success.art
mean2.289
σ0.002
min2.288
max2.292
mean436.000
σ0.000
min436.000
max436.000
mean0.305
σ0.012
min0.282
max0.373
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean436.000
σ0.000
min436.000
max436.000
mean0.291
σ0.007
min0.281
max0.325

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean298.100
σ0.997
min297.713
max300.935
mean444.200
σ15.866
min422.000
max471.000
mean0.609
σ0.017
min0.582
max0.645

Timed compile per phase

Factorallocated MiBpeak allocated MiBtime (ms)
phase=buildDeclTree
mean222.008
σ0.000
min222.008
max222.008
mean1761.750
σ7.869
min1749.000
max1766.000
mean206.884
σ4.016
min202.252
max212.931
phase=macro expansion
mean6.130
σ0.000
min6.130
max6.130
mean1761.750
σ7.869
min1749.000
max1766.000
mean8.018
σ1.950
min6.101
max10.180
phase=parser
mean1042.098
σ0.000
min1042.098
max1042.098
mean1761.750
σ7.869
min1749.000
max1766.000
mean630.888
σ157.262
min383.221
max835.359
phase=processProdDef
mean6169.659
σ0.000
min6169.659
max6169.660
mean1763.875
σ6.010
min1749.000
max1766.000
mean5569.503
σ1445.582
min3739.423
max7437.021
phase=renaming
mean21.670
σ0.000
min21.670
max21.670
mean1761.750
σ7.869
min1749.000
max1766.000
mean29.153
σ6.030
min20.229
max36.935
phase=type checker
mean958.537
σ0.066
min958.439
max958.626
mean1761.750
σ7.869
min1749.000
max1766.000
mean678.668
σ64.825
min629.136
max765.389

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean293.379
σ0.034
min293.331
max293.415
mean445.000
σ0.000
min445.000
max445.000
mean0.405
σ0.007
min0.400
max0.413
iters=5
new-facts=1
prior-facts=6402
mean1303.462
σ0.088
min1303.313
max1303.539
mean1085.000
σ225.493
min824.000
max1382.000
mean2.009
σ0.168
min1.753
max2.141
iters=5
new-facts=6402
prior-facts=1
mean1546.537
σ4.018
min1544.579
max1553.720
mean624.200
σ92.896
min494.000
max737.000
mean2.352
σ0.206
min2.171
max2.680
iters=5
new-facts=6402
prior-facts=6402
mean1865.439
σ0.043
min1865.395
max1865.503
mean1688.600
σ166.983
min1514.000
max1939.000
mean2.881
σ0.139
min2.715
max3.090

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.748
σ0.176
min1.440
max1.874

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.988
σ579.254
min158.357
max1316.870
mean96.250
σ8.500
min92.000
max109.000
mean441.000
σ0.000
min441.000
max441.000
mean0.543
σ0.561
min0.261
max1.384
policies=20
mean1583.920
σ0.355
min1583.669
max1584.444
mean920.000
σ0.000
min920.000
max920.000
mean445.500
σ5.196
min441.000
max450.000
mean2.629
σ0.017
min2.604
max2.641
policies=200
mean15847.102
σ0.109
min15846.954
max15847.189
mean9200.000
σ0.000
min9200.000
max9200.000
mean495.250
σ3.304
min491.000
max499.000
mean26.568
σ0.130
min26.444
max26.732