46056923ceefd61a0d86001cd91d2f3712dc697a

Home / Branches / marcelkalveram/exp-1444-implement-supertable-e2e-tests-advanced / 46056923ceefd61a0d86001cd91d2f3712dc697a

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.575
σ0.349
min54.443
max55.567
mean417.000
σ0.000
min417.000
max417.000
mean0.138
σ0.006
min0.131
max0.148
cache=y
dps=1
iters=10
policies=100
mean43.706
σ0.007
min43.695
max43.719
mean417.000
σ0.000
min417.000
max417.000
mean0.123
σ0.005
min0.116
max0.132

CSV - indexed operations

Factorallocated MiBpeak allocated MiBtime (ms)
op=column_set() on indexed
mean36.618
σ0.002
min36.616
max36.620
mean4149.625
σ1896.697
min1552.000
max7290.000
mean12.732
σ0.257
min12.316
max13.045
op=column_set() on indexed, repeat
mean36.617
σ0.002
min36.615
max36.620
mean4149.625
σ1896.697
min1552.000
max7290.000
mean12.508
σ0.603
min11.481
max13.248
op=table_records(), no indexes
mean41.932
σ0.001
min41.929
max41.933
mean7290.000
σ0.000
min7290.000
max7290.000
mean15.485
σ0.366
min14.709
max15.856
op=table_records(), repeat
mean41.928
σ0.002
min41.927
max41.931
mean4149.625
σ1896.697
min1552.000
max7290.000
mean13.096
σ1.838
min11.138
max15.377
op=vertical_lookup_list() on indexed, after table_records()
mean27.653
σ0.136
min27.603
max27.990
mean4149.625
σ1896.697
min1552.000
max7290.000
mean9.229
σ0.475
min8.568
max9.793
op=vertical_lookup_list() on indexed, after table_records(), repeat
mean26.400
σ0.002
min26.399
max26.403
mean4149.625
σ1896.697
min1552.000
max7290.000
mean6.554
σ0.334
min5.963
max6.966
op=vertical_lookup_row_list() on 2 indexed
mean25.666
σ0.002
min25.665
max25.668
mean4149.625
σ1896.697
min1552.000
max7290.000
mean6.069
σ0.213
min5.768
max6.401
op=vertical_lookup_row_list() on 3 (1 unindexed)
mean25.968
σ0.002
min25.967
max25.972
mean4149.625
σ1896.697
min1552.000
max7290.000
mean5.749
σ0.226
min5.438
max6.012

CSV - loading a lazy table

Factorallocated MiBpeak allocated MiBtime (ms)
op=load_product(), no indexes
mean2524.606
σ0.000
min2524.605
max2524.606
mean7290.000
σ0.000
min7290.000
max7290.000
mean1335.091
σ604.639
min1033.938
max2791.194
op=load_product(), with indexes
mean8744.722
σ0.469
min8744.553
max8745.883
mean3572.625
σ1793.779
min1047.000
max5791.000
mean5040.409
σ1665.686
min3506.098
max7261.491

CSV - unindexed operations

Factorallocated MiBpeak allocated MiBtime (ms)
op=column_set() on unindexed, dense
mean62.078
σ0.002
min62.076
max62.080
mean4149.625
σ1896.697
min1552.000
max7290.000
mean84.111
σ10.578
min70.799
max99.314
op=vertical_lookup_list() on unindexed missing Int
mean40.944
σ0.001
min40.944
max40.945
mean7290.000
σ0.000
min7290.000
max7290.000
mean107.285
σ4.086
min98.112
max109.992
op=vertical_lookup_row_list() on unindexed small unique Int
mean66.686
σ0.000
min66.685
max66.687
mean7290.000
σ0.000
min7290.000
max7290.000
mean164.229
σ8.864
min143.849
max170.260

CSV - warmup

Factorallocated MiBpeak allocated MiBtime (ms)
op=table_records()
mean11656.836
σ4.324
min11655.305
max11667.537
mean4149.625
σ1896.697
min1552.000
max7290.000
mean6325.082
σ1177.293
min4881.249
max7900.242
op=vertical_lookup_list() on indexed
mean11560.065
σ0.001
min11560.064
max11560.066
mean7290.000
σ0.000
min7290.000
max7290.000
mean5118.083
σ1213.303
min4399.571
max7567.563

CSV internal benchmark: pointedIndexFromKvs

Factorallocated MiBpeak allocated MiBtime (ms)
op=pointedIndexFromKvs
rows=200000
mean172.559
σ0.001
min172.558
max172.562
mean477.000
σ0.000
min477.000
max477.000
mean377.757
σ18.256
min347.410
max392.502
op=pointedIndexFromKvs
rows=400000
mean357.322
σ0.001
min357.321
max357.325
mean560.000
σ0.000
min560.000
max560.000
mean760.213
σ43.946
min660.788
max801.183

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1008.502
σ0.760
min1008.025
max1011.641
mean1054.650
σ309.709
min561.000
max1467.000
mean1.515
σ0.063
min1.463
max1.733

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.913
σ0.020
min0.903
max0.949
mean402.000
σ0.000
min402.000
max402.000
mean0.457
σ0.487
min0.154
max1.306
name=error_case.art
mean2.339
σ0.012
min2.333
max2.361
mean402.000
σ0.000
min402.000
max402.000
mean0.474
σ0.322
min0.317
max1.050
name=heavy_item.art
mean1.522
σ0.002
min1.521
max1.525
mean402.000
σ0.000
min402.000
max402.000
mean0.221
σ0.019
min0.205
max0.253
name=nested_use.art
mean2.357
σ0.002
min2.356
max2.360
mean402.000
σ0.000
min402.000
max402.000
mean0.336
σ0.018
min0.319
max0.365

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.741
σ0.011
min964.736
max964.760
mean436.600
σ6.066
min431.000
max443.000
mean0.526
σ0.050
min0.479
max0.607
name=cdr_enhanced_4k_loc.art
mean885.814
σ0.002
min885.812
max885.816
mean443.000
σ0.000
min443.000
max443.000
mean0.462
σ0.047
min0.394
max0.524

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.708
σ0.002
min7.707
max7.711
mean443.000
σ0.000
min443.000
max443.000
mean2.605
σ0.082
min2.462
max2.893
name=record_render_large_syntax_err.art
mean7.656
σ0.002
min7.655
max7.659
mean443.000
σ0.000
min443.000
max443.000
mean2.583
σ0.086
min2.461
max3.069
name=record_render_success.art
mean2.289
σ0.002
min2.288
max2.292
mean443.000
σ0.000
min443.000
max443.000
mean0.303
σ0.010
min0.288
max0.373
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean443.000
σ0.000
min443.000
max443.000
mean0.295
σ0.047
min0.273
max0.753

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.956
σ1.000
min297.583
max300.799
mean442.900
σ18.640
min416.000
max467.000
mean0.617
σ0.012
min0.600
max0.636

Timed compile per phase

Factorallocated MiBpeak allocated MiBtime (ms)
phase=buildDeclTree
mean222.008
σ0.000
min222.008
max222.008
mean1744.000
σ0.000
min1744.000
max1744.000
mean215.517
σ22.520
min205.092
max270.978
phase=macro expansion
mean6.130
σ0.000
min6.130
max6.130
mean1744.000
σ0.000
min1744.000
max1744.000
mean10.732
σ1.539
min9.362
max12.609
phase=parser
mean1042.099
σ0.000
min1042.098
max1042.099
mean1744.000
σ0.000
min1744.000
max1744.000
mean660.536
σ63.350
min572.848
max728.305
phase=processProdDef
mean6169.656
σ0.001
min6169.655
max6169.657
mean1744.000
σ0.000
min1744.000
max1744.000
mean5593.148
σ1484.733
min3461.004
max7323.249
phase=renaming
mean21.667
σ0.000
min21.667
max21.667
mean1744.000
σ0.000
min1744.000
max1744.000
mean43.382
σ5.415
min34.184
max49.716
phase=type checker
mean958.457
σ0.066
min958.360
max958.547
mean1744.000
σ0.000
min1744.000
max1744.000
mean795.471
σ85.665
min660.556
max881.200

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean293.689
σ0.041
min293.631
max293.732
mean445.000
σ0.000
min445.000
max445.000
mean0.404
σ0.009
min0.397
max0.419
iters=5
new-facts=1
prior-facts=6402
mean1303.777
σ0.085
min1303.648
max1303.856
mean1099.200
σ190.985
min837.000
max1329.000
mean2.124
σ0.334
min1.813
max2.613
iters=5
new-facts=6402
prior-facts=1
mean1546.814
σ4.045
min1544.806
max1554.044
mean618.000
σ80.215
min497.000
max712.000
mean2.282
σ0.209
min2.143
max2.644
iters=5
new-facts=6402
prior-facts=6402
mean1865.781
σ0.068
min1865.723
max1865.892
mean1729.400
σ176.452
min1479.000
max1891.000
mean3.097
σ0.353
min2.892
max3.725

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.583
σ0.110
min1.388
max1.650

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.981
σ579.242
min158.357
max1316.844
mean96.250
σ8.500
min92.000
max109.000
mean443.000
σ0.000
min443.000
max443.000
mean0.543
σ0.547
min0.268
max1.363
policies=20
mean1583.923
σ0.360
min1583.674
max1584.455
mean920.000
σ0.000
min920.000
max920.000
mean444.500
σ1.000
min443.000
max445.000
mean2.654
σ0.007
min2.647
max2.664
policies=200
mean15847.071
σ0.187
min15846.965
max15847.351
mean9200.000
σ0.000
min9200.000
max9200.000
mean496.000
σ5.292
min491.000
max503.000
mean26.631
σ0.193
min26.441
max26.848