7a8ec004f071af3f4ade7ce7fe78a563c486275a

Home / Branches / marcelkalveram/exp-1444-implement-supertable-e2e-tests-advanced / 7a8ec004f071af3f4ade7ce7fe78a563c486275a

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.618
σ0.350
min54.488
max55.612
mean414.000
σ0.000
min414.000
max414.000
mean0.140
σ0.004
min0.136
max0.147
cache=y
dps=1
iters=10
policies=100
mean43.787
σ0.006
min43.780
max43.800
mean414.000
σ0.000
min414.000
max414.000
mean0.124
σ0.004
min0.119
max0.131

CSV - indexed operations

Factorallocated MiBpeak allocated MiBtime (ms)
op=column_set() on indexed
mean36.618
σ0.002
min36.616
max36.620
mean4116.875
σ1565.483
min1984.000
max6035.000
mean12.329
σ0.147
min12.063
max12.484
op=column_set() on indexed, repeat
mean36.617
σ0.002
min36.616
max36.620
mean4116.875
σ1565.483
min1984.000
max6035.000
mean12.256
σ0.619
min11.480
max12.898
op=table_records(), no indexes
mean41.928
σ0.000
min41.928
max41.929
mean6035.000
σ0.000
min6035.000
max6035.000
mean13.063
σ1.175
min10.695
max14.594
op=table_records(), repeat
mean41.929
σ0.002
min41.927
max41.932
mean4051.125
σ1616.770
min1984.000
max6035.000
mean12.591
σ1.917
min10.345
max14.882
op=vertical_lookup_list() on indexed, after table_records()
mean27.605
σ0.002
min27.603
max27.607
mean4051.125
σ1616.770
min1984.000
max6035.000
mean8.417
σ0.423
min7.888
max8.948
op=vertical_lookup_list() on indexed, after table_records(), repeat
mean26.400
σ0.002
min26.399
max26.403
mean4051.125
σ1616.770
min1984.000
max6035.000
mean6.396
σ0.262
min5.983
max6.772
op=vertical_lookup_row_list() on 2 indexed
mean25.666
σ0.002
min25.664
max25.670
mean4116.875
σ1565.483
min1984.000
max6035.000
mean5.484
σ0.177
min5.191
max5.634
op=vertical_lookup_row_list() on 3 (1 unindexed)
mean25.968
σ0.002
min25.967
max25.971
mean4116.875
σ1565.483
min1984.000
max6035.000
mean5.323
σ0.092
min5.160
max5.424

CSV - loading a lazy table

Factorallocated MiBpeak allocated MiBtime (ms)
op=load_product(), no indexes
mean2524.593
σ0.000
min2524.593
max2524.594
mean6035.000
σ0.000
min6035.000
max6035.000
mean1471.050
σ681.338
min1033.405
max2657.461
op=load_product(), with indexes
mean8744.559
σ0.033
min8744.544
max8744.641
mean3830.500
σ1645.898
min1984.000
max6035.000
mean4641.855
σ1479.564
min3564.077
max7187.213

CSV - unindexed operations

Factorallocated MiBpeak allocated MiBtime (ms)
op=column_set() on unindexed, dense
mean62.078
σ0.002
min62.075
max62.081
mean4116.875
σ1565.483
min1984.000
max6035.000
mean121.589
σ122.478
min70.587
max424.092
op=vertical_lookup_list() on unindexed missing Int
mean40.944
σ0.001
min40.944
max40.945
mean6035.000
σ0.000
min6035.000
max6035.000
mean94.582
σ9.718
min81.251
max105.463
op=vertical_lookup_row_list() on unindexed small unique Int
mean66.686
σ0.001
min66.685
max66.690
mean6035.000
σ0.000
min6035.000
max6035.000
mean220.650
σ223.922
min124.532
max773.811

CSV - warmup

Factorallocated MiBpeak allocated MiBtime (ms)
op=table_records()
mean11656.833
σ4.318
min11655.305
max11667.520
mean4051.125
σ1616.770
min1984.000
max6035.000
mean6308.342
σ1288.346
min5017.626
max8246.630
op=vertical_lookup_list() on indexed
mean11560.068
σ0.001
min11560.066
max11560.069
mean6035.000
σ0.000
min6035.000
max6035.000
mean7104.700
σ1362.402
min4463.714
max8461.867

CSV internal benchmark: pointedIndexFromKvs

Factorallocated MiBpeak allocated MiBtime (ms)
op=pointedIndexFromKvs
rows=200000
mean172.581
σ0.028
min172.558
max172.626
mean1984.000
σ0.000
min1984.000
max1984.000
mean336.055
σ45.314
min262.192
max399.870
op=pointedIndexFromKvs
rows=400000
mean357.365
σ0.044
min357.321
max357.429
mean1984.000
σ0.000
min1984.000
max1984.000
mean770.510
σ27.678
min724.058
max813.930

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1008.183
σ0.902
min1007.686
max1011.927
mean1039.050
σ303.481
min557.000
max1467.000
mean1.523
σ0.084
min1.447
max1.742

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.002
min0.881
max0.886
mean1467.000
σ0.000
min1467.000
max1467.000
mean0.435
σ0.142
min0.345
max0.687
name=error_case.art
mean2.333
σ0.003
min2.332
max2.337
mean1467.000
σ0.000
min1467.000
max1467.000
mean0.896
σ0.086
min0.822
max1.045
name=heavy_item.art
mean1.521
σ0.002
min1.520
max1.524
mean1467.000
σ0.000
min1467.000
max1467.000
mean0.548
σ0.048
min0.509
max0.628
name=nested_use.art
mean2.355
σ0.002
min2.355
max2.358
mean1467.000
σ0.000
min1467.000
max1467.000
mean0.897
σ0.053
min0.848
max0.973

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.543
σ0.032
min963.523
max963.598
mean1467.000
σ0.000
min1467.000
max1467.000
mean0.809
σ0.076
min0.710
max0.867
name=cdr_enhanced_4k_loc.art
mean884.853
σ0.006
min884.847
max884.860
mean1467.000
σ0.000
min1467.000
max1467.000
mean0.702
σ0.046
min0.640
max0.749

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706
σ0.002
min7.705
max7.709
mean1467.000
σ0.000
min1467.000
max1467.000
mean4.310
σ0.075
min4.197
max4.558
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.659
mean1467.000
σ0.000
min1467.000
max1467.000
mean4.307
σ0.071
min4.146
max4.498
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1467.000
σ0.000
min1467.000
max1467.000
mean0.760
σ0.020
min0.731
max0.880
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1467.000
σ0.000
min1467.000
max1467.000
mean0.721
σ0.017
min0.687
max0.793

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.427
σ0.223
min297.254
max298.041
mean1984.000
σ0.000
min1984.000
max1984.000
mean0.551
σ0.023
min0.505
max0.583

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean289.776
σ0.036
min289.727
max289.812
mean1467.000
σ0.000
min1467.000
max1467.000
mean0.401
σ0.012
min0.392
max0.422
iters=5
new-facts=1
prior-facts=6402
mean1299.622
σ0.105
min1299.503
max1299.742
mean1467.000
σ0.000
min1467.000
max1467.000
mean1.939
σ0.064
min1.866
max2.006
iters=5
new-facts=6402
prior-facts=1
mean1542.608
σ4.046
min1540.571
max1549.836
mean1467.000
σ0.000
min1467.000
max1467.000
mean2.289
σ0.175
min2.106
max2.485
iters=5
new-facts=6402
prior-facts=6402
mean1861.640
σ0.060
min1861.566
max1861.710
mean1772.000
σ223.951
min1478.000
max1984.000
mean3.150
σ0.246
min2.867
max3.435

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.777
σ0.056
min1.684
max1.833

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean446.184
σ577.139
min157.613
max1311.893
mean96.250
σ8.500
min92.000
max109.000
mean1467.000
σ0.000
min1467.000
max1467.000
mean0.546
σ0.568
min0.260
max1.397
policies=20
mean1576.397
σ0.339
min1576.167
max1576.900
mean920.000
σ0.000
min920.000
max920.000
mean1467.000
σ0.000
min1467.000
max1467.000
mean2.605
σ0.022
min2.587
max2.638
policies=200
mean15772.307
σ0.134
min15772.206
max15772.504
mean9200.000
σ0.000
min9200.000
max9200.000
mean1467.000
σ0.000
min1467.000
max1467.000
mean26.273
σ0.088
min26.150
max26.338