6da8ab69e83d3a6456033863b9e0e35dddda877f

Home / Branches / exp-1444-implement-supertable-e2e-tests / 6da8ab69e83d3a6456033863b9e0e35dddda877f

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.616
σ0.350
min54.478
max55.613
mean416.000
σ0.000
min416.000
max416.000
mean0.140
σ0.003
min0.136
max0.145
cache=y
dps=1
iters=10
policies=100
mean43.786
σ0.006
min43.776
max43.799
mean416.000
σ0.000
min416.000
max416.000
mean0.123
σ0.004
min0.120
max0.130

CSV - indexed operations

Factorallocated MiBpeak allocated MiBtime (ms)
op=column_set() on indexed
mean36.618
σ0.002
min36.616
max36.620
mean4102.500
σ1574.760
min1961.000
max6047.000
mean12.411
σ0.330
min11.966
max12.694
op=column_set() on indexed, repeat
mean36.617
σ0.002
min36.615
max36.619
mean4102.500
σ1574.760
min1961.000
max6047.000
mean12.001
σ0.607
min11.198
max13.019
op=table_records(), no indexes
mean41.932
σ0.000
min41.932
max41.933
mean6047.000
σ0.000
min6047.000
max6047.000
mean13.308
σ1.183
min11.363
max15.102
op=table_records(), repeat
mean41.928
σ0.002
min41.927
max41.932
mean4102.500
σ1574.760
min1961.000
max6047.000
mean13.107
σ2.095
min10.621
max15.701
op=vertical_lookup_list() on indexed, after table_records()
mean27.605
σ0.002
min27.603
max27.609
mean4102.500
σ1574.760
min1961.000
max6047.000
mean9.239
σ1.258
min8.136
max12.169
op=vertical_lookup_list() on indexed, after table_records(), repeat
mean26.400
σ0.002
min26.399
max26.403
mean4102.500
σ1574.760
min1961.000
max6047.000
mean6.855
σ1.214
min6.210
max9.824
op=vertical_lookup_row_list() on 2 indexed
mean25.666
σ0.002
min25.665
max25.670
mean4102.500
σ1574.760
min1961.000
max6047.000
mean5.677
σ0.074
min5.565
max5.797
op=vertical_lookup_row_list() on 3 (1 unindexed)
mean25.968
σ0.002
min25.967
max25.971
mean4102.500
σ1574.760
min1961.000
max6047.000
mean5.400
σ0.076
min5.256
max5.492

CSV - loading a lazy table

Factorallocated MiBpeak allocated MiBtime (ms)
op=load_product(), no indexes
mean2524.597
σ0.001
min2524.597
max2524.598
mean6047.000
σ0.000
min6047.000
max6047.000
mean1456.715
σ681.749
min1042.753
max2933.060
op=load_product(), with indexes
mean8744.558
σ0.032
min8744.545
max8744.639
mean3819.375
σ1655.702
min1961.000
max6047.000
mean4650.378
σ1506.776
min3573.007
max7594.343

CSV - unindexed operations

Factorallocated MiBpeak allocated MiBtime (ms)
op=column_set() on unindexed, dense
mean62.077
σ0.002
min62.076
max62.080
mean4102.500
σ1574.760
min1961.000
max6047.000
mean88.346
σ17.826
min71.545
max121.116
op=vertical_lookup_list() on unindexed missing Int
mean40.944
σ0.001
min40.944
max40.945
mean6047.000
σ0.000
min6047.000
max6047.000
mean95.355
σ8.646
min81.993
max106.448
op=vertical_lookup_row_list() on unindexed small unique Int
mean66.686
σ0.001
min66.685
max66.689
mean6047.000
σ0.000
min6047.000
max6047.000
mean225.284
σ233.246
min126.888
max801.602

CSV - warmup

Factorallocated MiBpeak allocated MiBtime (ms)
op=table_records()
mean11656.833
σ4.317
min11655.305
max11667.517
mean4102.500
σ1574.760
min1961.000
max6047.000
mean6504.478
σ1262.406
min4992.525
max8507.639
op=vertical_lookup_list() on indexed
mean11560.065
σ0.000
min11560.064
max11560.066
mean6047.000
σ0.000
min6047.000
max6047.000
mean6806.318
σ1192.907
min4487.236
max8089.245

CSV internal benchmark: pointedIndexFromKvs

Factorallocated MiBpeak allocated MiBtime (ms)
op=pointedIndexFromKvs
rows=200000
mean172.584
σ0.024
min172.558
max172.617
mean1961.000
σ0.000
min1961.000
max1961.000
mean376.586
σ21.489
min352.047
max406.255
op=pointedIndexFromKvs
rows=400000
mean357.360
σ0.043
min357.321
max357.426
mean1961.000
σ0.000
min1961.000
max1961.000
mean762.982
σ60.313
min618.271
max800.912

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1008.185
σ0.903
min1007.689
max1011.937
mean1040.900
σ306.965
min548.000
max1472.000
mean1.536
σ0.106
min1.454
max1.807

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.002
min0.881
max0.886
mean1472.000
σ0.000
min1472.000
max1472.000
mean0.418
σ0.135
min0.340
max0.658
name=error_case.art
mean2.333
σ0.003
min2.332
max2.337
mean1472.000
σ0.000
min1472.000
max1472.000
mean0.890
σ0.087
min0.819
max1.040
name=heavy_item.art
mean1.521
σ0.002
min1.520
max1.524
mean1472.000
σ0.000
min1472.000
max1472.000
mean0.550
σ0.063
min0.491
max0.643
name=nested_use.art
mean2.355
σ0.002
min2.355
max2.358
mean1472.000
σ0.000
min1472.000
max1472.000
mean0.855
σ0.039
min0.826
max0.924

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.548
σ0.036
min963.523
max963.610
mean1472.000
σ0.000
min1472.000
max1472.000
mean0.825
σ0.014
min0.814
max0.849
name=cdr_enhanced_4k_loc.art
mean884.853
σ0.006
min884.847
max884.858
mean1472.000
σ0.000
min1472.000
max1472.000
mean0.733
σ0.016
min0.707
max0.749

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706
σ0.002
min7.705
max7.712
mean1472.000
σ0.000
min1472.000
max1472.000
mean4.322
σ0.082
min4.188
max4.622
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.662
mean1472.000
σ0.000
min1472.000
max1472.000
mean4.277
σ0.075
min4.074
max4.538
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1472.000
σ0.000
min1472.000
max1472.000
mean0.757
σ0.017
min0.732
max0.859
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1472.000
σ0.000
min1472.000
max1472.000
mean0.717
σ0.015
min0.684
max0.781

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.550
σ0.178
min297.390
max298.009
mean1961.000
σ0.000
min1961.000
max1961.000
mean0.563
σ0.062
min0.501
max0.715

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean289.775
σ0.036
min289.720
max289.808
mean1472.000
σ0.000
min1472.000
max1472.000
mean0.401
σ0.010
min0.394
max0.418
iters=5
new-facts=1
prior-facts=6402
mean1299.622
σ0.104
min1299.502
max1299.760
mean1472.000
σ0.000
min1472.000
max1472.000
mean1.939
σ0.059
min1.866
max2.001
iters=5
new-facts=6402
prior-facts=1
mean1542.606
σ4.040
min1540.585
max1549.825
mean1472.000
σ0.000
min1472.000
max1472.000
mean2.194
σ0.156
min2.014
max2.405
iters=5
new-facts=6402
prior-facts=6402
mean1861.649
σ0.071
min1861.571
max1861.734
mean1757.600
σ215.898
min1472.000
max1961.000
mean3.260
σ0.373
min2.848
max3.762

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.668
σ0.142
min1.487
max1.842

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean446.184
σ577.140
min157.613
max1311.893
mean96.250
σ8.500
min92.000
max109.000
mean1472.000
σ0.000
min1472.000
max1472.000
mean0.534
σ0.543
min0.260
max1.349
policies=20
mean1576.400
σ0.339
min1576.174
max1576.905
mean920.000
σ0.000
min920.000
max920.000
mean1472.000
σ0.000
min1472.000
max1472.000
mean2.610
σ0.011
min2.595
max2.620
policies=200
mean15772.252
σ0.071
min15772.190
max15772.327
mean9200.000
σ0.000
min9200.000
max9200.000
mean1472.000
σ0.000
min1472.000
max1472.000
mean26.288
σ0.018
min26.272
max26.312