6215a082b4f944103d44aa89887152869d5edf41

Home / Branches / sergeiwinitzki/lan-43-fix-csv-benchmark / 6215a082b4f944103d44aa89887152869d5edf41

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.523
σ0.370
min54.385
max55.575
mean415.000
σ0.000
min415.000
max415.000
mean0.139
σ0.006
min0.132
max0.147
cache=y
dps=1
iters=10
policies=100
mean43.766
σ0.006
min43.757
max43.780
mean415.000
σ0.000
min415.000
max415.000
mean0.124
σ0.004
min0.120
max0.131

CSV - indexed operations

Factorallocated MiBpeak allocated MiBtime (ms)
op=column_set() on indexed
mean36.618
σ0.002
min36.615
max36.620
mean4264.125
σ1878.969
min1976.000
max7543.000
mean12.883
σ1.727
min11.886
max17.115
op=column_set() on indexed, repeat
mean36.617
σ0.002
min36.616
max36.620
mean4264.125
σ1878.969
min1976.000
max7543.000
mean12.956
σ1.860
min11.424
max17.382
op=table_records(), no indexes
mean41.928
σ0.000
min41.928
max41.929
mean7543.000
σ0.000
min7543.000
max7543.000
mean13.395
σ1.427
min10.678
max14.805
op=table_records(), repeat
mean41.928
σ0.002
min41.927
max41.932
mean4264.125
σ1878.969
min1976.000
max7543.000
mean12.385
σ2.123
min10.307
max15.023
op=vertical_lookup_list() on indexed, after table_records()
mean27.605
σ0.002
min27.603
max27.607
mean4264.125
σ1878.969
min1976.000
max7543.000
mean8.738
σ1.318
min7.803
max11.819
op=vertical_lookup_list() on indexed, after table_records(), repeat
mean26.400
σ0.002
min26.399
max26.403
mean4264.125
σ1878.969
min1976.000
max7543.000
mean6.610
σ1.274
min5.880
max9.710
op=vertical_lookup_row_list() on 2 indexed
mean25.666
σ0.002
min25.665
max25.670
mean4264.125
σ1878.969
min1976.000
max7543.000
mean5.641
σ0.535
min5.356
max6.960
op=vertical_lookup_row_list() on 3 (1 unindexed)
mean25.968
σ0.002
min25.967
max25.971
mean4264.125
σ1878.969
min1976.000
max7543.000
mean5.440
σ0.503
min4.991
max6.623

CSV - loading a lazy table

Factorallocated MiBpeak allocated MiBtime (ms)
op=load_product(), no indexes
mean2524.594
σ0.000
min2524.594
max2524.594
mean7543.000
σ0.000
min7543.000
max7543.000
mean1099.776
σ160.868
min1028.472
max1497.231
op=load_product(), with indexes
mean8744.559
σ0.033
min8744.544
max8744.640
mean3787.125
σ1610.387
min1976.000
max5947.000
mean4829.529
σ1578.639
min3523.643
max7563.326

CSV - unindexed operations

Factorallocated MiBpeak allocated MiBtime (ms)
op=column_set() on unindexed, dense
mean62.078
σ0.002
min62.076
max62.080
mean4264.125
σ1878.969
min1976.000
max7543.000
mean87.590
σ11.794
min75.569
max110.639
op=vertical_lookup_list() on unindexed missing Int
mean40.944
σ0.001
min40.944
max40.945
mean7543.000
σ0.000
min7543.000
max7543.000
mean97.730
σ11.114
min77.621
max108.101
op=vertical_lookup_row_list() on unindexed small unique Int
mean66.686
σ0.000
min66.686
max66.686
mean7543.000
σ0.000
min7543.000
max7543.000
mean148.232
σ17.233
min116.515
max165.356

CSV - warmup

Factorallocated MiBpeak allocated MiBtime (ms)
op=table_records()
mean11656.833
σ4.318
min11655.305
max11667.520
mean4264.125
σ1878.969
min1976.000
max7543.000
mean6683.259
σ1285.837
min4900.735
max8053.327
op=vertical_lookup_list() on indexed
mean11560.069
σ0.001
min11560.068
max11560.070
mean7543.000
σ0.000
min7543.000
max7543.000
mean5636.849
σ1326.021
min4421.057
max7481.210

CSV internal benchmark: pointedIndexFromKvs

Factorallocated MiBpeak allocated MiBtime (ms)
op=pointedIndexFromKvs
rows=200000
mean172.583
σ0.023
min172.558
max172.615
mean1976.000
σ0.000
min1976.000
max1976.000
mean352.412
σ39.650
min262.359
max392.803
op=pointedIndexFromKvs
rows=400000
mean357.359
σ0.037
min357.321
max357.398
mean1976.000
σ0.000
min1976.000
max1976.000
mean778.567
σ23.640
min738.105
max816.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1008.185
σ0.877
min1007.684
max1011.812
mean1038.050
σ305.459
min544.000
max1464.000
mean1.564
σ0.095
min1.471
max1.786

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.002
min0.881
max0.886
mean1464.000
σ0.000
min1464.000
max1464.000
mean0.419
σ0.132
min0.346
max0.654
name=error_case.art
mean2.333
σ0.003
min2.332
max2.337
mean1464.000
σ0.000
min1464.000
max1464.000
mean0.882
σ0.090
min0.825
max1.041
name=heavy_item.art
mean1.521
σ0.002
min1.520
max1.524
mean1464.000
σ0.000
min1464.000
max1464.000
mean0.537
σ0.050
min0.506
max0.626
name=nested_use.art
mean2.355
σ0.002
min2.355
max2.358
mean1464.000
σ0.000
min1464.000
max1464.000
mean0.855
σ0.047
min0.812
max0.929

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.541
σ0.032
min963.523
max963.596
mean1464.000
σ0.000
min1464.000
max1464.000
mean0.791
σ0.073
min0.694
max0.867
name=cdr_enhanced_4k_loc.art
mean884.853
σ0.006
min884.847
max884.860
mean1464.000
σ0.000
min1464.000
max1464.000
mean0.720
σ0.046
min0.638
max0.744

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706
σ0.002
min7.705
max7.709
mean1464.000
σ0.000
min1464.000
max1464.000
mean4.225
σ0.079
min4.113
max4.586
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1464.000
σ0.000
min1464.000
max1464.000
mean4.214
σ0.084
min4.070
max4.555
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1464.000
σ0.000
min1464.000
max1464.000
mean0.736
σ0.018
min0.702
max0.860
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1464.000
σ0.000
min1464.000
max1464.000
mean0.699
σ0.014
min0.673
max0.783

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.555
σ0.199
min297.433
max298.109
mean1976.000
σ0.000
min1976.000
max1976.000
mean0.563
σ0.037
min0.510
max0.605

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean289.767
σ0.038
min289.717
max289.808
mean1464.000
σ0.000
min1464.000
max1464.000
mean0.392
σ0.009
min0.387
max0.407
iters=5
new-facts=1
prior-facts=6402
mean1299.652
σ0.062
min1299.583
max1299.709
mean1464.000
σ0.000
min1464.000
max1464.000
mean2.084
σ0.058
min2.015
max2.149
iters=5
new-facts=6402
prior-facts=1
mean1542.603
σ4.017
min1540.593
max1549.781
mean1464.000
σ0.000
min1464.000
max1464.000
mean2.229
σ0.116
min2.128
max2.401
iters=5
new-facts=6402
prior-facts=6402
mean1861.620
σ0.075
min1861.503
max1861.698
mean1765.600
σ222.149
min1474.000
max1976.000
mean3.243
σ0.380
min2.863
max3.689

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.837
σ0.049
min1.767
max1.895

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean446.142
σ577.065
min157.607
max1311.740
mean96.250
σ8.500
min92.000
max109.000
mean1464.000
σ0.000
min1464.000
max1464.000
mean0.554
σ0.561
min0.267
max1.395
policies=20
mean1576.370
σ0.334
min1576.138
max1576.866
mean920.000
σ0.000
min920.000
max920.000
mean1464.000
σ0.000
min1464.000
max1464.000
mean2.600
σ0.015
min2.582
max2.617
policies=200
mean15771.978
σ0.105
min15771.877
max15772.085
mean9200.000
σ0.000
min9200.000
max9200.000
mean1464.000
σ0.000
min1464.000
max1464.000
mean26.515
σ0.094
min26.410
max26.612