6a0f2d2c12ba30ed898e7da6e2cafe6b0ccf6b5e

Home / Branches / alexjeffery/lan-54-improve-units-parsing / 6a0f2d2c12ba30ed898e7da6e2cafe6b0ccf6b5e

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.618
σ0.350
min54.483
max55.612
mean416.000
σ0.000
min416.000
max416.000
mean0.141
σ0.004
min0.136
max0.148
cache=y
dps=1
iters=10
policies=100
mean43.785
σ0.006
min43.780
max43.797
mean416.000
σ0.000
min416.000
max416.000
mean0.123
σ0.003
min0.121
max0.128

CSV - indexed operations

Factorallocated MiBpeak allocated MiBtime (ms)
op=column_set() on indexed
mean36.618
σ0.002
min36.616
max36.620
mean4255.250
σ1893.520
min1906.000
max7552.000
mean13.340
σ1.734
min12.167
max17.545
op=column_set() on indexed, repeat
mean36.617
σ0.002
min36.615
max36.620
mean4255.250
σ1893.520
min1906.000
max7552.000
mean12.919
σ1.692
min11.442
max16.680
op=table_records(), no indexes
mean41.932
σ0.000
min41.932
max41.933
mean7552.000
σ0.000
min7552.000
max7552.000
mean14.278
σ0.982
min12.829
max15.527
op=table_records(), repeat
mean41.929
σ0.002
min41.927
max41.931
mean4255.250
σ1893.520
min1906.000
max7552.000
mean12.089
σ1.901
min10.306
max15.089
op=vertical_lookup_list() on indexed, after table_records()
mean27.605
σ0.002
min27.603
max27.609
mean4255.250
σ1893.520
min1906.000
max7552.000
mean8.899
σ1.228
min7.914
max11.792
op=vertical_lookup_list() on indexed, after table_records(), repeat
mean26.400
σ0.002
min26.399
max26.403
mean4255.250
σ1893.520
min1906.000
max7552.000
mean7.006
σ1.070
min5.975
max9.559
op=vertical_lookup_row_list() on 2 indexed
mean25.666
σ0.002
min25.665
max25.668
mean4255.250
σ1893.520
min1906.000
max7552.000
mean5.794
σ0.485
min5.552
max6.988
op=vertical_lookup_row_list() on 3 (1 unindexed)
mean25.968
σ0.002
min25.967
max25.971
mean4255.250
σ1893.520
min1906.000
max7552.000
mean5.567
σ0.534
min5.339
max6.884

CSV - loading a lazy table

Factorallocated MiBpeak allocated MiBtime (ms)
op=load_product(), no indexes
mean2524.597
σ0.000
min2524.597
max2524.597
mean7552.000
σ0.000
min7552.000
max7552.000
mean1055.425
σ7.376
min1046.267
max1065.795
op=load_product(), with indexes
mean8744.558
σ0.033
min8744.544
max8744.641
mean3767.625
σ1633.613
min1906.000
max5947.000
mean4953.184
σ1550.679
min3547.406
max7103.344

CSV - unindexed operations

Factorallocated MiBpeak allocated MiBtime (ms)
op=column_set() on unindexed, dense
mean62.078
σ0.002
min62.075
max62.080
mean4255.250
σ1893.520
min1906.000
max7552.000
mean84.677
σ11.283
min72.419
max104.382
op=vertical_lookup_list() on unindexed missing Int
mean40.944
σ0.001
min40.944
max40.945
mean7552.000
σ0.000
min7552.000
max7552.000
mean237.989
σ385.332
min89.607
max1191.486
op=vertical_lookup_row_list() on unindexed small unique Int
mean66.686
σ0.000
min66.685
max66.687
mean7552.000
σ0.000
min7552.000
max7552.000
mean155.512
σ10.827
min141.792
max168.043

CSV - warmup

Factorallocated MiBpeak allocated MiBtime (ms)
op=table_records()
mean11656.834
σ4.318
min11655.305
max11667.521
mean4255.250
σ1893.520
min1906.000
max7552.000
mean6675.035
σ1389.705
min4962.128
max8226.655
op=vertical_lookup_list() on indexed
mean11560.065
σ0.001
min11560.065
max11560.066
mean7552.000
σ0.000
min7552.000
max7552.000
mean5388.724
σ1211.008
min4430.232
max7280.309

CSV internal benchmark: pointedIndexFromKvs

Factorallocated MiBpeak allocated MiBtime (ms)
op=pointedIndexFromKvs
rows=200000
mean172.582
σ0.028
min172.562
max172.630
mean1906.000
σ0.000
min1906.000
max1906.000
mean350.931
σ54.726
min268.223
max404.645
op=pointedIndexFromKvs
rows=400000
mean357.359
σ0.036
min357.321
max357.408
mean1906.000
σ0.000
min1906.000
max1906.000
mean769.971
σ43.398
min675.147
max811.415

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1008.189
σ0.856
min1007.687
max1011.716
mean1039.100
σ306.256
min544.000
max1467.000
mean1.529
σ0.085
min1.453
max1.751

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.881
max0.886
mean1467.000
σ0.000
min1467.000
max1467.000
mean0.424
σ0.125
min0.344
max0.644
name=error_case.art
mean2.334
σ0.003
min2.332
max2.339
mean1467.000
σ0.000
min1467.000
max1467.000
mean0.885
σ0.089
min0.836
max1.043
name=heavy_item.art
mean1.522
σ0.002
min1.520
max1.524
mean1467.000
σ0.000
min1467.000
max1467.000
mean0.554
σ0.052
min0.510
max0.641
name=nested_use.art
mean2.356
σ0.002
min2.355
max2.358
mean1467.000
σ0.000
min1467.000
max1467.000
mean0.854
σ0.042
min0.821
max0.924

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.543
σ0.024
min963.523
max963.581
mean1467.000
σ0.000
min1467.000
max1467.000
mean0.831
σ0.041
min0.771
max0.864
name=cdr_enhanced_4k_loc.art
mean884.853
σ0.006
min884.847
max884.860
mean1467.000
σ0.000
min1467.000
max1467.000
mean0.738
σ0.029
min0.687
max0.759

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706
σ0.002
min7.705
max7.711
mean1467.000
σ0.000
min1467.000
max1467.000
mean3.542
σ0.090
min3.225
max3.973
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1467.000
σ0.000
min1467.000
max1467.000
mean3.504
σ0.080
min3.375
max3.931
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1467.000
σ0.000
min1467.000
max1467.000
mean0.757
σ0.019
min0.728
max0.875
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1467.000
σ0.000
min1467.000
max1467.000
mean0.713
σ0.015
min0.681
max0.793

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.434
σ0.210
min297.153
max297.832
mean1906.000
σ0.000
min1906.000
max1906.000
mean0.590
σ0.033
min0.518
max0.623

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean289.775
σ0.039
min289.732
max289.816
mean1467.000
σ0.000
min1467.000
max1467.000
mean0.405
σ0.006
min0.398
max0.414
iters=5
new-facts=1
prior-facts=6402
mean1299.644
σ0.062
min1299.571
max1299.711
mean1467.000
σ0.000
min1467.000
max1467.000
mean2.066
σ0.060
min2.007
max2.166
iters=5
new-facts=6402
prior-facts=1
mean1542.628
σ4.033
min1540.670
max1549.838
mean1467.000
σ0.000
min1467.000
max1467.000
mean2.280
σ0.197
min2.109
max2.567
iters=5
new-facts=6402
prior-facts=6402
mean1861.627
σ0.084
min1861.495
max1861.705
mean1738.600
σ182.183
min1479.000
max1906.000
mean3.167
σ0.318
min2.884
max3.684

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.703
σ0.118
min1.563
max1.869

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean446.185
σ577.140
min157.614
max1311.895
mean96.250
σ8.500
min92.000
max109.000
mean1467.000
σ0.000
min1467.000
max1467.000
mean0.534
σ0.541
min0.262
max1.346
policies=20
mean1576.407
σ0.353
min1576.165
max1576.932
mean920.000
σ0.000
min920.000
max920.000
mean1467.000
σ0.000
min1467.000
max1467.000
mean2.623
σ0.010
min2.611
max2.637
policies=200
mean15772.299
σ0.129
min15772.181
max15772.473
mean9200.000
σ0.000
min9200.000
max9200.000
mean1467.000
σ0.000
min1467.000
max1467.000
mean26.498
σ0.075
min26.405
max26.585