baa52e716be63cc0549ca33e313a4d85533416c9

Home / Branches / tomaszwawreniuk/qa-17-calculate-parametrised-derived-datapoints-and-meta-keys-only / baa52e716be63cc0549ca33e313a4d85533416c9

AST compact size (buildDeclTree)

Factorcompact size MiB
phase=buildDeclTree
mean0.203
σ0.000
min0.203
max0.203

AST compact size (macro expansion)

Factorcompact size MiB
phase=macro expansion
mean5.301
σ0.000
min5.301
max5.301

AST compact size (parser)

Factorcompact size MiB
phase=parser
mean5.176
σ0.000
min5.176
max5.176

AST compact size (processProdDef)

Factorcompact size MiB
phase=processProdDef
mean558.695
σ0.000
min558.695
max558.695

AST compact size (renaming)

Factorcompact size MiB
phase=renaming
mean5.488
σ0.000
min5.488
max5.488

AST compact size (type checker)

Factorcompact size MiB
phase=type checker
mean6.676
σ0.000
min6.676
max6.676

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.891
σ0.356
min54.756
max55.903
mean417.000
σ0.000
min417.000
max417.000
mean0.141
σ0.004
min0.136
max0.148
cache=y
dps=1
iters=10
policies=100
mean43.855
σ0.005
min43.847
max43.863
mean417.000
σ0.000
min417.000
max417.000
mean0.125
σ0.005
min0.121
max0.134

CSV - indexed operations

Factorallocated MiBpeak allocated MiBtime (ms)
op=column_set() on indexed
mean36.618
σ0.002
min36.616
max36.621
mean4042.000
σ2008.769
min1216.000
max7144.000
mean12.729
σ0.231
min12.407
max13.076
op=column_set() on indexed, repeat
mean36.618
σ0.002
min36.616
max36.620
mean4042.000
σ2008.769
min1216.000
max7144.000
mean13.021
σ0.637
min11.492
max13.382
op=table_records(), no indexes
mean41.930
σ0.002
min41.929
max41.933
mean7144.000
σ0.000
min7144.000
max7144.000
mean15.098
σ0.189
min14.808
max15.317
op=table_records(), repeat
mean41.930
σ0.002
min41.928
max41.933
mean4042.000
σ2008.769
min1216.000
max7144.000
mean14.523
σ1.482
min11.730
max16.250
op=vertical_lookup_list() on indexed, after table_records()
mean27.654
σ0.136
min27.604
max27.991
mean4042.000
σ2008.769
min1216.000
max7144.000
mean9.856
σ1.682
min8.569
max12.591
op=vertical_lookup_list() on indexed, after table_records(), repeat
mean26.401
σ0.002
min26.400
max26.404
mean4042.000
σ2008.769
min1216.000
max7144.000
mean7.816
σ1.515
min6.728
max10.343
op=vertical_lookup_row_list() on 2 indexed
mean25.668
σ0.004
min25.666
max25.678
mean4042.000
σ2008.769
min1216.000
max7144.000
mean5.929
σ0.135
min5.735
max6.083
op=vertical_lookup_row_list() on 3 (1 unindexed)
mean25.970
σ0.002
min25.969
max25.973
mean4042.000
σ2008.769
min1216.000
max7144.000
mean5.749
σ0.071
min5.632
max5.830

CSV - loading a lazy table

Factorallocated MiBpeak allocated MiBtime (ms)
op=load_product(), no indexes
mean1021.626
σ0.002
min1021.625
max1021.629
mean7144.000
σ0.000
min7144.000
max7144.000
mean370.684
σ44.584
min352.169
max480.938
op=load_product(), with indexes
mean7917.806
σ0.469
min7917.638
max7918.967
mean3274.500
σ1824.413
min809.000
max5623.000
mean3623.506
σ1093.277
min3100.782
max6181.284

CSV - unindexed operations

Factorallocated MiBpeak allocated MiBtime (ms)
op=column_set() on unindexed, dense
mean62.078
σ0.002
min62.077
max62.080
mean4042.000
σ2008.769
min1216.000
max7144.000
mean90.481
σ22.693
min70.160
max124.393
op=vertical_lookup_list() on unindexed missing Int
mean40.946
σ0.002
min40.945
max40.950
mean7144.000
σ0.000
min7144.000
max7144.000
mean61.121
σ1.217
min60.442
max64.103
op=vertical_lookup_row_list() on unindexed small unique Int
mean66.688
σ0.002
min66.686
max66.691
mean7144.000
σ0.000
min7144.000
max7144.000
mean208.924
σ215.492
min98.264
max672.632

CSV - warmup

Factorallocated MiBpeak allocated MiBtime (ms)
op=table_records()
mean14217.202
σ4.291
min14215.576
max14227.820
mean4042.000
σ2008.769
min1216.000
max7144.000
mean8161.220
σ1958.199
min5986.520
max10954.042
op=vertical_lookup_list() on indexed
mean13159.109
σ0.002
min13159.106
max13159.110
mean7144.000
σ0.000
min7144.000
max7144.000
mean5293.080
σ579.005
min5006.314
max6672.843

CSV internal benchmark: pointedIndexFromKvs

Factorallocated MiBpeak allocated MiBtime (ms)
op=pointedIndexFromKvs
rows=200000
mean172.559
σ0.001
min172.558
max172.562
mean477.000
σ0.000
min477.000
max477.000
mean372.715
σ32.926
min298.191
max393.675
op=pointedIndexFromKvs
rows=400000
mean357.322
σ0.001
min357.321
max357.325
mean562.000
σ0.000
min562.000
max562.000
mean756.426
σ50.212
min639.850
max800.615

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean896.270
σ0.760
min895.793
max899.411
mean819.550
σ187.758
min552.000
max1070.000
mean1.532
σ0.068
min1.440
max1.719

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.913
σ0.020
min0.903
max0.949
mean402.000
σ0.000
min402.000
max402.000
mean0.404
σ0.510
min0.144
max1.312
name=error_case.art
mean2.339
σ0.012
min2.333
max2.361
mean402.000
σ0.000
min402.000
max402.000
mean0.474
σ0.324
min0.319
max1.053
name=heavy_item.art
mean1.522
σ0.002
min1.521
max1.525
mean402.000
σ0.000
min402.000
max402.000
mean0.221
σ0.034
min0.198
max0.279
name=nested_use.art
mean2.357
σ0.002
min2.356
max2.360
mean402.000
σ0.000
min402.000
max402.000
mean0.333
σ0.016
min0.322
max0.362

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.852
σ0.011
min964.847
max964.871
mean436.000
σ5.612
min431.000
max442.000
mean0.566
σ0.060
min0.482
max0.610
name=cdr_enhanced_4k_loc.art
mean885.828
σ0.002
min885.826
max885.830
mean442.000
σ0.000
min442.000
max442.000
mean0.502
σ0.044
min0.424
max0.524

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.709
σ0.002
min7.708
max7.712
mean442.000
σ0.000
min442.000
max442.000
mean1.972
σ0.088
min1.819
max2.291
name=record_render_large_syntax_err.art
mean7.657
σ0.002
min7.656
max7.660
mean442.000
σ0.000
min442.000
max442.000
mean2.585
σ0.283
min1.875
max3.111
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.293
mean442.000
σ0.000
min442.000
max442.000
mean0.326
σ0.069
min0.294
max0.829
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean442.000
σ0.000
min442.000
max442.000
mean0.291
σ0.007
min0.279
max0.319

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.426
σ1.001
min299.056
max302.272
mean440.100
σ13.051
min417.000
max462.000
mean0.574
σ0.034
min0.519
max0.616

Timed compile per phase

Factorallocated MiBpeak allocated MiBtime (ms)
phase=buildDeclTree
mean237.534
σ0.000
min237.534
max237.534
mean940.750
σ17.678
min897.000
max947.000
mean201.265
σ3.620
min195.596
max207.451
phase=macro expansion
mean6.146
σ0.000
min6.146
max6.146
mean939.125
σ22.274
min884.000
max947.000
mean9.132
σ2.015
min6.471
max12.866
phase=parser
mean1042.372
σ0.000
min1042.372
max1042.373
mean939.125
σ22.274
min884.000
max947.000
mean494.284
σ109.538
min402.695
max750.716
phase=processProdDef
mean4850.766
σ0.000
min4850.766
max4850.766
mean947.000
σ0.000
min947.000
max947.000
mean4812.917
σ658.866
min3686.248
max5329.542
phase=renaming
mean21.682
σ0.000
min21.682
max21.682
mean939.125
σ22.274
min884.000
max947.000
mean36.949
σ8.936
min20.765
max48.351
phase=type checker
mean993.557
σ0.071
min993.452
max993.671
mean940.625
σ18.031
min896.000
max947.000
mean693.577
σ45.728
min646.924
max791.790

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean293.863
σ0.038
min293.810
max293.902
mean442.400
σ0.548
min442.000
max443.000
mean0.398
σ0.010
min0.390
max0.413
iters=5
new-facts=1
prior-facts=6402
mean1190.641
σ0.057
min1190.580
max1190.701
mean848.200
σ93.684
min742.000
max967.000
mean2.117
σ0.138
min2.027
max2.357
iters=5
new-facts=6402
prior-facts=1
mean1430.964
σ6.212
min1427.983
max1442.073
mean565.200
σ58.195
min504.000
max651.000
mean2.383
σ0.217
min2.081
max2.627
iters=5
new-facts=6402
prior-facts=6402
mean1752.638
σ0.055
min1752.580
max1752.711
mean1247.800
σ169.674
min1073.000
max1487.000
mean2.931
σ0.153
min2.765
max3.105

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.746
σ0.253
min1.297
max1.894

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean452.502
σ583.317
min160.841
max1327.477
mean102.250
σ8.500
min98.000
max115.000
mean448.000
σ0.000
min448.000
max448.000
mean0.552
σ0.556
min0.273
max1.386
policies=20
mean1608.745
σ0.407
min1608.464
max1609.347
mean980.000
σ0.000
min980.000
max980.000
mean448.000
σ0.000
min448.000
max448.000
mean2.676
σ0.010
min2.667
max2.690
policies=200
mean16095.713
σ0.108
min16095.635
max16095.864
mean9800.000
σ0.000
min9800.000
max9800.000
mean497.000
σ5.944
min490.000
max504.000
mean27.140
σ0.095
min27.008
max27.234