7ab75174613d8ea76f5344141f9412fa7c30bd9b

Home / Branches / josephyoung/exp-1444-implement-super-basic-inputs-e2e-test / 7ab75174613d8ea76f5344141f9412fa7c30bd9b

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.617
σ0.350
min54.484
max55.612
mean415.000
σ0.000
min415.000
max415.000
mean0.143
σ0.005
min0.136
max0.151
cache=y
dps=1
iters=10
policies=100
mean43.786
σ0.006
min43.779
max43.798
mean415.000
σ0.000
min415.000
max415.000
mean0.123
σ0.004
min0.119
max0.130

CSV - indexed operations

Factorallocated MiBpeak allocated MiBtime (ms)
op=column_set() on indexed
mean36.618
σ0.002
min36.615
max36.620
mean4268.625
σ1880.006
min1984.000
max7556.000
mean12.407
σ0.312
min11.832
max12.864
op=column_set() on indexed, repeat
mean36.617
σ0.002
min36.616
max36.620
mean4268.625
σ1880.006
min1984.000
max7556.000
mean12.443
σ0.550
min11.593
max12.994
op=table_records(), no indexes
mean41.928
σ0.000
min41.928
max41.929
mean7556.000
σ0.000
min7556.000
max7556.000
mean13.872
σ1.164
min12.312
max15.207
op=table_records(), repeat
mean41.928
σ0.002
min41.927
max41.932
mean4268.625
σ1880.006
min1984.000
max7556.000
mean12.477
σ2.218
min10.287
max15.388
op=vertical_lookup_list() on indexed, after table_records()
mean27.605
σ0.002
min27.603
max27.607
mean4268.625
σ1880.006
min1984.000
max7556.000
mean8.819
σ1.340
min7.951
max12.092
op=vertical_lookup_list() on indexed, after table_records(), repeat
mean26.400
σ0.002
min26.399
max26.403
mean4268.625
σ1880.006
min1984.000
max7556.000
mean6.629
σ1.260
min5.185
max9.522
op=vertical_lookup_row_list() on 2 indexed
mean25.666
σ0.003
min25.664
max25.672
mean4268.625
σ1880.006
min1984.000
max7556.000
mean5.366
σ0.148
min5.117
max5.507
op=vertical_lookup_row_list() on 3 (1 unindexed)
mean25.968
σ0.002
min25.967
max25.971
mean4268.625
σ1880.006
min1984.000
max7556.000
mean5.211
σ0.059
min5.099
max5.269

CSV - loading a lazy table

Factorallocated MiBpeak allocated MiBtime (ms)
op=load_product(), no indexes
mean2524.594
σ0.000
min2524.594
max2524.594
mean7556.000
σ0.000
min7556.000
max7556.000
mean1041.801
σ8.660
min1029.657
max1054.133
op=load_product(), with indexes
mean8744.559
σ0.032
min8744.545
max8744.639
mean3789.250
σ1608.131
min1984.000
max5946.000
mean4243.893
σ1169.983
min3502.366
max6517.220

CSV - unindexed operations

Factorallocated MiBpeak allocated MiBtime (ms)
op=column_set() on unindexed, dense
mean62.078
σ0.002
min62.075
max62.080
mean4268.625
σ1880.006
min1984.000
max7556.000
mean87.722
σ13.601
min71.934
max111.112
op=vertical_lookup_list() on unindexed missing Int
mean40.944
σ0.001
min40.944
max40.948
mean7556.000
σ0.000
min7556.000
max7556.000
mean246.021
σ409.479
min89.091
max1259.290
op=vertical_lookup_row_list() on unindexed small unique Int
mean66.686
σ0.000
min66.685
max66.687
mean7556.000
σ0.000
min7556.000
max7556.000
mean153.148
σ11.437
min141.628
max168.205

CSV - warmup

Factorallocated MiBpeak allocated MiBtime (ms)
op=table_records()
mean11656.833
σ4.318
min11655.305
max11667.520
mean4268.625
σ1880.006
min1984.000
max7556.000
mean5790.247
σ1117.992
min4863.424
max7928.792
op=vertical_lookup_list() on indexed
mean11560.068
σ0.001
min11560.066
max11560.069
mean7556.000
σ0.000
min7556.000
max7556.000
mean5155.407
σ1123.335
min4345.615
max7359.690

CSV internal benchmark: pointedIndexFromKvs

Factorallocated MiBpeak allocated MiBtime (ms)
op=pointedIndexFromKvs
rows=200000
mean172.582
σ0.026
min172.558
max172.626
mean1984.000
σ0.000
min1984.000
max1984.000
mean362.868
σ43.042
min269.384
max402.871
op=pointedIndexFromKvs
rows=400000
mean357.361
σ0.043
min357.321
max357.410
mean1984.000
σ0.000
min1984.000
max1984.000
mean784.969
σ16.660
min745.897
max800.472

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1008.189
σ0.866
min1007.683
max1011.765
mean1044.450
σ292.836
min565.000
max1432.000
mean1.508
σ0.046
min1.458
max1.618

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.002
min0.881
max0.886
mean1432.000
σ0.000
min1432.000
max1432.000
mean0.434
σ0.144
min0.357
max0.690
name=error_case.art
mean2.333
σ0.003
min2.332
max2.337
mean1432.000
σ0.000
min1432.000
max1432.000
mean0.922
σ0.190
min0.821
max1.261
name=heavy_item.art
mean1.521
σ0.002
min1.520
max1.524
mean1432.000
σ0.000
min1432.000
max1432.000
mean0.535
σ0.052
min0.488
max0.622
name=nested_use.art
mean2.355
σ0.002
min2.355
max2.358
mean1432.000
σ0.000
min1432.000
max1432.000
mean0.838
σ0.044
min0.805
max0.914

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.547
σ0.033
min963.523
max963.605
mean1432.000
σ0.000
min1432.000
max1432.000
mean0.817
σ0.039
min0.776
max0.860
name=cdr_enhanced_4k_loc.art
mean884.853
σ0.008
min884.847
max884.864
mean1432.000
σ0.000
min1432.000
max1432.000
mean0.699
σ0.053
min0.616
max0.745

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706
σ0.002
min7.705
max7.711
mean1432.000
σ0.000
min1432.000
max1432.000
mean3.514
σ0.069
min3.376
max3.815
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.659
mean1432.000
σ0.000
min1432.000
max1432.000
mean3.509
σ0.087
min3.382
max3.827
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1432.000
σ0.000
min1432.000
max1432.000
mean0.741
σ0.018
min0.711
max0.853
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1432.000
σ0.000
min1432.000
max1432.000
mean0.706
σ0.014
min0.672
max0.763

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.424
σ0.202
min297.270
max297.959
mean1984.000
σ0.000
min1984.000
max1984.000
mean0.558
σ0.036
min0.506
max0.592

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean289.771
σ0.038
min289.717
max289.808
mean1432.000
σ0.000
min1432.000
max1432.000
mean0.394
σ0.008
min0.388
max0.408
iters=5
new-facts=1
prior-facts=6402
mean1299.622
σ0.100
min1299.506
max1299.735
mean1432.000
σ0.000
min1432.000
max1432.000
mean1.955
σ0.060
min1.861
max2.022
iters=5
new-facts=6402
prior-facts=1
mean1542.605
σ4.026
min1540.602
max1549.798
mean1432.000
σ0.000
min1432.000
max1432.000
mean2.216
σ0.169
min2.044
max2.418
iters=5
new-facts=6402
prior-facts=6402
mean1861.648
σ0.067
min1861.570
max1861.724
mean1770.200
σ225.493
min1473.000
max1984.000
mean3.147
σ0.295
min2.860
max3.569

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.664
σ0.086
min1.563
max1.758

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean446.148
σ577.065
min157.614
max1311.745
mean96.250
σ8.500
min92.000
max109.000
mean1432.000
σ0.000
min1432.000
max1432.000
mean0.534
σ0.543
min0.261
max1.348
policies=20
mean1576.425
σ0.360
min1576.184
max1576.960
mean920.000
σ0.000
min920.000
max920.000
mean1432.000
σ0.000
min1432.000
max1432.000
mean2.631
σ0.019
min2.612
max2.657
policies=200
mean15772.310
σ0.104
min15772.226
max15772.459
mean9200.000
σ0.000
min9200.000
max9200.000
mean1432.000
σ0.000
min1432.000
max1432.000
mean26.480
σ0.090
min26.389
max26.570