Compare commits

Home / Compare cdb7cc10 .. 8bf807c2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

CSV - column_set() on indexed

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=column_set() on indexed
rows=200000
mean36.783
σ0.002
min36.781
max36.785
mean9804.000
σ0.000
min9804.000
max9804.000
mean13.376
σ0.458
min12.653
max13.982
iterations=10
operation_display=column_set() on indexed
rows=200000
scenario_id=mixed_indexes/benchmark4
step_id=column_set.indexed.4
mean36.783
σ0.002
min36.781
max36.785
mean9574.000
σ0.000
min9574.000
max9574.000
mean13.240
σ0.326
min12.550
max13.672
iterations=10
operation_display=column_set() on indexed, repeat
rows=200000
mean36.783
σ0.002
min36.781
max36.785
mean9804.000
σ0.000
min9804.000
max9804.000
mean13.009
σ0.547
min12.223
max13.891
iterations=10
operation_display=column_set() on indexed, repeat
rows=200000
scenario_id=mixed_indexes/benchmark4
step_id=column_set.indexed.repeat.4
mean36.783
σ0.003
min36.781
max36.788
mean9574.000
σ0.000
min9574.000
max9574.000
mean92.028
σ205.651
min12.215
max663.999

CSV - column_set() on unindexed

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=column_set() on unindexed, dense, repeat
rows=200000
mean62.241
σ0.000
min62.241
max62.241
mean5086.500
σ2509.664
min1297.000
max8381.000
mean106.990
σ14.383
min79.469
max118.602
iterations=10
operation_display=column_set() on unindexed, dense, repeat
rows=200000
scenario_id=mixed_indexes/benchmark1
step_id=column_set.unindexed.dense.repeat.1
mean62.241
σ0.000
min62.241
max62.242
mean5218.400
σ2577.148
min1268.000
max8619.000
mean102.447
σ14.949
min74.469
max120.625
iterations=10
operation_display=column_set() on unindexed, sparse, repeat
rows=200000
mean70.832
σ0.002
min70.830
max70.834
mean9804.000
σ0.000
min9804.000
max9804.000
mean139.831
σ5.166
min131.539
max148.728
iterations=10
operation_display=column_set() on unindexed, sparse, repeat
rows=200000
scenario_id=no_indexes/benchmark3
step_id=column_set.unindexed.sparse.repeat.3
mean70.832
σ0.002
min70.830
max70.834
mean9574.000
σ0.000
min9574.000
max9574.000
mean137.802
σ6.449
min122.263
max145.754

CSV - column_set(), warmup

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=column_set() on unindexed, dense
rows=200000
mean15109.841
σ3.993
min15108.577
max15121.206
mean5086.500
σ2509.664
min1297.000
max8381.000
mean10337.854
σ1966.407
min6610.779
max12033.518
iterations=10
operation_display=column_set() on unindexed, dense
rows=200000
scenario_id=mixed_indexes/benchmark1
step_id=column_set.unindexed.dense.1
mean15109.841
σ3.993
min15108.577
max15121.205
mean5218.400
σ2577.148
min1268.000
max8619.000
mean9497.259
σ1930.396
min6742.339
max11727.827
iterations=10
operation_display=column_set() on unindexed, sparse
rows=200000
mean14060.904
σ0.005
min14060.899
max14060.910
mean9804.000
σ0.000
min9804.000
max9804.000
mean6838.172
σ1454.580
min5462.941
max8935.807
iterations=10
operation_display=column_set() on unindexed, sparse
rows=200000
scenario_id=no_indexes/benchmark3
step_id=column_set.unindexed.sparse.3
mean14060.903
σ0.004
min14060.899
max14060.912
mean9574.000
σ0.000
min9574.000
max9574.000
mean6634.859
σ1660.548
min5478.495
max10260.077

CSV - loading a lazy table

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=load_product()
rows=200000
mean8744.667
σ0.418
min8744.531
max8745.856
mean4688.300
σ2487.452
min1051.000
max8381.000
mean4951.119
σ1538.749
min3497.933
max7292.302
iterations=10
operation_display=load_product()
rows=200000
scenario_id=mixed_indexes/benchmark1
step_id=load_product.1
mean8744.667
σ0.417
min8744.531
max8745.854
mean4844.000
σ2511.652
min1043.000
max8619.000
mean4531.465
σ1320.007
min3503.270
max6734.436
iterations=10
operation_display=load_product()
rows=200000
scenario_id=mixed_indexes/benchmark2
step_id=load_product.2
mean8744.534
σ0.003
min8744.530
max8744.539
mean8619.000
σ0.000
min8619.000
max8619.000
mean4213.319
σ1143.837
min3500.468
max6226.504
iterations=10
operation_display=load_product()
rows=200000
scenario_id=mixed_indexes/benchmark4
step_id=load_product.4.mixed_indexes
mean8744.535
σ0.003
min8744.531
max8744.540
mean9574.000
σ0.000
min9574.000
max9574.000
mean4870.190
σ1442.789
min3507.968
max7128.090
iterations=10
operation_display=load_product(), no indexes
rows=200000
mean2524.581
σ0.002
min2524.579
max2524.584
mean9804.000
σ0.000
min9804.000
max9804.000
mean1091.560
σ144.192
min1034.767
max1501.659
iterations=10
operation_display=load_product(), no indexes
rows=200000
scenario_id=no_indexes/benchmark3
step_id=load_product.3.no_indexes
mean2524.583
σ0.004
min2524.579
max2524.591
mean9574.000
σ0.000
min9574.000
max9574.000
mean1423.374
σ833.068
min1021.510
max3366.740

CSV - table_records()

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=table_records()
rows=200000
mean42.069
σ0.002
min42.066
max42.072
mean9804.000
σ0.000
min9804.000
max9804.000
mean14.443
σ1.338
min11.146
max15.529
iterations=10
operation_display=table_records()
rows=200000
scenario_id=no_indexes/benchmark3
step_id=table_records.3
mean42.069
σ0.002
min42.066
max42.071
mean9574.000
σ0.000
min9574.000
max9574.000
mean14.085
σ1.758
min11.118
max16.261
iterations=10
operation_display=table_records(), repeat
rows=200000
mean42.067
σ0.002
min42.066
max42.070
mean8523.300
σ449.992
min8381.000
max9804.000
mean12.917
σ1.891
min11.308
max15.826
iterations=10
operation_display=table_records(), repeat
rows=200000
scenario_id=mixed_indexes/benchmark2
step_id=table_records.repeat.2
mean42.068
σ0.002
min42.066
max42.071
mean8714.500
σ301.998
min8619.000
max9574.000
mean13.233
σ1.564
min11.740
max16.543
iterations=10
operation_display=table_records(), repeat
rows=200000
scenario_id=no_indexes/benchmark3
step_id=table_records.repeat.3
mean42.069
σ0.002
min42.066
max42.071
mean9574.000
σ0.000
min9574.000
max9574.000
mean12.669
σ1.525
min10.752
max15.342

CSV - table_records(), warmup

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=table_records()
rows=200000
mean15088.407
σ0.003
min15088.403
max15088.411
mean8523.300
σ449.992
min8381.000
max9804.000
mean9611.924
σ2057.889
min6640.943
max11646.023
iterations=10
operation_display=table_records()
rows=200000
scenario_id=mixed_indexes/benchmark2
step_id=table_records.2
mean15088.408
σ0.003
min15088.403
max15088.413
mean8714.500
σ301.998
min8619.000
max9574.000
mean9394.319
σ1998.389
min6604.096
max11476.951

CSV - vertical_lookup_list() on indexed

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=vertical_lookup_list() on indexed, repeat
rows=200000
mean26.567
σ0.002
min26.565
max26.569
mean5086.500
σ2509.664
min1297.000
max8381.000
mean7.292
σ0.350
min6.594
max7.789
iterations=10
operation_display=vertical_lookup_list() on indexed, repeat
rows=200000
scenario_id=mixed_indexes/benchmark1
step_id=vertical_lookup_list.indexed.repeat.1
mean26.567
σ0.002
min26.565
max26.569
mean5218.400
σ2577.148
min1268.000
max8619.000
mean7.387
σ0.401
min6.613
max7.817
iterations=10
operation_display=vertical_lookup_list() on indexed, repeat
rows=200000
scenario_id=mixed_indexes/benchmark2
step_id=vertical_lookup_list.indexed.repeat.2
mean26.567
σ0.002
min26.565
max26.569
mean8714.500
σ301.998
min8619.000
max9574.000
mean6.896
σ0.889
min6.094
max8.985
iterations=10
operation_display=vertical_lookup_list() on indexed, repeat
rows=200000
scenario_id=mixed_indexes/benchmark4
step_id=vertical_lookup_list.indexed.repeat.4
mean26.567
σ0.003
min26.565
max26.572
mean9574.000
σ0.000
min9574.000
max9574.000
mean8.292
σ0.298
min7.732
max8.575

CSV - vertical_lookup_list() on unindexed

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=vertical_lookup_list() on unindexed missing Int
rows=200000
mean41.112
σ0.002
min41.109
max41.116
mean9804.000
σ0.000
min9804.000
max9804.000
mean204.494
σ330.404
min86.903
max1144.653
iterations=10
operation_display=vertical_lookup_list() on unindexed missing Int
rows=200000
scenario_id=no_indexes/benchmark3
step_id=vertical_lookup_list.unindexed.missing_int.3
mean41.111
σ0.002
min41.110
max41.114
mean9574.000
σ0.000
min9574.000
max9574.000
mean95.035
σ17.050
min64.817
max108.296
iterations=10
operation_display=vertical_lookup_list() on unindexed missing Int, repeat
rows=200000
mean41.112
σ0.002
min41.109
max41.114
mean9804.000
σ0.000
min9804.000
max9804.000
mean98.172
σ8.729
min81.567
max106.874
iterations=10
operation_display=vertical_lookup_list() on unindexed missing Int, repeat
rows=200000
scenario_id=no_indexes/benchmark3
step_id=vertical_lookup_list.unindexed.missing_int.repeat.3
mean41.112
σ0.002
min41.109
max41.114
mean9574.000
σ0.000
min9574.000
max9574.000
mean94.218
σ18.074
min64.363
max109.670
iterations=10
operation_display=vertical_lookup_list() on unindexed unique Int near end, repeat
rows=200000
mean41.116
σ0.002
min41.115
max41.120
mean9804.000
σ0.000
min9804.000
max9804.000
mean100.449
σ6.611
min87.241
max105.997
iterations=10
operation_display=vertical_lookup_list() on unindexed unique Int near end, repeat
rows=200000
scenario_id=no_indexes/benchmark3
step_id=vertical_lookup_list.unindexed.tail_unique_int.repeat.3
mean41.117
σ0.002
min41.115
max41.120
mean9574.000
σ0.000
min9574.000
max9574.000
mean194.064
σ303.501
min72.054
max1056.997

CSV - vertical_lookup_list(), mini warmup

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=vertical_lookup_list() on indexed
rows=200000
mean27.771
σ0.003
min27.769
max27.778
mean5086.500
σ2509.664
min1297.000
max8381.000
mean9.948
σ0.652
min8.829
max10.568
iterations=10
operation_display=vertical_lookup_list() on indexed
rows=200000
scenario_id=mixed_indexes/benchmark1
step_id=vertical_lookup_list.indexed.1
mean27.771
σ0.003
min27.769
max27.778
mean5218.400
σ2577.148
min1268.000
max8619.000
mean9.759
σ0.718
min8.714
max10.499
iterations=10
operation_display=vertical_lookup_list() on indexed
rows=200000
scenario_id=mixed_indexes/benchmark2
step_id=vertical_lookup_list.indexed.2
mean27.771
σ0.002
min27.769
max27.773
mean8714.500
σ301.998
min8619.000
max9574.000
mean9.157
σ0.802
min8.443
max11.052
iterations=10
operation_display=vertical_lookup_list() on unindexed unique Int near end
rows=200000
mean41.117
σ0.002
min41.114
max41.119
mean9804.000
σ0.000
min9804.000
max9804.000
mean100.917
σ6.958
min86.917
max106.360
iterations=10
operation_display=vertical_lookup_list() on unindexed unique Int near end
rows=200000
scenario_id=no_indexes/benchmark3
step_id=vertical_lookup_list.unindexed.tail_unique_int.3
mean41.117
σ0.002
min41.114
max41.122
mean9574.000
σ0.000
min9574.000
max9574.000
mean167.321
σ207.315
min76.031
max756.651

CSV - vertical_lookup_list(), warmup

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=vertical_lookup_list() on indexed
rows=200000
mean15074.110
σ0.003
min15074.106
max15074.114
mean9804.000
σ0.000
min9804.000
max9804.000
mean9323.317
σ1967.760
min6560.235
max12186.100
iterations=10
operation_display=vertical_lookup_list() on indexed
rows=200000
scenario_id=mixed_indexes/benchmark4
step_id=vertical_lookup_list.indexed.4
mean15074.109
σ0.002
min15074.106
max15074.113
mean9574.000
σ0.000
min9574.000
max9574.000
mean10263.945
σ2139.286
min6553.331
max12353.869

CSV - vertical_lookup_row_list() on indexed

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=vertical_lookup_row_list() on 2 indexed
rows=200000
mean25.801
σ0.002
min25.798
max25.804
mean8523.300
σ449.992
min8381.000
max9804.000
mean5.297
σ0.102
min5.138
max5.423
iterations=10
operation_display=vertical_lookup_row_list() on 2 indexed
rows=200000
scenario_id=mixed_indexes/benchmark2
step_id=vertical_lookup_row_list.two_indexed.2
mean25.801
σ0.003
min25.798
max25.806
mean8714.500
σ301.998
min8619.000
max9574.000
mean5.431
σ0.612
min5.053
max7.100
iterations=10
operation_display=vertical_lookup_row_list() on 2 indexed, repeat
rows=200000
mean25.796
σ0.002
min25.793
max25.798
mean8523.300
σ449.992
min8381.000
max9804.000
mean5.224
σ0.169
min4.939
max5.412
iterations=10
operation_display=vertical_lookup_row_list() on 2 indexed, repeat
rows=200000
scenario_id=mixed_indexes/benchmark2
step_id=vertical_lookup_row_list.two_indexed.repeat.2
mean25.795
σ0.002
min25.793
max25.797
mean8714.500
σ301.998
min8619.000
max9574.000
mean5.392
σ0.622
min4.951
max7.095
iterations=10
operation_display=vertical_lookup_row_list() on 3 (1 unindexed)
rows=200000
mean26.100
σ0.002
min26.097
max26.102
mean8523.300
σ449.992
min8381.000
max9804.000
mean5.280
σ0.145
min4.972
max5.441
iterations=10
operation_display=vertical_lookup_row_list() on 3 (1 unindexed)
rows=200000
scenario_id=mixed_indexes/benchmark2
step_id=vertical_lookup_row_list.three_one_unindexed.2
mean26.101
σ0.003
min26.097
max26.106
mean8714.500
σ301.998
min8619.000
max9574.000
mean5.460
σ0.586
min5.028
max7.054
iterations=10
operation_display=vertical_lookup_row_list() on 3 (1 unindexed), repeat
rows=200000
mean26.099
σ0.002
min26.097
max26.101
mean8523.300
σ449.992
min8381.000
max9804.000
mean5.326
σ0.161
min4.968
max5.586
iterations=10
operation_display=vertical_lookup_row_list() on 3 (1 unindexed), repeat
rows=200000
scenario_id=mixed_indexes/benchmark2
step_id=vertical_lookup_row_list.three_one_unindexed.repeat.2
mean26.099
σ0.002
min26.097
max26.101
mean8714.500
σ301.998
min8619.000
max9574.000
mean5.380
σ0.580
min4.902
max6.957

CSV - vertical_lookup_row_list() on unindexed

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=vertical_lookup_row_list() on unindexed small unique Int
rows=200000
mean66.839
σ0.002
min66.837
max66.841
mean9804.000
σ0.000
min9804.000
max9804.000
mean150.105
σ14.672
min118.053
max163.336
iterations=10
operation_display=vertical_lookup_row_list() on unindexed small unique Int
rows=200000
scenario_id=no_indexes/benchmark3
step_id=vertical_lookup_row_list.unindexed.small_unique_int.3
mean66.839
σ0.002
min66.837
max66.841
mean9574.000
σ0.000
min9574.000
max9574.000
mean144.012
σ24.091
min105.871
max165.032
iterations=10
operation_display=vertical_lookup_row_list() on unindexed small unique Int, repeat
rows=200000
mean66.839
σ0.002
min66.837
max66.843
mean9804.000
σ0.000
min9804.000
max9804.000
mean203.688
σ169.573
min119.935
max684.620
iterations=10
operation_display=vertical_lookup_row_list() on unindexed small unique Int, repeat
rows=200000
scenario_id=no_indexes/benchmark3
step_id=vertical_lookup_row_list.unindexed.small_unique_int.repeat.3
mean66.839
σ0.002
min66.837
max66.841
mean9574.000
σ0.000
min9574.000
max9574.000
mean144.580
σ23.999
min107.133
max167.556

CSV internal benchmark: pointedIndexFromKvs

Factorallocated MiBpeak allocated MiBtime (ms)
benchmark=pointed_index_from_kvs
iterations=10
rows=400000
mean357.322
σ0.002
min357.321
max357.325
mean555.000
σ4.830
min548.000
max558.000
mean769.093
σ57.009
min632.951
max827.347
iterations=10
operation_display=pointedIndexFromKvs
rows=400000
mean357.322
σ0.002
min357.321
max357.325
mean557.600
σ4.427
min545.000
max559.000
mean757.670
σ60.162
min637.075
max805.263