Compare commits

Home / Compare 68b3038d .. 50835d55

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

CSV - column_set() on indexed

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=column_set() on indexed
rows=200000
mean36.614-36.614=-0.001
σ0.000-0.001=-0.001
min36.614-36.614=-0.000
max36.614-36.618=-0.004
mean9798.000-9802.000=-4.000
σ0.000
min9798.000-9802.000=-4.000
max9798.000-9802.000=-4.000
mean13.166-13.046=0.121
σ0.326-0.298=0.029
min12.720-12.576=0.143
max13.782-13.474=0.308
iterations=10
operation_display=column_set() on indexed, repeat
rows=200000
mean36.614-36.614=0.000
σ0.001-0.000=0.001
min36.614-36.613=0.000
max36.617-36.614=0.003
mean9798.000-9802.000=-4.000
σ0.000
min9798.000-9802.000=-4.000
max9798.000-9802.000=-4.000
mean107.406-95.312=12.093
σ300.026-260.687=39.338
min11.730-11.981=-0.252
max961.292-837.240=124.052

CSV - column_set() on unindexed

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=column_set() on unindexed, dense, repeat
rows=200000
mean62.074-62.074=0.000
σ0.000-0.000=-0.000
min62.074-62.073=0.000
max62.074
mean5218.100-5041.400=176.700
σ2576.494-2529.900=46.594
min1268.000-1289.000=-21.000
max8618.000-8543.000=75.000
mean105.673-102.608=3.065
σ14.804-11.017=3.786
min80.940-81.796=-0.856
max120.695-115.144=5.552
iterations=10
operation_display=column_set() on unindexed, sparse, repeat
rows=200000
mean70.664-70.664=0.000
σ0.002-0.002=0.000
min70.662-70.662=-0.000
max70.667-70.667=0.000
mean9798.000-9802.000=-4.000
σ0.000
min9798.000-9802.000=-4.000
max9798.000-9802.000=-4.000
mean137.127-136.772=0.355
σ4.496-2.370=2.126
min128.612-131.978=-3.366
max144.522-139.111=5.411

CSV - column_set(), warmup

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=column_set() on unindexed, dense
rows=200000
mean15109.672-15109.671=0.000
σ3.988-3.988=0.000
min15108.410
max15121.022-15121.020=0.001
mean5218.100-5041.400=176.700
σ2576.494-2529.900=46.594
min1268.000-1289.000=-21.000
max8618.000-8543.000=75.000
mean9732.607-10733.358=-1000.750
σ2174.568-1846.468=328.100
min6670.918-6604.157=66.761
max12125.881-12429.992=-304.111
iterations=10
operation_display=column_set() on unindexed, sparse
rows=200000
mean14060.732-14060.733=-0.000
σ0.001-0.002=-0.000
min14060.731-14060.731=-0.000
max14060.735-14060.736=-0.001
mean9798.000-9802.000=-4.000
σ0.000
min9798.000-9802.000=-4.000
max9798.000-9802.000=-4.000
mean6829.666-7117.724=-288.058
σ1691.151-1402.395=288.756
min5450.345-5425.772=24.573
max9508.461-9086.346=422.115

CSV - loading a lazy table

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=load_product() with indexes
rows=200000
mean8744.535-8744.535=-0.000
σ0.000-0.000=-0.000
min8744.534-8744.534=-0.000
max8744.535-8744.536=-0.000
mean9798.000-9802.000=-4.000
σ0.000
min9798.000-9802.000=-4.000
max9798.000-9802.000=-4.000
mean4119.158-4109.446=9.713
σ1176.482-947.293=229.189
min3521.167-3507.404=13.762
max7062.576-6263.552=799.024
iterations=10
operation_display=load_product(), no indexes
rows=200000
mean2524.580-2524.581=-0.000
σ0.002-0.002=0.000
min2524.579-2524.579=-0.000
max2524.583-2524.583=-0.000
mean9798.000-9802.000=-4.000
σ0.000
min9798.000-9802.000=-4.000
max9798.000-9802.000=-4.000
mean1087.360-1217.253=-129.892
σ142.831-556.728=-413.897
min1033.003-1034.296=-1.294
max1493.621-2801.655=-1308.035
iterations=10
operation_display=load_product(), with indexes
rows=200000
mean8744.667-8744.667=-0.000
σ0.419-0.418=0.000
min8744.534-8744.534=-0.000
max8745.858-8745.858=0.000
mean4843.800-4771.200=72.600
σ2510.168-2503.137=7.032
min1046.000-1050.000=-4.000
max8618.000-8543.000=75.000
mean4590.232-5053.929=-463.697
σ1354.761-1456.251=-101.490
min3538.389-3469.960=68.429
max7460.601-7242.487=218.114
iterations=10
operation_display=load_product()with indexes
rows=200000
mean8744.532-8744.533=-0.001
σ0.002-0.002=-0.000
min8744.530-8744.531=-0.000
max8744.535-8744.536=-0.001
mean8618.000-8543.000=75.000
σ0.000
min8618.000-8543.000=75.000
max8618.000-8543.000=75.000
mean4427.384-4224.102=203.282
σ1527.985-1173.574=354.410
min3515.349-3482.747=32.602
max7800.084-6970.329=829.755

CSV - table_records()

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=table_records(), no indexes
rows=200000
mean41.901-41.901=-0.000
σ0.002-0.002=0.000
min41.899-41.900=-0.000
max41.904-41.904=0.001
mean9798.000-9802.000=-4.000
σ0.000
min9798.000-9802.000=-4.000
max9798.000-9802.000=-4.000
mean14.498-14.105=0.393
σ0.910-0.828=0.082
min12.797-12.597=0.200
max15.586-15.017=0.569
iterations=10
operation_display=table_records(), no indexes, repeat
rows=200000
mean41.901-41.900=0.000
σ0.002-0.002=-0.000
min41.900
max41.903-41.903=-0.000
mean9798.000-9802.000=-4.000
σ0.000
min9798.000-9802.000=-4.000
max9798.000-9802.000=-4.000
mean13.811-12.581=1.230
σ0.770-1.104=-0.334
min12.454-11.585=0.870
max14.874-14.640=0.234
iterations=10
operation_display=table_records(), repeat
rows=200000
mean41.901-41.901=-0.000
σ0.002-0.002=-0.000
min41.899
max41.903-41.904=-0.001
mean8736.000-8668.900=67.100
σ373.149-398.131=-24.982
min8618.000-8543.000=75.000
max9798.000-9802.000=-4.000
mean12.764-13.063=-0.300
σ1.599-2.065=-0.466
min11.395-10.685=0.710
max15.615-15.869=-0.254

CSV - table_records(), warmup

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=table_records()
rows=200000
mean15088.238-15088.238=0.000
σ0.002-0.002=0.000
min15088.237
max15088.241
mean8736.000-8668.900=67.100
σ373.149-398.131=-24.982
min8618.000-8543.000=75.000
max9798.000-9802.000=-4.000
mean9359.534-9445.920=-86.386
σ2257.817-2254.916=2.901
min6612.497-6525.324=87.173
max12439.613-12513.602=-73.989

CSV - vertical_lookup_list() on indexed

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=vertical_lookup_list() on indexed, after column_set(), repeat
rows=200000
mean26.397
σ0.000
min26.397
max26.398
mean5218.100-5041.400=176.700
σ2576.494-2529.900=46.594
min1268.000-1289.000=-21.000
max8618.000-8543.000=75.000
mean7.002-7.001=0.000
σ0.725-0.519=0.205
min5.818-5.877=-0.059
max8.365-7.858=0.507
iterations=10
operation_display=vertical_lookup_list() on indexed, after table_records(), repeat
rows=200000
mean26.398-26.398=-0.000
σ0.002-0.002=-0.000
min26.397
max26.401-26.401=-0.000
mean8736.000-8668.900=67.100
σ373.149-398.131=-24.982
min8618.000-8543.000=75.000
max9798.000-9802.000=-4.000
mean6.927-6.854=0.073
σ0.275-1.126=-0.851
min6.477-6.068=0.409
max7.383-9.767=-2.384
iterations=10
operation_display=vertical_lookup_list() on indexed, repeat
rows=200000
mean26.398
σ0.000
min26.398
max26.398
mean9798.000-9802.000=-4.000
σ0.000
min9798.000-9802.000=-4.000
max9798.000-9802.000=-4.000
mean8.108-8.135=-0.027
σ0.244-0.221=0.023
min7.799-7.782=0.017
max8.522-8.446=0.076

CSV - vertical_lookup_list() on unindexed

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=vertical_lookup_list() on unindexed missing Int
rows=200000
mean40.943-40.943=0.000
σ0.002-0.002=0.000
min40.942
max40.947-40.947=0.000
mean9798.000-9802.000=-4.000
σ0.000
min9798.000-9802.000=-4.000
max9798.000-9802.000=-4.000
mean100.717-99.798=0.920
σ8.535-8.130=0.405
min84.045-84.291=-0.246
max108.199-107.061=1.138
iterations=10
operation_display=vertical_lookup_list() on unindexed missing Int, repeat
rows=200000
mean40.943-40.943=0.000
σ0.002-0.002=-0.000
min40.942
max40.946
mean9798.000-9802.000=-4.000
σ0.000
min9798.000-9802.000=-4.000
max9798.000-9802.000=-4.000
mean100.602-99.967=0.636
σ8.444-8.158=0.286
min84.091-84.556=-0.465
max108.163-107.059=1.105
iterations=10
operation_display=vertical_lookup_list() on unindexed unique Int near end
rows=200000
mean40.949-40.949=0.000
σ0.002-0.002=-0.000
min40.947-40.947=0.000
max40.952-40.952=0.000
mean9798.000-9802.000=-4.000
σ0.000
min9798.000-9802.000=-4.000
max9798.000-9802.000=-4.000
mean100.814-99.951=0.864
σ8.640-8.260=0.380
min83.838-83.619=0.219
max108.598-106.650=1.948
iterations=10
operation_display=vertical_lookup_list() on unindexed unique Int near end, repeat
rows=200000
mean40.948-40.948=-0.000
σ0.002-0.002=0.000
min40.947-40.947=0.000
max40.951-40.950=0.001
mean9798.000-9802.000=-4.000
σ0.000
min9798.000-9802.000=-4.000
max9798.000-9802.000=-4.000
mean100.757-99.914=0.843
σ8.504-8.134=0.370
min84.119-84.310=-0.192
max108.477-106.574=1.904

CSV - vertical_lookup_list(), mini warmup

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=vertical_lookup_list() on indexed, after column_set()
rows=200000
mean27.602-27.602=-0.000
σ0.002-0.002=0.000
min27.602
max27.607-27.607=0.000
mean5218.100-5041.400=176.700
σ2576.494-2529.900=46.594
min1268.000-1289.000=-21.000
max8618.000-8543.000=75.000
mean9.718-9.765=-0.048
σ0.597-0.590=0.007
min8.838-8.849=-0.011
max10.235-10.327=-0.092
iterations=10
operation_display=vertical_lookup_list() on indexed, after table_records()
rows=200000
mean27.602-27.603=-0.000
σ0.002-0.002=-0.000
min27.602-27.602=-0.000
max27.605
mean8736.000-8668.900=67.100
σ373.149-398.131=-24.982
min8618.000-8543.000=75.000
max9798.000-9802.000=-4.000
mean9.045-9.545=-0.500
σ0.515-1.189=-0.674
min8.301-8.583=-0.282
max9.890-12.564=-2.674

CSV - vertical_lookup_list(), warmup

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=vertical_lookup_list() on indexed
rows=200000
mean15073.940-15073.940=-0.000
σ0.000-0.000=0.000
min15073.939
max15073.940
mean9798.000-9802.000=-4.000
σ0.000
min9798.000-9802.000=-4.000
max9798.000-9802.000=-4.000
mean9433.384-9351.923=81.461
σ1993.975-2292.629=-298.654
min6562.324-6553.272=9.051
max12295.147-12534.160=-239.013

CSV - vertical_lookup_row_list() on indexed

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=vertical_lookup_row_list() on 2 indexed
rows=200000
mean25.633-25.633=-0.000
σ0.002-0.002=0.000
min25.631-25.631=-0.000
max25.637
mean8736.000-8668.900=67.100
σ373.149-398.131=-24.982
min8618.000-8543.000=75.000
max9798.000-9802.000=-4.000
mean5.332-5.368=-0.036
σ0.175-0.956=-0.782
min5.122-4.886=0.235
max5.704-8.012=-2.308
iterations=10
operation_display=vertical_lookup_row_list() on 2 indexed, repeat
rows=200000
mean25.628-25.628=0.000
σ0.002-0.002=0.000
min25.626-25.626=-0.000
max25.630-25.630=0.000
mean8736.000-8668.900=67.100
σ373.149-398.131=-24.982
min8618.000-8543.000=75.000
max9798.000-9802.000=-4.000
mean5.233-5.205=0.028
σ0.243-1.032=-0.790
min4.955-4.736=0.219
max5.815-8.109=-2.293
iterations=10
operation_display=vertical_lookup_row_list() on 3 (1 unindexed)
rows=200000
mean25.932-25.932=-0.000
σ0.002-0.003=-0.001
min25.930-25.930=-0.000
max25.935-25.939=-0.003
mean8736.000-8668.900=67.100
σ373.149-398.131=-24.982
min8618.000-8543.000=75.000
max9798.000-9802.000=-4.000
mean5.169-5.256=-0.087
σ0.207-1.020=-0.812
min4.907-4.822=0.085
max5.617-8.135=-2.518
iterations=10
operation_display=vertical_lookup_row_list() on 3 (1 unindexed), repeat
rows=200000
mean25.931-25.931=-0.000
σ0.002-0.002=0.000
min25.930-25.930=-0.000
max25.934
mean8736.000-8668.900=67.100
σ373.149-398.131=-24.982
min8618.000-8543.000=75.000
max9798.000-9802.000=-4.000
mean5.120-5.239=-0.120
σ0.198-0.977=-0.780
min4.848-4.743=0.105
max5.325-7.985=-2.659

CSV - vertical_lookup_row_list() on unindexed

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=vertical_lookup_row_list() on unindexed small unique Int
rows=200000
mean66.671-66.671=-0.000
σ0.002-0.002=0.000
min66.670
max66.674
mean9798.000-9802.000=-4.000
σ0.000
min9798.000-9802.000=-4.000
max9798.000-9802.000=-4.000
mean282.577-260.870=21.707
σ411.520-344.148=67.372
min129.101-131.857=-2.757
max1453.287-1239.843=213.444
iterations=10
operation_display=vertical_lookup_row_list() on unindexed small unique Int, repeat
rows=200000
mean66.670-66.671=-0.000
σ0.002-0.002=0.000
min66.670
max66.673
mean9798.000-9802.000=-4.000
σ0.000
min9798.000-9802.000=-4.000
max9798.000-9802.000=-4.000
mean184.136-189.328=-5.192
σ102.383-125.644=-23.261
min130.226-131.804=-1.578
max473.428-545.277=-71.849

CSV internal benchmark: pointedIndexFromKvs

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=pointedIndexFromKvs
rows=200000
mean172.559
σ0.002
min172.558
max172.562
mean478.000-473.900=4.100
σ0.000-0.316=-0.316
min478.000-473.000=5.000
max478.000-474.000=4.000
mean378.536-392.765=-14.228
σ24.825-22.743=2.082
min343.174-330.337=12.837
max414.525-408.303=6.221
iterations=10
operation_display=pointedIndexFromKvs
rows=400000
mean357.322
σ0.002
min357.321
max357.325
mean560.000-559.000=1.000
σ0.000
min560.000-559.000=1.000
max560.000-559.000=1.000
mean738.127-747.785=-9.658
σ52.515-66.359=-13.844
min635.720-636.680=-0.960
max784.652-813.933=-29.282