Compare commits

Home / Compare 2c767354 .. d9086d07

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

CSV - column_set() on indexed

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=column_set() on indexed
rows=200000
mean36.614-36.614=0.000
σ0.000-0.000=0.000
min36.614
max36.615-36.615=0.000
mean8702.700-8900.500=-197.800
σ191.950-7.906=184.045
min8642.000-8898.000=-256.000
max9249.000-8923.000=326.000
mean119.460-12.611=106.850
σ228.693-0.191=228.501
min12.751-12.357=0.394
max639.005-12.976=626.029
iterations=10
operation_display=column_set() on indexed, repeat
rows=200000
mean36.614-36.614=-0.000
σ0.000-0.000=-0.000
min36.614-36.613=0.000
max36.614-36.614=-0.000
mean8702.700-8900.500=-197.800
σ191.950-7.906=184.045
min8642.000-8898.000=-256.000
max9249.000-8923.000=326.000
mean14.743-12.660=2.084
σ4.040-0.565=3.474
min12.200-11.784=0.415
max22.491-13.405=9.086

CSV - column_set() on unindexed

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=column_set() on unindexed, dense, repeat
rows=200000
mean62.074-62.074=-0.000
σ0.000-0.000=0.000
min62.073
max62.074-62.074=-0.000
mean5223.000-5227.200=-4.200
σ2585.075-2588.170=-3.095
min1265.000-1268.000=-3.000
max8642.000-8655.000=-13.000
mean101.268-101.484=-0.216
σ14.994-15.417=-0.423
min79.019-79.086=-0.068
max117.469-117.167=0.302
iterations=10
operation_display=column_set() on unindexed, sparse, repeat
rows=200000
mean70.663-70.664=-0.000
σ0.002-0.001=0.000
min70.662-70.662=-0.000
max70.667-70.666=0.001
mean8642.000-8898.000=-256.000
σ0.000
min8642.000-8898.000=-256.000
max8642.000-8898.000=-256.000
mean143.057-132.213=10.843
σ34.614-6.504=28.110
min122.062-123.802=-1.740
max238.755-143.081=95.674

CSV - column_set(), warmup

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=column_set() on unindexed, dense
rows=200000
mean15109.672-15109.672=0.000
σ3.988-3.988=-0.000
min15108.410-15108.410=0.000
max15121.021-15121.021=-0.000
mean5223.000-5227.200=-4.200
σ2585.075-2588.170=-3.095
min1265.000-1268.000=-3.000
max8642.000-8655.000=-13.000
mean9723.555-9634.233=89.321
σ2124.233-2487.039=-362.805
min6641.068-6608.957=32.112
max12479.614-12607.891=-128.276
iterations=10
operation_display=column_set() on unindexed, sparse
rows=200000
mean14060.733-14060.733=-0.000
σ0.002-0.002=-0.000
min14060.731-14060.731=0.000
max14060.735
mean8642.000-8898.000=-256.000
σ0.000
min8642.000-8898.000=-256.000
max8642.000-8898.000=-256.000
mean7375.148-7476.783=-101.635
σ1734.958-1191.168=543.791
min5445.681-5438.984=6.697
max10083.332-8836.979=1246.353

CSV - loading a lazy table

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=load_product() with indexes
rows=200000
mean8744.535-8744.534=0.000
σ0.002-0.000=0.001
min8744.534
max8744.539-8744.535=0.004
mean8642.000-8900.500=-258.500
σ0.000-7.906=-7.906
min8642.000-8898.000=-256.000
max8642.000-8923.000=-281.000
mean4729.340-4732.892=-3.552
σ1449.412-1291.552=157.860
min3497.337-3539.566=-42.229
max6875.559-7031.458=-155.899
iterations=10
operation_display=load_product(), no indexes
rows=200000
mean2524.581-2524.581=-0.000
σ0.002-0.002=-0.000
min2524.579
max2524.583-2524.584=-0.000
mean8642.000-8898.000=-256.000
σ0.000
min8642.000-8898.000=-256.000
max8642.000-8898.000=-256.000
mean1298.473-1536.310=-237.837
σ341.448-894.430=-552.982
min1035.391-1024.768=10.623
max1782.208-3279.167=-1496.960
iterations=10
operation_display=load_product(), with indexes
rows=200000
mean8744.667-8744.667=0.000
σ0.419-0.419=-0.000
min8744.535-8744.534=0.001
max8745.859-8745.859=-0.000
mean4847.600-4850.300=-2.700
σ2515.145-2516.959=-1.814
min1045.000-1046.000=-1.000
max8642.000-8655.000=-13.000
mean4693.544-4698.528=-4.984
σ1345.380-1287.114=58.266
min3503.030-3513.283=-10.253
max7616.575-7056.256=560.319
iterations=10
operation_display=load_product()with indexes
rows=200000
mean8744.532-8744.532=0.000
σ0.002-0.002=0.000
min8744.530-8744.530=-0.001
max8744.535-8744.535=-0.000
mean8642.000-8679.300=-37.300
σ0.000-76.843=-76.843
min8642.000-8655.000=-13.000
max8642.000-8898.000=-256.000
mean4934.265-4486.250=448.015
σ1668.782-990.049=678.733
min3514.396-3499.622=14.774
max7142.018-5884.975=1257.043

CSV - table_records()

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=table_records(), no indexes
rows=200000
mean41.901-41.901=-0.000
σ0.002-0.002=-0.000
min41.899
max41.904-41.904=-0.000
mean8642.000-8898.000=-256.000
σ0.000
min8642.000-8898.000=-256.000
max8642.000-8898.000=-256.000
mean13.357-13.260=0.097
σ1.838-1.286=0.552
min10.878-11.595=-0.718
max15.225-15.077=0.148
iterations=10
operation_display=table_records(), no indexes, repeat
rows=200000
mean41.901-41.901=0.000
σ0.002-0.002=0.000
min41.900-41.900=-0.000
max41.904-41.903=0.000
mean8642.000-8898.000=-256.000
σ0.000
min8642.000-8898.000=-256.000
max8642.000-8898.000=-256.000
mean12.211-12.056=0.156
σ1.259-1.056=0.203
min10.527-10.915=-0.388
max13.713-13.571=0.141
iterations=10
operation_display=table_records(), repeat
rows=200000
mean41.901-41.901=-0.000
σ0.002-0.002=0.000
min41.899
max41.903-41.904=-0.000
mean8642.000-8679.300=-37.300
σ0.000-76.843=-76.843
min8642.000-8655.000=-13.000
max8642.000-8898.000=-256.000
mean13.776-13.611=0.164
σ2.113-1.637=0.476
min10.908-10.692=0.215
max16.237-15.634=0.603

CSV - table_records(), warmup

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=table_records()
rows=200000
mean15088.238-15088.238=-0.000
σ0.002-0.002=-0.000
min15088.236
max15088.241-15088.242=-0.001
mean8642.000-8679.300=-37.300
σ0.000-76.843=-76.843
min8642.000-8655.000=-13.000
max8642.000-8898.000=-256.000
mean9851.185-10043.494=-192.309
σ2314.890-1908.500=406.390
min6563.475-6533.487=29.988
max12466.473-11843.495=622.978

CSV - vertical_lookup_list() on indexed

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=vertical_lookup_list() on indexed, after column_set(), repeat
rows=200000
mean26.397-26.397=-0.000
σ0.000-0.000=0.000
min26.397-26.397=-0.000
max26.398-26.398=-0.000
mean5223.000-5227.200=-4.200
σ2585.075-2588.170=-3.095
min1265.000-1268.000=-3.000
max8642.000-8655.000=-13.000
mean6.829-6.306=0.524
σ0.445-0.576=-0.131
min6.275-5.390=0.884
max7.619-7.072=0.546
iterations=10
operation_display=vertical_lookup_list() on indexed, after table_records(), repeat
rows=200000
mean26.398-26.398=0.000
σ0.002-0.002=-0.000
min26.397
max26.401
mean8642.000-8679.300=-37.300
σ0.000-76.843=-76.843
min8642.000-8655.000=-13.000
max8642.000-8898.000=-256.000
mean7.758-6.463=1.295
σ1.386-0.390=0.997
min6.664-5.472=1.193
max10.449-6.761=3.688
iterations=10
operation_display=vertical_lookup_list() on indexed, repeat
rows=200000
mean26.398
σ0.000
min26.398
max26.398
mean8702.700-8900.500=-197.800
σ191.950-7.906=184.045
min8642.000-8898.000=-256.000
max9249.000-8923.000=326.000
mean8.033-7.514=0.519
σ0.249-0.371=-0.122
min7.672-6.835=0.837
max8.418-8.024=0.394

CSV - vertical_lookup_list() on unindexed

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=vertical_lookup_list() on unindexed missing Int
rows=200000
mean40.943-40.943=0.000
σ0.002-0.002=-0.000
min40.942-40.942=0.000
max40.947-40.947=-0.000
mean8642.000-8898.000=-256.000
σ0.000
min8642.000-8898.000=-256.000
max8642.000-8898.000=-256.000
mean88.677-91.440=-2.763
σ18.810-13.091=5.719
min64.462-74.446=-9.983
max108.837-107.907=0.930
iterations=10
operation_display=vertical_lookup_list() on unindexed missing Int, repeat
rows=200000
mean40.943-40.943=-0.000
σ0.002-0.002=-0.000
min40.942-40.942=0.000
max40.945-40.946=-0.001
mean8642.000-8898.000=-256.000
σ0.000
min8642.000-8898.000=-256.000
max8642.000-8898.000=-256.000
mean88.563-91.304=-2.741
σ18.678-13.012=5.666
min64.060-74.552=-10.492
max108.035-107.532=0.503
iterations=10
operation_display=vertical_lookup_list() on unindexed unique Int near end
rows=200000
mean40.949-40.949=0.000
σ0.002-0.002=-0.000
min40.947-40.947=0.000
max40.952-40.953=-0.000
mean8642.000-8898.000=-256.000
σ0.000
min8642.000-8898.000=-256.000
max8642.000-8898.000=-256.000
mean88.698-91.285=-2.587
σ18.486-13.312=5.174
min65.496-74.230=-8.734
max108.319-107.435=0.884
iterations=10
operation_display=vertical_lookup_list() on unindexed unique Int near end, repeat
rows=200000
mean40.948-40.948=-0.000
σ0.002-0.002=0.000
min40.947
max40.951-40.951=0.000
mean8642.000-8898.000=-256.000
σ0.000
min8642.000-8898.000=-256.000
max8642.000-8898.000=-256.000
mean88.745-91.410=-2.665
σ18.599-13.166=5.433
min64.791-74.353=-9.562
max108.080-107.829=0.251

CSV - vertical_lookup_list(), mini warmup

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=vertical_lookup_list() on indexed, after column_set()
rows=200000
mean27.602-27.602=-0.000
σ0.002-0.002=0.000
min27.602
max27.607
mean5223.000-5227.200=-4.200
σ2585.075-2588.170=-3.095
min1265.000-1268.000=-3.000
max8642.000-8655.000=-13.000
mean9.687-9.295=0.392
σ0.687-0.740=-0.053
min8.662-8.244=0.418
max10.384-10.116=0.268
iterations=10
operation_display=vertical_lookup_list() on indexed, after table_records()
rows=200000
mean27.602-27.602=0.000
σ0.001-0.001=0.000
min27.602
max27.605-27.605=0.000
mean8642.000-8679.300=-37.300
σ0.000-76.843=-76.843
min8642.000-8655.000=-13.000
max8642.000-8898.000=-256.000
mean9.733-9.078=0.655
σ1.594-0.562=1.033
min8.315-7.801=0.514
max12.641-9.619=3.022

CSV - vertical_lookup_list(), warmup

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=vertical_lookup_list() on indexed
rows=200000
mean15073.940-15073.940=0.000
σ0.001-0.001=-0.000
min15073.939
max15073.941-15073.941=0.000
mean8702.700-8900.500=-197.800
σ191.950-7.906=184.045
min8642.000-8898.000=-256.000
max9249.000-8923.000=326.000
mean9592.321-9752.198=-159.877
σ1969.397-1927.388=42.010
min6547.069-6572.003=-24.935
max11965.846-11702.880=262.966

CSV - vertical_lookup_row_list() on indexed

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=vertical_lookup_row_list() on 2 indexed
rows=200000
mean25.634-25.634=-0.000
σ0.002-0.002=-0.000
min25.631
max25.637-25.637=-0.000
mean8642.000-8679.300=-37.300
σ0.000-76.843=-76.843
min8642.000-8655.000=-13.000
max8642.000-8898.000=-256.000
mean5.918-4.859=1.059
σ1.236-0.103=1.134
min5.215-4.708=0.507
max8.287-5.004=3.283
iterations=10
operation_display=vertical_lookup_row_list() on 2 indexed, repeat
rows=200000
mean25.628-25.628=-0.000
σ0.002-0.002=0.000
min25.626-25.626=-0.000
max25.631
mean8642.000-8679.300=-37.300
σ0.000-76.843=-76.843
min8642.000-8655.000=-13.000
max8642.000-8898.000=-256.000
mean5.871-4.877=0.994
σ1.256-0.195=1.061
min5.186-4.673=0.513
max8.281-5.342=2.939
iterations=10
operation_display=vertical_lookup_row_list() on 3 (1 unindexed)
rows=200000
mean25.932-25.932=0.000
σ0.002-0.002=0.000
min25.930-25.930=-0.000
max25.935
mean8642.000-8679.300=-37.300
σ0.000-76.843=-76.843
min8642.000-8655.000=-13.000
max8642.000-8898.000=-256.000
mean5.904-4.919=0.985
σ1.292-0.090=1.201
min5.199-4.815=0.384
max8.424-5.057=3.367
iterations=10
operation_display=vertical_lookup_row_list() on 3 (1 unindexed), repeat
rows=200000
mean25.931-25.931=0.000
σ0.002-0.002=-0.000
min25.930-25.930=0.000
max25.934
mean8642.000-8679.300=-37.300
σ0.000-76.843=-76.843
min8642.000-8655.000=-13.000
max8642.000-8898.000=-256.000
mean5.796-4.870=0.925
σ1.300-0.057=1.243
min4.798-4.801=-0.002
max8.264-5.004=3.260

CSV - vertical_lookup_row_list() on unindexed

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=vertical_lookup_row_list() on unindexed small unique Int
rows=200000
mean66.671-66.671=0.000
σ0.001-0.002=-0.000
min66.670
max66.673-66.673=-0.000
mean8642.000-8898.000=-256.000
σ0.000
min8642.000-8898.000=-256.000
max8642.000-8898.000=-256.000
mean215.516-141.214=74.302
σ251.943-17.821=234.123
min105.784-118.233=-12.449
max929.426-163.358=766.067
iterations=10
operation_display=vertical_lookup_row_list() on unindexed small unique Int, repeat
rows=200000
mean66.671-66.671=-0.000
σ0.003-0.003=-0.000
min66.670
max66.677
mean8642.000-8898.000=-256.000
σ0.000
min8642.000-8898.000=-256.000
max8642.000-8898.000=-256.000
mean244.380-141.548=102.832
σ345.111-17.251=327.860
min106.525-119.236=-12.711
max1224.581-163.285=1061.296

CSV internal benchmark: pointedIndexFromKvs

Factorallocated MiBpeak allocated MiBtime (ms)
iterations=10
operation_display=pointedIndexFromKvs
rows=200000
mean172.559
σ0.002
min172.558
max172.562
mean476.000-477.000=-1.000
σ0.000
min476.000-477.000=-1.000
max476.000-477.000=-1.000
mean367.449-381.868=-14.419
σ36.945-28.023=8.921
min302.495-303.599=-1.104
max405.419-398.137=7.282
iterations=10
operation_display=pointedIndexFromKvs
rows=400000
mean357.322
σ0.002
min357.321
max357.325
mean561.000-560.000=1.000
σ0.000
min561.000-560.000=1.000
max561.000-560.000=1.000
mean711.715-731.764=-20.049
σ86.832-64.915=21.917
min571.700-627.824=-56.124
max797.561-823.151=-25.590