Published August 11, 2026 | Version v1
Image Open

Supplementary datasets (large images, interactive 3D visualizations, spreadsheets) for Kočí et al. "Sparse sampling and rare-variant depletion distort PCA visualizations of population structure: recovery with objective-guided manifold learning"

Description

Supplementary Dataset 1: Comprehensive summary of manifold-learning-derived LDEs across the full parameter space of the objective-guided embedding-optimization protocol. Each point in the PC-space-dimensionality versus k-NN biplots is colored by the median Δr² or Δρ² between an manifold-learning-derived embedding and the corresponding drift-normalized classic PC1–PC2–PC3 space. Each figure in this dataset consists of a collection of such biplots spanning different PC-space types, PC-space distance metrics, and manifold-learning algorithms. Individual figures are defined by the combination of LDE-ranking objective, landscape-sampling approach, either random or clustered, and MAF-filtering threshold, either no filtering or MAF = 1%. Separate sets of figures show the PC-space-dimensionality versus k-NN parameter space using either log10 or linear axis scales.

Supplementary Dataset 2: An interactive R application for visualizing any selected PC1–PC2–PC3 space derived from the IBR-LDM simulations and for generating UMAP, UMAP/densMAP, densMAP, or PHATE 3D LDEs from these data using user-defined parameters. For each embedding, we display Pearson’s correlation with geographic distances and Spearman’s correlation with GRM-derived dissimilarities, the best-performing LDE-ranking objective.

Supplementary Dataset 3: Parameters and fits of the top 100 LDEs for each objective function are shown for each of the four case studies in which simple, non-layered LDE ranking was used.

Supplementary Dataset 4: Comprehensive summary of manifold-learning-derived LDEs across the full parameter space of the objective-guided embedding-optimization protocol in the Orang Asli case study. Each point in the PC-space-dimensionality versus k-NN biplots is colored by the Δr² or Δρ² between a manifold-learning-derived embedding and the corresponding drift-normalized classic PC1–PC2 space (MAC = 1, no missing data). Each figure in this dataset consists of a collection of such biplots spanning different PC-space types, PC-space distance metrics, and manifold-learning algorithms. Individual figures are defined by the LDE-ranking objective: FST, Hamming distance (default), GRM-derived dissimilarity, or outgroup f3-statistics, each evaluated using either Pearson’s or Spearman’s correlation. Geography-based Pearson and Spearman objectives are shown for comparison. Separate sets of figures show the PC-space-dimensionality versus k-NN parameter space using either log10 or linear axis scales.

Supplementary Dataset 5: Alternative PC1–PC2–PC3 spaces (a–h) and the top-ranked manifold-learning-derived LDE (i) from the Cervus elaphus case study, shown as interactive 3D plots. For the PCA algorithm, SNP-filtering scheme, and missing-data removal regime used for each analysis, see the file names and Supplementary Table 1. Corresponding goodness-of-fit statistics are provided in Supplementary Table 1 and Supplementary Dataset 3. Individuals are colored by the geographic regions defined by de Jong et al. (2025).

Supplementary Dataset 6: Comprehensive summary of manifold-learning-derived LDEs across the full parameter space of the objective-guided embedding-optimization protocol in the Cervus elaphus case study. Each point in the PC-space-dimensionality versus k-NN biplots is colored by the Δr² or Δρ² between a manifold-learning-derived embedding and the corresponding drift-normalized classic PC1–PC2–PC3 space (MAC = 1, no missing data). Each figure in this dataset consists of a collection of such biplots spanning different PC-space types, PC-space distance metrics, and manifold-learning algorithms. Individual figures are defined by the LDE-ranking objective: FST, Hamming distance (default), GRM-derived dissimilarity, or outgroup f3-statistics, each evaluated using either Pearson’s or Spearman’s correlation. Geography-based Pearson and Spearman objectives are shown for comparison. Separate sets of figures show the PC-space-dimensionality versus k-NN parameter space using either log10 or linear axis scales.

Supplementary Dataset 7: Alternative PC1–PC2–PC3 spaces (a–h) and the top-ranked manifold-learning-derived LDE (i) from the PNG case study, shown as interactive 3D plots. For the PCA algorithm, SNP-filtering scheme, and missing-data removal regime used for each analysis, see the file names and Supplementary Table 1. Corresponding goodness-of-fit statistics are provided in Supplementary Table 1 and Supplementary Dataset 3. Following Bergström et al. (2017), individuals whose parents were born in the same province are colored according to their province of parental origin, defined by Papua New Guinea provincial boundaries.

Supplementary Dataset 8: Comprehensive summary of manifold-learning-derived LDEs across the full parameter space of the objective-guided embedding-optimization protocol in the PNG case study. Each point in the PC-space-dimensionality versus k-NN biplots is colored by the Δr² or Δρ² between a manifold-learning-derived embedding and the corresponding drift-normalized classic PC1–PC2–PC3 space (MAC = 1, no missing data). Each figure in this dataset consists of a collection of such biplots spanning different PC-space types, PC-space distance metrics, and manifold-learning algorithms. Individual figures are defined by the LDE-ranking objective: FST, Hamming distance (default), GRM-derived dissimilarity, or outgroup f3-statistics, each evaluated using either Pearson’s or Spearman’s correlation. Geography-based Pearson and Spearman objectives are shown for comparison. Separate sets of figures show the PC-space-dimensionality versus k-NN parameter space using either log10 or linear axis scales.

Supplementary Dataset 9: Alternative PC1–PC2–PC3 spaces (a–h) and the top-ranked manifold-learning-derived LDE (i) from the SEA case study, shown as interactive 3D plots. For the PCA algorithm, SNP-filtering scheme, and missing-data removal regime used for each analysis, see the file names and Supplementary Table 1. Corresponding goodness-of-fit statistics are provided in Supplementary Table 1 and Supplementary Dataset 3. Individuals are colored according to their linguistic affiliation (language family).

Supplementary Dataset 10: Comprehensive summary of manifold-learning-derived LDEs across the full parameter space of the objective-guided embedding-optimization protocol in the SEA case study. Each point in the PC-space-dimensionality versus k-NN biplots is colored by the Δr² or Δρ² between a manifold-learning-derived embedding and the corresponding drift-normalized classic PC1–PC2–PC3 space (MAC = 1, no missing data). Each figure in this dataset consists of a collection of such biplots spanning different PC-space types, PC-space distance metrics, and manifold-learning algorithms. Individual figures are defined by the LDE-ranking objective: FST, Hamming distance (default), GRM-derived dissimilarity, or outgroup f3-statistics, each evaluated using either Pearson’s or Spearman’s correlation. Geography-based Pearson and Spearman objectives are shown for comparison. Separate sets of figures show the PC-space-dimensionality versus k-NN parameter space using either log10 or linear axis scales.

Supplementary Dataset 11: PCA LDEs visualizing the projected (ancient Eurasian; a–c) and basis (present-day Eurasian; d–f) individuals separately. The PC1–PC2–PC3 spaces are presented as interactive 3D plots. A separate series of interactive plots displays the projected and basis individuals jointly (g–i). Shown are results from three PCA approaches: classic PC scores on data that were centered and normalized by genetic-drift dispersion prior to eigendecomposition (a, d, g); classic PC scores on centered data (b, e, h); and eigenvectors on data centered and normalized by genetic-drift dispersion (c, f, i). Ancient Eurasian individuals are colored according to the 23 largest IBD-sharing communities including 20 or more individuals (Supplementary Table 2) in all plots; present-day Eurasian individuals are colored according to the 41 largest IBD-sharing communities including 10 or more individuals (Supplementary Table 2) in plots d–f and shown as grey dots in plots g–i. All fidelity metrics for these 3D PC spaces are provided in Supplementary Table 4.

Supplementary Dataset 12: Three prioritized results from the multi-step LDE-ranking procedure applied to 5,133 ancient Eurasian individuals: the final LDE (a, d) and two additional LDEs (b, c) produced under the highest k-NN settings among the top 20 LDEs from step 3. Each LDE is shown as an interactive 3D plot, with individuals colored by the 23 largest IBD-sharing communities (a–c) or by 10 geographic regions (d). In plot d, members of the CEE IBD-sharing community are shown as medium-sized points, while CEE individuals from the Roman and Migration period (eCEE) are emphasized as the largest points. The parameter settings used to generate these LDEs, along with all associated fidelity metrics, are listed in Supplementary Table 4.

Supplementary Dataset 13: Comparison of manifold-learning optimization outcomes (using 5,133 ancient Eurasian individuals) obtained under different objectives. For each of the following key objectives, the best-performing 3D LDE is shown:  (a),  (b),  with the default missingness correction (c),  (d), median Mahalanobis distance among the 23 largest IBD-sharing communities (e), neighborhood-preservation metric at k = 500 (f) or k = 50 (g), and median Mahalanobis distance among the 21 Y-lineages with intra-lineage coalescence around 2,800 ya (h). The LDEs are displayed as interactive 3D plots, with individuals colored by the 23 largest IBD-sharing communities. Settings used to generate each LDE and all fidelity metrics are provided in Supplementary Table 4.

Supplementary Dataset 14: Illustrating the LDE ranking procedure applied to the ancient Eurasian dataset: fits, Mahalanobis and Bhattacharya distances between IBD-sharing communities, and four metrics assessing how well the geometry of the (s – 1)-dimensional PC space (Fischer & Ma 2024) is preserved in an LDE are shown for the broader optimal region of the parameter space: 85,188 PHATE embeddings on classic PC scores. The results are displayed on logarithmic (a) or linear (b) PC space dimensionality and k-NN axes. In each row, the results are grouped by: (i) PCA variant – classic PCA with centering only, and classic PCA with centering plus normalization by genetic-drift dispersion; (ii) distance/affinity in the input PC space – Euclidean (ℓ₂), Manhattan (ℓ₁), and cosine.

Supplementary Dataset 15: Illustrating the LDE ranking procedure applied to the present-day Eurasian dataset: fits, Mahalanobis and Bhattacharya distances between IBD-sharing communities, and four metrics assessing how well the geometry of the (s – 1)-dimensional PC space (Fischer & Ma 2024) is preserved in an LDE are shown for the region of the parameter space we explored: 83,544 PHATE embeddings on classic PC scores. The results are displayed on logarithmic (a) or linear (b) PC space dimensionality and k-NN axes. In each row, the results are grouped by: (i) PCA variant – classic PCA with centering only, and classic PCA with centering plus normalization by genetic-drift dispersion; (ii) distance/affinity in the input PC space – Euclidean (ℓ₂), Manhattan (ℓ₁), and cosine.

Supplementary Dataset 16: Comparison of manifold-learning optimization outcomes (using 2,425 present-day Eurasian individuals) obtained under different objectives. For each of the following key objectives, the best-performing 3D LDE is shown:  (a),  (b),  with the default missingness correction (c),  (d),  (e),  (f),  (g),  (h), median Mahalanobis distance among the 41 largest IBD-sharing communities (i), neighborhood-preservation metric at k = 250 (j) or k = 50 (k). The LDEs are displayed as interactive 3D plots, with individuals colored by the 41 largest IBD-sharing communities. Settings used to generate each LDE and all fidelity metrics are provided in Supplementary Table 4.

Supplementary Dataset 17: Five prioritized results from the multi-step LDE-ranking procedure applied to 2,425 present-day Eurasian individuals: the final LDE (a, f) and the four next highest-scoring LDEs (b–e). Each LDE is shown as an interactive 3D plot, with individuals colored by the 41 largest IBD-sharing communities or by groups used for the HapNe-IBD analysis (f). The parameter settings used to generate these LDEs, along with all associated fidelity metrics, are listed in Supplementary Table 4.

Supplementary Dataset 18: Optimization landscape from objective-guided manifold-learning search in the ancient Eurasian case study: fits of 809,286 unique 3D LDE configurations to genetic and geographic distances. Values shown are differences in squared correlation relative to a baseline of classic 3D PC space (with data normalized by genetic‐drift dispersion): or Panels a–c use Spearman’s rank correlation, and panels d–f use Pearson’s linear correlation. Each panel reports fits to pairwise distances among 5,133 individuals: (a, d) Hamming genetic distances; (b, e) GRM genetic distances; (c, f) great-circle geographic distances. The color scales use a power (warp-top) transform  with to enhance contrast near the best-fitting regions of the landscape. In each panel, the results are grouped by: (i) PCA variant – smartPCA eigenvectors, classic PC scores with centering only, and classic PC scores with centering plus normalization by genetic-drift dispersion; (ii) distance/affinity in the input PC space – Euclidean (ℓ₂), Manhattan (ℓ₁), cosine, and correlation; (iii) manifold-learning algorithm and its settings – UMAP (two min_dist values), a UMAP–densMAP hybrid (dens_scale = 0.5), densMAP (dens_scale = 1), and PHATE. Both the PC space dimensionality and k-NN axes use a logarithmic scale.

Supplementary Dataset 19: The optimization landscapes from Supplementary Dataset 18, displayed on linear (non-logarithmic) PC space dimensionality and k-NN axes.

Supplementary Dataset 20: Most frequent Y-lineages in the ancient Eurasian dataset at selected intra-lineage coalescence cut-offs, 2,800 ya (a) and 4,600 ya (b), visualized on the 2D isometric unfolding of the best-fitting 3D LDE. Interactive 2D plots are shown. The sets of 21 (a) and 31 (b) Y-chromosomal lineages, each represented by at least 10 individuals, were defined using a reduced subset of individuals with SNP counts above the 25th percentile; however, the plots themselves were not filtered by this SNP-count threshold. Males carrying other Y-lineages are shown as grey dots and labeled “zzz”.

Supplementary Dataset 21: Quantifying Y-lineage separation in PHATE embeddings based on classic PC spaces in the ancient Eurasian case study.

Files

SData_12.zip

Files (2.6 GB)

Name Size
md5:b82525d9af30099a359023a8ce20bd89
305.8 MB Preview Download
md5:48ba44b3a6f8ea2acd912f62d838822a
468.0 MB Preview Download
md5:6358641a566ac8ae40ddd2eddc8314d6
12.4 MB Preview Download
md5:40db0535da4053ca471e5539591a57f9
5.7 MB Preview Download
md5:1c060a7072479dce74bbe0d07a07bb89
11.5 MB Preview Download
md5:e4f70c8ea952d63e45b2a880c8c55e90
144.1 MB Preview Download
md5:9b42ca989b55da492244a8d88a7980aa
190.4 MB Preview Download
md5:12da40cc4af74b0cbfefcacf608caa57
13.5 MB Preview Download
md5:21535bff860593b9865310c92dba9071
7.4 MB Preview Download
md5:29885881e09c1c31d39f13019cffe95c
218.0 MB Preview Download
md5:dad9dab7a88bd9b2862739ef24ebbe75
222.3 MB Preview Download
md5:cbdba9d980430c13b956a3eab3ff51e5
194.2 MB Preview Download
md5:ff4df0c375f6fcdc25f38521d82eba27
2.9 MB Preview Download
md5:f7677b657a21aaa27011a39a98e4e766
154.7 MB Preview Download
md5:c8f877b55cf57b7559b89aff89f15939
4.0 MB Download
md5:42e79cdab5b034ca6b06881458d31dec
116.2 MB Preview Download
md5:5f5b5c99aee53f98caf42d29d95bf2e8
10.1 MB Preview Download
md5:97b23fb8ba8e1dbd040ca907026f95e1
114.3 MB Preview Download
md5:ac037e0855e36297f747f52967c3a93f
10.1 MB Preview Download
md5:6a0528685c5856e594a26667b74eb062
344.0 MB Preview Download
md5:1c14ee59e73731546c248f904af8483e
10.3 MB Preview Download

Additional details

Funding

Czech Ministry of Education, Youth and Sports
Improving robustness of archaeogenetic studies of highly admixed human populations in Late Holocene Eurasia ERC CZ LL2404
Czech Science Foundation
An archaeogenetic window on the Slavic dispersal in the first millennium CE: Leveraging the power of cultural outliers and haplotype-sharing networks 25-17789S
European Union Operational Programme Just Transition
Life Environment Research Center Ostrava CZ.10.03.01/00/22_003/0000003
Ministry of Education, Youth and Sports of the Czech Republic
e-INFRA CZ 90254

Software

Repository URL
https://github.com/flegontovlab/optimized_manifold_learning
Programming language
R
Development Status
Active