DADA2 formatted 16S rRNA gene sequences for both bacteria & archaea
These two combined bacterial and archaeal 16S rRNA gene sequence databases were collated from various sources and formatted for the purpose of using the "assignTaxonomy" command within the DADA2 pipeline.
RefSeq+RDP: This database contains 14676 bacterial & 660 archaea full 16S rRNA gene sequences. It was compiled in 14/05/2018 from predominantly the NCBI RefSeq 16S rrna database (https://www.ncbi.nlm.nih.gov/refseq/targetedloci/16S_process/) and was supplemented with extra sequences from the RDP database (https://rdp.cme.msu.edu/misc/resources.jsp).
Genome Taxonomy Database (GTDB): The new version of our dada2 formatted GTDB reference sequences now contains 17460 bacteria and 873 archaea full 16S rRNA gene sequences. The reduction in the number of species (bac =23,458 species & arc= 1248 species) as far as I understand was due to a new approach they have taken, where species were clustered according to their genome nucleotide identity and a representative species annotation was given to all belonging to the same cluster. If you wonder why there are fewer species with 16S rRNA, that is because some metagenomics assembled genomes (MAGs) lack the 16S gene and thus cannot be extracted. I believe the reason why on the r89 release notes it mentions higher numbers because they are not limited to 16S only for species identification and as is mentioned they use other single-copy genes for that purpose anyway. The database was downloaded from (https://data.ace.uq.edu.au/public/gtdb/data/releases/release89/89.0/) on 03/07/2019. Please read the release notes and file descriptions.
The formatting to DADA2 format of the databases was done using a locally written python 2.7 / bash scripts. The script takes as input a taxonomy .tsv file and a fasta file as provided by the core databases creators and then these two files are matched according to a unique sequence identifier available in both files. Then it outputs a fasta file with all 7 taxonomy ranks separated by ";" as required for DADA2 compatibility. Additionally, we have concatenated the unique sequence ID be it NCBI/RDP or GTDB ID to the species entry. We see this as an important QC step to highlight the issues/confidence associated with short read taxonomy assignment at the more finer rank levels.
The RefSeq+RDP database was updated due to a quotation mark bug that was wrongly placed in front of some of the species names. A file with all the affected species names has been uploaded to review. This shouldn't affect any assignments but might have caused some issues reading into R.
The GTDB was updated due to a new release with taxonomy changes has been made available. The core GTDB team advises that everyone using the GTDB to convert to the release 89. I have also formatted all the 16S rRNA sequences in the GTDBr89 that have passed QC. If anyone finds a need for them I can share outside of here because I do not want to confuse anyone. Also, you can download the file "ssu_r89.tsv" unformatted from the GTDB website shared above.
Python script can be provided on request.
Parks, D. H., et al. (2018). "A standardized bacterial taxonomy based on genome phylogeny substantially revises the tree of life." Nature Biotechnology.
Cole, J. R., Q. Wang, J. A. Fish, B. Chai, D. M. McGarrell, Y. Sun, C. T. Brown, A. Porras-Alfaro, C. R. Kuske, and J. M. Tiedje. 2014. Ribosomal Database Project: data and tools for high throughput rRNA analysis Nucl. Acids Res. 42(Database issue):D633-D642; doi: 10.1093/nar/gkt1244 [PMID: 24288368]