Benchmarking metagenomic software with the new CAMI web portal

Poster presented by Fernando Meyer at the 32nd Conference on Intelligent Systems for Molecular Biology (ISMB 2024), July 12-16, 2024, in Montreal, Canada.

To enable objective and comprehensive benchmarking of metagenomic software, the community-led initiative for the Critical Assessment of Metagenome Interpretation (CAMI) promotes standards and good practices agreed upon by the community, by providing comprehensive datasets for developers to assess their software on, together with software facilitating their assessment, benchmarking guidelines, and challenges. However, assessing methods in between challenges and comparing their performances to other techniques still requires substantial time and technical expertise. We introduce the new CAMI benchmarking web portal, which frees users from the need to install and execute other methods and evaluation software for a comprehensive assessment of individual tools.