Published April 23, 2024 | Version v1
Other Open

Towards real world medical image analysis

  • 1. Department of Population Health, University of Oxford, Oxford, UK
  • 2. Nuffield Department of Surgical Sciences, University of Oxford, Oxford, UK
  • 3. School of Data Science, Fudan University, Shanghai, China
  • 4. School of Imaging, Fujian Medical University, Fuzhou, China
  • 5. CIC-IT 1433, INSERM, Université de Lorraine and CHRU Nancy, Nancy, France
  • 6. IADI U1254, INSERM and Université de Lorraine, Nancy, France
  • 7. ADI U1254, INSERM and Université de Lorraine, Nancy, France
  • 8. School of Computing Sciences, University of East Anglia, Norwich, U.K
  • 9. Renji Hospital, School of Medicine, Shanghai Jiao Tong UniversityShanghai, China
  • 10. Department of Radiology, Zhongshan Hospital, Fudan University, Shanghai, China
  • 11. Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, China
  • 12. Shanghai Public Health Clinical Center, Fudan University,Shanghai, China
  • 13. Yuanye Liu, School of Data Science, Fudan University, Shanghai, China
  • 14. Fei Shan, Shanghai Public Health Clinical Center, Fudan University,Shanghai, China
  • 15. Xiahai Zhuang, School of Data Science, Fudan University, Shanghai, China
  • 16. School of Electronics & Computer Science, University of Southampton, Southampton, UK
  • 17. Bioengineering Department and Imperial-X, Imperial College London, London, UK
  • 18. Department of College of Physics and Information Engineering Fuzhou University, Fuzhou, China
  • 19. College of Physics and Information Engineering, Fuzhou University, Fuzhou, China

Description

Many foundation models for medical image analysis, such as Segment Anything Model (SAM), have been released and proved to be useful in multiple tasks. However, their effectiveness on real world medical imaging data has not been explored. For example, specific images targeted on organs with large deformation, i.e., heart and liver, exhibit greater challenges for analysis.

[challenges]
First, the misalignment caused by the respiratory motion and cardiac pulsation increases the complexity of performing joint analysis on these data. Second, the inhomogeneity of real-world medical images poses a challenge, including the diversity of modality and the distribution shift caused by collection from various centers.
Third, it could be more challenging for those foundation model to work on irregular ROIs, such as lesions or scars, whose size can be very small and shape irregular. Hence, developing effective and efficient transfer learning approaches to fully utilize those foundation models for real world medical image segmentation is of great values.

[our contribution]
In this challenge, we set up a fair and public stage for developing and validating algorithms and applications of transferring foundation models to diverse real-world medical images to address specific practical medical image analysis problems, as well as using conventional methods without pre-trained models.

[Datasets]
Four specific datasets will be released grouped by clinical requirements, targeted on organs with grand large  deformation, i.e., heart and liver, and consisting of over 1250 patients from three continents. The diversity of datasets manifests in the following aspects, i.e., multi-continents: collected from over 18 centers across three continents, multi-modality: various modalities are encompassed, misalignment: inherent misalignment exists caused by the respiratory motion and cardiac pulsation, and missing data: refers to the modality missing occurred in practice.

[Track]
Five tracks will be held in this challenge, including one comprehensive issue and four specific tracks with corresponding images and clinical problems, namely, (1) Transferring Foundation model track, (2) MyoPS ++, (3) LiFS, (4) Whole Heart Segmentation ++, (5) LAScarQS++. Specifically, the first track aims at a uniform Transferring
Foundation model for the generality across the other four tracks, namely to address all or partial tasks. The uniform model will undergo comprehensive evaluation, with various metrics being integrated for ranking purposes.

Files

Towards real world medical image analysis.pdf

Files (178.2 kB)

Name Size Download all
md5:a34dc4cf28952fc82d1a39b94fed68f5
178.2 kB Preview Download