Published June 30, 2024 | Version CC-BY-NC-ND 4.0
Journal article Open

Enhanced Medical Image Segmentation using Transfer Learning with Res101_UNet: Experimental Insights and Comparative Performance Analysis

  • 1. Department of Computer Science & Systems Engineering, Andhra University College of Engineering, Visakha Patnam, Andhra Pradesh, India.

Contributors

Contact person:

  • 1. Department of Computer Science & Systems Engineering, Andhra University College of Engineering, Visakha Patnam, Andhra Pradesh, India.

Description

Abstract: Throughout the past few decades, artificial intelligence and machine learning have seen a lot of active research in areas such as computer vision, natural language processing, and speech processing. As a result, deep learning models became state-of-the-art for computer vision tasks such as object detection, classification, segmentation, and other allied tasks. Of course, the fruits of this research are extended to the design of robust and reliable digital health systems as well as other applications in the healthcare sector. Many clinical applications require the automatic segmentation of medical images. Recent deep learning-based approaches have demonstrated state-of-the-art performance in medical image segmentation tasks. In addition to their ability to automatically extract features and generalize over large amounts of data, transfer learning based deep learning models have proven to be handy for data scared areas like medical domains. In this research, we investigate and demonstrate the efficacy of a DCNN-based transfer learning model -Res101_Unet, which has been trained and/or fine-tuned to execute tumor tissue segmentation tasks in MRI, CT, PET, and X-RAY pictures of medical organ scans with little data. For our experimental study, we employed two image datasets: 'Liver Tumor' and 'Gland Colon Cancer', both obtained from the Kaggle portal. This experimental setup includes an Open-Source segmentation model API. Our findings indicate that domain similarity-based transfer learning can be used to data-scarce sectors. We achieved 98.47% accuracy and a IoU score of 0.9891 on Liver Tumor data and 0.6956 accuracy and a IoU score of 0.7043 on gland colon dataset.

Files

E446013050624.pdf

Files (1.2 MB)

Name Size Download all
md5:eac0e993b39946d578c7020cc841c03e
1.2 MB Preview Download

Additional details

Identifiers

Dates

Accepted
2024-06-15
Manuscript received on 27 April 2024 | Revised Manuscript received on 06 May 2024 | Manuscript Accepted on 15 June 2024 | Manuscript published on 30 June 2024.

References

  • Zhang, Jing & Li, Wanqing & Ogunbona, Philip. (2017). https://www.researchgate.net/publication/316921517_Transfer_Learning_for_Cross-Dataset_Recognition_A_Survey
  • Ronneberger O., Fischer P., Brox T. (2015) U-Net: Convolutional Networks for Biomedical Image Segmentation. In: Navab N., Hornegger J., Wells W., Frangi A. (eds) Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015. MICCAI 2015. Lecture Notes in Computer Science, vol 9351. Springer, Cham. https://doi.org/10.1007/978-3-319-24574-4_28. https://doi.org/10.1007/978-3-319-24574-4_28
  • Badrinarayanan, Vijay et al. "SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation." IEEE Transactions on Pattern Analysis and Machine Intelligence 39 (2017): 2481-2495. https://doi.org/10.1109/TPAMI.2016.2644615
  • Chen, Liang & Bentley, Paul & Mori, Kensaku & Misawa, Kazunari & Fujiwara, Michitaka & Rueckert, Daniel. (2018). DRINet for Medical Image Segmentation. IEEE Transactions on Medical Imaging. PP. 1-1. 10.1109/TMI.2018.2835303. https://doi.org/10.1109/TMI.2018.2835303
  • Krupinski, Elizabeth. (2016). Medical Imaging. 10.1007/978-3-319-14346-0_186. https://www.researchgate.net/publication/310238383_Medical_Imaging. https://doi.org/10.1117/1.JMI.3.1.011001
  • J. Deng, W. Dong, R. Socher, L. -J. Li, Kai Li and Li Fei-Fei, "ImageNet: A large-scale hierarchical image database," 2009 IEEE Conference on Computer Vision and Pattern Recognition, 2009, pp. 248-255, doi: 10.1109/CVPR.2009.5206848. https://doi.org/10.1109/CVPR.2009.5206848
  • Raghu, M., Zhang, C., Kleinberg, J.M., & Bengio, S. (2019). Transfusion: Understanding Transfer Learning for Medical Imaging. NeurIPS.
  • Kaggle Competitions. (n.d.). https://www.kaggle.com/competitions
  • 3DIRCADB. (2022, February 19). Kaggle. https://www.kaggle.com/datasets/nguyenhoainam27/3dircadb
  • GlaS@MICCAI'2015: Gland Segmentation. (2022, June 6). Kaggle. https://www.kaggle.com/datasets/sani84/glasmiccai2015-gland-segmentation
  • K. He, X. Zhang, S. Ren and J. Sun, "Deep Residual Learning for Image Recognition," 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 2016, pp. 770-778, doi: 10.1109/CVPR.2016.90. https://doi.org/10.1109/CVPR.2016.90
  • Huang, H., Chen, H., Xu, H. et al. Cross-Tissue/Organ Transfer Learning for the Segmentation of Ultrasound Images Using Deep Residual U-Net. J. Med. Biol. Eng. 41, 137–145 (2021). https://doi.org/10.1007/s40846-020-00585-w
  • Huang, Z., Wang, H., Deng, Z., Ye, J., Su, Y., Sun, H., ... & Qiao, Y. (2023). Stu-net: Scalable and transferable medical image segmentation models empowered by large-scale supervised pre-training. arXiv preprint arXiv:2304.06716.
  • Hosseinzadeh Taher MR, Haghighi F, Feng R, Gotway MB, Liang J. A Systematic Benchmarking Analysis of Transfer Learning for Medical Image Analysis. Domain Adapt Represent Transf Afford Healthc AI Resour Divers Glob Health (2021). 2021 Sep-Oct;12968:3-13. doi: 10.1007/978-3-030-87722-4_1. Epub 2021 Sep 21. PMID: 35713581; PMCID: PMC9197759. https://doi.org/10.1007/978-3-030-87722-4_1
  • Nampalle, Kishore Babu & Uppala, Vivek & Raman, Balasubramanian. (2023). Transfer learning-based framework for image segmentation using medical images and Tversky similarity. 10.21203/rs.3.rs-2587704/v1. https://doi.org/10.21203/rs.3.rs-2587704/v1
  • Karimi D, Warfield SK, Gholipour A. Transfer learning in medical image segmentation: New insights from analysis of the dynamics of model parameters and learned representations. Artif Intell Med. 2021 Jun;116:102078. doi: 10.1016/j.artmed.2021.102078. Epub 2021 Apr 23. PMID: 34020754; PMCID: PMC8164174. https://doi.org/10.1016/j.artmed.2021.102078
  • Ghavami, A. (2023). Image segmentation using UNet architecture in Pytorch for biomedical image processing. Retrieved from arXiv preprint arXiv:2305.14841v1.
  • Poudel, K., Dhakal, M., Bhandari, P., Adhikari, R., Thapaliya, S., & Khanal, B. (2023). Exploring Transfer Learning in Medical Image Segmentation using Vision-Language Models. ArXiv, abs/2308.07706.
  • Papers with Code - Transfer Learning U-Net Deep Learning for Lung Ultrasound Segmentation. (2021, October 5). https://paperswithcode.com/paper/transfer-learning-u-net-deep-learning-for\
  • Das, S., S, S., M, A., & Jayaram, S. (2021). Deep Learning Convolutional Neural Network for Defect Identification and Classification in Woven Fabric. In Indian Journal of Artificial Intelligence and Neural Networking (Vol. 1, Issue 2, pp. 9–13). https://doi.org/10.54105/ijainn.b1011.041221
  • Kanani, P., & Padole, Dr. M. (2019). Deep Learning to Detect Skin Cancer using Google Colab. In International Journal of Engineering and Advanced Technology (Vol. 8, Issue 6, pp. 2176–2183). https://doi.org/10.35940/ijeat.f8587.088619
  • Wanjau, S. K., Wambugu, G. M., & Oirere, A. M. (2022). Network Intrusion Detection Systems: A Systematic Literature Review of Hybrid Deep Learning Approaches. In International Journal of Emerging Science and Engineering (Vol. 10, Issue 7, pp. 1–16). https://doi.org/10.35940/ijese.f2530.0610722
  • Behera, D. K., Das, M., & Swetanisha, S. (2019). A Research on Collaborative Filtering Based Movie Recommendations: From Neighborhood to Deep Learning Based System. In International Journal of Recent Technology and Engineering (IJRTE) (Vol. 8, Issue 4, pp. 10809–10814). https://doi.org/10.35940/ijrte.d4362.118419
  • Nikam, S. S., & Dalvi, Prof. R. (2020). Fake News Detection on Social Media using Machine Learning Techniques. In International Journal of Innovative Technology and Exploring Engineering (Vol. 9, Issue 7, pp. 940–943). https://doi.org/10.35940/ijitee.g5428.059720