Journal article Open Access

Decibel Imaging for Generating Medical Report using Ultrasonic

Sathya.N; Sanjai.D; Swathi.R

Sponsor(s)
Blue Eyes Intelligence Engineering & Sciences Publication (BEIESP)

Medical imaging is commonly used for diagnosis and care in clinical practice. Report-writing would be prone to mistakes for inexperienced physicians, and experienced physicians would be time consuming and boring. To handle these issues, we study the automated generation of medical imaging reports. This task presents several challenges. First, a complete report contains multiple heterogeneous types of information including findings and tags. Second, abnormal regions in medical images are difficult to spot. Third, usually, the reports are lengthy and contain multiple sentences. To deal with these challenges, we (1) build a multi-task learning framework which jointly performs the prediction of tags and therefore the generation of paragraphs, (2) propose a co-attention mechanism to localize regions containing abnormalities and generate narrations for them, (3) develop a hierarchical LSTM model to get long paragraphs. We show the efficacy of the proposed methods on two datasets which are publicly accessible.

Files (461.5 kB)
Name Size
D8309049420.pdf
md5:ee89c70f150ae3a42e331ffe62821de4
461.5 kB Download
11
8
views
downloads
Views 11
Downloads 8
Data volume 3.7 MB
Unique views 8
Unique downloads 8

Share

Cite as