A Dual-View Approach to Classifying Radiology Reports by Co-Training (2024.lrec-main)
Copied to clipboard
| Challenge: | Using the structure of a radiology report, we propose a co-training approach to train two machine learning models using the dual views of MRI and CT data. |
| Approach: | They propose a co-training approach where two machine learning models are built upon the Findings and Impression sections and use each other's information to boost performance with massive unlabeled data in a semi-supervised manner. |
| Outcome: | The proposed model outperforms supervised and semi-supervised methods in a public health surveillance study and outperformed existing methods. |
Similar Papers
JPG - Jointly Learn to Align: Automated Disease Prediction and Radiology Report Generation (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods rarely consider cross-modal alignment between textual and visual features and ignore disease tags as auxiliary for report generation. |
| Approach: | They propose a "Jointly learning framework for automated disease Prediction and radiology report Generation" the framework integrates cross-modal alignment between textual and visual features and disease tags to improve the quality of reports. |
| Outcome: | The proposed framework improves the quality of radiology reports by combining the main task and auxiliary tasks. |
Show, Describe and Conclude: On Exploiting the Structure Information of Chest X-ray Reports (P19-1)
Copied to clipboard
| Challenge: | Existing studies do not consider the complex structure information between and within report sections. |
| Approach: | They propose a framework which exploits the structure information between and within report sections for generating CXR imaging reports. |
| Outcome: | The proposed framework achieves state-of-the-art performance on two CXR report datasets. |
The More, The Better? A Critical Study of Multimodal Context in Radiology Report Summarization (2025.findings-emnlp)
Copied to clipboard
Mong Yuan Sim, Wei Emma Zhang, Xiang Dai, Biaoyan Fang, Sarbin Ranjitkar, Arjun Burlakoti, Jamie Taylor, Haojie Zhuang
| Challenge: | Current multimodal summarization models often fail to utilize radiology images in summarizing Findings section. |
| Approach: | They conduct a thorough analysis to determine whether current multimodal summarization models can utilize radiology images in summarizing Findings section. |
| Outcome: | The Impression section plays a crucial role in communication between radiologists and physicians. |
Multimodal Generation of Radiology Reports using Knowledge-Grounded Extraction of Entities and Relations (2022.aacl-main)
Copied to clipboard
Francesco Dalla Serra, William Clackett, Hamish MacKinnon, Chaoyang Wang, Fani Deligianni, Jeff Dalton, Alison Q. O’Neil
| Challenge: | Existing approaches to generate text radiology reports are prone to errors and poor clinical accuracy. |
| Approach: | They propose a two-step pipeline that subdivides the problem into factual triple extraction followed by free-text report generation. |
| Outcome: | The proposed pipeline shows that the generated reports exhibit realistic style but lack clinical accuracy. |
Controllable Chest X-Ray Report Generation from Longitudinal Representations (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Radiology reports are detailed text descriptions of the content of medical scans. |
| Approach: | They propose a method to align, concatenate and fuse the current and prior visual information into a joint longitudinal representation which can be provided to a multimodal report generation model. |
| Outcome: | The proposed method achieves state-of-the-art results while enabling anatomy-wise controllable report generation. |
Differentiable Multi-Agent Actor-Critic for Multi-Step Radiology Report Summarization (2022.acl-long)
Copied to clipboard
| Challenge: | Prior research on radiology report summarization has focused on single-step end-to-end models which subsume the task of salient content acquisition. |
| Approach: | They propose a two-step extractive summarization followed by abstractive summaries and a new method that breaks down the extractive part into two independent tasks: extraction of salient (1) sentences and (2) keywords. |
| Outcome: | The proposed model improves on English radiology reports with an overall improvement in F1 score of 3-4% compared to single-step and two-step-with-single-extractive-process baselines. |
Graph Enhanced Contrastive Learning for Radiology Findings Summarization (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods for automating impression generation have limited the relationship between extra knowledge and the original findings. |
| Approach: | They propose a framework for automating impression generation that exploits extra knowledge and original findings . they propose combining key words and their relations to extract critical information . |
| Outcome: | The proposed framework exploits extra knowledge and the original findings in an integrated way . the state-of-the-art results on two datasets confirm the effectiveness of the proposed method . |
Learning Visual-Semantic Embeddings for Reporting Abnormal Findings on Chest X-rays (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work on report generation often trains encoder-decoder networks to generate complete reports, but such models are affected by data bias and face common issues inherent in text generation models. |
| Approach: | They propose a method to identify abnormal findings from radiology images and group them with unsupervised clustering and minimal rules. |
| Outcome: | The proposed method outperforms existing generation models on correctness and text generation metrics. |
Reinforced Cross-modal Alignment for Radiology Report Generation (2022.findings-acl)
Copied to clipboard
| Challenge: | Medical images are widely used in clinical decision-making, where writing radiology reports can be enhanced by automatic solutions to alleviate physicians’ workload. |
| Approach: | They propose an approach with reinforcement learning over a cross-modal memory to better align visual and textual features for radiology report generation. |
| Outcome: | The proposed approach improves cross-modal alignment on two English radiology report datasets and human evaluation confirms the results. |
Enhancing Image-to-Text Generation in Radiology Reports through Cross-modal Multi-Task Learning (2024.lrec-main)
Copied to clipboard
| Challenge: | Image-to-text generation relies on independent models for image understanding and natural language generation, which often exhibit a semantic gap between visual and textual information. |
| Approach: | They propose a multi-task learning framework to leverage both visual and non-imaging data for generating radiology reports. |
| Outcome: | The proposed framework improves performance over single-task baselines across language generation metrics and mitigates overfitting in auxiliary tasks. |