Cross-modal Contrastive Attention Model for Medical Report Generation (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for medical report generation are unable to capture useful information from historical cases. |
| Approach: | They propose a model that captures both visual and semantic information from similar cases. |
| Outcome: | The proposed model outperforms the state-of-the-art models on almost all metrics on IU X-Ray and MIMIC-CXR benchmarks. |
Similar Papers
Contrastive Attention for Automatic Chest X-ray Report Generation (2021.findings-acl)
Copied to clipboard
| Challenge: | Recent studies show that learning-based models fail to accurately capture and describe abnormal regions due to data bias. |
| Approach: | They propose a model that compares the current input image with normal images to capture abnormal regions by contrasting the input image and normal images. |
| Outcome: | The proposed model can be easily incorporated into existing models to boost their performance under most metrics. |
CmEAA: Cross-modal Enhancement and Alignment Adapter for Radiology Report Generation (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for automatic radiology report generation suffer from data bias. |
| Approach: | They propose a method that connects a vision encoder with a frozen large language model by using a cross-modal enhancement and alignment adapter. |
| Outcome: | The proposed model outperforms existing state-of-the-art methods on IU X-Ray and MIMIC-CXR datasets. |
Cross-modal Memory Networks for Radiology Report Generation (2021.acl-long)
Copied to clipboard
| Challenge: | Medical imaging reports are essential in clinical practice, and generating the reports is beneficial to reduce the burden of radiologists. |
| Approach: | They propose to use a shared memory to enhance the encoder-decoder framework for radiology report generation. |
| Outcome: | The proposed model can generate more accurate reports on two widely used datasets. |
Learning Visual-Semantic Embeddings for Reporting Abnormal Findings on Chest X-rays (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work on report generation often trains encoder-decoder networks to generate complete reports, but such models are affected by data bias and face common issues inherent in text generation models. |
| Approach: | They propose a method to identify abnormal findings from radiology images and group them with unsupervised clustering and minimal rules. |
| Outcome: | The proposed method outperforms existing generation models on correctness and text generation metrics. |
Weakly Supervised Contrastive Learning for Chest X-Ray Report Generation (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Radiology report generation aims at generating descriptive text from radiology images automatically. |
| Approach: | They propose a weakly supervised contrastive loss method that generates descriptive text from radiology images automatically. |
| Outcome: | The proposed method outperforms previous work on correctness and text generation metrics for two public benchmarks. |
Enhancing Image-to-Text Generation in Radiology Reports through Cross-modal Multi-Task Learning (2024.lrec-main)
Copied to clipboard
| Challenge: | Image-to-text generation relies on independent models for image understanding and natural language generation, which often exhibit a semantic gap between visual and textual information. |
| Approach: | They propose a multi-task learning framework to leverage both visual and non-imaging data for generating radiology reports. |
| Outcome: | The proposed framework improves performance over single-task baselines across language generation metrics and mitigates overfitting in auxiliary tasks. |
Reinforced Cross-modal Alignment for Radiology Report Generation (2022.findings-acl)
Copied to clipboard
| Challenge: | Medical images are widely used in clinical decision-making, where writing radiology reports can be enhanced by automatic solutions to alleviate physicians’ workload. |
| Approach: | They propose an approach with reinforcement learning over a cross-modal memory to better align visual and textual features for radiology report generation. |
| Outcome: | The proposed approach improves cross-modal alignment on two English radiology report datasets and human evaluation confirms the results. |
Controllable Chest X-Ray Report Generation from Longitudinal Representations (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Radiology reports are detailed text descriptions of the content of medical scans. |
| Approach: | They propose a method to align, concatenate and fuse the current and prior visual information into a joint longitudinal representation which can be provided to a multimodal report generation model. |
| Outcome: | The proposed method achieves state-of-the-art results while enabling anatomy-wise controllable report generation. |
On the Automatic Generation of Medical Imaging Reports (P18-1)
Copied to clipboard
| Challenge: | a complete medical imaging report contains multiple heterogeneous forms of information, including findings and tags . abnormal regions in medical images are difficult to identify and the reports are typically long, containing multiple sentences. |
| Approach: | They propose a multi-task learning framework which predicts tags and generates paragraphs for abnormal regions in medical images. |
| Outcome: | The proposed framework can generate long paragraphs on two publicly available datasets. |
Normal-Abnormal Decoupling Memory for Medical Report Generation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for capturing nuanced visual information are prone to data bias and noise. |
| Approach: | They propose a normal-abnormal semantic decoupling network that utilizes abnormal pattern memory to optimize visual extraction through the extraction of abnormal semantics from the reports. |
| Outcome: | The proposed approach surpasses the current state-of-the-art methods on the benchmark MIMIC-CXR and shows excellent performance on the same dataset. |