Challenge: Existing medical report generation efforts focus on producing human-readable reports, yet the generated text may not be well aligned to the clinical facts.
Approach: They propose to automate the generation of medical reports from chest X-ray image inputs . medical reports are the primary medium, which physicians communicate findings from scans - authors say .
Outcome: The proposed method achieves fluency and clinical accuracy on common metrics.

Similar Papers

Learning to Generate Clinically Coherent Chest X-Ray Reports (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing abstractive methods for radiology report generation produce fluent, but clinically incorrect reports.
Approach: They propose a radiology report generation model that uses the transformer architecture to extract clinical information from generated reports and fine-tune the model to produce more clinically coherent reports.
Outcome: The proposed model produces superior reports as measured by standard language generation and clinical coherence metrics compared to competitive baselines.
MedCycle: Unpaired Medical Report Generation via Cycle-Consistency (2024.findings-naacl)

Copied to clipboard

Challenge: Generating medical reports for X-ray images presents a significant challenge . previous studies have required a specific labeling schema for images and reports .
Approach: They propose a cycle-consistent mapping function that transforms image embeddings into report embedds and auto-encoding for medical report generation.
Outcome: The proposed approach outperforms state-of-the-art results in unpaired chest X-ray report generation, showing improvements in both language and clinical metrics.
Replace and Report: NLP Assisted Radiology Report Generation (2023.findings-acl)

Copied to clipboard

Challenge: Clinical practice frequently uses medical imaging for diagnosis and treatment.
Approach: They propose a template-based approach to generate radiology reports from radiographs . they use multilabel image classifiers to generate tags, pathological descriptions from tags .
Outcome: The proposed method improves on the most popular radiology report datasets.
Weakly Supervised Contrastive Learning for Chest X-Ray Report Generation (2021.findings-emnlp)

Copied to clipboard

Challenge: Radiology report generation aims at generating descriptive text from radiology images automatically.
Approach: They propose a weakly supervised contrastive loss method that generates descriptive text from radiology images automatically.
Outcome: The proposed method outperforms previous work on correctness and text generation metrics for two public benchmarks.
Multimodal Generation of Radiology Reports using Knowledge-Grounded Extraction of Entities and Relations (2022.aacl-main)

Copied to clipboard

Challenge: Existing approaches to generate text radiology reports are prone to errors and poor clinical accuracy.
Approach: They propose a two-step pipeline that subdivides the problem into factual triple extraction followed by free-text report generation.
Outcome: The proposed pipeline shows that the generated reports exhibit realistic style but lack clinical accuracy.
The Impact of Auxiliary Patient Data on Automated Chest X-Ray Report Generation and How to Incorporate It (2025.acl-long)

Copied to clipboard

Challenge: Traditionally, CXR report generation relies on data from a patient’s exam, overlooking valuable information from patient electronic health records.
Approach: They propose to integrate patient data from ED records into multimodal language models that embed patient data into a language model.
Outcome: The proposed model incorporates patient data from the MIMIC-CXR and MIMICIV-ED datasets to improve diagnostic accuracy and improves radiologist effectiveness.
A Self-training Framework for Automated Medical Report Generation (2023.emnlp-main)

Copied to clipboard

Challenge: Medical report generation is an important medical artificial intelligence task.
Approach: They propose a framework for medical report generation that exploits unlabeled medical images and a reference-free evaluation metric.
Outcome: The proposed framework performs better than previous fully-supervised models trained on entire training data.
On the Automatic Generation of Medical Imaging Reports (P18-1)

Copied to clipboard

Challenge: a complete medical imaging report contains multiple heterogeneous forms of information, including findings and tags . abnormal regions in medical images are difficult to identify and the reports are typically long, containing multiple sentences.
Approach: They propose a multi-task learning framework which predicts tags and generates paragraphs for abnormal regions in medical images.
Outcome: The proposed framework can generate long paragraphs on two publicly available datasets.
Learning Visual-Semantic Embeddings for Reporting Abnormal Findings on Chest X-rays (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing work on report generation often trains encoder-decoder networks to generate complete reports, but such models are affected by data bias and face common issues inherent in text generation models.
Approach: They propose a method to identify abnormal findings from radiology images and group them with unsupervised clustering and minimal rules.
Outcome: The proposed method outperforms existing generation models on correctness and text generation metrics.
Contrastive Attention for Automatic Chest X-ray Report Generation (2021.findings-acl)

Copied to clipboard

Challenge: Recent studies show that learning-based models fail to accurately capture and describe abnormal regions due to data bias.
Approach: They propose a model that compares the current input image with normal images to capture abnormal regions by contrasting the input image and normal images.
Outcome: The proposed model can be easily incorporated into existing models to boost their performance under most metrics.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations