Two-Pronged Human Evaluation of ChatGPT Self-Correction in Radiology Report Simplification (2024.findings-acl)
Copied to clipboard
| Challenge: | Radiology reports are highly technical documents aimed primarily at doctor-doctor communication. |
| Approach: | They propose a new evaluation protocol that employs radiologists and laypeople to produce high-quality simplifications. |
| Outcome: | The proposed evaluation protocol combines radiologists and laypeople to produce high-quality simplifications. |
Similar Papers
Data Augmentation for Radiology Report Simplification (2023.findings-eacl)
Copied to clipboard
| Challenge: | Existing approaches to improve radiology reports are limited due to the high cost of manual simplification. |
| Approach: | They propose a data augmentation approach to generate simplifications of unlabeled radiology sentences using a pre-trained language model and paraphrasing of labeled radiologists sentences. |
| Outcome: | The proposed model generates simplifications of unlabeled radiology sentences and paraphrases labeled radiologists sentences. |
Replace, Paraphrase or Fine-tune? Evaluating Automatic Simplification for Medical Texts in Spanish (2024.lrec-main)
Copied to clipboard
Leonardo Campillos-Llanos, Ana Rosa Terroba, Rocío Bartolomé, Ana Valverde-Mateos, Cristina González, Adrián Capllonch-Carrión, Jonathan Heras
| Challenge: | lexicon-based simplification methods can help patients understand medical documents . but they must ensure that the content is transmitted rigorously and not creating wrong information. |
| Approach: | They tested automatic simplification techniques using a Spanish lexicon of technical and laymen terms. |
| Outcome: | The proposed methods improve the quantitative results and the human evaluation of medical documents. |
X-ray Made Simple: Lay Radiology Report Generation and Robust Evaluation (2026.findings-acl)
Copied to clipboard
Kun Zhao, Chenghao Xiao, Sixing Yan, Haoteng Tang, William K. Cheung, Noura Al Moubayed, Liang Zhan, Chenghua Lin
| Challenge: | Technical language and templated nature of professional reports hinder patient comprehension and allow models to artificially boost lexical metrics such as BLEU by reproducing common report patterns. |
| Approach: | They propose a layman's RRG framework that leverages layperson-friendly language to enhance patient accessibility and promote robust evaluation and report generation by encouraging models to focus on semantic accuracy over rigid templates. |
| Outcome: | The proposed framework improves model performance with more layman-style data, compared to templated professional language and inflated lexical scores. |
Exploring the Boundaries of GPT-4 in Radiology (2023.emnlp-main)
Copied to clipboard
Qianchu Liu, Stephanie Hyland, Shruthi Bannur, Kenza Bouzid, Daniel Castro, Maria Wetscherek, Robert Tinn, Harshita Sharma, Fernando Pérez-García, Anton Schwaighofer, Pranav Rajpurkar, Sameer Khanna, Hoifung Poon, Naoto Usuyama, Anja Thieme, Aditya Nori, Matthew Lungren, Ozan Oktay, Javier Alvarez-Valle
| Challenge: | Recent success of general-domain large language models has changed the natural language processing paradigm towards a unified foundation model across domains and applications. |
| Approach: | They evaluate the performance of GPT-4 on a variety of radiology tasks . they find it outperforms or matches current SOTA radiology models . |
| Outcome: | The proposed model outperforms or matches current SOTA radiology models on a range of tasks. |
Divide and Conquer Radiology Report Generation via Observation Level Fine-grained Pretraining and Prompt Tuning (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in image captioning and vision-language pretraining have made it difficult for radiologists to generate coherent and accurate reports. |
| Approach: | They propose a model which breaks down full-text radiology reports into concise observation descriptions and encodes observation predictions into a decoding stage. |
| Outcome: | The proposed model achieves significant improvements across all metrics, underscoring its capability to generate semantically coherent and clinically accurate radiology reports. |
Multimodal Generation of Radiology Reports using Knowledge-Grounded Extraction of Entities and Relations (2022.aacl-main)
Copied to clipboard
Francesco Dalla Serra, William Clackett, Hamish MacKinnon, Chaoyang Wang, Fani Deligianni, Jeff Dalton, Alison Q. O’Neil
| Challenge: | Existing approaches to generate text radiology reports are prone to errors and poor clinical accuracy. |
| Approach: | They propose a two-step pipeline that subdivides the problem into factual triple extraction followed by free-text report generation. |
| Outcome: | The proposed pipeline shows that the generated reports exhibit realistic style but lack clinical accuracy. |
AutoMeTS: The Autocomplete for Medical Text Simplification (2020.coling-main)
Copied to clipboard
| Challenge: | Semi-automated text simplification approaches can be used to simplify text faster and at a higher quality. |
| Approach: | They propose to use autocomplete to simplify medical texts using aligned English Wikipedia sentences and pretrained neural language models to analyze the additional context. |
| Outcome: | The proposed model outperforms the best individual model by 2.1% and achieves a word prediction accuracy of 64.52%. |
DDGIP: Radiology Report Generation Through Disease Description Graph and Informed Prompting (2025.findings-naacl)
Copied to clipboard
| Challenge: | Automatic radiology report generation is challenging due to inherent biases in medical imaging data. |
| Approach: | They propose a disease description graph that encapsulates comprehensive and pertinent disease information. |
| Outcome: | The proposed model outperforms state-of-the-art models on two widely-used datasets . the proposed model is based on a three-layer decoder and improves on existing models . |
GREEN: Generative Radiology Report Evaluation and Error Notation (2024.findings-emnlp)
Copied to clipboard
Sophie Ostmeier, Justin Xu, Zhihong Chen, Maya Varma, Louis Blankemeier, Christian Bluethgen, Arne Md, Michael Moseley, Curtis Langlotz, Akshay Chaudhari, Jean-Benoit Delbrouck
| Challenge: | Existing automated evaluation metrics fail to consider factual correctness or are limited in their interpretability. |
| Approach: | They propose a radiology report evaluation metric that leverages natural language understanding of language models to identify and explain clinically significant errors. |
| Outcome: | The proposed method demonstrates higher correlation with expert error counts and higher alignment with expert preferences when compared to previous methods. |
Medical Text Simplification: Optimizing for Readability with Unlikelihood Training and Reranked Beam Search Decoding (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Text simplification has emerged as an increasingly useful application of AI for bridging the communication gap in specialized fields such as medicine, where the lexicon is often dominated by technical jargon and complex constructs. |
| Approach: | They propose a unlikelihood loss that encourages generation of simpler terms and a reranked beam search decoding method that optimizes for simplicity. |
| Outcome: | The proposed methods achieve better performance on readability metrics on three datasets. |