Papers with F1CheXbert
Fact-Aware Multimodal Retrieval Augmentation for Accurate Medical Radiology Report Generation (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing multimodal foundation models suffer from serious factual inaccuracy in radiology report generation. |
| Approach: | They propose a fact-aware multimodal retrieval-augmented pipeline for generating accurate radiology reports using RadGraph. |
| Outcome: | The proposed multimodal retrieval-augmented pipeline outperforms state-of-the-art retrievers on language generation and radiology-specific metrics. |
RadEval: A framework for radiology text evaluation (2025.emnlp-demos)
Copied to clipboard
Justin Xu, Xi Zhang, Javid Abderezaei, Julie Bauml, Roger Boodoo, Fatemeh Haghighi, Ali Ganjizadeh, Eric Brattain, Dave Van Veen, Zaiqiao Meng, David W Eyre, Jean-Benoit Delbrouck
| Challenge: | Evaluating automated radiology report generation systems remains a fundamental challenge in the development of safe, accurate, and clinically useful medical AI. |
| Approach: | They propose a unified, open-source framework for evaluating radiology texts that consolidates a diverse range of metrics from classic ngram overlap (BLEU) and contextual measures (BERTScore) to clinical concept-based scores (GREEN). |
| Outcome: | The framework consolidates a diverse range of metrics from ngram overlap (BLEU) and contextual measures (BERTScore) to clinical concept-based scores (F1CheXbert, F1RadGraph, RaTEScore, SRR-BERT, TemporalEntityF1) and advanced LLMbased evaluators (GREEN). |