Making the Most Out of the Limited Context Length: Predictive Power Varies with Clinical Note Type and Note Section (2023.acl-srw)
Copied to clipboard
| Challenge: | Clinical notes have a long time span over multiple long documents. |
| Approach: | They propose a framework to analyze clinical notes with high predictive power . they propose to combine different types of notes to improve performance . |
| Outcome: | The proposed framework could be used to extract information from clinical notes . it shows that the sample size can be optimized for large contexts . |
Similar Papers
SEGMENT+: Long Text Processing with Short-Context Language Models (2024.emnlp-main)
Copied to clipboard
Wei Shi, Shuang Li, Kerun Yu, Jinglei Chen, Zujie Liang, Xinhui Wu, Yuxi Qian, Feng Wei, Bo Zheng, Jiaqing Liang, Jiangjie Chen, Yanghua Xiao
| Challenge: | Existing frameworks that increase context window do not guarantee robust performance across long input tasks. |
| Approach: | They propose a framework that enables language models to handle extended inputs within limited context windows efficiently. |
| Outcome: | The framework improves performance on long-document question-answering and Needle-in-a-Haystack tasks. |
MIMICause: Representation and automatic extraction of causal relation types from clinical notes (2022.findings-acl)
Copied to clipboard
| Challenge: | Extracted causal information from clinical notes can be combined with structured EHR data such as demographics, diagnoses, and medications. |
| Approach: | They propose to annotate clinical notes and develop an annotated corpus and provide baseline scores to identify types and direction of causal relations between a pair of biomedical concepts. |
| Outcome: | The proposed annotation guidelines achieved a high inter-annotator agreement and a macro F1 score on the clinical text. |
Large Language Models with Temporal Reasoning for Longitudinal Clinical Summarization and Prediction (2025.findings-emnlp)
Copied to clipboard
Maya Kruse, Shiyue Hu, Nicholas Derby, Yifu Wu, Samantha Stonbraker, Bingsheng Yao, Dakuo Wang, Elizabeth M. Goldberg, Yanjun Gao
| Challenge: | Recent advances in large language models have shown potential in clinical text summarization, but their ability to handle long patient trajectories with multi-modal data spread across time remains underexplored. |
| Approach: | They evaluate open-source large language models, their Retrieval Augmented Generation variants and chain-of-thought prompting on long-context clinical summarization and prediction. |
| Outcome: | The proposed models can synthesize structured and unstructured EHR data while reasoning over temporal coherence. |
The Medical Scribe: Corpus Development and Model Performance Analyses (2020.lrec-1)
Copied to clipboard
Izhak Shafran, Nan Du, Linh Tran, Amanda Perry, Lauren Keyes, Mark Knichel, Ashley Domin, Lei Huang, Yu-hui Chen, Gang Li, Mingqiu Wang, Laurent El Shafey, Hagen Soltau, Justin Stuart Paul
| Challenge: | Existing tools to assist in clinical note generation using audio of provider-patient encounters are lacking. |
| Approach: | They develop an annotation scheme to extract relevant clinical concepts from audio of provider-patient encounters and train a state-of-the-art tagging model. |
| Outcome: | The proposed model is more useful than the F-scores reflect and can be used in clinical notes. |
How Robust Are Large Language Models for Clinical Numeracy? An Empirical Study on Numerical Reasoning Abilities in Clinical Contexts (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluations of Large Language Models for clinical numerical reasoning provide limited operation-level coverage and limited robustness of numerical understanding across clinical note formats. |
| Approach: | They propose a benchmarking tool that evaluates four main types of clinical numeracy . they present longitudinal MIMIC-IV vital-sign records in three semantically equivalent representations . |
| Outcome: | The proposed benchmark evaluates four main types of clinical numeracy: value retrieval, arithmetic computation, relational comparison, and aggregation. |
CLIP: A Dataset for Extracting Action Items for Physicians from Hospital Discharge Notes (2021.acl-long)
Copied to clipboard
James Mullenbach, Yada Pruksachatkun, Sean Adler, Jennifer Seale, Jordan Swartz, Greg McKelvey, Hui Dai, Yi Yang, David Sontag
| Challenge: | Continuity of care is crucial to ensuring positive health outcomes for patients discharged from an inpatient hospital setting. |
| Approach: | They propose to annotate clinical action items from a dataset of medical notes annotated by physicians and extract them as multi-aspect extractive summarization. |
| Outcome: | The proposed dataset is annotated by physicians and covers 718 documents representing 100K sentences. |
Data Drift in Clinical Outcome Prediction from Admission Notes (2024.lrec-main)
Copied to clipboard
Paul Grundmann, Jens-Michalis Papaioannou, Tom Oberhauser, Thomas Steffek, Amy Siu, Wolfgang Nejdl, Alexander Loeser
| Challenge: | a pivotal dataset for clinical NLP research was released in 2016 . public access to such datasets is limited due to privacy and ethical concerns . |
| Approach: | They propose a novel clinical outcome prediction dataset based on MIMIC-IV . they provide initial insights into the performance of models trained on MIDIC-III . |
| Outcome: | The proposed dataset aims to probe the robustness and generalization of clinical outcome prediction models . the study focuses on challenges tied to evolving documentation standards and changing codes in the ICD taxonomy . |
Modelling Temporal Document Sequences for Clinical ICD Coding (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing studies on the ICD coding task focus on extracting codes from the discharge summary, but there is potential to automate the task by identifying relevant information from clinical notes. |
| Approach: | They propose a hierarchical transformer architecture that uses text across the entire sequence of clinical notes in each hospital stay for ICD coding. |
| Outcome: | The proposed model exceeds the state-of-the-art when using only discharge summaries as input and achieves performance improvements when all clinical notes are used as input. |
Towards Adapting Open-Source Large Language Models for Expert-Level Clinical Note Generation (2025.findings-acl)
Copied to clipboard
Hanyin Wang, Chufan Gao, Bolun Liu, Qiping Xu, Guleid Hussein, Mohamad El Labban, Kingsley Iheasirim, Hariprasad Reddy Korsapati, Chuck Outcalt, Jimeng Sun
| Challenge: | Proprietary Large Language Models (LLMs) have demonstrated promising capabilities in clinical text summarization tasks. |
| Approach: | They propose a domain- and task-specific adaptation process for an open-source LLaMA-2 model . LLama-2 can generate high-quality clinical notes from outpatient patient-doctor dialogues . |
| Outcome: | The proposed model can generate clinical notes comparable to those authored by physicians. |
How to leverage the multimodal EHR data for better medical prediction? (2021.emnlp-main)
Copied to clipboard
| Challenge: | Using deep learning to improve healthcare is challenging due to the complexity of EHR data. |
| Approach: | They propose a method to integrate clinical notes from EHR and combine them with different data to improve prediction performance. |
| Outcome: | The proposed model outperforms the state-of-the-art method without clinical notes on two prediction tasks. |