Attention Networks for Augmenting Clinical Text with Support Sets for Diagnosis Prediction (2022.coling-1)
Copied to clipboard
| Challenge: | Clinical language models may suffer from imbalanced vocabulary for describing diseases or symptoms. |
| Approach: | They propose to augment clinical text with potentially complementary diagnostic codes from prior admissions or as they emerge during differential diagnosis to improve the performance. |
| Outcome: | The proposed approach outperforms the previous state-of-the-art PubMedBERT by up 3% points. |
Similar Papers
Explainable Prediction of Medical Codes from Clinical Text (N18-1)
Copied to clipboard
| Challenge: | Clinical notes are text documents that are created by clinicians for each patient encounter. |
| Approach: | They propose a method that aggregates information across the document using a convolutional neural network and uses an attention mechanism to select the most relevant segments for each of the thousands of possible codes. |
| Outcome: | The proposed method is accurate and better than the current state of the art. |
A Novel Framework Based on Medical Concept Driven Attention for Explainable Medical Code Prediction via External Knowledge (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to predict medical codes from clinical notes lack interpretability due to lengthy and noisy clinical notes. |
| Approach: | They propose a framework based on medical concept driven attention to integrate external knowledge for explainable medical code prediction from clinical notes. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on a benchmark dataset showing that it is more accurate than existing methods. |
Clinical Outcome Prediction from Admission Notes using Self-Supervised Knowledge Integration (2021.eacl-main)
Copied to clipboard
Betty van Aken, Jens-Michalis Papaioannou, Manuel Mayrdorfer, Klemens Budde, Felix Gers, Alexander Loeser
| Challenge: | Clinical decision support systems can help in situations where the patient's development is predicted based on textual data. |
| Approach: | They propose to use clinical outcome pre-training to integrate knowledge about patient outcomes from multiple public sources into the models. |
| Outcome: | The proposed model improves performance against several baselines and demonstrates that it is transferable and can be used in clinical decision support systems. |
This Patient Looks Like That Patient: Prototypical Networks for Interpretable Diagnosis Prediction from Clinical Text (2022.aacl-main)
Copied to clipboard
Betty van Aken, Jens-Michalis Papaioannou, Marcel Naik, Georgios Eleftheriadis, Wolfgang Nejdl, Felix Gers, Alexander Loeser
| Challenge: | a novel method for diagnosis prediction from clinical text is needed in clinical practice . prototypical part networks and label-wise attention are used to make models interpretable and helpful . |
| Approach: | They propose a deep neural model that makes predictions based on parts of the text that are similar to prototypical patients. |
| Outcome: | The proposed method outperforms baseline models on two clinical datasets and provides valuable explanations for clinical decision support. |
Literature-Augmented Clinical Outcome Prediction (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing approaches to clinical outcome prediction use only clinical notes and general biomedical literature. |
| Approach: | They propose to retrieve patient-specific medical literature and incorporate it into predictive models by combining clinical notes with language models. |
| Outcome: | The proposed approach boosts predictive performance on three important clinical tasks in comparison to strong LM baselines, increasing F1 by up to 5 points and precision@Top-K by a large margin of over 25%. |
Less is More: Explainable and Efficient ICD Code Prediction with Clinical Entities (2025.acl-long)
Copied to clipboard
| Challenge: | Clinical coding is labor-intensive and prone to delays, leading to global backlogs. |
| Approach: | They propose an approach that combines Named Entity Recognition (NER) and Assertion Classification (AC) to filter for clinically important content before supervised code prediction. |
| Outcome: | The proposed approach reduces training time by over half on a standard evaluation dataset compared to current methods . it uses Named Entity Recognition (NER) and Assertion Classification (AC) to filter for clinically important content before supervised code prediction. |
LIFTED: Multimodal Clinical Trial Outcome Prediction via Large Language Models and Mixture-of-Experts (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Clinical trials are costly and pivotal processes that require substantial expenses . a new approach to integrate multimodal data for clinical outcome prediction is needed . |
| Approach: | a proposed framework transforms modality-specific data into natural language descriptions . a sparse Mixture-of-Experts mechanism then identifies shared patterns across modalities . |
| Outcome: | a proposed framework outperforms baseline methods in predicting clinical trial outcomes . it transforms modality-specific data into natural language descriptions, encoded via unified encoders . |
SpanPredict: Extraction of Predictive Document Spans with Neural Attention (2021.naacl-main)
Copied to clipboard
| Challenge: | identifying predictive text in clinical notes can be as important as the predictions themselves . identifying specific content in clinical note descriptions may illuminate previously unknown risk factors . |
| Approach: | They propose a method for identifying predictive text in clinical notes . they use linear attention to formalize the problem as predictive extraction . |
| Outcome: | The proposed model preserves differentiability and allows scalable inference via stochastic gradient descent. |
Analyzing Code Embeddings for Coding Clinical Narratives (2021.findings-acl)
Copied to clipboard
| Challenge: | Recent work on automated ICD coding learn mappings between low-dimensional representations of clinical text reports and codes. |
| Approach: | They propose novel neural networks for encoding medical codes based on textual, structural and statistical characteristics using a single deep learning baseline model. |
| Outcome: | The proposed methods improve the accuracy of medical codes based on their textual, structural and statistical characteristics. |
Knowledge-augmented Graph Neural Networks with Concept-aware Attention for Adverse Drug Event Detection (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent studies have used word embedding and deep learning to automate ADE detection from text, but they did not incorporate explicit medical knowledge about drugs and adverse reactions or the corresponding feature learning. |
| Approach: | They propose to integrate medical knowledge into ADE detection from text . they use contextualized embeddings from pretrained language models and convolutional graph neural networks to learn features differently for different types of nodes in the graph. |
| Outcome: | The proposed model outperforms existing models on four public datasets and shows that it is based on medical knowledge and embeddings from pretrained language models and neural networks. |