| Challenge: | Clinical notes are text documents that are created by clinicians for each patient encounter. |
| Approach: | They propose a method that aggregates information across the document using a convolutional neural network and uses an attention mechanism to select the most relevant segments for each of the thousands of possible codes. |
| Outcome: | The proposed method is accurate and better than the current state of the art. |
Similar Papers
A Novel Framework Based on Medical Concept Driven Attention for Explainable Medical Code Prediction via External Knowledge (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to predict medical codes from clinical notes lack interpretability due to lengthy and noisy clinical notes. |
| Approach: | They propose a framework based on medical concept driven attention to integrate external knowledge for explainable medical code prediction from clinical notes. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on a benchmark dataset showing that it is more accurate than existing methods. |
Attention Networks for Augmenting Clinical Text with Support Sets for Diagnosis Prediction (2022.coling-1)
Copied to clipboard
| Challenge: | Clinical language models may suffer from imbalanced vocabulary for describing diseases or symptoms. |
| Approach: | They propose to augment clinical text with potentially complementary diagnostic codes from prior admissions or as they emerge during differential diagnosis to improve the performance. |
| Outcome: | The proposed approach outperforms the previous state-of-the-art PubMedBERT by up 3% points. |
Medical Code Assignment with Gated Convolution and Note-Code Interaction (2021.findings-acl)
Copied to clipboard
| Challenge: | Medical code assignment from clinical text is a longstanding challenge due to lengthy semantic information in medical notes. |
| Approach: | They propose a method to capture the semantic information of medical notes and a note-code interaction to automate medical code assignment from clinical text. |
| Outcome: | The proposed method outperforms state-of-the-art models on real-world clinical datasets and is on par with light-weighted baselines. |
Clinical-Coder: Assigning Interpretable ICD-10 Codes to Chinese Clinical Notes (2020.acl-demos)
Copied to clipboard
| Challenge: | Existing methods of automatic coding prediction have been successful, but the interpretability of predicted codes is a challenge. |
| Approach: | They propose an online system that can predict ICD codes for Chinese clinical notes by using a Dilated Convolutional Attention network with N-gram Matching mechanism. |
| Outcome: | The proposed system is able to provide supporting information in clinical decision making. |
Explainable Clinical Decision Support from Text (2020.emnlp-main)
Copied to clipboard
| Challenge: | Clinical prediction models often use structured variables and provide outcomes that are not readily interpretable by clinicians. |
| Approach: | They propose a hierarchical CNN-transformer model with explicit attention as an interpretable, multi-task clinical language model. |
| Outcome: | The proposed model achieves AUROCs of 0.75 and 0.78 on sepsis and mortality prediction. |
Beyond Label Attention: Transparency in Language Models for Automated Medical Coding via Dictionary Learning (2024.emnlp-main)
Copied to clipboard
| Challenge: | Current efforts in interpretability of medical coding rely heavily on label attention mechanisms, which often leads to the highlighting of extraneous tokens irrelevant to the ICD code. |
| Approach: | They propose to leverage dictionary learning to extract sparsely activated representations from dense language models embedded in superposition to facilitate accurate interpretability. |
| Outcome: | The proposed model extracts sparsely activated representations from dense language models in superposition, even when the highlighted tokens are medically irrelevant. |
MedCodER: A Generative AI Assistant for Medical Coding (2025.naacl-industry)
Copied to clipboard
Krishanu Das Baksi, Elijah Soba, John J Higgins, Ravi Saini, Jaden Wood, Jane Cook, Jack I Scott, Nirmala Pudota, Tim Weninger, Edward Bowen, Sanmitra Bhattacharya
| Challenge: | Medical coding is time-consuming and error-prone due to large label space, lengthy text inputs, and the absence of supporting evidence annotations. |
| Approach: | They propose a Generative AI framework for automatic medical coding that leverages extraction, retrieval, and re-ranking techniques as core components. |
| Outcome: | The proposed framework outperforms existing methods on the International Classification of Diseases (ICD) code prediction scale. |
SpanPredict: Extraction of Predictive Document Spans with Neural Attention (2021.naacl-main)
Copied to clipboard
| Challenge: | identifying predictive text in clinical notes can be as important as the predictions themselves . identifying specific content in clinical note descriptions may illuminate previously unknown risk factors . |
| Approach: | They propose a method for identifying predictive text in clinical notes . they use linear attention to formalize the problem as predictive extraction . |
| Outcome: | The proposed model preserves differentiability and allows scalable inference via stochastic gradient descent. |
Effective Convolutional Attention Network for Multi-label Clinical Document Classification (2021.emnlp-main)
Copied to clipboard
| Challenge: | a large number of medical encounters need to be coded everyday due to long document sets and large label set. |
| Approach: | They propose a convolutional attention network for multi-label document classification problem . they use convolution-based encoders and convolution networks to aggregate information across documents . |
| Outcome: | The proposed model outperforms prior best model and multilingual Transformer model on a widely used dataset in the medical domain. |
An Annotated Corpus of Textual Explanations for Clinical Decision Support (2022.lrec-1)
Copied to clipboard
Roland Roller, Aljoscha Burchardt, Nils Feldhus, Laura Seiffe, Klemens Budde, Simon Ronicke, Bilgin Osmanodja
| Challenge: | In recent years, machine learning for clinical decision support has gained more and more attention. |
| Approach: | They propose to use XAI to provide an explanation of a model's decision making process by constructing a corpus of sentences that are annotated with different semantic layers. |
| Outcome: | The proposed models outperform physicians on very specific, narrow tasks or can help physicians to work more efficiently. |