Medical Coding with Biomedical Transformer Ensembles and Zero/Few-shot Learning (2022.naacl-industry)
Copied to clipboard
| Challenge: | Medical coding (MC) is an essential pre-requisite for reliable data retrieval and reporting. |
| Approach: | They propose a method to classify medical terms into standardized alphanumerical terms and codes . they use a combination of traditional BERT-based classification and a zero/few-shot learning approach . |
| Outcome: | The proposed approach outperforms baselines in the few-shot regime. |
Similar Papers
MedCodER: A Generative AI Assistant for Medical Coding (2025.naacl-industry)
Copied to clipboard
Krishanu Das Baksi, Elijah Soba, John J Higgins, Ravi Saini, Jaden Wood, Jane Cook, Jack I Scott, Nirmala Pudota, Tim Weninger, Edward Bowen, Sanmitra Bhattacharya
| Challenge: | Medical coding is time-consuming and error-prone due to large label space, lengthy text inputs, and the absence of supporting evidence annotations. |
| Approach: | They propose a Generative AI framework for automatic medical coding that leverages extraction, retrieval, and re-ranking techniques as core components. |
| Outcome: | The proposed framework outperforms existing methods on the International Classification of Diseases (ICD) code prediction scale. |
Extreme Zero-Shot Learning for Extreme Text Classification (2022.naacl-main)
Copied to clipboard
| Challenge: | Experimental results show that MACLR achieves superior performance compared to other baseline methods. |
| Approach: | They propose to pre-train Transformer-based encoders with self-supervised contrastive losses to learn the semantic embeddings of instances and labels with raw text. |
| Outcome: | The proposed method improves on the EZ-XMC model with a limited number of ground-truth positive pairs. |
Large language models are few-shot clinical information extractors (2022.emnlp-main)
Copied to clipboard
| Challenge: | a long-running goal of clinical NLP is the extraction of important variables trapped in clinical notes. |
| Approach: | They propose to use large language models to tackle diverse clinical extraction tasks . they propose to reannote existing CASI datasets to compare their models with clinical text. |
| Outcome: | The proposed models outperform existing models on few-shot clinical information extraction tasks. |
When Raw Data Prevails: Are Large Language Model Embeddings Effective in Numerical Data Representation for Medical Machine Learning Applications? (2024.findings-emnlp)
Copied to clipboard
Yanjun Gao, Skatje Myers, Shan Chen, Dmitriy Dligach, Timothy Miller, Danielle Bitterman, Matthew Churpek, Majid Afshar
| Challenge: | Numerical data is pivotal for medical questions and answers, but tabular data is not fully integrated into LLMs. |
| Approach: | They examine the effectiveness of vector representations from last hidden states of LLMs for medical diagnostics and prognostics using electronic health record data. |
| Outcome: | The proposed representations outperform those using raw numerical EHR data in medical diagnostics and prognostics. |
Can Medical Vision-Language Pre-training Succeed with Purely Synthetic Data? (2025.findings-acl)
Copied to clipboard
Che Liu, Zhongwei Wan, Haozhe Wang, Yinda Chen, Talha Qaiser, Chen Jin, Nikolay Burlutskiy, Fariba Yousefi, Rossella Arcucci
| Challenge: | Medical Vision-Language Pretraining (MedVLP) models typically require large-scale datasets with paired, high-quality image-text data. |
| Approach: | They propose to generate large-scale synthetic image-text pairs using off-the-shelf generative models . they propose to isolate model and training settings, focusing entirely from the data perspective. |
| Outcome: | The proposed pipeline outperforms models trained on real data by 3.8% on averaged AUC on zero-shot classification tasks. |
Just Read the Codebook! Make Use of Quality Codebooks in Zero-Shot Classification of Multilabel Frame Datasets (2025.coling-main)
Copied to clipboard
| Challenge: | Recent development of Large Language Models has led to more scrutiny of their performance on complex datasets. |
| Approach: | They propose to use large language models to provide concise instructions on how to code text with a multitude of complex labels on two datasets with varying topics. |
| Outcome: | The proposed approach outperforms few-shot In-Context-Learning setups on two complex datasets and is token-efficient and requires less hands-on engineering. |
AutoMIR: Effective Zero-Shot Medical Information Retrieval without Relevance Labels (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Effective zero-shot dense retrieval in the medical domain remains difficult due to the scarcity of relevance-labeled data. |
| Approach: | They propose a framework that leverages large language models to generate hypothetical documents . they also propose 'CMIRB' to provide a rigorous evaluation suite . |
| Outcome: | The proposed framework outperforms HyDE in retrieval accuracy and generalization . it leverages large language models to generate hypothetical documents conditioned on a query . |
Zero-shot Medical Entity Retrieval without Annotation: Learning From Rich Knowledge Graph Semantics (2021.findings-acl)
Copied to clipboard
| Challenge: | Current approaches to medical entity retrieval generalize poorly to unseen sub-specialties . zero-shot retrieval is challenging due to the high degree of ambiguity and variability in medical corpora . |
| Approach: | They propose a set of learning tasks designed to train efficient zero-shot entity retrieval models. |
| Outcome: | The proposed architecture outperforms common zero-shot benchmarks with 7% to 30% higher recall across multiple major medical ontologies. |
A Zero-shot and Few-shot Study of Instruction-Finetuned Large Language Models Applied to Clinical and Biomedical Tasks (2024.lrec-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have enabled advances in the field of natural language processing . however, their application and potential are still underexplored . |
| Approach: | They evaluate four state-of-the-art instruction-tuned Large Language Models on 13 NLP tasks in English. |
| Outcome: | The evaluated models outperform state-of-the-art models on 13 real-world clinical and biomedical NLP tasks in English. |
Boosting Transformers and Language Models for Clinical Prediction in Immunotherapy (2023.acl-industry)
Copied to clipboard
| Challenge: | Current machine learning approaches to predict clinical outcomes are limited to tabular data and are not applicable to clinical prediction. |
| Approach: | They investigate the potential of transformers to improve clinical prediction compared to conventional machine learning approaches and address the challenge of few-shot learning in predicting rare disease areas. |
| Outcome: | The proposed model improves the accuracy of baseline models and language models under few-shot regimes and shows that it is more accurate than previous models. |