BioLORD: Learning Ontological Representations from Definitions for Biomedical Concepts and their Textual Descriptions (2022.findings-emnlp)
Copied to clipboard
| Challenge: | BioLORD is a pre-training strategy for producing meaningful representations for clinical sentences and biomedical concepts. |
| Approach: | They propose a pre-training strategy for producing meaningful representations for clinical sentences and biomedical concepts using definitions and ontologies. |
| Outcome: | The proposed model produces more semantic representations that match more closely the hierarchical structure of ontologies. |
Similar Papers
BioHiCL: Hierarchical Multi-Label Contrastive Learning for Biomedical Retrieval with MeSH Labels (2026.acl-short)
Copied to clipboard
| Challenge: | Existing biomedical generative retrievers lack domain semantics and hierarchical relationships among biomedically related texts. |
| Approach: | They propose a biomedical retrieval model with hierarchical multi-label contrastive learning that leverages hierarchic MeSH annotations to provide structured supervision for multi-labor contrastive training. |
| Outcome: | The proposed models achieve promising performance on biomedical retrieval, sentence similarity, and question answering tasks while remaining computationally efficient for deployment. |
Robust Representation Learning of Biomedical Names (P19-1)
Copied to clipboard
| Challenge: | Biomedical concepts are often mentioned in medical documents under different name variations. |
| Approach: | They propose a framework for learning robust representations of biomedical names and terms . they encode contextual meaning, conceptual meaning, and similarity between synonyms . |
| Outcome: | The proposed framework outperforms baselines on retrieval, similarity and relatedness benchmarks. |
Generative Biomedical Entity Linking via Knowledge Base-Guided Pre-training and Synonyms-Aware Fine-tuning (2022.naacl-main)
Copied to clipboard
| Challenge: | Generative methods for biomedical entity linking (EL) use synonyms knowledge from knowledge bases (KB) this is not trivial to inject into a generative method, but it is cost-effective. |
| Approach: | They propose to inject synonyms knowledge into a generative model of biomedical EL by constructing synthetic samples with synonyms and definitions from KB and requiring the model to recover concept names. |
| Outcome: | The proposed method achieves state-of-the-art results on several biomedical EL tasks without candidate selection. |
Deep Neural Models for Medical Concept Normalization in User-Generated Texts (P19-2)
Copied to clipboard
| Challenge: | a medical concept normalization problem is a challenge since social media texts are ambiguous and noisy . a recent study shows that neural architectures leverage the semantic meaning of the entity mention . |
| Approach: | They propose to map a health-related entity mention to a controlled vocabulary . they use powerful neural networks and contextualized word representation models . |
| Outcome: | The proposed model outperforms existing state-of-the-art models in mapping medical concepts to medical terms . the proposed model is based on recurrent neural networks and contextualized word representation models . |
Biomedical relation extraction with pre-trained language representations and minimal task-specific architecture (D19-57)
Copied to clipboard
| Challenge: | Using a pre-trained BERT-Base model, we learn domain-specific language representations using biomedical text. |
| Approach: | They propose a system that extends BERT, a state-of-the-art language model, which learns contextual language representations from a large unlabelled corpus. |
| Outcome: | The proposed model outperforms a baseline model while relying on an extremely simple setup with no specially engineered features. |
Guiding Large Language Models for Biomedical Entity Linking via Restrictive and Contrastive Decoding (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing attempts to apply large language models to BioEL have revealed difficulties . |
| Approach: | They propose a framework that enables large language models to adapt well to BioEL . they employ restrictive decoding to ensure the generation of valid entities . |
| Outcome: | Extensive experiments show that the framework outperforms existing LLMs. |
MedCATTrainer: A Biomedical Free Text Annotation Interface with Active Learning and Research Use Case Specific Customisation (D19-3)
Copied to clipboard
| Challenge: | 80% of biomedical data is stored in unstructured text such as electronic health records (EHRs). |
| Approach: | They propose a web-based interface for building, improving and customising a given Named Entity Recognition and Linking (NER+L) model for biomedical domain text. |
| Outcome: | The proposed interface is designed to build, improve and customise a NER+L model for biomedical domain text and collate accurate research use case specific training data. |
Descriptive Knowledge Graph in Biomedical Domain (2023.emnlp-demo)
Copied to clipboard
| Challenge: | Existing systems that retrieve unconnected passages do not provide efficient search for relational knowledge. |
| Approach: | They propose a system that automatically extracts and generates informative and descriptive sentences from the biomedical corpus and facilitates efficient search for relational knowledge. |
| Outcome: | The proposed system extracts and generates informative and descriptive sentences from the biomedical corpus and facilitates the efficient search for relational knowledge. |
BioEL: A Comprehensive Python Package for Biomedical Entity Linking (2025.findings-naacl)
Copied to clipboard
Prasanth Bathala, Christophe Ye, Batuhan Nursal, Shubham Lohiya, David Kartchner, Cassie S. Mitchell
| Challenge: | Entity Linking in biomedical literature is a critical task that enhances the extraction and integration of information from diverse scientific literature. |
| Approach: | They propose a Python package that allows for better Entity Linking in biomedical literature . the package includes four components: Ontology Object, Dataset Object and Evaluation Framework . |
| Outcome: | The proposed open-source package enables the implementation and comparison of biomedical entity linking tasks. |
Can Language Models be Biomedical Knowledge Bases? (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies have focused on probing LMs in the general domain but little attention has been given to whether they can be used as domain knowledge bases. |
| Approach: | They propose to use 49K biomedical factual knowledge triples to probe LMs for biomedically . they find that biomedic LM can achieve up to 18.51% Acc@5 on retrieving biomedcial knowledge. |
| Outcome: | The proposed biomedical factual knowledge probing benchmark achieves 18.51% Acc@5 on biomedically-relevant knowledge retrieval. |