Knowledge-Rich Self-Supervision for Biomedical Entity Linking (2022.findings-emnlp)
Copied to clipboard
Sheng Zhang, Hao Cheng, Shikhar Vashishth, Cliff Wong, Jinfeng Xiao, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
| Challenge: | Entity linking is challenging in high-value domains with myriad entities . standard classification approaches suffer from the annotation bottleneck . |
| Approach: | They propose a self-supervised approach to learn domain knowledge for biomedical entity linking . it generates self-reported mention examples on unlabeled text and trains contextual encoder . |
| Outcome: | The proposed method outperforms existing methods by 20 points in accuracy on biomedical datasets. |
Similar Papers
Generative Biomedical Entity Linking via Knowledge Base-Guided Pre-training and Synonyms-Aware Fine-tuning (2022.naacl-main)
Copied to clipboard
| Challenge: | Generative methods for biomedical entity linking (EL) use synonyms knowledge from knowledge bases (KB) this is not trivial to inject into a generative method, but it is cost-effective. |
| Approach: | They propose to inject synonyms knowledge into a generative model of biomedical EL by constructing synthetic samples with synonyms and definitions from KB and requiring the model to recover concept names. |
| Outcome: | The proposed method achieves state-of-the-art results on several biomedical EL tasks without candidate selection. |
BERT might be Overkill: A Tiny but Effective Biomedical Entity Linker based on Residual Convolutional Neural Networks (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Biomedical entity linking is a task of linking entities in biomedical documents to referent entities in a knowledge base. |
| Approach: | They propose an efficient convolutional neural network with residual connections for biomedical entity linking. |
| Outcome: | The proposed model achieves comparable or even better linking accuracy on five public datasets while having about 60 times fewer parameters. |
BioFEG: Generate Latent Features for Biomedical Entity Linking (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to biomedical entity linking suffer from multiple types of errors due to the rarity of many biomedically relevant entities in real-world scenarios. |
| Approach: | They propose a latent feature generation framework to generate latent semantic features for unseen entities to capture fine-grained coherence information of unseened entities. |
| Outcome: | The proposed framework is superior to existing models on two benchmark datasets. |
Clustering-based Inference for Biomedical Entity Linking (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing approaches to linking entities ignore relationships between entities in biomedical knowledge bases. |
| Approach: | They propose a model which can link mentions of unseen entities using learned representations of entities. |
| Outcome: | The proposed model improves on the largest publicly available biomedical dataset by 3.0 points of accuracy and 2.3 points of reliability. |
TrainX – Named Entity Linking with Active Sampling and Bi-Encoders (2020.coling-demos)
Copied to clipboard
Tom Oberhauser, Tim Bischoff, Karl Brendel, Maluna Menke, Tobias Klatt, Amy Siu, Felix Alexander Gers, Alexander Löser
| Challenge: | Existing easyto-use annotation tools do not support entity linking, which leads to additional training costs for medical professionals. |
| Approach: | They propose a system for Named Entity Linking for medical experts . they use Flair and BERT to support annotating training data with active sampling . |
| Outcome: | The proposed system is capable of linking against large knowledge bases and supporting zero-shot cases where the linker has never seen the entity before. |
Self-Alignment Pretraining for Biomedical Entity Representations (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing approaches to self-supervised learning of biomedical entities are limited in the biomedic domain. |
| Approach: | They propose a pretraining scheme that self-aligns the representation space of biomedical entities. |
| Outcome: | The proposed framework achieves state-of-the-art on six MEL benchmarking datasets. |
LLM as Entity Disambiguator for Biomedical Entity-Linking (2025.acl-short)
Copied to clipboard
| Challenge: | Entity linking involves normalizing a mention in medical text to a unique identifier in a knowledge base, such as UMLS or MeSH. |
| Approach: | They propose to use a large language model as an entity disambiguator to enhance the accuracy of alias-matching entity linking methods. |
| Outcome: | The proposed method surpasses existing methods on biomedical datasets by up to 16 points in accuracy. |
Guiding Large Language Models for Biomedical Entity Linking via Restrictive and Contrastive Decoding (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing attempts to apply large language models to BioEL have revealed difficulties . |
| Approach: | They propose a framework that enables large language models to adapt well to BioEL . they employ restrictive decoding to ensure the generation of valid entities . |
| Outcome: | Extensive experiments show that the framework outperforms existing LLMs. |
Learning Domain-Specialised Representations for Cross-Lingual Biomedical Entity Linking (2021.acl-short)
Copied to clipboard
| Challenge: | Existing work on transferring domain-specific knowledge from a pretraining model to a resource-poor language is limited to English . a novel cross-lingual biomedical entity linking task is proposed to improve this capability. |
| Approach: | They propose a cross-lingual biomedical entity linking task and establish a new benchmark spanning 10 typologically diverse languages. |
| Outcome: | The proposed methods yield consistent gains across all target languages, sometimes up to 20 Precision@1 points, without any in-domain knowledge in the target language and without any parallel data. |
DOCENT: Learning Self-Supervised Entity Representations from Large Document Collections (2021.eacl-main)
Copied to clipboard
Yury Zemlyanskiy, Sudeep Gandhe, Ruining He, Bhargav Kanagal, Anirudh Ravula, Juraj Gottweis, Fei Sha, Ilya Eckstein
| Challenge: | Using pre-trained models, we learn to jointly predict words and entities from multiple text sources without any human supervision. |
| Approach: | They propose to learn rich self-supervised entity representations from large amounts of associated text. |
| Outcome: | The proposed models outperform baseline models on downstream tasks in the TV-Movies domain, and scale to very large corpora. |