Fair Evaluation in Concept Normalization: a Large-scale Comparative Analysis for BERT-based Models (2020.coling-main)
Copied to clipboard
| Challenge: | a large number of biomedical entity mentions are retrieved from different ontologies, requiring non-syntactic interpretation. |
| Approach: | They propose to use bidirectional encoder representations from transformers to link biomedical entities across three domains for a task called medical concept normalization. |
| Outcome: | The proposed neural architectures are efficient for linking biomedical entities across domains and corpora. |
Similar Papers
Handling Entity Normalization with no Annotated Corpus: Weakly Supervised Methods Based on Distributional Representation and Ontological Information (2020.lrec-1)
Copied to clipboard
Arnaud Ferré, Robert Bossy, Mouhamadou Ba, Louise Deléger, Thomas Lavergne, Pierre Zweigenbaum, Claire Nédellec
| Challenge: | Entity normalization is an important subtask of information extraction . it links entities mentions in text to categories or concepts in a reference vocabulary . |
| Approach: | They propose a method that uses corpus selection, pre-processing and weak supervision strategies to address the scarcity of training data. |
| Outcome: | The proposed method outperforms state-of-the-art methods in terms of accuracy and parametrization . it uses corpus selection, pre-processing and weak supervision strategies . |
A Primer in BERTology: What We Know About How BERT Works (2020.tacl-1)
Copied to clipboard
| Challenge: | a new study examines the current state of knowledge about the BERT model . the model is a stack of transformer encoder layers that are based on multiple self-attention ''heads'' |
| Approach: | They present a survey of over 150 studies of the popular Transformer-based model BERT . they discuss the current state of knowledge about how BERT works and how it is represented . |
| Outcome: | The proposed model is based on the Transformer-based model with state-of-the-art results . the proposed model has little cognitive motivation and is too small to perform ablation studies . |
A Fair and In-Depth Evaluation of Existing End-to-End Entity Linking Systems (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing evaluations of entity linking systems often lack detailed error analysis or a closer look at the results. |
| Approach: | They evaluate existing entity linking systems and propose two new benchmarks . they characterize their strengths and weaknesses and report on reproducibility aspects . |
| Outcome: | The evaluations of existing system have strong biases and artifacts . they characterize their strengths and weaknesses and report on reproducibility aspects . |
BERT Prescriptions to Avoid Unwanted Headaches: A Comparison of Transformer Architectures for Adverse Drug Event Detection (2021.eacl-main)
Copied to clipboard
| Challenge: | Pretrained transformer-based models are a common choice for identifying drug events from social media texts. |
| Approach: | They propose to compare transformer-based models with in-domain language pretraining to find out which one is better at ADE detection. |
| Outcome: | The proposed models outperform SpanBERT and PubMedBERT on two benchmarks. |
Transfer Learning in Biomedical Named Entity Recognition: An Evaluation of BERT in the PharmaCoNER task (D19-57)
Copied to clipboard
| Challenge: | Existing methods for natural language processing are labor-intensive and skill-dependent . Currently, most biomedical natural language tasks focus on English documents . |
| Approach: | They introduce a BERT benchmark to facilitate the research of PharmaCoNER task . they evaluate two baselines based on Multilingual BERT and BioBERT on the corpus . |
| Outcome: | The proposed task is based on multilingual BERT and BioBERT on the PharmaCoNER corpus. |
BERT might be Overkill: A Tiny but Effective Biomedical Entity Linker based on Residual Convolutional Neural Networks (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Biomedical entity linking is a task of linking entities in biomedical documents to referent entities in a knowledge base. |
| Approach: | They propose an efficient convolutional neural network with residual connections for biomedical entity linking. |
| Outcome: | The proposed model achieves comparable or even better linking accuracy on five public datasets while having about 60 times fewer parameters. |
An ensemble CNN method for biomedical entity normalization (D19-57)
Copied to clipboard
| Challenge: | Named entity recognition (NER) and entity normalization (entity linking) are two fundamental natural language processing tasks to achieve entity normalizing. |
| Approach: | They propose a CNN method that normalizes microbiology-related entities to concepts in standard dictionaries. |
| Outcome: | The proposed method performs well in the BioNLP-OST19 shared task Bacteria Biotope. |
Leveraging Large Language Models for NLG Evaluation: Advances and Challenges (2024.emnlp-main)
Copied to clipboard
| Challenge: | introducing Large Language Models (LLMs) has opened new avenues for assessing generated content quality, e.g., coherence, creativity, and context relevance. |
| Approach: | They propose a taxonomy for organizing existing LLM-based evaluation metrics and a structured framework to understand and compare them. |
| Outcome: | The proposed taxonomy offers a framework to understand and compare LLM-based evaluation methods. |
A Corpus with Multi-Level Annotations of Patients, Interventions and Outcomes to Support Language Processing for Medical Literature (P18-1)
Copied to clipboard
| Challenge: | In 2015 alone, about 100 manuscripts describing randomized controlled trials for medical interventions were published every day. |
| Approach: | They propose a corpus of 5,000 medical articles annotated with demarcations of text spans that describe the Patient population enrolled, the Interventions studied and to what they were Compared, and the Outcomes measured. |
| Outcome: | The proposed corpus includes 5,000 medical articles describing clinical randomized controlled trials. |
Deep Neural Models for Medical Concept Normalization in User-Generated Texts (P19-2)
Copied to clipboard
| Challenge: | a medical concept normalization problem is a challenge since social media texts are ambiguous and noisy . a recent study shows that neural architectures leverage the semantic meaning of the entity mention . |
| Approach: | They propose to map a health-related entity mention to a controlled vocabulary . they use powerful neural networks and contextualized word representation models . |
| Outcome: | The proposed model outperforms existing state-of-the-art models in mapping medical concepts to medical terms . the proposed model is based on recurrent neural networks and contextualized word representation models . |