Structured Multi-Label Biomedical Text Tagging via Attentive Neural Tree Decoding (D18-1)
Copied to clipboard
| Challenge: | Existing methods for tagging unstructured texts with arbitrary number of terms drawn from an ontology are lacking. |
| Approach: | They propose a model for tagging unstructured texts with an arbitrary number of terms drawn from an ontology. |
| Outcome: | The proposed model yields state-of-the-art results on the important task of assigning MeSH terms to biomedical abstracts. |
Similar Papers
Deep Neural Models for Medical Concept Normalization in User-Generated Texts (P19-2)
Copied to clipboard
| Challenge: | a medical concept normalization problem is a challenge since social media texts are ambiguous and noisy . a recent study shows that neural architectures leverage the semantic meaning of the entity mention . |
| Approach: | They propose to map a health-related entity mention to a controlled vocabulary . they use powerful neural networks and contextualized word representation models . |
| Outcome: | The proposed model outperforms existing state-of-the-art models in mapping medical concepts to medical terms . the proposed model is based on recurrent neural networks and contextualized word representation models . |
Compositional Generalization via Semantic Tagging (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing neural sequence-to-sequence models fail at compositional generalization, i.e., they cannot generalize to unseen compositions of seen components. |
| Approach: | They propose a decoding framework that preserves expressivity and generality of sequence-to-sequence models while featuring lexicon-style alignments and disentangled information processing. |
| Outcome: | The proposed framework improves compositional generalization across model architectures, domains, and semantic formalisms on three semantic parsing datasets. |
BioHiCL: Hierarchical Multi-Label Contrastive Learning for Biomedical Retrieval with MeSH Labels (2026.acl-short)
Copied to clipboard
| Challenge: | Existing biomedical generative retrievers lack domain semantics and hierarchical relationships among biomedically related texts. |
| Approach: | They propose a biomedical retrieval model with hierarchical multi-label contrastive learning that leverages hierarchic MeSH annotations to provide structured supervision for multi-labor contrastive training. |
| Outcome: | The proposed models achieve promising performance on biomedical retrieval, sentence similarity, and question answering tasks while remaining computationally efficient for deployment. |
AMR dependency parsing with a typed semantic algebra (P18-1)
Copied to clipboard
| Challenge: | Abstract Meaning Representations (AMRs) are graphs which describe the predicate-argument structure of a sentence. |
| Approach: | They propose a semantic parser which parses strings into tree representations of the compositional structure of an AMR graph. |
| Outcome: | The proposed parser outperforms baselines and standard neural techniques for supertagging and dependency tree parsing. |
Bringing Emerging Architectures to Sequence Labeling in NLP (2026.eacl-long)
Copied to clipboard
| Challenge: | Pretrained Transformer encoders are the dominant approach to sequence labeling . however, few have been applied to sequence labels on flat or simplified tasks . |
| Approach: | They propose to use pretrained Transformer encoders to model relations across words . they find that the architectures adapt well across tagging tasks that vary in complexity . |
| Outcome: | The proposed architectures perform well across tagging tasks across languages and datasets. |
KenMeSH: Knowledge-enhanced End-to-end Biomedical Text Labelling (2022.acl-long)
Copied to clipboard
| Challenge: | Medical Subject Headings (MeSH) are manually assigned to every biomedical article to facilitate retrieval of relevant information. |
| Approach: | They propose a model that combines new text features with a dynamic knowledge-enhanced mask attention that integrates document features with MeSH label hierarchy and journal correlation features to index MeSH terms. |
| Outcome: | The proposed model achieves state-of-the-art on a number of measures. |
End-to-End Graph-Based TAG Parsing with Neural Networks (N18-1)
Copied to clipboard
| Challenge: | Using BiLSTMs, highway connections, and character-level CNNs, we propose a graph-based Tree Adjoining Grammar (TAG) parser. |
| Approach: | They propose a graph-based Tree Adjoining Grammar parser that uses BiLSTMs, highway connections, and character-level CNNs. |
| Outcome: | The proposed parser outperforms the previously reported best by more than 2.2 LAS and UAS points. |
Multilingualization of Medical Terminology: Semantic and Structural Embedding Approaches (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing methods for multilingual terminology curation are limited as they do not fit the term within existing terminology. |
| Approach: | They propose a method to encode the structural property of a term by aligning embeddings using graph convolutional networks trained from separate languages. |
| Outcome: | The proposed method can encode the structural property of a term by aligning embeddings using graph convolutional networks trained from separate languages. |
Unleashing the True Potential of Sequence-to-Sequence Models for Sequence Tagging and Structure Parsing (2023.tacl-1)
Copied to clipboard
| Challenge: | Sequence-to-Sequence (S2S) models have been successful on text generation tasks . however, learning complex structures with S2S models remains challenging . |
| Approach: | They propose to use constrained decoding to model part-of-speech tagging, named entity recognition, constituency, and dependency parsing tasks with 3 lexically diverse linearization schemas and corresponding constrained coding methods. |
| Outcome: | The proposed methods outperform the state-of-the-art on four core tasks. |
Generative Biomedical Entity Linking via Knowledge Base-Guided Pre-training and Synonyms-Aware Fine-tuning (2022.naacl-main)
Copied to clipboard
| Challenge: | Generative methods for biomedical entity linking (EL) use synonyms knowledge from knowledge bases (KB) this is not trivial to inject into a generative method, but it is cost-effective. |
| Approach: | They propose to inject synonyms knowledge into a generative model of biomedical EL by constructing synthetic samples with synonyms and definitions from KB and requiring the model to recover concept names. |
| Outcome: | The proposed method achieves state-of-the-art results on several biomedical EL tasks without candidate selection. |