Challenge: Existing biomedical generative retrievers lack domain semantics and hierarchical relationships among biomedically related texts.
Approach: They propose a biomedical retrieval model with hierarchical multi-label contrastive learning that leverages hierarchic MeSH annotations to provide structured supervision for multi-labor contrastive training.
Outcome: The proposed models achieve promising performance on biomedical retrieval, sentence similarity, and question answering tasks while remaining computationally efficient for deployment.

Similar Papers

BioLORD: Learning Ontological Representations from Definitions for Biomedical Concepts and their Textual Descriptions (2022.findings-emnlp)

Copied to clipboard

Challenge: BioLORD is a pre-training strategy for producing meaningful representations for clinical sentences and biomedical concepts.
Approach: They propose a pre-training strategy for producing meaningful representations for clinical sentences and biomedical concepts using definitions and ontologies.
Outcome: The proposed model produces more semantic representations that match more closely the hierarchical structure of ontologies.
KenMeSH: Knowledge-enhanced End-to-end Biomedical Text Labelling (2022.acl-long)

Copied to clipboard

Challenge: Medical Subject Headings (MeSH) are manually assigned to every biomedical article to facilitate retrieval of relevant information.
Approach: They propose a model that combines new text features with a dynamic knowledge-enhanced mask attention that integrates document features with MeSH label hierarchy and journal correlation features to index MeSH terms.
Outcome: The proposed model achieves state-of-the-art on a number of measures.
Structured Multi-Label Biomedical Text Tagging via Attentive Neural Tree Decoding (D18-1)

Copied to clipboard

Challenge: Existing methods for tagging unstructured texts with arbitrary number of terms drawn from an ontology are lacking.
Approach: They propose a model for tagging unstructured texts with an arbitrary number of terms drawn from an ontology.
Outcome: The proposed model yields state-of-the-art results on the important task of assigning MeSH terms to biomedical abstracts.
Guiding Large Language Models for Biomedical Entity Linking via Restrictive and Contrastive Decoding (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing attempts to apply large language models to BioEL have revealed difficulties .
Approach: They propose a framework that enables large language models to adapt well to BioEL . they employ restrictive decoding to ensure the generation of valid entities .
Outcome: Extensive experiments show that the framework outperforms existing LLMs.
Multimodal Graph-based Transformer Framework for Biomedical Relation Extraction (2021.findings-acl)

Copied to clipboard

Challenge: Existing models based on textual data do not capture context beyond the sentence.
Approach: They propose a framework that enables the model to learn multi-omnics biological information about entities (proteins) with the help of additional multi-modal cues like molecular structure.
Outcome: The proposed model is generalized and optimized for protein-protein interaction task and benefited from additional domain-specific cues.
BioFEG: Generate Latent Features for Biomedical Entity Linking (2023.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to biomedical entity linking suffer from multiple types of errors due to the rarity of many biomedically relevant entities in real-world scenarios.
Approach: They propose a latent feature generation framework to generate latent semantic features for unseen entities to capture fine-grained coherence information of unseened entities.
Outcome: The proposed framework is superior to existing models on two benchmark datasets.
Hierarchical Label Generation for Text Classification (2023.findings-eacl)

Copied to clipboard

Challenge: None Hierarchical text classification (HTC) aims to assign the most relevant labels with their structure for a given document.
Approach: They propose a method that captures the label hierarchy for real-world classification applications by using a taxonomic hierarchy.
Outcome: The proposed method can generate unseen labels in subword level.
HMCL: Task-Optimal Text Representation Adaptation through Hierarchical Contrastive Learning (2025.findings-emnlp)

Copied to clipboard

Challenge: Hierarchical Multilevel Contrastive Learning (HMCL) improves text representation for general large language models.
Approach: a new contrastive learning framework is developed to improve general large language models . HMCL integrates 3-level semantic differentiation and unifies contrastive and pair classification into a strategy .
Outcome: HMCL outperforms unsupervised methods and supervised fine-tuning approaches in multi-domain and multilingual benchmarks.
Federated Document-Level Biomedical Relation Extraction with Localized Context Contrast (2024.lrec-main)

Copied to clipboard

Challenge: Existing studies on relation extraction focus on document-level training without sharing raw medical texts.
Approach: They propose a federated framework for relation extraction that enables collaborative training without sharing raw medical texts.
Outcome: The proposed framework extends document-level relation extraction to a federated environment.
Syntax-aware Multi-task Graph Convolutional Networks for Biomedical Relation Extraction (D19-62)

Copied to clipboard

Challenge: 80% of the data sets for relation extraction tasks are negative instances, resulting in a lack of syntactic information between two entity mentions.
Approach: They propose a graph convolutional networks model that incorporates dependency parsing and contextualized embedding to capture comprehensive contextual information.
Outcome: The proposed model achieves state-of-the-art F-score on the 2013 drug-drug interaction extraction task.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations