MedDistant19: Towards an Accurate Benchmark for Broad-Coverage Biomedical Relation Extraction (2022.coling-1)
Copied to clipboard
| Challenge: | Relation extraction in the biomedical domain is challenging due to the lack of labeled data and high annotation costs. |
| Approach: | They propose to use distant supervision to pair knowledge graph relationships with raw texts to tackle the scarcity of annotated data and to validate their results. |
| Outcome: | The proposed benchmarks are more accurate and consistent with existing benchmarks and show that there is no train-test leakage. |
Similar Papers
Bio-RFX: Refining Biomedical Extraction via Advanced Relation Classification and Structural Constraints (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for extracting structured data from unstructured texts neglect unique features of the biomedical literature, such as ambiguous entities and nested proper nouns. |
| Approach: | They propose a model that leverages sentence-level relation classification before entity extraction to tackle entity ambiguity. |
| Outcome: | The proposed model outperforms baselines in both NER and RE tasks and has competitive performance compared to the state-of-the-art fine-tuned baselines for RE. |
A Domain-Specific Curated Benchmark for Entity and Document-Level Relation Extraction (2026.findings-eacl)
Copied to clipboard
Marco Martinelli, Stefano Marchesin, Vanessa Bonato, Giorgio Di Nunzio, Nicola Ferro, Ornella Irrera, Laura Menotti, Federica Vezzani, Gianmaria Silvello
| Challenge: | Existing biomedical IE benchmarks are narrow in scope and rely heavily on distantly supervised annotations. |
| Approach: | They propose a benchmark for Information Extraction (IE) that annotates entities, concept-level links, and relations manually from PubMed abstracts. |
| Outcome: | The GutBrainIE benchmark is based on more than 1,600 PubMed abstracts, manually annotated by biomedical and terminological experts with fine-grained entities, concept-level links, and relations. |
A Distant Supervision Corpus for Extracting Biomedical Relationships Between Chemicals, Diseases and Genes (2022.lrec-1)
Copied to clipboard
| Challenge: | Biomedical researchers have used manual curation to extract biomedical interactions from research texts to improve coverage. |
| Approach: | They propose a new dataset for training and evaluating multi-class multi-label biomedical relation extraction models using human annotations and the CTD database. |
| Outcome: | The proposed dataset is substantially larger and cleaner than existing datasets and includes annotations linking mentions to their entities. |
Syntax-aware Multi-task Graph Convolutional Networks for Biomedical Relation Extraction (D19-62)
Copied to clipboard
| Challenge: | 80% of the data sets for relation extraction tasks are negative instances, resulting in a lack of syntactic information between two entity mentions. |
| Approach: | They propose a graph convolutional networks model that incorporates dependency parsing and contextualized embedding to capture comprehensive contextual information. |
| Outcome: | The proposed model achieves state-of-the-art F-score on the 2013 drug-drug interaction extraction task. |
Can NLI Provide Proper Indirect Supervision for Low-resource Biomedical Relation Extraction? (2023.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to biomedical relation extraction (RE) are limited due to the scarcity of annotations and the prevalence of instances without explicitly pre-defined labels. |
| Approach: | They propose a method which converts biomedical relation extraction (RE) as natural language inference formulation through indirect supervision. |
| Outcome: | Extensive experiments on three widely-used biomedical RE benchmarks show that indirect supervision improves biomedically relation extraction even when a domain gap exists. |
Towards Accurate and Consistent Evaluation: A Dataset for Distantly-Supervised Relation Extraction (2020.coling-main)
Copied to clipboard
| Challenge: | Distant Supervision (DS) generates large-scale annotated data but has wrong labels that result in incorrect evaluation scores during testing. |
| Approach: | They build a dataset using DS-generated data as training data and hire annotators to label test data. |
| Outcome: | The proposed dataset NYTH has a much larger test set and performs more accurate and consistent evaluation. |
Dependency Parsing-Based Syntactic Enhancement of Relation Extraction in Scientific Texts (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a pipeline approach to extract entities and relations from scientific text is challenging due to long sentences with densely packed entities. |
| Approach: | They propose a syntactic filtering method that prunes unlikely entity pairs before relation prediction. |
| Outcome: | The proposed method improves Rel+ F1 scores on SciERC, SciER, and ACE05 datasets. |
Global Relation Embedding for Relation Extraction (N18-1)
Copied to clipboard
| Challenge: | Existing methods to extract textual relations with distant supervision are limited by their reliance on supervised training data. |
| Approach: | They propose to embed relations with global statistics of relations to combat the wrong labeling problem of distant supervision. |
| Outcome: | The proposed method is more robust to training noise introduced by distant supervision and improves relation extraction models. |
What Do You Mean by Relation Extraction? A Survey on Datasets and Study on Scientific Relation Classification (2022.acl-srw)
Copied to clipboard
| Challenge: | Existing RE surveys focus on modeling techniques, but there are few that are based on real-world scenarios. |
| Approach: | They propose to survey RE datasets and revisit the task definition and its adoption by the community. |
| Outcome: | The proposed approach improves the reliability of RE evaluations across multiple datasets and reveals significant discrepancies in annotations. |
Leveraging Dependency Forest for Neural Medical Relation Extraction (D19-1)
Copied to clipboard
| Challenge: | Existing methods for medical relation extraction use dependency syntax as a source of features. |
| Approach: | They propose a method to extract relational information from medical literature by using dependency forests. |
| Outcome: | The proposed method outperforms the standard tree-based methods in the medical domain. |