Keep Your Bearings: Lightly-Supervised Information Extraction with Ladder Networks That Avoids Semantic Drift (N18-2)
Copied to clipboard
| Challenge: | Using ladder networks, semi-supervised learning can be iterative and drifts semantically as learning progresses. |
| Approach: | They propose a method that uses ladder networks to perform a task of named entity classification using a large, unannotated dataset. |
| Outcome: | The proposed method improves on two standard datasets for named entity classification. |
Similar Papers
An Exploration of Three Lightly-supervised Representation Learning Approaches for Named Entity Classification (C18-1)
Copied to clipboard
| Challenge: | a recent study compares semi-supervised learning methods with bootstrapping methods . semi-semi-supervised methods reduce the amount of semantic drift introduced by iterative approaches . |
| Approach: | They propose to adapt three semi-supervised representation learning methods to an information extraction task . they show that all methods outperform state-of-the-art semi-representation learning methods . |
| Outcome: | The proposed methods outperform state-of-the-art semi-supervised methods on named entity classification task. |
Learning from Noisy Labels for Entity-Centric Information Extraction (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent information extraction approaches can easily overfit noisy labels and suffer from performance degradation. |
| Approach: | They propose a co-regularization framework for entity-centric information extraction that optimizes neural models with task-specific losses and regularizes them to generate similar predictions based on agreement loss. |
| Outcome: | The proposed framework is optimized with task-specific losses and generates similar predictions based on agreement loss. |
Entity or Relation Embeddings? An Analysis of Encoding Strategies for Relation Extraction (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to relation extraction use concatenating embeddings of head and tail entities . however, such representations capture the types of the entities involved, leading to false positives and confusion between relations involving entities of the same type. |
| Approach: | They propose a model which combines [MASK] embeddings with entity embedds to learn relation embeddations. |
| Outcome: | The proposed model outperforms the state-of-the-art on several benchmarks . it uses a self-supervised pre-training strategy which further improves the results. |
Weakly Supervised Named Entity Tagging with Learnable Logical Rules (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for building entity tagging systems use weak supervision . previous methods focus on disambiguating entity types based on contexts and expert-provided rules . |
| Approach: | They propose a method that bootstraps high-quality logical rules to train a neural tagger in a fully automated manner. |
| Outcome: | The proposed method outperforms weakly supervised methods on three datasets . it rivals state-of-the-art supervised method with lexicon of over 2,000 terms . |
A Frustratingly Easy Approach for Entity and Relation Extraction (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing work on end-to-end relation extraction models combine two tasks: named entity recognition and relation extraction. |
| Approach: | They propose a pipelined approach for entity and relation extraction that uses two independent encoders to construct the relation model. |
| Outcome: | The proposed approach achieves an 8.16 speedup with a slight reduction in accuracy on standard benchmarks. |
Coarse-to-Fine Pre-training for Named Entity Recognition (2020.emnlp-main)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) is a task of discovering information entities and identifying their corresponding categories. |
| Approach: | They propose a NER-specific framework to inject coarse-to-fine named entity knowledge into pre-trained models by using a remote supervision strategy. |
| Outcome: | The proposed framework achieves significant improvements against several pre-trained base-lines, demonstrating its effectiveness in label-few and low-resource scenarios. |
Weakly Supervised Attention Networks for Entity Recognition (D19-1)
Copied to clipboard
| Challenge: | Existing approaches to entity recognition require large amounts of token-level data, which can be expensive and cumbersome to obtain. |
| Approach: | They propose a weakly supervised model that can be annotated at word level from a corpus containing binary presence/absence labels. |
| Outcome: | The proposed model performs reasonably well on the task of entity recognition despite not having access to token-level ground truth data. |
Improving Fine-grained Entity Typing with Entity Linking (D19-1)
Copied to clipboard
| Challenge: | Existing methods for fine-grained entity typing require a large tag set and knowledge of the context. |
| Approach: | They propose a deep neural model that uses context and information from entity linking to improve fine-grained entity typing. |
| Outcome: | The proposed model achieves 5% absolute strict accuracy improvement over the state of the art on two datasets. |
Generic and Trend-aware Curriculum Learning for Relation Extraction (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing curriculum learning approaches for relation extraction are lacking in text graphs. |
| Approach: | They propose a generic and trend-aware curriculum learning approach that integrates textual and structural information in text graphs for relation extraction between entities. |
| Outcome: | The proposed model shows improvement over state-of-the-art methods across several datasets. |
Learning from Context or Names? An Empirical Study on Neural Relation Extraction (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing datasets may leak shallow heuristics via entity mentions, thus contributing to the high performance on RE benchmarks. |
| Approach: | They propose an entity-masked contrastive framework for relation extraction to gain a deeper understanding on textual context and type information while avoiding rote memorization of entities. |
| Outcome: | The proposed framework improves the effectiveness and robustness of neural models in different RE scenarios. |