Challenge: Existing work on Named Entity Recognition (NER) only used generative or information compression models to improve performance.
Approach: They propose to combine two types of IB models into one system to enhance Named Entity Recognition (NER) they incorporate unsupervised generative components span reconstruction and synonym generation into a span-based NER system.
Outcome: The proposed model focuses on learning span representation, which is applicable not only to span-based NER but also to other span-related tasks such as event coreference resolution and question answering.

Similar Papers

SpanNER: Named Entity Re-/Recognition as Span Prediction (2021.acl-long)

Copied to clipboard

Challenge: Recent years have seen the paradigm shift of Named Entity Recognition (NER) systems from sequence labeling to span prediction.
Approach: They experimentally implement 154 named entity recognition models on 11 datasets and show that span prediction can serve as a system combiner to re-recognize named entities from different systems’ outputs.
Outcome: The proposed model can be used to re-recognize named entities from different systems’ outputs.
Decoding Text Spans for Efficient and Accurate Named-Entity Recognition (2026.acl-industry)

Copied to clipboard

Challenge: Named Entity Recognition (NER) is a key component in industrial information extraction pipelines, where systems must satisfy strict latency and throughput constraints in addition to strong accuracy.
Approach: They propose a span-based NER framework that can be used to compute span representations at the final transformer stage, avoiding redundant computation in earlier layers.
Outcome: The proposed framework matches competitive baselines while improving throughput and reducing computational cost.
Nested Named Entity Recognition with Span-level Graphs (2022.acl-long)

Copied to clipboard

Challenge: Named entity recognition is one of the major subtasks of information extraction for extracting categorized named entities from unstructured text.
Approach: They propose to use retrieval-based span-level graphs to connect spans and entities in the training data based on n-gram features to integrate information of similar neighbor entities into the span representation.
Outcome: The proposed method achieves general improvements on all three benchmarks and special superiority on low frequency entities.
A Unified Generative Framework for Various NER Subtasks (2021.acl-long)

Copied to clipboard

Challenge: Named Entity Recognition (NER) is the task of identifying spans that represent entities in sentences.
Approach: They propose to formulate NER subtasks as entity span sequence generation task . framework can be used to solve all three kinds of NER tasks without tagging schema .
Outcome: The proposed framework achieves state-of-the-art (SoTA) or near SoTA performance on eight English NER datasets.
T 2 -NER: A Two-Stage Span-Based Framework for Unified Named Entity Recognition with Templates (2023.tacl-1)

Copied to clipboard

Challenge: Named Entity Recognition (NER) has evolved from flat to overlapped and discontinuous . NER is a text recognition task that recognizes mentions that represent entities in text .
Approach: They propose a two-stage span-based framework to solve a unified NER task using two stages . they extract entity spans, classify over all entity span pairs and combine them to train two stages.
Outcome: The proposed framework beats all the current competitive baselines on eight benchmark datasets, obtaining the best performance of unified NER.
Locate and Label: A Two-stage Identifier for Nested Named Entity Recognition (2021.acl-long)

Copied to clipboard

Challenge: Named entity recognition (NER) is a well-studied task in natural language processing.
Approach: They propose a method that generates span proposals and labels them with categories . they use boundary information of entities and partially matched spans to locate them .
Outcome: The proposed method outperforms state-of-the-art models on nested NER datasets.
Deep Span Representations for Named Entity Recognition (2023.findings-acl)

Copied to clipboard

Challenge: Existing span-based NER systems shallowly aggregate token representations to span representations, causing performance degradations.
Approach: They propose a method that shallowly aggregates token representations to span representations . DSpERT produces span representation of deep semantics with weight initialization .
Outcome: The proposed model performs better than or competitive with state-of-the-art systems on six NER benchmarks.
Pre-training Entity Relation Encoder with Intra-span and Inter-span Information (2020.emnlp-main)

Copied to clipboard

Challenge: Existing pre-trained models do not handle text spans and relation among text span pairs.
Approach: They propose to integrate span-related information into pre-trained encoder for entity relation extraction task.
Outcome: The proposed pre-training method outperforms distantly supervised pre-trained models on two entity relation extraction benchmark datasets.
Span-based Joint Entity and Relation Extraction with Attention-based Span-specific and Contextual Semantic Representations (2020.coling-main)

Copied to clipboard

Challenge: Existing methods treat each span token equally important, ignoring significant features.
Approach: They propose a span-based joint extraction framework with attention-based semantic representations that utilizes span-specific and contextual representations.
Outcome: The proposed model outperforms existing models on ACE2005, CoNLL2004 and ADE.
Extract-Select: A Span Selection Framework for Nested Named Entity Recognition with Generative Adversarial Training (2022.findings-acl)

Copied to clipboard

Challenge: Existing studies treat named entity recognition as a sequential labeling problem.
Approach: They propose a span selection framework for nested named entity recognition . they propose nesting entities with different input categories would be separately extracted .
Outcome: The proposed framework outperforms competing models on four benchmark datasets.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations