| Challenge: | Existing methods to integrate word boundary information into character-level Chinese NER are inefficient and lack semantic interaction. |
| Approach: | They propose an extension of transformer encoder that is tailored for ChineseNER to incorporate lexicons into character-level Chinese NER by lattices. |
| Outcome: | The proposed extension performs 11.4 times faster than state-of-the-art methods while retaining the rich long-term dependencies. |
Similar Papers
FLAT: Chinese NER Using Flat-Lattice Transformer (2020.acl-main)
Copied to clipboard
| Challenge: | Named entity recognition (NER) models are difficult to use because of the complex nature of the lattice structure and the low inference speed. |
| Approach: | They propose a character-word lattice structure that converts lattics into flat structures consisting of spans. |
| Outcome: | The proposed model outperforms other lexicon-based models on four datasets and is highly parallel. |
Lattice-Based Transformer Encoder for Neural Machine Translation (P19-1)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) takes deterministic sequences for source representations. However, word-level or subword-level segmentation has multiple choices to split a source sequence with different word segmentors or different subword vocabulary sizes. |
| Approach: | They propose lattice-based encoders to explore effective word or subword representations in an automatic way during training. |
| Outcome: | The proposed encoders can explore effective word or subword representation in an automatic way during training. |
Simplify the Usage of Lexicon in Chinese NER (2020.acl-main)
Copied to clipboard
| Challenge: | Named entity recognition (NER) is concerned with the identification of named entities in unstructured text. |
| Approach: | They propose a method for incorporating word lexicon into character representations . experimental results show method can be easily incorporated with pre-trained models . |
| Outcome: | The proposed method achieves 6.15 times faster inference speed and better performance on four benchmark Chinese NER datasets. |
Chinese NER Using Lattice LSTM (P18-1)
Copied to clipboard
| Challenge: | Chinese named entity recognition (NER) is a fundamental task in information extraction. |
| Approach: | They propose a lattice-structured LSTM model for Chinese named entity recognition (NER) model leverages word and word sequence information to encode a sequence of input characters and all potential words that match a lexicon. |
| Outcome: | The proposed model outperforms word-based and character-based models on Chinese NER datasets. |
Lattice Transformer for Speech Translation (P19-1)
Copied to clipboard
| Challenge: | Recent advances in sequence modeling have highlighted the strengths of the transformer architecture. |
| Approach: | They propose a general lattice transformer for speech translation where the input is the output of the automatic speech recognition (ASR) they propose 'controllable' lattica attention mechanism to consume latent representations. |
| Outcome: | The proposed model outperforms baseline and lattice LSTM on the Chinese-English translation task. |
An Encoding Strategy Based Word-Character LSTM for Chinese NER (N19-1)
Copied to clipboard
| Challenge: | Existing word-based model can not be trained in batches due to its DAG structure. |
| Approach: | They propose a lattice model that integrates word information into the start or end characters of a word and integrates it into a fixed-sized representation for efficient batch training. |
| Outcome: | The proposed model outperforms other state-of-the-art models on benchmark datasets and shows that it can be trained in batches without a shortcut path. |
Lattice-BERT: Leveraging Multi-Granularity Representations in Chinese Pre-trained Language Models (2021.naacl-main)
Copied to clipboard
| Challenge: | Pre-trained language models process text as a sequence of characters, ignoring more coarse granularity, e.g., words. |
| Approach: | They propose a new pre-training paradigm for Chinese that incorporates word representations along with characters and can model a sentence in a multi-granular manner. |
| Outcome: | The proposed model can bring an average increase of 1.5% under the 12-layer setting, which achieves new state-of-the-art among base-size models on the CLUE benchmarks. |
Entity Enhanced BERT Pre-training for Chinese NER (2020.emnlp-main)
Copied to clipboard
| Challenge: | Character-level BERT pre-trained in Chinese suffers from lacking lexicon information, which shows effectiveness for Chinese NER. |
| Approach: | They propose a semi-supervised method to integrate lexicon into pre-trained LMs in Chinese . they extract an entity lexiconal from raw text and integrate it into BERT . |
| Outcome: | The proposed method is highly effective and achieves the best results on a news dataset and two datasets annotated by the authors. |
MECT: Multi-Metadata Embedding based Cross-Transformer for Chinese Named Entity Recognition (2021.acl-long)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) is a sequence tagging task that extracts named entities from unstructured text. |
| Approach: | They propose to integrate Chinese character features with radical-level embedding to improve Chinese NER by integrating Chinese character information. |
| Outcome: | The proposed method can improve Chinese Named Entity Recognition (NER) on well-known datasets. |
AHVE-CNER: Aligned Hanzi Visual Encoding Enhance Chinese Named Entity Recognition with Multi-Information (2025.coling-main)
Copied to clipboard
| Challenge: | Existing glyph-based models neglect the relationship between pictorial elements and radicals for Named Entity Recognition (NER) tasks. |
| Approach: | They propose a model that integrates multi-source visual and phonetic information of Hanzi . they propose combining pictographic features with radicals to facilitate integration . |
| Outcome: | The proposed model improves performance on benchmark datasets. |