Challenge: Chinese word segmentation datasets have ambiguous annotation criteria resulting in multi-grained compounds.
Approach: They propose a domain adaptive segmenter to exploit diverse annotation criteria of datasets . they use bidirectional encoder representations from transformers to introduce open-domain knowledge .
Outcome: The proposed model outperforms the state-of-the-art models on 10 Chinese word datasets with superior efficiency.

Similar Papers

A Concise Model for Multi-Criteria Chinese Word Segmentation with Transformer Encoder (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing work on multicriteria Chinese word segmentation focuses on combining multiple heterogeneous segmentation criteria into a single task.
Approach: They propose a unified model for multi-criteria Chinese word segmentation which is fully-shared for all criteria.
Outcome: The proposed model outperforms existing models on eight datasets with different criteria.
Advancing Multi-Criteria Chinese Word Segmentation Through Criterion Classification and Denoising (2023.acl-long)

Copied to clipboard

Challenge: Recent research on multi-criteria Chinese word segmentation focuses on building complex private structures, adding more handcrafted features, or introducing complex optimization processes.
Approach: They propose a model that fits multiple Chinese word segments using input-hint inputs.
Outcome: The proposed model achieves state-of-the-art (SoTA) performance on multiple datasets simultaneously.
Adaptive Multi-Task Transfer Learning for Chinese Word Segmentation in Medical Text (C18-1)

Copied to clipboard

Challenge: Chinese word segmentation (CWS) tools face a performance drop when dealing with domain text . domain-specific CWS requires extremely high annotation cost due to ambiguity caused by domain terms and writing style .
Approach: They propose to exploit domain-invariant knowledge from high resource to low resource domains to build Chinese word segmentation models.
Outcome: The proposed model achieves higher accuracy than single-task CWS and other transfer learning baselines . the model is based on domain-invariant knowledge from high resource to low resource domains based in the biomedical domain .
A Joint Multiple Criteria Model in Transfer Learning for Cross-domain Chinese Word Segmentation (2020.emnlp-main)

Copied to clipboard

Challenge: Existing methods for word-level segmentation (CWS) for the Chinese language have been successful in large-scale annotated corpora.
Approach: They propose a method that integrates different segmentation criteria into one model . they use a transfer learning method to improve the performance of OOV words .
Outcome: The proposed method achieves state-of-the-art performance on multiple benchmark datasets . it shows a competitive practicability and generalization ability for the CWS task .
Improving Multi-Criteria Chinese Word Segmentation through Learning Sentence Representation (2023.findings-emnlp)

Copied to clipboard

Challenge: Recent Chinese word segmentation models tend to learn the segmentation knowledge through in-vocabulary words rather than understanding the meaning of the entire context.
Approach: They propose a context-aware approach that incorporates unsupervised sentence representation learning over different dropout masks into the multi-criteria training framework.
Outcome: The proposed approach achieves state-of-the-art (SoTA) performance on six of the nine CWS benchmark datasets and out-of vocabulary (OOV) recalls for eight of nine.
CWSeg: An Efficient and General Approach to Chinese Word Segmentation (2023.acl-industry)

Copied to clipboard

Challenge: Existing methods for Chinese word segmentation have achieved state-of-the-art performance, but they pose challenges in the deployment.
Approach: They propose to augment PLM-based Chinese word segmentation schemes by developing cohort training and versatile decoding strategies.
Outcome: The proposed model can be used to augment existing PLM-based models and improve their performance on Chinese LLaMA and Alpaca datasets.
Coupling Distant Annotation and Adversarial Training for Cross-Domain Chinese Word Segmentation (2020.acl-main)

Copied to clipboard

Challenge: Fully supervised neural approaches have achieved significant progress in the task of Chinese word segmentation (CWS) however, they suffer from the cross-domain issue when they come to processing of out-of-domain data.
Approach: They propose to use Chinese word as a target domain for distant annotation and adversarial training to reduce noise and maximize utilization of the source domain information.
Outcome: The proposed method outperforms existing state-of-the-art methods on real-world datasets and significantly outperformed previous state- of-the art methods.
Segment, Mask, and Predict: Augmenting Chinese Word Segmentation with Self-Supervision (2021.emnlp-main)

Copied to clipboard

Challenge: Recent state-of-the-art (SOTA) effective neural network methods have been used in Chinese word segmentation (CWS) However, the robustness of the previous neural methods is limited by the large-scale annotated corpus.
Approach: They propose a self-supervised Chinese word segmentation approach with a straightforward and effective architecture.
Outcome: The proposed approach outperforms previous methods on 9 different CWS datasets with single criterion training and multiple criteria training and achieves better robustness.
Attention Is All You Need for Chinese Word Segmentation (2020.emnlp-main)

Copied to clipboard

Challenge: Recent work on Chinese word segmentation has been concerned about the following three perspectives.
Approach: They propose to use a greedy decoding algorithm to improve Chinese word segmentation model.
Outcome: The proposed model achieves state-of-the-art or comparable performance against strong baselines in strict closed test setting.
Lexicon-Based Graph Convolutional Network for Chinese Word Segmentation (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for Chinese word segmentation have high performance on benchmarks but are limited by the small-scale annotated corpus.
Approach: They propose a framework that incorporates a lexicon-based graph convolutional network into the Transformer encoder to improve Chinese word segmentation (CWS) Chinese word is an essential and pre-processing step for many downstream NLP tasks.
Outcome: The proposed framework captures the information of candidate words and improves performance on benchmarks and datasets.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations