Challenge: Fully supervised neural approaches have achieved significant progress in the task of Chinese word segmentation (CWS) however, they suffer from the cross-domain issue when they come to processing of out-of-domain data.
Approach: They propose to use Chinese word as a target domain for distant annotation and adversarial training to reduce noise and maximize utilization of the source domain information.
Outcome: The proposed method outperforms existing state-of-the-art methods on real-world datasets and significantly outperformed previous state- of-the art methods.

Similar Papers

Improving Cross-Domain Chinese Word Segmentation with Word Embeddings (N19-1)

Copied to clipboard

Challenge: Existing approaches to Chinese word segmentation (CWS) are character-based and word-based . character-driven approaches use conditional random field models to label sequences, with complex hand-crafted discrete features.
Approach: They propose a semi-supervised word-based approach to improve cross-domain Chinese word segmentation given a baseline segmenter.
Outcome: The proposed model outperforms state-of-the-art approaches on five datasets covering domains in novels, medicine, and patent.
Adaptive Multi-Task Transfer Learning for Chinese Word Segmentation in Medical Text (C18-1)

Copied to clipboard

Challenge: Chinese word segmentation (CWS) tools face a performance drop when dealing with domain text . domain-specific CWS requires extremely high annotation cost due to ambiguity caused by domain terms and writing style .
Approach: They propose to exploit domain-invariant knowledge from high resource to low resource domains to build Chinese word segmentation models.
Outcome: The proposed model achieves higher accuracy than single-task CWS and other transfer learning baselines . the model is based on domain-invariant knowledge from high resource to low resource domains based in the biomedical domain .
Mining Word Boundaries from Speech-Text Parallel Data for Cross-domain Chinese Word Segmentation (2025.coling-main)

Copied to clipboard

Challenge: Recent studies on Chinese Word Segmentation (CWS) have focused on the cross-domain scenarios, but there is a high cost of manually annotating high-quality data.
Approach: They propose to explicitly mine word boundaries from parallel speech-text data by using the Montreal Forced Aligner toolkit to perform character-level alignment on speech- text data.
Outcome: The proposed approach is based on character-level alignment on speech-text data and a robust complete-then-train (CTT) strategy.
CWSeg: An Efficient and General Approach to Chinese Word Segmentation (2023.acl-industry)

Copied to clipboard

Challenge: Existing methods for Chinese word segmentation have achieved state-of-the-art performance, but they pose challenges in the deployment.
Approach: They propose to augment PLM-based Chinese word segmentation schemes by developing cohort training and versatile decoding strategies.
Outcome: The proposed model can be used to augment existing PLM-based models and improve their performance on Chinese LLaMA and Alpaca datasets.
Improving Multi-Criteria Chinese Word Segmentation through Learning Sentence Representation (2023.findings-emnlp)

Copied to clipboard

Challenge: Recent Chinese word segmentation models tend to learn the segmentation knowledge through in-vocabulary words rather than understanding the meaning of the entire context.
Approach: They propose a context-aware approach that incorporates unsupervised sentence representation learning over different dropout masks into the multi-criteria training framework.
Outcome: The proposed approach achieves state-of-the-art (SoTA) performance on six of the nine CWS benchmark datasets and out-of vocabulary (OOV) recalls for eight of nine.
Is Word Segmentation Necessary for Deep Learning of Chinese Representations? (P19-1)

Copied to clipboard

Challenge: Using word-based models, we compare word-oriented models with char-based ones . word-driven models are more vulnerable to data sparsity and the presence of out-of-vocabulary words .
Approach: They benchmark word-based models with char-based model which does not involve word segmentation in four NLP benchmark tasks.
Outcome: The proposed model outperforms char-based models in four NLP benchmark tasks.
A Joint Multiple Criteria Model in Transfer Learning for Cross-domain Chinese Word Segmentation (2020.emnlp-main)

Copied to clipboard

Challenge: Existing methods for word-level segmentation (CWS) for the Chinese language have been successful in large-scale annotated corpora.
Approach: They propose a method that integrates different segmentation criteria into one model . they use a transfer learning method to improve the performance of OOV words .
Outcome: The proposed method achieves state-of-the-art performance on multiple benchmark datasets . it shows a competitive practicability and generalization ability for the CWS task .
Segment, Mask, and Predict: Augmenting Chinese Word Segmentation with Self-Supervision (2021.emnlp-main)

Copied to clipboard

Challenge: Recent state-of-the-art (SOTA) effective neural network methods have been used in Chinese word segmentation (CWS) However, the robustness of the previous neural methods is limited by the large-scale annotated corpus.
Approach: They propose a self-supervised Chinese word segmentation approach with a straightforward and effective architecture.
Outcome: The proposed approach outperforms previous methods on 9 different CWS datasets with single criterion training and multiple criteria training and achieves better robustness.
Federated Chinese Word Segmentation with Global Character Associations (2021.findings-acl)

Copied to clipboard

Challenge: Chinese word segmentation (CWS) is a fundamental task for natural language processing.
Approach: They propose a neural model for Chinese word segmentation with federated learning to help CWS deal with data isolation.
Outcome: The proposed model outperforms baselines on a simulated environment with five nodes.
Distant Supervision from Disparate Sources for Low-Resource Part-of-Speech Tagging (D18-1)

Copied to clipboard

Challenge: Low-resource languages lack manual annotated data to learn basic models such as part-of-speech (POS) taggers.
Approach: They propose a cross-lingual neural part-of-speech tagger that learns from disparate sources of distant supervision in a uniform framework.
Outcome: The proposed model scales to hundreds of low-resource languages without access to gold annotated data.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations