| Challenge: | Existing approaches to Chinese word segmentation (CWS) are character-based and word-based . character-driven approaches use conditional random field models to label sequences, with complex hand-crafted discrete features. |
| Approach: | They propose a semi-supervised word-based approach to improve cross-domain Chinese word segmentation given a baseline segmenter. |
| Outcome: | The proposed model outperforms state-of-the-art approaches on five datasets covering domains in novels, medicine, and patent. |
Similar Papers
Coupling Distant Annotation and Adversarial Training for Cross-Domain Chinese Word Segmentation (2020.acl-main)
Copied to clipboard
| Challenge: | Fully supervised neural approaches have achieved significant progress in the task of Chinese word segmentation (CWS) however, they suffer from the cross-domain issue when they come to processing of out-of-domain data. |
| Approach: | They propose to use Chinese word as a target domain for distant annotation and adversarial training to reduce noise and maximize utilization of the source domain information. |
| Outcome: | The proposed method outperforms existing state-of-the-art methods on real-world datasets and significantly outperformed previous state- of-the art methods. |
CWSeg: An Efficient and General Approach to Chinese Word Segmentation (2023.acl-industry)
Copied to clipboard
| Challenge: | Existing methods for Chinese word segmentation have achieved state-of-the-art performance, but they pose challenges in the deployment. |
| Approach: | They propose to augment PLM-based Chinese word segmentation schemes by developing cohort training and versatile decoding strategies. |
| Outcome: | The proposed model can be used to augment existing PLM-based models and improve their performance on Chinese LLaMA and Alpaca datasets. |
Multiple Character Embeddings for Chinese Word Segmentation (P19-2)
Copied to clipboard
| Challenge: | Chinese word segmentation is regarded as character-based sequence labeling task in most current work but it neglects important fact: Chinese characters contain both semantic and phonetic meanings. |
| Approach: | They propose a shared bi-LSTM-CRF model which fuses linguistic features efficiently by sharing the LSTM network during the training procedure. |
| Outcome: | The proposed model achieves state-of-the-art in AS and CityU corpora without external lexical resources. |
Mining Word Boundaries from Speech-Text Parallel Data for Cross-domain Chinese Word Segmentation (2025.coling-main)
Copied to clipboard
| Challenge: | Recent studies on Chinese Word Segmentation (CWS) have focused on the cross-domain scenarios, but there is a high cost of manually annotating high-quality data. |
| Approach: | They propose to explicitly mine word boundaries from parallel speech-text data by using the Montreal Forced Aligner toolkit to perform character-level alignment on speech- text data. |
| Outcome: | The proposed approach is based on character-level alignment on speech-text data and a robust complete-then-train (CTT) strategy. |
Adaptive Multi-Task Transfer Learning for Chinese Word Segmentation in Medical Text (C18-1)
Copied to clipboard
| Challenge: | Chinese word segmentation (CWS) tools face a performance drop when dealing with domain text . domain-specific CWS requires extremely high annotation cost due to ambiguity caused by domain terms and writing style . |
| Approach: | They propose to exploit domain-invariant knowledge from high resource to low resource domains to build Chinese word segmentation models. |
| Outcome: | The proposed model achieves higher accuracy than single-task CWS and other transfer learning baselines . the model is based on domain-invariant knowledge from high resource to low resource domains based in the biomedical domain . |
RethinkCWS: Is Chinese Word Segmentation a Solved Task? (2020.emnlp-main)
Copied to clipboard
| Challenge: | Recent years have seen remarkable success in the use of deep neural networks on Chinese word segmentation (CWS) however, the performance of CWS systems has gradually reached a plateau with the rapid development of deep networks. |
| Approach: | They propose a fine-grained evaluation for existing Chinese word segmentation systems that allows us to diagnose the strengths and weaknesses of existing models. |
| Outcome: | The proposed model can diagnose strengths and weaknesses of existing models and alleviate negative transfer problem when doing multi-criteria learning. |
Segment, Mask, and Predict: Augmenting Chinese Word Segmentation with Self-Supervision (2021.emnlp-main)
Copied to clipboard
Mieradilijiang Maimaiti, Yang Liu, Yuanhang Zheng, Gang Chen, Kaiyu Huang, Ji Zhang, Huanbo Luan, Maosong Sun
| Challenge: | Recent state-of-the-art (SOTA) effective neural network methods have been used in Chinese word segmentation (CWS) However, the robustness of the previous neural methods is limited by the large-scale annotated corpus. |
| Approach: | They propose a self-supervised Chinese word segmentation approach with a straightforward and effective architecture. |
| Outcome: | The proposed approach outperforms previous methods on 9 different CWS datasets with single criterion training and multiple criteria training and achieves better robustness. |
Is Word Segmentation Necessary for Deep Learning of Chinese Representations? (P19-1)
Copied to clipboard
| Challenge: | Using word-based models, we compare word-oriented models with char-based ones . word-driven models are more vulnerable to data sparsity and the presence of out-of-vocabulary words . |
| Approach: | They benchmark word-based models with char-based model which does not involve word segmentation in four NLP benchmark tasks. |
| Outcome: | The proposed model outperforms char-based models in four NLP benchmark tasks. |
Handling Cross- and Out-of-Domain Samples in Thai Word Segmentation (2021.findings-acl)
Copied to clipboard
Peerat Limkonchotiwat, Wannaphong Phatthiyaphaibun, Raheem Sarwar, Ekapol Chuangsuwanich, Sarana Nutanong
| Challenge: | Word segmentation is domain-dependent, which can be a challenge in low-resource languages like Thai and Urdu . a framework to handle out-of-domain inputs is proposed to improve word segmentation . |
| Approach: | They propose a domaingeneric domain adaptation framework and data augmentation technique to combat low-resource problems. |
| Outcome: | The proposed model outperforms the state-of-the-art Thai word segmentation method in out-of domain scenarios. |
Federated Chinese Word Segmentation with Global Character Associations (2021.findings-acl)
Copied to clipboard
| Challenge: | Chinese word segmentation (CWS) is a fundamental task for natural language processing. |
| Approach: | They propose a neural model for Chinese word segmentation with federated learning to help CWS deal with data isolation. |
| Outcome: | The proposed model outperforms baselines on a simulated environment with five nodes. |