Challenge: Chinese word segmentation (CWS) tools face a performance drop when dealing with domain text . domain-specific CWS requires extremely high annotation cost due to ambiguity caused by domain terms and writing style .
Approach: They propose to exploit domain-invariant knowledge from high resource to low resource domains to build Chinese word segmentation models.
Outcome: The proposed model achieves higher accuracy than single-task CWS and other transfer learning baselines . the model is based on domain-invariant knowledge from high resource to low resource domains based in the biomedical domain .

Similar Papers

Improving Multi-Criteria Chinese Word Segmentation through Learning Sentence Representation (2023.findings-emnlp)

Copied to clipboard

Challenge: Recent Chinese word segmentation models tend to learn the segmentation knowledge through in-vocabulary words rather than understanding the meaning of the entire context.
Approach: They propose a context-aware approach that incorporates unsupervised sentence representation learning over different dropout masks into the multi-criteria training framework.
Outcome: The proposed approach achieves state-of-the-art (SoTA) performance on six of the nine CWS benchmark datasets and out-of vocabulary (OOV) recalls for eight of nine.
Coupling Distant Annotation and Adversarial Training for Cross-Domain Chinese Word Segmentation (2020.acl-main)

Copied to clipboard

Challenge: Fully supervised neural approaches have achieved significant progress in the task of Chinese word segmentation (CWS) however, they suffer from the cross-domain issue when they come to processing of out-of-domain data.
Approach: They propose to use Chinese word as a target domain for distant annotation and adversarial training to reduce noise and maximize utilization of the source domain information.
Outcome: The proposed method outperforms existing state-of-the-art methods on real-world datasets and significantly outperformed previous state- of-the art methods.
RethinkCWS: Is Chinese Word Segmentation a Solved Task? (2020.emnlp-main)

Copied to clipboard

Challenge: Recent years have seen remarkable success in the use of deep neural networks on Chinese word segmentation (CWS) however, the performance of CWS systems has gradually reached a plateau with the rapid development of deep networks.
Approach: They propose a fine-grained evaluation for existing Chinese word segmentation systems that allows us to diagnose the strengths and weaknesses of existing models.
Outcome: The proposed model can diagnose strengths and weaknesses of existing models and alleviate negative transfer problem when doing multi-criteria learning.
Towards Fast and Accurate Neural Chinese Word Segmentation with Multi-Criteria Learning (2020.coling-main)

Copied to clipboard

Challenge: Chinese word segmentation datasets have ambiguous annotation criteria resulting in multi-grained compounds.
Approach: They propose a domain adaptive segmenter to exploit diverse annotation criteria of datasets . they use bidirectional encoder representations from transformers to introduce open-domain knowledge .
Outcome: The proposed model outperforms the state-of-the-art models on 10 Chinese word datasets with superior efficiency.
Improving Cross-Domain Chinese Word Segmentation with Word Embeddings (N19-1)

Copied to clipboard

Challenge: Existing approaches to Chinese word segmentation (CWS) are character-based and word-based . character-driven approaches use conditional random field models to label sequences, with complex hand-crafted discrete features.
Approach: They propose a semi-supervised word-based approach to improve cross-domain Chinese word segmentation given a baseline segmenter.
Outcome: The proposed model outperforms state-of-the-art approaches on five datasets covering domains in novels, medicine, and patent.
CWSeg: An Efficient and General Approach to Chinese Word Segmentation (2023.acl-industry)

Copied to clipboard

Challenge: Existing methods for Chinese word segmentation have achieved state-of-the-art performance, but they pose challenges in the deployment.
Approach: They propose to augment PLM-based Chinese word segmentation schemes by developing cohort training and versatile decoding strategies.
Outcome: The proposed model can be used to augment existing PLM-based models and improve their performance on Chinese LLaMA and Alpaca datasets.
A Joint Multiple Criteria Model in Transfer Learning for Cross-domain Chinese Word Segmentation (2020.emnlp-main)

Copied to clipboard

Challenge: Existing methods for word-level segmentation (CWS) for the Chinese language have been successful in large-scale annotated corpora.
Approach: They propose a method that integrates different segmentation criteria into one model . they use a transfer learning method to improve the performance of OOV words .
Outcome: The proposed method achieves state-of-the-art performance on multiple benchmark datasets . it shows a competitive practicability and generalization ability for the CWS task .
Mining Word Boundaries from Speech-Text Parallel Data for Cross-domain Chinese Word Segmentation (2025.coling-main)

Copied to clipboard

Challenge: Recent studies on Chinese Word Segmentation (CWS) have focused on the cross-domain scenarios, but there is a high cost of manually annotating high-quality data.
Approach: They propose to explicitly mine word boundaries from parallel speech-text data by using the Montreal Forced Aligner toolkit to perform character-level alignment on speech- text data.
Outcome: The proposed approach is based on character-level alignment on speech-text data and a robust complete-then-train (CTT) strategy.
ChiMST: A Chinese Medical Corpus for Word Segmentation and Medical Term Recognition (2022.lrec-1)

Copied to clipboard

Challenge: Chinese word segmentation and named entity recognition are important tasks in natural language processing.
Approach: They develop a Chinese medical corpus annotated with Chinese word boundary and medical term information to address this problem.
Outcome: The proposed corpus will be a valuable resource for Chinese word segmentation and named entity recognition research on the medical domain.
Is Word Segmentation Necessary for Deep Learning of Chinese Representations? (P19-1)

Copied to clipboard

Challenge: Using word-based models, we compare word-oriented models with char-based ones . word-driven models are more vulnerable to data sparsity and the presence of out-of-vocabulary words .
Approach: They benchmark word-based models with char-based model which does not involve word segmentation in four NLP benchmark tasks.
Outcome: The proposed model outperforms char-based models in four NLP benchmark tasks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations