| Challenge: | Classical Chinese word segmentation is largely neglected due to its obsoleteness . a new approach to segmentation using a marked-up corpus is needed . |
| Approach: | They propose a pragmatic approach to deal with Classical Chinese word segmentation without any marked-up corpus. |
| Outcome: | The proposed method makes the CCWS without any marked-up corpus more accurate compared with collocation-based methods. |
Similar Papers
CWSeg: An Efficient and General Approach to Chinese Word Segmentation (2023.acl-industry)
Copied to clipboard
| Challenge: | Existing methods for Chinese word segmentation have achieved state-of-the-art performance, but they pose challenges in the deployment. |
| Approach: | They propose to augment PLM-based Chinese word segmentation schemes by developing cohort training and versatile decoding strategies. |
| Outcome: | The proposed model can be used to augment existing PLM-based models and improve their performance on Chinese LLaMA and Alpaca datasets. |
Advancing Multi-Criteria Chinese Word Segmentation Through Criterion Classification and Denoising (2023.acl-long)
Copied to clipboard
| Challenge: | Recent research on multi-criteria Chinese word segmentation focuses on building complex private structures, adding more handcrafted features, or introducing complex optimization processes. |
| Approach: | They propose a model that fits multiple Chinese word segments using input-hint inputs. |
| Outcome: | The proposed model achieves state-of-the-art (SoTA) performance on multiple datasets simultaneously. |
Multi-Tiered Cantonese Word Segmentation (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing work on word segmentation for Chinese does not have conventional word boundaries as English does. |
| Approach: | They propose a linguistically motivated, multi-tiered word segmentation system for Cantonese . they propose linguisticly motivated, linguistic-motivated system that can cater to different needs . |
| Outcome: | The proposed system can be adapted to Cantonese corpus data. |
Is Word Segmentation Necessary for Deep Learning of Chinese Representations? (P19-1)
Copied to clipboard
| Challenge: | Using word-based models, we compare word-oriented models with char-based ones . word-driven models are more vulnerable to data sparsity and the presence of out-of-vocabulary words . |
| Approach: | They benchmark word-based models with char-based model which does not involve word segmentation in four NLP benchmark tasks. |
| Outcome: | The proposed model outperforms char-based models in four NLP benchmark tasks. |
RethinkCWS: Is Chinese Word Segmentation a Solved Task? (2020.emnlp-main)
Copied to clipboard
| Challenge: | Recent years have seen remarkable success in the use of deep neural networks on Chinese word segmentation (CWS) however, the performance of CWS systems has gradually reached a plateau with the rapid development of deep networks. |
| Approach: | They propose a fine-grained evaluation for existing Chinese word segmentation systems that allows us to diagnose the strengths and weaknesses of existing models. |
| Outcome: | The proposed model can diagnose strengths and weaknesses of existing models and alleviate negative transfer problem when doing multi-criteria learning. |
TopWORDS-Poetry: Simultaneous Text Segmentation and Word Discovery for Classical Chinese Poetry via Bayesian Inference (2023.emnlp-main)
Copied to clipboard
| Challenge: | Experimental studies confirm that TopWORDS-Poetry can successfully segment poetry words without pre-given vocabulary or training corpus. |
| Approach: | They propose an unsupervised method that can achieve reliable text segmentation and word discovery for classical Chinese poetry simultaneously without pre-given vocabulary or training corpus. |
| Outcome: | Experimental results show that TopWORDS-Poetry can segment poetry lines into meaningful words with high quality without pre-given vocabulary or training corpus. |
Multi-grained Chinese Word Segmentation with Weakly Labeled Data (2020.coling-main)
Copied to clipboard
| Challenge: | Existing work on single-grained word segmentation (SWS) focuses on segmenting a sentence into multiple word sequences to preserve all words of different granularities. |
| Approach: | They propose to use a graph-based parser to accommodate weakly labeled data for MWS by employing a simple yet competitive graph-basic parsers with local loss. |
| Outcome: | The proposed model outperforms the state-of-the-art model on weakly labeled data on a high-quality dataset from canonical newswire (NEWS) and non-canonical web (BAIKE) data. |
Improving Multi-Criteria Chinese Word Segmentation through Learning Sentence Representation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Recent Chinese word segmentation models tend to learn the segmentation knowledge through in-vocabulary words rather than understanding the meaning of the entire context. |
| Approach: | They propose a context-aware approach that incorporates unsupervised sentence representation learning over different dropout masks into the multi-criteria training framework. |
| Outcome: | The proposed approach achieves state-of-the-art (SoTA) performance on six of the nine CWS benchmark datasets and out-of vocabulary (OOV) recalls for eight of nine. |
State-of-the-art Chinese Word Segmentation with Bi-LSTMs (D18-1)
Copied to clipboard
| Challenge: | A wide variety of neural-network architectures have been proposed for the task of Chinese word segmentation. |
| Approach: | They propose a bidirectional LSTM model with standard deep learning techniques and best practices for the task of Chinese word segmentation. |
| Outcome: | The proposed model outperforms models based on standard deep learning techniques and best practices on Chinese word segmentation datasets. |
A Probabilistic Toolkit for Multi-grained Word Segmentation in Chinese (2025.coling-demos)
Copied to clipboard
| Challenge: | Existing tools for word segmentation are based on different linguistic theories or target different scenarios. |
| Approach: | They propose a probabilistic toolkit for multi-grained word segmentation in Chinese . they adopt semi-Markov CRF for single-grain word segmenting (SWS) . |
| Outcome: | The proposed approach can produce marginal probabilities of words during inference and significantly improve performance in the cross-domain scenario. |