| Challenge: | Chinese word segmentation is regarded as character-based sequence labeling task in most current work but it neglects important fact: Chinese characters contain both semantic and phonetic meanings. |
| Approach: | They propose a shared bi-LSTM-CRF model which fuses linguistic features efficiently by sharing the LSTM network during the training procedure. |
| Outcome: | The proposed model achieves state-of-the-art in AS and CityU corpora without external lexical resources. |
Similar Papers
Federated Chinese Word Segmentation with Global Character Associations (2021.findings-acl)
Copied to clipboard
| Challenge: | Chinese word segmentation (CWS) is a fundamental task for natural language processing. |
| Approach: | They propose a neural model for Chinese word segmentation with federated learning to help CWS deal with data isolation. |
| Outcome: | The proposed model outperforms baselines on a simulated environment with five nodes. |
Improving Cross-Domain Chinese Word Segmentation with Word Embeddings (N19-1)
Copied to clipboard
| Challenge: | Existing approaches to Chinese word segmentation (CWS) are character-based and word-based . character-driven approaches use conditional random field models to label sequences, with complex hand-crafted discrete features. |
| Approach: | They propose a semi-supervised word-based approach to improve cross-domain Chinese word segmentation given a baseline segmenter. |
| Outcome: | The proposed model outperforms state-of-the-art approaches on five datasets covering domains in novels, medicine, and patent. |
CWSeg: An Efficient and General Approach to Chinese Word Segmentation (2023.acl-industry)
Copied to clipboard
| Challenge: | Existing methods for Chinese word segmentation have achieved state-of-the-art performance, but they pose challenges in the deployment. |
| Approach: | They propose to augment PLM-based Chinese word segmentation schemes by developing cohort training and versatile decoding strategies. |
| Outcome: | The proposed model can be used to augment existing PLM-based models and improve their performance on Chinese LLaMA and Alpaca datasets. |
More than Text: Multi-modal Chinese Word Segmentation (2021.acl-short)
Copied to clipboard
| Challenge: | Currently, word segmentation is performed in many languages without word delimiters. |
| Approach: | They propose to combine the multi-modality to perform Chinese word segmentation . they propose a time-dependent multi-module interactive model to integrate multi-modality information . |
| Outcome: | The proposed model integrates multi-modal information for word sequence labeling with Chinese language as target . the proposed model performs well on three training sets on Chinese and other languages without word delimiters. |
State-of-the-art Chinese Word Segmentation with Bi-LSTMs (D18-1)
Copied to clipboard
| Challenge: | A wide variety of neural-network architectures have been proposed for the task of Chinese word segmentation. |
| Approach: | They propose a bidirectional LSTM model with standard deep learning techniques and best practices for the task of Chinese word segmentation. |
| Outcome: | The proposed model outperforms models based on standard deep learning techniques and best practices on Chinese word segmentation datasets. |
Subword Encoding in Lattice LSTM for Chinese Word Segmentation (N19-1)
Copied to clipboard
| Challenge: | Using subwords, Chinese word segmentation models use character combination information to disambiguate characters. |
| Approach: | They propose a subword-based neural word segmentor that integrates character embeddings into a Lattice LSTM network over a character sequence. |
| Outcome: | The proposed model can utilize abundant character combination information, which is effective to disambiguate characters. |
Improving Chinese Named Entity Recognition with Multi-grained Words and Part-of-Speech Tags via Joint Modeling (2024.lrec-main)
Copied to clipboard
| Challenge: | Named entity recognition (CNER) is a fundamental task in natural language processing (NLP). |
| Approach: | They propose a tree parsing approach for jointly modeling Chinese named entity recognition (CNER) with multi-grained word segmentation (MWS) and POS tagging tasks. |
| Outcome: | The proposed approach achieves better or comparable performance with current methods. |
VCWE: Visual Character-Enhanced Word Embeddings (N19-1)
Copied to clipboard
| Challenge: | Currently, word embeddings are playing a pivotal role in many natural language processing tasks. |
| Approach: | They propose a model to learn Chinese word embeddings via three-level composition . they use convolutional neural network to extract intra-character compositionality from character shape . |
| Outcome: | The proposed model performs better on word similarity, sentiment analysis, named entity recognition and part-of-speech tagging tasks. |
Joint Chinese Word Segmentation and Part-of-speech Tagging via Multi-channel Attention of Character N-grams (2020.coling-main)
Copied to clipboard
| Challenge: | Chinese word segmentation and part-of-speech tagging can be performed in a sequential order . existing studies have shown that jointly performing them can be effective . |
| Approach: | They propose a character-based neural model enhanced by multi-channel attention of n-grams. |
| Outcome: | The proposed model outperforms baseline models on five benchmark datasets. |
Is Word Segmentation Necessary for Deep Learning of Chinese Representations? (P19-1)
Copied to clipboard
| Challenge: | Using word-based models, we compare word-oriented models with char-based ones . word-driven models are more vulnerable to data sparsity and the presence of out-of-vocabulary words . |
| Approach: | They benchmark word-based models with char-based model which does not involve word segmentation in four NLP benchmark tasks. |
| Outcome: | The proposed model outperforms char-based models in four NLP benchmark tasks. |