Papers with SIGHAN
Two Issues with Chinese Spelling Correction and A Refinement Solution (2024.acl-short)
Copied to clipboard
| Challenge: | Existing models contain many spelling errors, resulting in performance bottlenecks and performance issues. |
| Approach: | They propose to fix the SIGHAN datasets and re-evaluate four representative Chinese Spelling Correction models using the fixed datasets. |
| Outcome: | The proposed model improves the models in all metrics by notable margins. |
Weighted self Distillation for Chinese word segmentation (2022.findings-acl)
Copied to clipboard
| Challenge: | Recent researches show that multi-criteria resources and n-gram features are beneficial to Chinese word segmentation (CWS). |
| Approach: | They propose a framework that uses weighted self distillation to learn Chinese word segmentation using unigram features. |
| Outcome: | The proposed framework achieves state-of-the-art or competitive performance on SIGHAN Bakeoff datasets. |
Correcting Chinese Spelling Errors with Phonetic Pre-training (2021.findings-acl)
Copied to clipboard
Ruiqing Zhang, Chao Pang, Chuanqiang Zhang, Shuohuan Wang, Zhongjun He, Yu Sun, Hua Wu, Haifeng Wang
| Challenge: | Existing methods for Chinese spelling correction only use pre-trained language model or incorporate phonological information as external knowledge. |
| Approach: | They propose a phonetic Chinese spelling correction model that integrates phonetic features into language model by leveraging pre-training and fine-tuning methods. |
| Outcome: | The proposed model outperforms existing methods on SIGHAN datasets and improves on other datasets. |
The Past Mistake is the Future Wisdom: Error-driven Contrastive Probability Optimization for Chinese Spell Checking (2022.findings-acl)
Copied to clipboard
Yinghui Li, Qingyu Zhou, Yangning Li, Zhongli Li, Ruiyang Liu, Rongyi Sun, Zizhen Wang, Chao Li, Yunbo Cao, Hai-Tao Zheng
| Challenge: | Chinese Spell Checking (CSC) aims to detect and correct spelling errors, which are caused by the phonological or visual similarity. |
| Approach: | They propose an Error-driven COntrastive Probability Optimization framework to refine the knowledge representations of pre-trained language models to avoid predicting common characters. |
| Outcome: | Extensive experiments and detailed analyses on SIGHAN datasets demonstrate that ECOPO is simple yet effective. |
Self-Supervised Curriculum Learning for Spelling Error Correction (2021.emnlp-main)
Copied to clipboard
| Challenge: | Current approaches to SEC typically leverage a pre-training then fine-tuning procedure that treats data equally. |
| Approach: | They propose a self-supervised curriculum learning approach to improve model performance and model learning. |
| Outcome: | The proposed approach improves the model training and improves CL measurement. |
Attention Is All You Need for Chinese Word Segmentation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Recent work on Chinese word segmentation has been concerned about the following three perspectives. |
| Approach: | They propose to use a greedy decoding algorithm to improve Chinese word segmentation model. |
| Outcome: | The proposed model achieves state-of-the-art or comparable performance against strong baselines in strict closed test setting. |
PTCSpell: Pre-trained Corrector Based on Character Shape and Pinyin for Chinese Spelling Correction (2023.findings-acl)
Copied to clipboard
| Challenge: | Chinese spelling correction (CSC) is a task which detects incorrect characters in Chinese text and corrects them. |
| Approach: | They propose to pre-train a Chinese spelling correction corrector under the detector-corrector architecture and propose to capture pronunciation and shape information in Chinese characters. |
| Outcome: | The proposed corrector achieves an average of 5.8% F1 improvements over state-of-the-art methods, verifying its effectiveness. |
Constructing Word-Context-Coupled Space Aligned with Associative Knowledge Relations for Interpretable Language Modeling (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to train language models have limitations in interpretability . a Word-Context-Coupled Space (W2CSpace) is proposed to improve the performance of pre-trained models . |
| Approach: | They propose a Word-Context-Coupled Space to replace pre-trained models with interpretable statistical logic. |
| Outcome: | The proposed language model can achieve better performance and highly credible interpretability compared to state-of-the-art methods. |
Error-Robust Retrieval for Chinese Spelling Check (2024.lrec-main)
Copied to clipboard
| Challenge: | Chinese Spelling Check (CSC) aims to detect and correct spelling errors in Chinese texts . current methods may not fully leverage existing datasets, resulting in insufficient annotated data . |
| Approach: | They propose a plug-and-play retrieval method with error-robust information for Chinese Spelling Check . they employ multimodal representations that fuse phonetic, morphologic, and contextual information . |
| Outcome: | The proposed method improves on the SIGHAN benchmarks on Chinese spelling check (CSC) the proposed method is based on training data and lacks adequate parallel corpora . |
UMRSpell: Unifying the Detection and Correction Parts of Pre-trained Models towards Chinese Missing, Redundant, and Spelling Correction (2023.acl-long)
Copied to clipboard
| Challenge: | Chinese Spelling Correction (CSC) is a task of detecting and correcting misspelled charac- ters in Chinese texts. |
| Approach: | They propose a model to learn detection and correction parts together from a multi-task learning perspective. |
| Outcome: | The proposed model can learn detection and correction parts together from a multi-task learning perspective. |
Rethinking Masked Language Modeling for Chinese Spelling Correction (2023.acl-long)
Copied to clipboard
| Challenge: | Existing CSC models over-fit the error model while under-fitting the language model, resulting in poor generalization to out-of-distribution error patterns. |
| Approach: | They propose to use a multi-domain benchmark LEMON to assess the open domain generalization of Chinese Spelling Correction models. |
| Outcome: | The proposed method achieves state-of-the-art results on SIGHAN, ECSpell, and LEMON. |