Rethinking Masked Language Modeling for Chinese Spelling Correction (2023.acl-long)
Copied to clipboard
| Challenge: | Existing CSC models over-fit the error model while under-fitting the language model, resulting in poor generalization to out-of-distribution error patterns. |
| Approach: | They propose to use a multi-domain benchmark LEMON to assess the open domain generalization of Chinese Spelling Correction models. |
| Outcome: | The proposed method achieves state-of-the-art results on SIGHAN, ECSpell, and LEMON. |
Similar Papers
Spelling Error Correction with Soft-Masked BERT (2020.acl-main)
Copied to clipboard
| Challenge: | Experimental results show that the proposed method is significantly better than the baselines including the one solely based on BERT. |
| Approach: | They propose a neural architecture which uses a network for error detection and a system for error correction based on BERT, with the latter connected to the other using what they call soft-masking technique. |
| Outcome: | The proposed method performs better than baselines including the one solely based on BERT, and is general and may be employed in other language detection-correction problems. |
Driving Chinese Spelling Correction from a Fine-Grained Perspective (2025.coling-main)
Copied to clipboard
| Challenge: | Existing evaluations for Chinese spelling correction lack nuanced typology for spelling errors, creating an "invisible" bottleneck . |
| Approach: | They propose a fine-grained evaluation principle for Chinese spelling correction (CSC) they categorize spelling errors into six different types and use it to evaluate models . |
| Outcome: | The proposed evaluation principle can be leveraged to enhance CSC training models. |
Refining Corpora from a Model Calibration Perspective for Chinese Spelling Correction (2024.findings-acl)
Copied to clipboard
| Challenge: | Chinese Spelling Correction (CSC) lacks large-scale high-quality corpora due to labor-intensive labeling of spelling errors in real-life writing or typing scenarios. |
| Approach: | They propose to use OCR/ASR-based generation to refine Chinese Spelling Correction models on random replacement-based corpora and filter them based on prediction confidence. |
| Outcome: | The proposed model outperforms existing models on three widely-used benchmarks while significantly alleviating over-correction. |
uChecker: Masked Pretrained Language Models as Unsupervised Chinese Spelling Checkers (2022.coling-1)
Copied to clipboard
| Challenge: | Chinese Spelling Check (CSC) is a crucial and essential task in the area of natural language processing. |
| Approach: | They propose a framework to conduct unsupervised spelling error detection and correction using masked pretrained language models such as BERT. |
| Outcome: | The proposed model improves character-level and sentence-level accuracy, precision, recall, and F1-Measure on standard datasets. |
Two Issues with Chinese Spelling Correction and A Refinement Solution (2024.acl-short)
Copied to clipboard
| Challenge: | Existing models contain many spelling errors, resulting in performance bottlenecks and performance issues. |
| Approach: | They propose to fix the SIGHAN datasets and re-evaluate four representative Chinese Spelling Correction models using the fixed datasets. |
| Outcome: | The proposed model improves the models in all metrics by notable margins. |
An Error-Guided Correction Model for Chinese Spelling Error Correction (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing neural network approaches have achieved great progress on Chinese spelling correction, but there is still room for improvement. |
| Approach: | They propose an error-guided correction model that uses pre-trained BERT models to detect errors and integrate the error confusion set into the model. |
| Outcome: | The proposed model outperforms state-of-the-art models on widely used benchmarks and achieves superior performance on both quality and computation speed. |
CRASpell: A Contextual Typo Robust Approach to Improve Chinese Spelling Correction (2022.findings-acl)
Copied to clipboard
| Challenge: | Recent research on Chinese spelling correction methods has poor performance on multi-typo texts. |
| Approach: | They propose to use Bert-based Chinese spelling correction models to overcome these limitations by constructing a noisy context for each training sample and a copy mechanism to encourage the model to choose the input character when the miscorrected and input character are both valid. |
| Outcome: | The proposed model outperforms state-of-the-art models on widely used benchmarks and achieves a remarkable gain. |
PLOME: Pre-training with Misspelled Knowledge for Chinese Spelling Correction (2021.acl-long)
Copied to clipboard
| Challenge: | Chinese spelling correction (CSC) is a task to detect and correct spelling errors in texts. |
| Approach: | They propose a Pre-trained masked Language model with Misspelled knowledgE (PLOME) which jointly learns how to understand language and correct spelling errors. |
| Outcome: | The proposed model outperforms state-of-the-art methods on widely used benchmarks and achieves superior performance against existing models. |
A Simple yet Effective Training-free Prompt-free Approach to Chinese Spelling Correction Based on Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Using an LLM for Chinese spelling correction tasks is completely different from previous approaches . given a Chinese character, there may exist many others with the same or similar pronunciations, or with similar shapes. |
| Approach: | They propose a training-free prompt-free approach to leverage large language models for Chinese spelling correction task. |
| Outcome: | The proposed model significantly improves performance on five public datasets, enabling them to compete with state-of-the-art domain-general CSC models. |
Mixture of Small and Large Models for Chinese Spelling Check (2025.acl-long)
Copied to clipboard
| Challenge: | Chinese Spelling Check (CSC) tasks have been developed to correct spelling errors in given sentences . fine-tuned BERT-based models show excellent performance but suffer from edit pattern overfitting . a novel mixture approach that effectively combines small models and LLMs during beam search decoding phase improves accuracy and fluency of LLM. |
| Approach: | They propose a dynamic mixture approach that effectively combines small models and LLMs during beam search decoding phase. |
| Outcome: | The proposed method significantly boosts error correction capabilities, achieving state-of-the-art results across multiple datasets. |