Tail-to-Tail Non-Autoregressive Sequence Prediction for Chinese Grammatical Error Correction (2021.acl-long)
Copied to clipboard
| Challenge: | Experimental results demonstrate the effectiveness of Tail-to-Tail (TtT) non-autoregressive sequence prediction for Chinese Grammatical Error Correction (CGEC) |
| Approach: | They propose a framework for Chinese Grammatical Error Correction (CGEC) that uses a BERT-initialized Transformer Encoder to model the error positions. |
| Outcome: | The proposed framework solves the problem of Chinese Grammatical Error Correction (CGEC) by modeling the token dependencies. |
Similar Papers
From Spelling to Grammar: A New Framework for Chinese Grammatical Error Correction (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Chinese Grammatical Error Correction (CGEC) aims to generate correct sentences from erroneous sequences. |
| Approach: | They propose a zero-shot approach for spelling error correction that is simple but effective . they propose auxiliary task to predict POS sequence of target sentence . |
| Outcome: | The proposed framework achieves 42.11 F-0.5 on the English GEC dataset outperforms the previous state-of-the-art by a wide margin of 1.30 points. |
Alirector: Alignment-Enhanced Chinese Grammatical Error Corrector (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to address overcorrection in Chinese grammatical error correction (CGEC) are difficult to adapt to decoder-only large language models (LLMs). |
| Approach: | They propose an alignment-enhanced corrector for the overcorrection problem that applies to both Seq2Seq models and decoder-only large language models (LLMs). |
| Outcome: | The proposed corrector alleviates the overcorrection problem in Chinese grammatical error correction (CGEC) using generative models and decoder-only large language models. |
CSRP: Chain-of-Thought Reasoning for Chinese Text Correction via Reinforcement Learning with Efficiency-Aware Rewards (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models lack specialized priors for subtle grammatical distinctions, and Supervised Fine-Tuning fails to optimize for precision-focused metrics. |
| Approach: | They propose a framework that builds correction capability through Continual Pre-training on 5.9M balanced samples to internalize domain knowledge. |
| Outcome: | The proposed framework outperforms existing models on the NACGEC benchmark with 50.99 F0.5 and 57.17 precision while mitigating over-correction bias. |
Improving Autoregressive Grammatical Error Correction with Non-autoregressive Models (2023.findings-acl)
Copied to clipboard
| Challenge: | Autoregressive models assign low probabilities to tokens that need corrections . grammatical error correction (GEC) is widely applied to natural language processing tasks . |
| Approach: | They propose to use a non-autoregressive model as an auxiliary model to train GEC models to correct grammatical errors in sentences. |
| Outcome: | The proposed method outperforms baselines on English and Chinese GEC tasks significantly. |
GEC-DePenD: Non-Autoregressive Grammatical Error Correction with Decoupled Permutation and Decoding (2023.acl-long)
Copied to clipboard
| Challenge: | grammatical error correction is an important NLP task that is usually solved with autoregressive sequence-to-sequence models. |
| Approach: | They propose a non-autoregressive approach to grammatical error correction that decouples a permutation network and a decoder network that fills in specific tokens. |
| Outcome: | The proposed approach improves over previously known non-autoregressive methods and reaches the level of autoregressive approaches that do not use language-specific synthetic data generation methods. |
FCGEC: Fine-Grained Corpus for Chinese Grammatical Error Correction (2022.findings-emnlp)
Copied to clipboard
| Challenge: | grammatical error correction (GEC) is a complex task that requires high-quality data from native speakers. |
| Approach: | They propose a human-annotated corpus to detect, identify and correct grammatical errors in Chinese examinations. |
| Outcome: | The proposed model outperforms other models in low-resource settings, but there is a significant gap between the models and humans that encourages future models to bridge it. |
Non-Autoregressive Chinese ASR Error Correction with Phonological Training (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing methods to correct ASR errors focus on fixed-length corrections, but rarely consider variable-length ones. |
| Approach: | They propose a non-autoregressive method to correct Chinese ASR errors . they use phonological tokens to extend the source sentence for variable-length correction . |
| Outcome: | The proposed method improves word error rate and speeds up inference by 6.2 times compared with the autoregressive model. |
SynGEC: Syntax-Enhanced Grammatical Error Correction with a Tailored GEC-Oriented Parser (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to grammatical error correction are unreliable when processing ungrammatically . a new approach is proposed that incorporates dependency syntactic information into the encoder part of GEC models. |
| Approach: | They propose a syntax-enhanced grammatical error correction approach called SynGEC that incorporates dependency syntactic information into the encoder part of GEC models. |
| Outcome: | The proposed approach outperforms strong baselines and achieves competitive performance on mainstream English and Chinese GEC datasets. |
NaSGEC: a Multi-Domain Chinese Grammatical Error Correction Dataset from Native Speaker Texts (2023.findings-acl)
Copied to clipboard
| Challenge: | Recent studies on Chinese grammatical error correction focus on learning essays. |
| Approach: | They propose a Chinese grammatical error correction dataset that annotates multiple references for 12,500 sentences from three native domains. |
| Outcome: | The proposed dataset can be used to facilitate research on Chinese grammatical error correction (CGEC) for native speaker texts from multiple domains. |
A Study of Non-autoregressive Model for Sequence Generation (2020.acl-main)
Copied to clipboard
| Challenge: | Non-autoregressive (NAR) models generate all tokens in parallel, resulting in faster generation speed compared to autoregressive models. |
| Approach: | They propose to use knowledge distillation and source-target alignment to bridge the gap between NAR and autoregressive models in various tasks. |
| Outcome: | The proposed techniques can speed up NAR models in some tasks but not all . the proposed techniques reduce target token dependency while allowing for faster inference . |