A Self-Refinement Strategy for Noise Reduction in Grammatical Error Correction (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches for grammatical error correction (GEC) rely on supervised learning with manually created datasets. |
| Approach: | They propose to denoise GEC datasets by leveraging prediction consistency of existing models. |
| Outcome: | The proposed method outperforms baseline methods on CoNLL-2014, JFLEG, and BEA-2019 benchmarks. |
Similar Papers
Leveraging Denoised Abstract Meaning Representation for Grammatical Error Correction (2023.findings-acl)
Copied to clipboard
| Challenge: | Popular GEC models use large-scale synthetic corpora or use a large number of human-designed rules. |
| Approach: | They propose a model that incorporates denoised AMR as additional knowledge to get AMRs more reliable. |
| Outcome: | The proposed model reduces training time by 32% while inference time is comparable. |
InstructGEC: Enhancing Unsupervised Grammatical Error Correction with Instruction Tuning (2025.coling-main)
Copied to clipboard
| Challenge: | Recent studies have proposed methods of generating synthetic data for unsupervised GEC . however, the cost of such methods is high and the quality of the data is poor . |
| Approach: | They propose a method to generate synthetic data automatically for unsupervised GEC . they use a masking strategy to mask an erroneous sentence and the instruction consistently . |
| Outcome: | The proposed method outperforms state-of-the-art unsupervised methods on English and Chinese GEC datasets. |
Do Grammatical Error Correction Models Realize Grammatical Generalization? (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing models for grammatical error correction use pseudo data, but they are inconvenient for realworld deployment due to large amounts of training data. |
| Approach: | They propose a method to evaluate whether GEC models can generalize to unseen errors by using synthetic and real GEC datasets with controlled vocabularies. |
| Outcome: | The proposed model fails to realize grammatical generalization even in simple settings with limited vocabulary and syntax, suggesting it lacks the generalization ability required to correct errors from provided training examples. |
Improving Autoregressive Grammatical Error Correction with Non-autoregressive Models (2023.findings-acl)
Copied to clipboard
| Challenge: | Autoregressive models assign low probabilities to tokens that need corrections . grammatical error correction (GEC) is widely applied to natural language processing tasks . |
| Approach: | They propose to use a non-autoregressive model as an auxiliary model to train GEC models to correct grammatical errors in sentences. |
| Outcome: | The proposed method outperforms baselines on English and Chinese GEC tasks significantly. |
Mitigating Exposure Bias in Grammatical Error Correction with Data Augmentation and Reweighting (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing approaches to grammatical error correction (GEC) use sequence-to-sequence models, but there is an exposure bias problem. |
| Approach: | They propose a data manipulation approach to overcome the exposure bias problem in seq2seq GEC . they propose augmentation methods to mimic decoder input and reweighting methods to automatically balance the importance of each kind of augmented samples. |
| Outcome: | The proposed method improves on benchmark GEC datasets. |
GEC-DePenD: Non-Autoregressive Grammatical Error Correction with Decoupled Permutation and Decoding (2023.acl-long)
Copied to clipboard
| Challenge: | grammatical error correction is an important NLP task that is usually solved with autoregressive sequence-to-sequence models. |
| Approach: | They propose a non-autoregressive approach to grammatical error correction that decouples a permutation network and a decoder network that fills in specific tokens. |
| Outcome: | The proposed approach improves over previously known non-autoregressive methods and reaches the level of autoregressive approaches that do not use language-specific synthetic data generation methods. |
TransGEC: Improving Grammatical Error Correction with Translationese (2023.findings-acl)
Copied to clipboard
| Challenge: | Experimental results show that data augmentation improves accuracy over strong baselines. |
| Approach: | They propose to use translationese as input for GEC data augmentation to overcome stylistic discrepancies . they propose to obtain human-translated texts with a more similar style to non-native texts . |
| Outcome: | The proposed method improves correction accuracy over strong baselines on four GEC benchmarks. |
A Crash Course in Automatic Grammatical Error Correction (2020.coling-tutorials)
Copied to clipboard
| Challenge: | Grammatical Error Correction (GEC) is the task of automatically detecting and correcting all types of errors in written text. |
| Approach: | tutorial aims to introduce participants to the field of Grammatical Error Correction . aim is to examine the development of neural-based GEC systems . |
| Outcome: | the tutorial aims to introduce participants to the current state of the art in the field of Grammatical Error Correction (GEC) |
Data Weighted Training Strategies for Grammatical Error Correction (2020.tacl-1)
Copied to clipboard
| Challenge: | Recent advances in the task of Grammatical Error Correction (GEC) have been driven by addressing data sparsity, both through new methods for generating large and noisy pretraining data and through the publication of small and higher-quality finetuning data in the BEA-2019 shared task. |
| Approach: | They propose to incorporate delta-log-perplexity, a type of example scoring, into a training schedule for Grammatical Error Correction (GEC) they perform experiments that shed light on the function and applicability of delta- log-perplicity. |
| Outcome: | The proposed methods incorporate delta-log-perplexity, a type of example scoring, into a training schedule for the task. |
Approaching Neural Grammatical Error Correction as a Low-Resource Machine Translation Task (N18-1)
Copied to clipboard
| Challenge: | Previously, neural methods in grammatical error correction did not reach state-of-the-art results compared to phrase-based statistical machine translation (SMT) systems that improve on results by SMT use their set-up as a backbone for more complex systems. |
| Approach: | They propose a set of model-independent methods for neural GEC that can be easily applied in most GEC settings. |
| Outcome: | The proposed methods outperform state-of-the-art neural GEC systems by 10% M2 on the CoNLL-2014 benchmark and 5.9% on the JFLEG test set. |