Mitigating Exposure Bias in Grammatical Error Correction with Data Augmentation and Reweighting (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing approaches to grammatical error correction (GEC) use sequence-to-sequence models, but there is an exposure bias problem. |
| Approach: | They propose a data manipulation approach to overcome the exposure bias problem in seq2seq GEC . they propose augmentation methods to mimic decoder input and reweighting methods to automatically balance the importance of each kind of augmented samples. |
| Outcome: | The proposed method improves on benchmark GEC datasets. |
Similar Papers
Improving Grammatical Error Correction via Contextual Data Augmentation (2024.findings-acl)
Copied to clipboard
| Challenge: | Increasing use of synthetic data due to inconsistent error distribution and noisy labels is limiting the use of these data. |
| Approach: | They propose a method for augmentation of synthetic data with a more consistent error distribution. |
| Outcome: | The proposed method outperforms strong baselines and achieves state-of-the-art with only a few synthetic data. |
Improving Grammatical Error Correction with Data Augmentation by Editing Latent Representation (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for enhancing grammatical error correction use noise to generate tokens . existing methods only generate sentences with limited error types, which leads to lack of diversity of generated errors. |
| Approach: | They propose a data augmentation method that can apply noise to latent representations of a sentence to generate synthetic samples with various error types. |
| Outcome: | The proposed method improves performance and robustness of existing models on public benchmarks and on FCE benchmarks. |
Data Weighted Training Strategies for Grammatical Error Correction (2020.tacl-1)
Copied to clipboard
| Challenge: | Recent advances in the task of Grammatical Error Correction (GEC) have been driven by addressing data sparsity, both through new methods for generating large and noisy pretraining data and through the publication of small and higher-quality finetuning data in the BEA-2019 shared task. |
| Approach: | They propose to incorporate delta-log-perplexity, a type of example scoring, into a training schedule for Grammatical Error Correction (GEC) they perform experiments that shed light on the function and applicability of delta- log-perplicity. |
| Outcome: | The proposed methods incorporate delta-log-perplexity, a type of example scoring, into a training schedule for the task. |
A Self-Refinement Strategy for Noise Reduction in Grammatical Error Correction (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches for grammatical error correction (GEC) rely on supervised learning with manually created datasets. |
| Approach: | They propose to denoise GEC datasets by leveraging prediction consistency of existing models. |
| Outcome: | The proposed method outperforms baseline methods on CoNLL-2014, JFLEG, and BEA-2019 benchmarks. |
Improving Seq2Seq Grammatical Error Correction via Decoding Interventions (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to grammatical error correction (GEC) are sequence-to-sequence and sequence-edit. |
| Approach: | They propose a unified decoding intervention framework that employs an external critic to assess the appropriateness of the token to be generated incrementally. |
| Outcome: | The proposed framework outperforms baselines and state-of-the-art methods on English and Chinese datasets. |
MixEdit: Revisiting Data Augmentation and Beyond for Grammatical Error Correction (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Various data augmentation strategies have been proposed to improve GEC models . high-quality parallel data for GEC is not as widely available . |
| Approach: | They propose a data augmentation approach that strategically augments real data by generating pseudo data. |
| Outcome: | The proposed approach significantly improves GEC models on English and Chinese datasets. |
TransGEC: Improving Grammatical Error Correction with Translationese (2023.findings-acl)
Copied to clipboard
| Challenge: | Experimental results show that data augmentation improves accuracy over strong baselines. |
| Approach: | They propose to use translationese as input for GEC data augmentation to overcome stylistic discrepancies . they propose to obtain human-translated texts with a more similar style to non-native texts . |
| Outcome: | The proposed method improves correction accuracy over strong baselines on four GEC benchmarks. |
Improving Grammatical Error Correction Models with Purpose-Built Adversarial Examples (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for grammatical error correction are data-hungry and it is hard to train a seq2seq model with good performance without suf-Clean. |
| Approach: | They propose a method inspired by adversarial training to generate more meaningful and valuable training examples by continually identifying weak spots of a model and to enhance the model by gradually adding adversarials to the training set. |
| Outcome: | The proposed method improves generalization and robustness of GEC models by adding adversarial examples to the training set. |
Grammatical Error Correction via Mixed-Grained Weighted Training (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Empirical evaluation shows that MainGEC achieves consistent and significant performance improvements on two benchmark datasets. |
| Approach: | They propose to use mixed-grained weighted training to improve the training effect for GEC by analyzing the inherent discrepancies in annotated training data. |
| Outcome: | Empirical results show that the proposed method achieves significant performance improvements on two benchmark datasets. |
InstructGEC: Enhancing Unsupervised Grammatical Error Correction with Instruction Tuning (2025.coling-main)
Copied to clipboard
| Challenge: | Recent studies have proposed methods of generating synthetic data for unsupervised GEC . however, the cost of such methods is high and the quality of the data is poor . |
| Approach: | They propose a method to generate synthetic data automatically for unsupervised GEC . they use a masking strategy to mask an erroneous sentence and the instruction consistently . |
| Outcome: | The proposed method outperforms state-of-the-art unsupervised methods on English and Chinese GEC datasets. |