| Challenge: | Grammatical Error Correction (GEC) is a computational task that requires large amounts of data to solve. |
| Approach: | They propose two approaches to generate large parallel datasets for GEC using publicly available Wikipedia edit histories using minimal filtration heuristics and round-trip translation through bridge languages. |
| Outcome: | The proposed methods yield similar sized parallel corpora with around 4B tokens and are far ahead of the state-of-the-art on the CoNLL ‘14 benchmark and the JFLEG task. |
Similar Papers
Byte-Level Grammatical Error Correction Using Synthetic and Curated Corpora (2023.acl-long)
Copied to clipboard
Svanhvít Lilja Ingólfsdóttir, Petur Ragnarsson, Haukur Jónsson, Haukur Simonarson, Vilhjalmur Thorsteinsson, Vésteinn Snæbjarnarson
| Challenge: | Spelling mistakes due to typos and rushed writing, nonstandard punctuation and spelling, and grammatical and stylistic issues are common to almost everyone who writes any kind of text. |
| Approach: | They propose to use a common subword unit vocabulary and byte-level encoding to fine tune two subword-level models and one byte level model on hand-corrected error corpora. |
| Outcome: | The proposed model improves accuracy for spelling and grammatical errors and more complex errors. |
A Simple Recipe for Multilingual Grammatical Error Correction (2021.acl-short)
Copied to clipboard
| Challenge: | Modern approaches view the task of Grammatical Error Correction (GEC) as monolingual text-to-text rewriting and employ encoderdecoder neural architectures. |
| Approach: | They propose a language-agnostic method to generate a large number of synthetic examples and use large-scale multilingual language models to train state-of-the-art GEC models. |
| Outcome: | The proposed method surpasses state-of-the-art results on GEC benchmarks in English, Czech, German and Russian. |
Cool English: a Grammatical Error Correction System Based on Large Learner Corpora (C18-2)
Copied to clipboard
| Challenge: | Existing systems that correct grammatical errors are lacking in second language learning due to limited vocabulary and inadequate command of grammar. |
| Approach: | They propose a grammatical error correction system that provides corrective feedback for essays using a sequence-to-sequence model. |
| Outcome: | The proposed system achieves competitive performance on a number of publicly available testsets. |
Efficient Grammatical Error Correction Via Multi-Task Training and Optimized Training Schedule (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent research has focused on using synthetic data for grammatical error correction . lack of annotated training data hinders progress in the field . |
| Approach: | They propose auxiliary tasks that exploit alignment between original and corrected sentences . they propose a sequence-to-sequence problem and perform multi-task training . |
| Outcome: | The proposed auxiliary tasks outperform the best models with a BART-based model on 11B parameters. |
Improving Grammatical Error Correction Models with Purpose-Built Adversarial Examples (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for grammatical error correction are data-hungry and it is hard to train a seq2seq model with good performance without suf-Clean. |
| Approach: | They propose a method inspired by adversarial training to generate more meaningful and valuable training examples by continually identifying weak spots of a model and to enhance the model by gradually adding adversarials to the training set. |
| Outcome: | The proposed method improves generalization and robustness of GEC models by adding adversarial examples to the training set. |
Corpora Generation for Urdu Grammatical Error Correction (2026.findings-acl)
Copied to clipboard
| Challenge: | grammatical error correction (GEC) for Urdu remains under-researched due to lack of annotated datasets. |
| Approach: | They propose a method for synthesizing a large dataset by collecting errors from the Urdu WikiEdits history and learning from them. |
| Outcome: | The proposed method synthesizes a large dataset and fine-tunes models against it. |
Improving Grammatical Error Correction with Machine Translation Pairs (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to generate error-corrected sentence pairs for improving grammatical error correction are not available. |
| Approach: | They propose a method to generate error-corrected sentence pairs for improving grammatical error correction based on machine translation models of different qualities . |
| Outcome: | The proposed method can generate multiple error-corrected sentence pairs from Chinese to English text. |
FCGEC: Fine-Grained Corpus for Chinese Grammatical Error Correction (2022.findings-emnlp)
Copied to clipboard
| Challenge: | grammatical error correction (GEC) is a complex task that requires high-quality data from native speakers. |
| Approach: | They propose a human-annotated corpus to detect, identify and correct grammatical errors in Chinese examinations. |
| Outcome: | The proposed model outperforms other models in low-resource settings, but there is a significant gap between the models and humans that encourages future models to bridge it. |
Comparison of Grammatical Error Correction Using Back-Translation Models (2021.naacl-srw)
Copied to clipboard
| Challenge: | Currently, a mainstream approach to generate pseudo data is back-translation (BT). |
| Approach: | They propose to use back-translation to generate pseudo data that contains grammatical and ungrammatically produced sentences. |
| Outcome: | The proposed methods improve or interpolate the performance of each error type compared with a single BT model with different seeds. |
Generating Inflectional Errors for Grammatical Error Correction in Hindi (2020.aacl-srw)
Copied to clipboard
| Challenge: | Automated grammatical error correction is a data-heavy task . indic languages have a relatively low amount of digitized content and complex morphology . |
| Approach: | They generate a corpus of inflectional errors for training neural networks to correct grammatical errors in Hindi. |
| Outcome: | The proposed model trains on a corpus of inflectional errors extracted from Wikipedia edits. |