Challenge: grammatical error correction is a labor-intensive task that requires large amounts of training data.
Approach: They propose to use a human-annotated corpus of human-generated grammatical errors to generate a synthetic model.
Outcome: The proposed method outperforms the current state of the art in grammatical error correction . human annotators achieve 39.39 F1 scores, suggesting the model generates mostly human-like instances .

Similar Papers

Automatic Grammatical Error Correction for Sequence-to-sequence Text Generation: An Empirical Study (P19-1)

Copied to clipboard

Challenge: Sequence-to-sequence (seq2sequ) models have a weakness: they cannot always generate sentences without grammatical errors.
Approach: They propose to use automatic grammatical error correction to improve seq2seq models . they conduct experiments on machine translation, formality style transfer, sentence compression and simplification .
Outcome: The proposed system can improve grammaticality of generated text and improve formal style tasks.
To Err Is Human, but Llamas Can Learn It Too (2024.findings-emnlp)

Copied to clipboard

Challenge: Specifically, we fine-tune Llama 2 LMs for error generation and find that this approach yields synthetic errors akin to human errors.
Approach: They propose to fine-tune Llama 2 LMs for error generation and train GEC Llma models using these artificial errors.
Outcome: The proposed approach outperforms state-of-the-art models with gains ranging between 0.8 and 6 F0.5 points across all languages tested.
Improving Grammatical Error Correction via Contextual Data Augmentation (2024.findings-acl)

Copied to clipboard

Challenge: Increasing use of synthetic data due to inconsistent error distribution and noisy labels is limiting the use of these data.
Approach: They propose a method for augmentation of synthetic data with a more consistent error distribution.
Outcome: The proposed method outperforms strong baselines and achieves state-of-the-art with only a few synthetic data.
Improved grammatical error correction by ranking elementary edits (2022.emnlp-main)

Copied to clipboard

Challenge: a new study shows that grammatical error correction models are far from perfect for English . reranking allows for a better classification of edits, but it can be difficult for other languages .
Approach: They propose a two-stage reranking method for grammatical error correction using a model as edit generator and a sequence labeling model as second step.
Outcome: The proposed method surpasses existing methods on BEA 2019 English dataset by 2-3%.
Improving Grammatical Error Correction with Machine Translation Pairs (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to generate error-corrected sentence pairs for improving grammatical error correction are not available.
Approach: They propose a method to generate error-corrected sentence pairs for improving grammatical error correction based on machine translation models of different qualities .
Outcome: The proposed method can generate multiple error-corrected sentence pairs from Chinese to English text.
Adversarial Grammatical Error Correction (2020.findings-emnlp)

Copied to clipboard

Challenge: Experimental results show that adversarial-GEC can achieve competitive GEC quality compared to NMT-based baselines.
Approach: They propose an adversarial approach to Grammatical Error Correction using a transformer-based model and a sentence-pair classification model.
Outcome: The proposed approach achieves competitive GEC quality compared to baselines.
Low-Resource Grammatical Error Correction: Selective Data Augmentation with Round-Trip Machine Translation (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for grammatical error correction require large amounts of parallel training data.
Approach: They propose to generate synthetic data through round-trip machine translation by generating a set of character-level errors using a technique known as SeLex-RT.
Outcome: The proposed technique produces errors similar to those observed with language learners, but lacks gold-labeled training data.
Improving Grammatical Error Correction Models with Purpose-Built Adversarial Examples (2020.emnlp-main)

Copied to clipboard

Challenge: Existing methods for grammatical error correction are data-hungry and it is hard to train a seq2seq model with good performance without suf-Clean.
Approach: They propose a method inspired by adversarial training to generate more meaningful and valuable training examples by continually identifying weak spots of a model and to enhance the model by gradually adding adversarials to the training set.
Outcome: The proposed method improves generalization and robustness of GEC models by adding adversarial examples to the training set.
Grammatical Error Correction: Are We There Yet? (2022.coling-1)

Copied to clipboard

Challenge: grammatical error correction (GEC) systems outperform humans on the CoNLL-2014 test set, but there are still classes of errors that they fail to correct.
Approach: They found that state-of-the-art GEC systems outperform humans by a wide margin on the CoNLL-2014 test set . however, they found that there are still classes of errors that they fail to correct .
Outcome: The F0.5 evaluation metric outperforms the CoNLL-2014 test set, but there are still classes of errors that they fail to correct.
Grammatical error detection in transcriptions of spoken English (2020.coling-main)

Copied to clipboard

Challenge: CrowdED corpus of spoken English monologues on business topics was crowdsourced from native speakers of English and learners of English with German as their first language.
Approach: They propose to use the corpus recordings to correct existing speech transcriptions and edit them to make them more fluent.
Outcome: The proposed transcription corrections and annotations can be used for automatic transcription post-editing and grammatical error correction for spoken English.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations