| Challenge: | Language model based GEC (LM-GEC) is a promising alternative to SMT and neural sequence-to-sequence models. |
| Approach: | They propose to use finite state transducers to improve LM-GEC by rescoring with neural language models. |
| Outcome: | The proposed model outperforms the best published results on the CoNLL-2014 test set and achieves far better relative improvements over the baselines. |
Similar Papers
Near Human-Level Performance in Grammatical Error Correction with Hybrid Machine Translation (N18-2)
Copied to clipboard
| Challenge: | Currently, most effective GEC systems are based on phrase-based statistical machine translation. |
| Approach: | They combine two of the most popular approaches to automated Grammatical Error Correction (GEC) they create a hybrid GEC system that preserves the accuracy of SMT output and generates more fluent sentences . |
| Outcome: | The proposed system achieves state-of-the-art on the CoNLL-2014 and JFLEG benchmarks. |
Approaching Neural Grammatical Error Correction as a Low-Resource Machine Translation Task (N18-1)
Copied to clipboard
| Challenge: | Previously, neural methods in grammatical error correction did not reach state-of-the-art results compared to phrase-based statistical machine translation (SMT) systems that improve on results by SMT use their set-up as a backbone for more complex systems. |
| Approach: | They propose a set of model-independent methods for neural GEC that can be easily applied in most GEC settings. |
| Outcome: | The proposed methods outperform state-of-the-art neural GEC systems by 10% M2 on the CoNLL-2014 benchmark and 5.9% on the JFLEG test set. |
Neural Quality Estimation of Grammatical Error Correction (D18-1)
Copied to clipboard
| Challenge: | Grammatical error correction systems are expected to correct most learners’ writing errors, but in practice they often produce spurious corrections and fail to correct many errors, thereby misleading learners. |
| Approach: | They propose to use supervised learning to estimate the quality of GEC output sentences to help instructors decide whether to correct the errors or ignore them altogether. |
| Outcome: | The proposed model improves on a feature-based baseline and shows that the state-of-the-art system can be improved when quality scores are used as features for re-ranking the N-best candidates. |
Improving Autoregressive Grammatical Error Correction with Non-autoregressive Models (2023.findings-acl)
Copied to clipboard
| Challenge: | Autoregressive models assign low probabilities to tokens that need corrections . grammatical error correction (GEC) is widely applied to natural language processing tasks . |
| Approach: | They propose to use a non-autoregressive model as an auxiliary model to train GEC models to correct grammatical errors in sentences. |
| Outcome: | The proposed method outperforms baselines on English and Chinese GEC tasks significantly. |
Cross-Sentence Grammatical Error Correction (P19-1)
Copied to clipboard
| Challenge: | Existing approaches to automatic grammatical error correction (GEC) ignore cross-sentence context . existing approaches only correct one sentence at a time and ignore useful contextual information . |
| Approach: | They propose to use an auxiliary encoder that encodes previous sentences and incorporates the encoding in the decoder via attention and gating mechanisms. |
| Outcome: | The proposed model improves over strong baselines on a synthetic dataset showing high performance in verb tense corrections that require cross-sentence context. |
No Error Left Behind: Multilingual Grammatical Error Correction with Pre-trained Translation Models (2024.eacl-long)
Copied to clipboard
| Challenge: | Grammatical Error Correction (GEC) research has primarily focused on English with little coverage for other languages. |
| Approach: | They propose a multilingual machine translation model that can be fine-tuned to improve error correction out-of-the-box. |
| Outcome: | The proposed model outperforms similar-sized MT5 models and competes favourably with larger models. |
A Crash Course in Automatic Grammatical Error Correction (2020.coling-tutorials)
Copied to clipboard
| Challenge: | Grammatical Error Correction (GEC) is the task of automatically detecting and correcting all types of errors in written text. |
| Approach: | tutorial aims to introduce participants to the field of Grammatical Error Correction . aim is to examine the development of neural-based GEC systems . |
| Outcome: | the tutorial aims to introduce participants to the current state of the art in the field of Grammatical Error Correction (GEC) |
Type-Driven Multi-Turn Corrections for Grammatical Error Correction (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing studies focus on data augmentation to combat exposure bias . but data augmented models lack the ability to recognize the procedure of gradual corrections . |
| Approach: | They propose a type-driven multi-turn corrections approach that uses multiple training instances to train dominant models. |
| Outcome: | The proposed model achieves state-of-the-art single-model performance on English GEC benchmarks. |
Controlling Grammatical Error Correction Using Word Edit Rate (P19-2)
Copied to clipboard
| Challenge: | Existing models for grammatical error correction only consider the single degree of correction suited for training corpus. |
| Approach: | They propose a neural grammar error correction method that can control the degree of correction by using new training data annotated with word edit rate. |
| Outcome: | The proposed method improves correction accuracy by using training data annotated with word edit rate. |
Frustratingly Easy System Combination for Grammatical Error Correction (2022.naacl-main)
Copied to clipboard
| Challenge: | Using a simple logistic regression algorithm, we combine GEC models for binary classification. |
| Approach: | They propose a logistic regression algorithm that can combine GEC models with binary classification. |
| Outcome: | The proposed method outperforms the state-of-the-art by 4.2 points on the CoNLL-2014 and 7.2 points on BEA-2019 test sets. |