| Challenge: | Grammatical error correction systems are expected to correct most learners’ writing errors, but in practice they often produce spurious corrections and fail to correct many errors, thereby misleading learners. |
| Approach: | They propose to use supervised learning to estimate the quality of GEC output sentences to help instructors decide whether to correct the errors or ignore them altogether. |
| Outcome: | The proposed model improves on a feature-based baseline and shows that the state-of-the-art system can be improved when quality scores are used as features for re-ranking the N-best candidates. |
Similar Papers
Controlling Grammatical Error Correction Using Word Edit Rate (P19-2)
Copied to clipboard
| Challenge: | Existing models for grammatical error correction only consider the single degree of correction suited for training corpus. |
| Approach: | They propose a neural grammar error correction method that can control the degree of correction by using new training data annotated with word edit rate. |
| Outcome: | The proposed method improves correction accuracy by using training data annotated with word edit rate. |
Approaching Neural Grammatical Error Correction as a Low-Resource Machine Translation Task (N18-1)
Copied to clipboard
| Challenge: | Previously, neural methods in grammatical error correction did not reach state-of-the-art results compared to phrase-based statistical machine translation (SMT) systems that improve on results by SMT use their set-up as a backbone for more complex systems. |
| Approach: | They propose a set of model-independent methods for neural GEC that can be easily applied in most GEC settings. |
| Outcome: | The proposed methods outperform state-of-the-art neural GEC systems by 10% M2 on the CoNLL-2014 benchmark and 5.9% on the JFLEG test set. |
A Crash Course in Automatic Grammatical Error Correction (2020.coling-tutorials)
Copied to clipboard
| Challenge: | Grammatical Error Correction (GEC) is the task of automatically detecting and correcting all types of errors in written text. |
| Approach: | tutorial aims to introduce participants to the field of Grammatical Error Correction . aim is to examine the development of neural-based GEC systems . |
| Outcome: | the tutorial aims to introduce participants to the current state of the art in the field of Grammatical Error Correction (GEC) |
Neural Quality Estimation with Multiple Hypotheses for Grammatical Error Correction (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing GEC models produce spurious corrections or fail to detect lots of errors. |
| Approach: | They propose a neural network for GEC quality estimation with multiple hypotheses . VERNet establishes interactions among hypothese based on reasoning graph . |
| Outcome: | The proposed model achieves state-of-the-art grammatical error detection performance and best quality estimation results on four GEC datasets. |
Neural Grammatical Error Correction with Finite State Transducers (N19-1)
Copied to clipboard
| Challenge: | Language model based GEC (LM-GEC) is a promising alternative to SMT and neural sequence-to-sequence models. |
| Approach: | They propose to use finite state transducers to improve LM-GEC by rescoring with neural language models. |
| Outcome: | The proposed model outperforms the best published results on the CoNLL-2014 test set and achieves far better relative improvements over the baselines. |
Improving Autoregressive Grammatical Error Correction with Non-autoregressive Models (2023.findings-acl)
Copied to clipboard
| Challenge: | Autoregressive models assign low probabilities to tokens that need corrections . grammatical error correction (GEC) is widely applied to natural language processing tasks . |
| Approach: | They propose to use a non-autoregressive model as an auxiliary model to train GEC models to correct grammatical errors in sentences. |
| Outcome: | The proposed method outperforms baselines on English and Chinese GEC tasks significantly. |
Near Human-Level Performance in Grammatical Error Correction with Hybrid Machine Translation (N18-2)
Copied to clipboard
| Challenge: | Currently, most effective GEC systems are based on phrase-based statistical machine translation. |
| Approach: | They combine two of the most popular approaches to automated Grammatical Error Correction (GEC) they create a hybrid GEC system that preserves the accuracy of SMT output and generates more fluent sentences . |
| Outcome: | The proposed system achieves state-of-the-art on the CoNLL-2014 and JFLEG benchmarks. |
System Combination via Quality Estimation for Grammatical Error Correction (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing quality estimation models are not good enough to distinguish good corrections from bad ones, resulting in low F0.5 scores when used for system combination. |
| Approach: | They propose a new quality estimation model that gives a better estimate of the quality of a corrected sentence. |
| Outcome: | The proposed model outperforms the state-of-the-art on the CoNLL-2014 and BEA-2019 test sets, and achieves the highest F0.5 scores published to date. |
Personalizing Grammatical Error Correction: Adaptation to Proficiency Level and L1 (D19-55)
Copied to clipboard
| Challenge: | Grammar error correction systems have become ubiquitous in a variety of software applications, but little is known about how to efficiently personalize them to the user’s characteristics, such as proficiency level and first language. |
| Approach: | They propose to adapt a general purpose neural GEC system to the proficiency level and the first language of a writer, using only a few thousand annotated sentences. |
| Outcome: | The proposed system improves on adapting to proficiency level and first language . the results are the broadest of its kind, covering five proficiency levels and twelve different languages. |
ProQE: Proficiency-wise Quality Estimation dataset for Grammatical Error Correction (2022.lrec-1)
Copied to clipboard
| Challenge: | Prior work has shown that QE models of grammatical error correction are biased toward data by learners with relatively high proficiency levels. |
| Approach: | They investigated whether learners' proficiency affects supervised quality estimation models of grammatical error correction (GEC) . they created a QE dataset that includes multiple proficiency levels and explored the necessity of performing proficiency-wise evaluation for QE of GEC. |
| Outcome: | The proposed model is based on multiple proficiency levels and can be performed in real-world scenarios. |