Challenge: Existing approaches to inducing APE have suffered from over-correction, where the APE system tends to keep the machine translated text without any modification.
Approach: They propose a neural programmer-interpreter approach to automated post-editing (APE) that mimics human perform post- editing using discrete edit operations . their model outperforms previous neural models for inducing PE programs on the WMT17 APE task for German-English up to +1 BLEU score and -0.7 TER scores.
Outcome: The proposed model outperforms previous neural models for inducing PE programs on the WMT17 APE task for German-English up to +1 BLEU score and -0.7 TER scores.

Similar Papers

Computer Assisted Translation with Neural Quality Estimation and Automatic Post-Editing (2020.findings-emnlp)

Copied to clipboard

Challenge: Using neural machine translation to approximate human parity is difficult due to the lack of parallel training corpora.
Approach: They propose an end-to-end deep learning framework for quality estimation and automatic post-editing of machine translation output.
Outcome: The proposed framework achieves state-of-the-art performance on the English–German dataset and human translators can significantly expedite their post-editing processing with the model.
Adaptation of Back-translation to Automatic Post-Editing for Synthetic Data Generation (2021.eacl-main)

Copied to clipboard

Challenge: Automated Post-Editing (APE) aims to correct errors in the output of a given machine translation system.
Approach: They propose two new methods of synthesizing additional MT outputs by adapting back-translation to the APE task, obtaining robust enlargements of existing synthetic APE training dataset.
Outcome: The proposed methods improve translation quality on the English-German APE task by enlarging the existing training dataset.
Learning to Copy for Automatic Post-Editing (D19-1)

Copied to clipboard

Challenge: Automatic post-editing (APE) is an important task in natural language processing.
Approach: They propose a method that explicitly models how to copy words from a machine translation to a correct translation.
Outcome: The proposed method outperforms all published methods on the WMT 2016-2017 datasets.
Automatic Correction of Human Translations (2022.naacl-main)

Copied to clipboard

Challenge: Despite recent advances in machine translation, a tremendous amount of translated content in the world is still written by humans.
Approach: They propose a task of translation error correction (TEC) that corrects human-generated translations by correcting all errors in a source sentence and a human-created translation.
Outcome: The proposed system improves translation accuracy by 5.1 points compared to MT systems with human errors .
Refer to the Reference: Reference-focused Synthetic Automatic Post-Editing Data Generation (2025.coling-main)

Copied to clipboard

Challenge: Existing approaches to synthetic APE data generation use source (src) sentences in a parallel corpus to obtain translations (mt) through an MT system and treat corresponding reference (ref) sentences as post-edits (pe).
Approach: They propose a reference-focused synthetic APE data generation technique that uses ‘ref’ instead of src’ sentences to obtain corrupted translations.
Outcome: The proposed technique improves on English-German, English-Russian, English -Marathi, English and Hindi language pairs.
MLQE-PE: A Multilingual Quality Estimation and Post-Editing Dataset (2022.lrec-1)

Copied to clipboard

Challenge: Existing datasets for machine translation quality estimation and post-editing have several shortcomings.
Approach: They propose a dataset for machine translation quality estimation and automatic post-editing . they report the performance of baseline systems trained on the MLQE-PE dataset .
Outcome: The proposed dataset contains human labels for up to 10,000 translations per language pair.
A Simple and Effective Approach to Automatic Post-Editing with Transfer Learning (P19-1)

Copied to clipboard

Challenge: Existing APE systems generate artificial triplets of source sentences, machine translation outputs and human post-edits.
Approach: They propose to use human post-edits to refine black-box machine translation (MT) models by fine-tuning pre-trained BERT models on both encoder and decoder of an APE system.
Outcome: The proposed method improves on a dataset of 23K sentences on x86 GPUs.
Leveraging GPT-4 for Automatic Translation Post-Editing (2023.findings-emnlp)

Copied to clipboard

Challenge: Neural Machine Translation models still require translation post-editing to rectify errors and enhance quality under critical settings.
Approach: They use GPT-4 to automatically post-edit NMT outputs across several language pairs . they show that GPT4 is adept at translation post- editing, producing meaningful edits .
Outcome: The proposed translation post-editor improves on state-of-the-art language models on English-Chinese, English-German, Chinese-English and German-English language pairs.
Understanding Pre-Editing for Black-Box Neural Machine Translation (2021.eacl-main)

Copied to clipboard

Challenge: a study has demonstrated the effectiveness of pre-editing for black-box neural MT, but a deep understanding of what it is and how it works for black box NMT is lacking.
Approach: They investigated 6,652 instances of pre-editing across three translation directions, two MT systems and four text domains.
Outcome: The proposed method can be used in MT systems with black-box neural MT (NMT) but it is not yet fully understood in the literature.
Can Automatic Post-Editing Improve NMT? (2020.emnlp-main)

Copied to clipboard

Challenge: APE has been successful with statistical machine translation systems but has not been as successful over neural machine translation (NMT) systems.
Approach: They propose to train neural APE models on a corpus of human post-edits of NMT and compile a larger corpus to test their hypothesis.
Outcome: The proposed model can improve a strong in-domain NMT system, challenging the current understanding in the field.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations