Improving NMT Models by Retrofitting Quality Estimators into Trainable Energy Loss (2025.coling-main)
Copied to clipboard
| Challenge: | Reinforcement learning has shown great promise in aligning language models with human preferences in a variety of text generation tasks, including machine translation. |
| Approach: | They propose a method that employs quality estimators as trainable loss networks to backpropagate to the NMT model. |
| Outcome: | The proposed method outperforms strong baselines and proximal policy optimizations on English-to-Mongolian translation. |
Similar Papers
A Reinforcement Learning Approach to Improve Low-Resource Machine Translation Leveraging Domain Monolingual Data (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for fine-tuning domain adaptation have overfitting problem in low-resource domains . lack of parallel data makes it difficult for model to learn domain-specific knowledge . |
| Approach: | They propose a Reinforcement Learning Domain Adaptation method for Neural Machine Translation that uses in-domain source monolingual data to make up for the lack of parallel data. |
| Outcome: | The proposed method can alleviate overfitting and reinforce the model to learn domain-specific knowledge. |
Improving Machine Translation with Human Feedback: An Exploration of Quality Estimation as a Reward Model (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing methods to improve translation quality using human feedback have not been validated. |
| Approach: | They propose to use quality estimation to predict human preferences for feedback training . they propose to detect incorrect translations and assign a penalty term to the reward scores . |
| Outcome: | The proposed method outperforms systems using larger parallel corpora by a small amount of monolingual data. |
Forge: Quality-Aware Reinforcement Learning for NP-Hard Optimization in LLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks focus on correctness, overlooking optimality . large language models excel at math, coding, logic and puzzles . |
| Approach: | They propose a framework for training and evaluating Large Language Models on NP-hard optimization problems through quality-aware RLVR. |
| Outcome: | The proposed framework outperforms existing benchmarks on math, coding, logic and puzzles. |
QUAK: A Synthetic Quality Estimation Dataset for Korean-English Neural Machine Translation (2022.coling-1)
Copied to clipboard
| Challenge: | despite its high utility, there are limitations concerning manual QE data creation. |
| Approach: | They propose to generate a Korean-English QE dataset that is fully automatic . they find that the algorithm is more accurate and faster than manual QE . |
| Outcome: | The proposed datasets show that they scale up to 1.58M and 6.58M, respectively, and show that the results are significantly better when compared to the previous datasets. |
Fine-Grained Reward Optimization for Machine Translation using Error Severity Mappings (2026.tacl-1)
Copied to clipboard
Miguel Moura Ramos, Tomás Almeida, Daniel Vareta, Filipe Azevedo, Sweta Agrawal, Patrick Fernandes, André F. T. Martins
| Challenge: | Reinforcement learning (RL) is an effective and robust method for training neural machine translation systems. |
| Approach: | They propose a method that leverages fine-grained, token-level quality assessments . they use a state-of-the-art quality estimation system as their token- level reward model . |
| Outcome: | The proposed approach leverages fine-grained, token-level quality assessments along with error severity levels to improve translation quality. |
Machine Translation for Machines: the Sentiment Classification Use Case (D19-1)
Copied to clipboard
| Challenge: | Traditionally, machine translation (MT) pursues a "human-oriented" objective: generating fluent output for a downstream task. |
| Approach: | They propose a neural machine translation approach that uses weak feedback to generate translations that are best suited for a downstream task. |
| Outcome: | The proposed approach outperforms general-purpose models and reinforcement learning methods on German and Italian tweets. |
A Study of Reinforcement Learning for Neural Machine Translation (D18-1)
Copied to clipboard
| Challenge: | Recent studies have shown that reinforcement learning (RL) is an effective approach for improving the performance of neural machine translation systems. |
| Approach: | They propose to leverage reinforcement learning to boost the performance of NMT systems trained with monolingual data. |
| Outcome: | The proposed method achieves competitive results on translation tasks in English-German, Chinese-English and English-English systems. |
Are we Estimating or Guesstimating Translation Quality? (2020.acl-main)
Copied to clipboard
| Challenge: | A carefully engineered ensemble of pre-trained multilingual language models won the QE shared task at WMT19. |
| Approach: | They propose to use pre-trained multilingual language models to train quality estimation for machine translation. |
| Outcome: | A carefully engineered ensemble of pre-trained language models wins the QE shared task at WMT19. |
TransQuest: Translation Quality Estimation with Cross-lingual Transformers (2020.coling-main)
Copied to clipboard
| Challenge: | Recent advances in the field of sentence-level quality estimation (QE) are based on neural-based architectures that require resourceintensive training. |
| Approach: | They propose a framework for sentence-level quality estimation based on cross-lingual transformers and use it to implement and evaluate two different neural architectures. |
| Outcome: | The proposed framework outperforms open-source QE frameworks when trained on WMT datasets and is very competitive in transfer learning settings. |
EPOQUE: An English-Persian Quality Estimation Dataset (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing human labeled QE datasets are limited to limited language pairs . a small subset of the proposed dataset can improve its performance by 8% . |
| Approach: | They propose to use an English-Persian QE dataset with manually annotated direct assessment labels to evaluate translation quality estimation models. |
| Outcome: | The proposed dataset improves on two state-of-the-art QE models by 8% . the proposed dataset contains 1000 translated sentences from English to Persian . |