Papers with TER
Reference Free Domain Adaptation for Translation of Noisy Questions with Question Specific Rewards (2023.findings-emnlp)
Copied to clipboard
Baban Gain, Ramakrishna Appicharla, Soumya Chennabasavaraj, Nikesh Garera, Asif Ekbal, Muthusamy Chelliah
| Challenge: | Creating a synthetic parallel corpus from noisy data is also difficult due to its noisy nature. |
| Approach: | They propose a training methodology that fine-tunes the NMT system only using source-side data to balance adequacy and fluency. |
| Outcome: | The proposed method surpasses the MLE-based fine-tuning approach by achieving a 1.9 BLEU improvement. |
PePe: Personalized Post-editing Model utilizing User-generated Post-edits (2023.findings-eacl)
Copied to clipboard
| Challenge: | Existing neural machine translation models ignore personal style in their translations, but in these studies the definition of personal style is over-simplified. |
| Approach: | They propose a personalized automatic post-editing framework that generates sentences considering distinct personal behaviors by collecting post-edited data from a live machine translation system and combining a discriminator module and user-specific parameters. |
| Outcome: | The proposed model outperforms baseline models on four different metrics including BLEU, TER, YiSi-1, and human evaluation. |
Giving the Old a Fresh Spin: Quality Estimation-Assisted Constrained Decoding for Automatic Post-Editing (2025.naacl-short)
Copied to clipboard
| Challenge: | Existing methods to improve automatic post-editing (APE) systems struggle with over-correction, despite the principle of minimal editing. |
| Approach: | They propose a method that incorporates word-level Quality Estimation (QE) information during the decoding process. |
| Outcome: | The proposed method improves on English-German, English-Hindi, and English-Marathi language pairs, with TER gains of 0.65, 1.86, and 1.44 points, respectively. |
Poor Man’s Quality Estimation: Predicting Reference-Based MT Metrics Without the Reference (2023.eacl-main)
Copied to clipboard
Vilém Zouhar, Shehzaad Dhuliawala, Wangchunshu Zhou, Nico Daheim, Tom Kocmi, Yuchen Eleanor Jiang, Mrinmaya Sachan
| Challenge: | State-of-the-art machine translation quality estimation systems have been achieving remarkable correlations with human judgements yet they require human annotations, which are expensive and computationally heavy. |
| Approach: | They propose a problem where one predicts automated metric scores without the reference. |
| Outcome: | The proposed model can estimate automated metrics at the sentence-level without the reference. |
GTR-LSTM: A Triple Encoder for Sentence Generation from RDF Data (P18-1)
Copied to clipboard
| Challenge: | Knowledge bases are becoming an enabling resource for many applications including Q&A systems, recommender systems, and summarization tools. |
| Approach: | They propose a system to translate RDF triples into natural sentences using an encoder-decoder framework. |
| Outcome: | The proposed model outperforms the baseline model by 17.6%, 6.0%, and 16.4% in terms of BLEU, METEOR, and TER scores. |
Guiding Large Language Models to Post-Edit Machine Translation with Error Annotations (2024.findings-naacl)
Copied to clipboard
| Challenge: | supervised systems have not replaced dedicated supervised models for machine translation tasks. |
| Approach: | They propose to guide LLMs to post-edit MT with feedback from MQM annotations . they then fine-tune the LLM to improve its ability to exploit the feedback . |
| Outcome: | The proposed model improves TER, BLEU and COMET scores on Chinese-English, English-German and English-Russian data. |
An End-to-End Generative Architecture for Paraphrase Generation (D19-1)
Copied to clipboard
| Challenge: | Existing methods for generating paraphrases with linguistic knowledge are often domain specific and hard to scale, or yield inferior results. |
| Approach: | They propose an end-to-end conditional generative architecture for generating paraphrases via adversarial training which does not depend on extra linguistic information. |
| Outcome: | The proposed method outperforms existing models on automatic metrics and human evaluations on four public datasets. |
Why should only High-Resource-Languages have all the fun? Pivot Based Evaluation in Low Resource Setting (2025.coling-main)
Copied to clipboard
| Challenge: | a limited number of evaluation metrics and resources are available for low-resource languages . a pivot-based evaluation framework is proposed to address these limitations . |
| Approach: | They propose a pivot-based evaluation framework that leverages advanced metrics for more meaningful evaluation. |
| Outcome: | The proposed framework extends the coverage of both lexical-based and embedding-based metrics even for languages not directly supported by advanced metrics. |
Training-Free Text Emotion Tagging via LLM-Based Best-Worst Scaling (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are often used as automatic annotators for tasks such as Text Emotion Recognition (TER). |
| Approach: | They propose a novel algorithm that leverages Best-Worst Scaling to prompt the LLM to choose the least and most suitable emotions for a given text from several label subsets. |
| Outcome: | The proposed method compares favorably to existing methods and naive prompting approaches in terms of accuracy and calibration. |
Empowering Tree-structured Entailment Reasoning: Rhetorical Perception and LLM-driven Interpretability (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing models for science question answering lack a framework for entailment trees . ambiguities and similarities between science facts complicate the fact retrieval process . |
| Approach: | They propose a framework for building entailment trees for science question answering . they propose to infuse knowledge that bridges the gap between reasoning types and rhetorical relations . |
| Outcome: | The proposed framework improves retrieval capabilities, understanding relationships and generating intermediate conclusions. |
It is not a piece of cake for GPT: Explaining Textual Entailment Recognition in the presence of Figurative Language (2025.coling-main)
Copied to clipboard
| Challenge: | Figure-based language is used to convey opinions, ideas, or emotions in texts and dialogues. |
| Approach: | They evaluate the capabilities of Large Language Models to address TER and generate textual explanations of TER predictions. |
| Outcome: | The proposed model outperforms the open-source models in Zero- and Few-Shot Learning settings and shows significant performance improvements. |
Using Context in Neural Machine Translation Training Objectives (2020.acl-main)
Copied to clipboard
| Challenge: | Neural Machine Translation (NMT) training is based on document-level metrics, not sentence-level BLEU. |
| Approach: | They propose to merge document-level metrics with batch-level documents to improve NMT training. |
| Outcome: | The proposed training is more robust for document-level metrics than sequence MRT and maximum-likelihood training. |
myMediCon: End-to-End Burmese Automatic Speech Recognition for Medical Conversations (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing medical conversation speech corpora for Burmese are limited, despite advances in ASR. |
| Approach: | They propose to use a manually curated medical conversation speech corpus for Burmese to examine the performance of ASR models. |
| Outcome: | The proposed model outperforms the Transformer model and the Recurrent Neural Network (RNN) models. |