Mitigating Hallucinations and Off-target Machine Translation with Source-Contrastive and Language-Contrastive Decoding (2024.eacl-short)
Copied to clipboard
| Challenge: | Hallucinations and off-target translations remain unsolved problems in machine translation, especially for low-resource languages and massively multilingual models. |
| Approach: | They propose two methods to mitigate hallucinations and off-target translations with a modified decoding objective without retraining or external models. |
| Outcome: | The proposed methods reduce translation errors with segment-level chrF2 below 10 by 67-83% on average across 57 tested translation directions. |
Similar Papers
Contrastive Decoding Reduces Hallucinations in Large Multilingual Machine Translation Models (2024.eacl-long)
Copied to clipboard
| Challenge: | Hallucinations occur when the target side sentence is detached from the source side sentence, or in other words, when there is a low contribution of the source sentence to the generation of the target sentence. |
| Approach: | They propose to use Contrastive Decoding to maximise the log-likelihood difference between a model and the same model with reduced contribution from the encoder outputs. |
| Outcome: | The proposed algorithm maximises the log-likelihood difference between a model and the same model with reduced contribution from the encoder outputs. |
Mitigating Hallucinated Translations in Large Language Models with Hallucination-focused Preference Optimization (2025.naacl-long)
Copied to clipboard
| Challenge: | Machine Translation (MT) systems based on fine-tuned large language models (LLMs) are at a higher risk of generating hallucinations, which can severely undermine user’s trust and safety. |
| Approach: | They propose a method that intrinsically learns to mitigate hallucinations during the model training phase. |
| Outcome: | The proposed method reduces hallucinations by 89% on an average across three unseen target languages while preserving translation quality. |
Regularized Contrastive Decoding with Hard Negative Samples for LLM Hallucination Mitigation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models are prone to generate hallucinations, which can undermine their reliability in high-stakes applications. |
| Approach: | They propose a method to capture hallucination signals for mitigating hallucis in large language models by regularizing the model's internal signals to a weaker model . |
| Outcome: | The proposed method achieves better hallucination mitigation performance on four benchmarks. |
Mitigating Hallucinations of Large Language Models in Medical Information Extraction via Contrastive Decoding (2024.findings-emnlp)
Copied to clipboard
Derong Xu, Ziheng Zhang, Zhihong Zhu, Zhenxi Lin, Qidong Liu, Xian Wu, Tong Xu, Xiangyu Zhao, Yefeng Zheng, Enhong Chen
| Challenge: | Medical Information Extraction (MIE) tasks are a fundamental component of medical NLP. |
| Approach: | They propose an alternative adaptive constraint strategy to adjust the scale and scope of contrastive tokens. |
| Outcome: | The proposed approach selectively enhances the identification and classification capabilities while minimizing the influence of other inherent abilities in LLMs. |
Paying More Attention to Source Context: Mitigating Unfaithful Translations from Large Language Model (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models lack explicit alignment between source and target contexts, leading to unfaithful translations. |
| Approach: | They propose three learning strategies to encourage LLMs to pay more attention to source context . they use a dataset to test the effectiveness of their model across multiple language pairs . |
| Outcome: | The proposed model reduces hallucinatory translation and improves fidelity across multiple languages. |
Critic-Driven Decoding for Mitigating Hallucinations in Data-to-text Generation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Hallucination of text lacking grounding in input data is a problem in neural data-to-text generation. |
| Approach: | They propose to combine probabilistic output of a generator language model with the output of an “text critic” classifier which guides the generation by assessing the match between the input data and the generated text. |
| Outcome: | The proposed method improves on the WebNLG and OpenDialKG benchmarks. |
Mitigating Hallucinations in Large Vision-Language Models with Instruction Contrastive Decoding (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent research in large vision-language models has shown promising results, but the issue of hallucination remains. |
| Approach: | They propose an instruction-based method to reduce hallucinations in large vision-language models . they use disturbance instructions to exacerbate hallucinosity in multimodal fusion modules . |
| Outcome: | The proposed method reduces hallucinations in multimodal fusion modules by reducing alignment uncertainty and subtracting hallucines from the original distribution. |
Alleviating Hallucinations of Large Language Models through Induced Hallucinations (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing studies have shown that large language models generate inaccurate or fabricated information, a phenomenon known as hallucinations. |
| Approach: | They propose a simple strategy to induce-then-contrast decode LLMs to enhance their factuality . they first induce hallucinations from the original model and penalize them . |
| Outcome: | The proposed strategy improves factuality of large language models across task formats, model sizes, and model families. |
On the Hallucination in Simultaneous Machine Translation (2024.acl-short)
Copied to clipboard
| Challenge: | Currently, there are no studies which systematically analyze hallucination in SiMT. |
| Approach: | They conduct a comprehensive analysis of hallucination in simultaneous machine translation (SiMT) they find that halluciation is extremely severe, especially as latency increases . |
| Outcome: | The results show that it is possible to alleviate hallucination by decreasing the over usage of target-side information for SiMT. |
Detecting and Mitigating Hallucinations in Machine Translation: Model Internal Workings Alone Do Well, Sentence Similarity Even Better (2023.acl-long)
Copied to clipboard
| Challenge: | a recent study shows that without artificially encouraging models to hallucinate, existing methods fall short . hallucinations are cases when the model generates output that is partially or fully unrelated to the source sentence. |
| Approach: | They propose a method that evaluates the percentage of the source contribution to a generated translation. |
| Outcome: | The proposed method improves detection accuracy for the most severe hallucinations by a factor of 2. |