Towards Robust In-Context Learning for Machine Translation with Large Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Experimental results demonstrate the effectiveness of our method, particularly in domain adaptation. |
| Approach: | They propose a method to retrieve translation pairs as demonstrations from an additional datastore to guide translation without updating the LLMs. |
| Outcome: | The proposed method reduces noise and improves translation performance in domain adaptation. |
Similar Papers
Can Large Language Models Learn Translation Robustness from Noisy-Source In-context Demonstrations? (2024.lrec-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have been used for machine translation, but their robustness remains a challenge, as they struggle to translate sentences in the presence of noise even when using similarity-based in-context learning methods. |
| Approach: | They propose a scheme for studying machine translation robustness on LLMs by using noisy-source demonstration examples. |
| Outcome: | The proposed model can learn robustness from noisy-source demonstration examples, thereby improving translation performance on noisy sentences. |
Towards Demonstration-Aware Large Language Models for Machine Translation (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models for machine translation often face difficulties in leveraging demonstrations to further improve their performance. |
| Approach: | They propose a novel approach that integrates demonstration-aware training and inference strategies within the framework of tuning-based LTMs. |
| Outcome: | The proposed model integrates demonstration-aware training and inference strategies within tuning-based LTMs. |
Efficiently Exploring Large Language Models for Document-Level Machine Translation with In-context Learning (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on sentence-level translation have focused on document level machine translation (DOCMT) document level translation is a complex task different from sentence- level translation. |
| Approach: | They propose a Context-Aware Prompting method which generates more accurate, coherent translations via in-context learning. |
| Outcome: | The proposed method is effective in literary translation tasks and zero pronoun translation tasks. |
An Empirical Study of In-context Learning in LLMs for Machine Translation (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent studies focus on optimizing translation quality, with limited attention to understanding specific aspects of ICL that influence the said quality. |
| Approach: | They conduct the first of its kind, exhaustive study of in-context learning for machine translation (MT) they establish that ICL is primarily example-driven and not instruction-driven . |
| Outcome: | The proposed model is based on examples and not instruction-driven learning. |
Multilingual Machine Translation with Large Language Models: Empirical Results and Analysis (2024.findings-naacl)
Copied to clipboard
Wenhao Zhu, Hongyi Liu, Qingxiu Dong, Jingjing Xu, Shujian Huang, Lingpeng Kong, Jiajun Chen, Lei Li
| Challenge: | Existing studies show that large language models (LLMs) can handle multilingual machine translation (MMT) However, the multilingual translation ability of LLMs remains under-explored. |
| Approach: | They evaluate eight popular LLMs including ChatGPT and GPT-4 to determine their performance in multilingual machine translation. |
| Outcome: | The proposed model can generate moderate translation even on zero-resource languages and cross-lingual exemplars can provide better task guidance for low-resourced translation than exemplar in the same language pairs. |
Robust and Scalable Model Editing for Large Language Models (2024.lrec-main)
Copied to clipboard
Yingfa Chen, Zhengyan Zhang, Xu Han, Chaojun Xiao, Zhiyuan Liu, Chen Chen, Kuai Li, Tao Yang, Maosong Sun
| Challenge: | Existing methods that ignore contextual knowledge fail to reliably fall back to parametric knowledge when presented with irrelevant context. |
| Approach: | They propose to use contextual knowledge to update and correct LLMs' knowledge by in-context editing instead of retraining. |
| Outcome: | The proposed method outperforms current state-of-the-art methods by a large margin on a dataset that contains irrelevant questions. |
Steering Large Language Models for Machine Translation with Finetuning and In-Context Learning (2023.findings-emnlp)
Copied to clipboard
Duarte Alves, Nuno Guerreiro, João Alves, José Pombal, Ricardo Rei, José de Souza, Pierre Colombo, Andre Martins
| Challenge: | Large language models (LLMs) are a promising avenue for machine translation (MT) however, their effectiveness depends on the choice of few-shot examples and they often require extra post-processing due to overgeneration. |
| Approach: | They propose a method that incorporates few-shot examples during finetuning to improve performance on MT tasks. |
| Outcome: | The proposed method outperforms few-shot prompting while eliminating the need for in-context examples. |
Understanding In-Context Machine Translation for Low-Resource Languages: A Case Study on Manchu (2025.acl-long)
Copied to clipboard
| Challenge: | In-context machine translation (MT) with large language models can take advantage of linguistic resources such as grammar books and dictionaries. |
| Approach: | They propose to use in-context machine translation (MT) with large language models to take advantage of linguistic resources such as grammar books and dictionaries. |
| Outcome: | The proposed approach can take advantage of dictionaries and grammar books, but its performance is poor for many lowresource languages. |
Balanced Multi-Factor In-Context Learning for Multilingual Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches address key factors that influence multilingual ICL, but they do not integrate them into the model. |
| Approach: | They propose a method that quantifies and optimally balances three factors for improved example selection. |
| Outcome: | Experiments on mCSQA and TYDI show that the proposed method outperforms existing methods. |
Benchmarking and Improving Long-Text Translation with Large Language Models (2024.findings-acl)
Copied to clipboard
Longyue Wang, Zefeng Du, Wenxiang Jiao, Chenyang Lyu, Jianhui Pang, Leyang Cui, Kaiqiang Song, Derek Wong, Shuming Shi, Zhaopeng Tu
| Challenge: | Recent studies have illuminated the promising capabilities of large language models (LLMs) in handling long texts. |
| Approach: | They construct a benchmark dataset specifically designed for the finetuning and evaluation of large language models (LLMs) they compare LLMs with MT models and find they exhibit shortcomings in long-text domains . |
| Outcome: | The proposed model performs better in long-text translation, and its performance diminishes as document size increases. |