The Challenges of Optimizing Machine Translation for Low Resource Cross-Language Information Retrieval (D19-1)
Copied to clipboard
| Challenge: | Existing studies do not investigate the effectiveness of MT metrics in predicting performance of downstream IR models. |
| Approach: | They examine the relationship between MT performance and IR quality in a CLIR-based system . they find that the choice of IR collection can significantly affect MT tuning decisions . |
| Outcome: | The proposed model can predict CLIR performance better from MT quality, the authors show . the proposed model is based on a BLEU-based model with a bag of words constraint . |
Similar Papers
Evaluating Large Language Models for Cross-Lingual Retrieval (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have been evaluated as second-stage reranking models for monolingual IR, but a systematic comparison is lacking for cross-lingual reranked IR. |
| Approach: | They propose to use machine translation to evaluate rerankers in cross-lingual IR . they find that LLMs perform better than LLM-based reranked models . |
| Outcome: | The proposed model improves cross-lingual IR but relies on machine translation for the first stage. |
Machine translation impact in E-commerce multilingual search (2022.emnlp-industry)
Copied to clipboard
| Challenge: | Existing studies have demonstrated that cross-lingual information retrieval performance is highly dependent on query translation quality. |
| Approach: | They investigate whether improving query translation quality yields little or no benefit to further improve retrieval performance. |
| Outcome: | The proposed methods compare query translations for multiple language pairs and identify the most promising language pairs to invest and improve. |
Cross-Lingual Learning-to-Rank with Shared Representations (N18-2)
Copied to clipboard
| Challenge: | Cross-lingual information retrieval (CLIR) is a document retrieval task where the documents are written in a language different from that of the user's query. |
| Approach: | They propose a large-scale dataset derived from Wikipedia to support CLIR research in 25 languages. |
| Outcome: | The proposed model can improve the results of Swahili-English CLIR in Japanese and Japanese. |
Weakly Supervised Attentional Model for Low Resource Ad-hoc Cross-lingual Information Retrieval (D19-61)
Copied to clipboard
| Challenge: | Low resource languages often lack relevance annotations for cross-lingual information retrieval . when available, the training data has limited coverage for possible queries . |
| Approach: | They propose a weakly supervised neural model for Cross-lingual information retrieval from low-resource languages using weak supervision instead of relevance annotations. |
| Outcome: | The proposed model achieves 19 MAP points improvement compared to CNNs and 12 points improvement from machine translation-based CLIR models. |
Cross-Lingual Training of Neural Models for Document Ranking (2020.findings-emnlp)
Copied to clipboard
| Challenge: | a recent study shows that multi-lingual BERT models can be used for document ranking in non-English languages . a blog post by Google suggests that the company is exploring this approach to improve web search across a number of languages. |
| Approach: | They propose to leverage relevance judgments in English to train neural document ranking models for mono-lingual retrieval in multiple target languages. |
| Outcome: | The proposed approach improves search quality in non-English languages while requiring low resources. |
Translation or Recitation? Calibrating Evaluation Scores for Machine Translation of Extremely Low-Resource Languages (2026.acl-short)
Copied to clipboard
| Challenge: | Existing studies show that performance across low-resource settings is variable, resulting in a significant barrier for the MT community. |
| Approach: | They propose to use FRED Difficulty Metrics to contextualize reported performance across different language pairs to determine whether breakthroughs reported in other contexts are artifacts of benchmark collection. |
| Outcome: | The proposed metrics explain a significant portion of result variability rather than model capability. |
Cross-Dialect Information Retrieval: Information Access in Low-Resource and High-Variance Languages (2025.coling-main)
Copied to clipboard
| Challenge: | lexical gaps between dialects in cross-lingual information retrieval (CLIR) are caused by orthographic variations and different regional expressions. |
| Approach: | They propose a dataset that consists of seven German dialects extracted from Wikipedia. |
| Outcome: | The proposed dataset consists of seven German dialects extracted from Wikipedia. |
CLIReval: Evaluating Machine Translation as a Cross-Lingual Information Retrieval Task (2020.acl-demos)
Copied to clipboard
| Challenge: | evaluating machine translation (MT) with cross-lingual information retrieval is relatively time-consuming and subjective. |
| Approach: | They propose a toolkit that evaluates machine translation with a proxy task of cross-lingual information retrieval. |
| Outcome: | The proposed toolkit is based on the "metrics shared task" of WMT2019. |
Data Cartography for Low-Resource Neural Machine Translation (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to improve machine translation (MT) in low-resource settings are limited in the number of languages spoken in the world. |
| Approach: | They apply cartography techniques to characterize the contribution of training samples in two low-resource MT tasks (Swahili-English and Turkish-English) they argue that data augmentation strategies for low-Resource ML would benefit from model-in-the-loop strategies to maximize improvements. |
| Outcome: | The proposed methods show that training samples contribute to model training in low-resource MT tasks, albeit not uniformly throughout the training process. |
Scaling Low-Resource MT via Synthetic Data Generation with LLMs (2025.emnlp-main)
Copied to clipboard
Ona de Gibert, Joseph Attieh, Teemu Vahtola, Mikko Aulamo, Zihao Li, Raúl Vázquez, Tiancheng Hu, Jörg Tiedemann
| Challenge: | a recent study has shown that LLM-generated synthetic data can improve low-resource machine translation performance . traditional data augmentation techniques like back-translation preserve the human-written target and synthesize the other . |
| Approach: | They construct a document-level synthetic corpus from English Europarl and extend it via pivoting to 147 additional language pairs. |
| Outcome: | The proposed model can significantly improve low-resource machine translation performance even when noisy. |