| Challenge: | Phrase-level dense retrieval has shown many appealing characteristics in downstream NLP tasks. |
| Approach: | They propose a task formulation of dense retrieval, cross-lingual contextualized phrase retrieval . they extract pairs of cross-linguistic phrases using word alignment information . |
| Outcome: | The proposed task formulation surpasses baselines on the phrase retrieval task and a downstream task, i.e., machine translation, and achieves top-1 accuracy 13 points higher. |
Similar Papers
Cross-Lingual Phrase Retrieval (2022.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to cross-lingual phrase retrieval learn word or sentence representations in word or sentences. |
| Approach: | They propose a cross-lingual phrase retrieval model that extracts phrase representations from unlabeled example sentences. |
| Outcome: | The proposed model outperforms state-of-the-art methods on a large-scale cross-lingual phrase retrieval dataset, showing it can perform in an unseen language pair during training. |
Improving In-context Learning of Multilingual Generative Language Models with Cross-lingual Alignment (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing studies show that multilingual generative models exhibit a strong language bias toward high-resource languages. |
| Approach: | They propose a cross-lingual alignment framework exploiting pairs of translation sentences to improve cross-linguistic abilities. |
| Outcome: | The proposed framework improves cross-lingual abilities and mitigates performance gap. |
Multimodal Cross-lingual Phrase Retrieval (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing approaches to cross-lingual phrase retrieval only deal with textual modality, leaving the question of the effectiveness of using multimodal information unanswered. |
| Approach: | They propose a multimodal cross-lingual phrase retrieval resource that integrates a Wikimedia Commons media store and a large multimodal pre-trained model to bridge the gap between different modalities. |
| Outcome: | The proposed approach performs significantly better than pure textual cross-lingual phrase retrieval on a benchmarked dataset covering eight language pairs. |
Phrase Retrieval Learns Passage Retrieval, Too (2021.emnlp-main)
Copied to clipboard
| Challenge: | Dense retrieval methods have shown great promise over sparse methods in a range of NLP problems. |
| Approach: | They propose to use dense phrase retrieval to learn coarse-level retrieval including passages . they show phrase retrievals can be fine-tuned for more coarse-grained retrieval units . |
| Outcome: | The proposed method improves passage retrieval accuracy and QA performance with fewer passages. |
Cross-Align: Modeling Deep Cross-lingual Interactions for Word Alignment (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing word alignment models capture few interactions between input sentence pairs, which severely degrades the word alignment quality. |
| Approach: | They propose to model deep interactions between input and target sentences using a two-stage training framework to train the model. |
| Outcome: | The proposed model achieves the state-of-the-art (SOTA) performance on four out of five language pairs. |
Learning High-Quality and General-Purpose Phrase Representations (2024.findings-eacl)
Copied to clipboard
| Challenge: | Pre-trained language models for phrasal embeddings are unnecessarily complex and require to be pre-tuned on a corpus with context sentences. |
| Approach: | They propose a framework to learn phrase representations in a context-free fashion. |
| Outcome: | The proposed framework generates superior phrase embeddings while requiring a smaller model size. |
Understanding LLMs’ Cross-Lingual Context Retrieval: How Good It Is And Where It Comes From (2025.emnlp-main)
Copied to clipboard
| Challenge: | Cross-lingual context retrieval is a fundamental aspect of cross-lingual alignment, but the performance and mechanism of it for large language models (LLMs) remains unclear. |
| Approach: | They evaluate cross-lingual context retrieval of over 40 large language models . they use cross-linguistic machine reading comprehension as a representative scenario . |
| Outcome: | The results show that open LLMs show strong cross-lingual context retrieval ability . the results also show that their oracle performances improve after training . |
Context-Aware Cross-Lingual Mapping (N19-1)
Copied to clipboard
| Challenge: | Cross-lingual word vectors are typically obtained by fitting an orthogonal matrix that maps the entries of a bilingual dictionary from a source to a target vector space. |
| Approach: | They propose an alternative to word-level mapping that better reflects sentence-level cross-lingual similarity by directly mapping the averaged embeddings of aligned sentences in a parallel corpus. |
| Outcome: | The proposed approach outperforms context-independent word mapping in translation retrieval. |
Boosting Data Utilization for Multilingual Dense Retrieval (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on fine-tuning multilingual dense retrieval models, but data scarcity for low-resource languages makes it difficult to align representations in a shared vector space. |
| Approach: | They propose to obtain high-quality hard negative samples and effective mini-batch data to boost data utilization for multilingual dense retrieval by obtaining high-quality negative samples. |
| Outcome: | The proposed method outperforms existing baselines on a multilingual retrieval benchmark, MIRACL, with 16 languages. |
Lightweight Cross-Lingual Sentence Representation Learning (2021.acl-long)
Copied to clipboard
| Challenge: | Existing models for learning fixed-dimensional cross-lingual sentence representations are impractical due to memory limitations. |
| Approach: | They propose a lightweight dual-transformer architecture with just 2 layers for generating memory-efficient cross-lingual sentence representations. |
| Outcome: | The proposed model improves performance on training tasks and improves memory efficiency. |