Challenge: Existing dense representations have shown limitations in zero-shot scenarios . however, passage representations fail to align with their gold queries .
Approach: They propose a query-focused concept of 'referentiable' which ensures passage representations are referenced by their gold queries.
Outcome: The proposed model outperforms existing models on the BEIR benchmark.

Similar Papers

Precise Zero-Shot Dense Retrieval without Relevance Labels (2023.acl-long)

Copied to clipboard

Challenge: Existing dense retrieval systems that use semantic embedding similarities can be effective across tasks and languages.
Approach: They propose to pivot through Hypothetical Document Embeddings (HyDE) given a query, HyDE first zero-shot prompts an instruction-following language model to generate a hypothetical document.
Outcome: The proposed method significantly outperforms the state-of-the-art unsupervised dense retriever Contriever and shows strong performance comparable to fine-tuned retrievers across tasks and languages.
Query-as-context Pre-training for Dense Passage Retrieval (2023.emnlp-main)

Copied to clipboard

Challenge: Existing methods to improve passage retrieval performance by using context-supervised pre-training are weakly correlated.
Approach: They propose to use query-as-context pre-training to train passage-query pairs . they evaluate the pre-trained models on large-scale passage retrieval benchmarks .
Outcome: The proposed technique improves performance on large-scale passage retrieval benchmarks and out-of-domain zero-shot benchmarks.
HIL: Hybrid Isotropy Learning for Zero-shot Performance in Dense retrieval (2024.naacl-long)

Copied to clipboard

Challenge: Recent advances in dense retrieval models have brought ColBERT to prominence in information retrieval, but it is underperforming in zero-shot tasks.
Approach: They propose a Hybrid Isotropy Learning architecture that integrates isotropic and anisotropic representations to improve zero-shot retrieval performance.
Outcome: The proposed model outperforms the baseline ColBERT model in BEIR benchmarks.
Dense Passage Retrieval for Open-Domain Question Answering (2020.emnlp-main)

Copied to clipboard

Challenge: Open-domain question answering relies on efficient passage retrieval to select candidate contexts.
Approach: They propose a dual-encoder framework that can be implemented to retrieve passages from a small number of questions and passages.
Outcome: The proposed system outperforms a strong Lucene-BM25 system in top-20 passage retrieval accuracy on multiple open-domain QA benchmarks.
Relevance-assisted Generation for Robust Zero-shot Retrieval (2023.emnlp-industry)

Copied to clipboard

Challenge: Despite strong in-domain performance, dense retrievers have shown poor generalization to out-of-domain zero-shot tasks where no training queries are available.
Approach: They propose to generate domain-specific pseudo queries for fine-tuning with domain-relevant relevance between PQ and documents.
Outcome: The proposed approach is more robust to domain shifts, validated on BEIR zero-shot tasks.
Zero-Shot Dense Retrieval with Momentum Adversarial Domain Invariant Representations (2022.findings-acl)

Copied to clipboard

Challenge: Dense retrieval (DR) methods first encode texts into a dense embedding space and then conduct text retrieval using efficient nearest neighbor search.
Approach: They propose Momentum adversarial Domain Invariant Representation learning to train a domain classifier that distinguishes source versus target domains and adversarially updates the DR encoder to learn domain invariant representations.
Outcome: The proposed method outperforms baselines on 10+ ranking datasets collected in the BEIR benchmark in the zero-shot setting, with more than 10% relative gains on datasets with enough sensitivity for DR models’ evaluation.
Referral Augmentation for Zero-Shot Information Retrieval (2024.findings-acl)

Copied to clipboard

Challenge: Referral-augmented retrieval improves zero-shot document retrieval in a variety of tasks . prior work shows sparse models struggle to reconcile with dense models .
Approach: They propose a technique that concatenates document indices with referrals from other documents that cite or link to the given document.
Outcome: The proposed technique outperforms generative text expansion techniques on structured tasks and improves on ACL paper retrieval.
A Representation Sharpening Framework for Zero Shot Dense Retrieval (2026.eacl-long)

Copied to clipboard

Challenge: Zero-shot dense retrieval requires generic, pretrained DRs, which struggle to represent semantic differences between similar documents.
Approach: They propose a training-free representation sharpening framework that augments a document’s representation with information that helps differentiate it from similar documents in the corpus.
Outcome: The proposed framework is compatible with prior approaches to zero-shot dense retrieval and consistently improves their performance.
Evidentiality-aware Retrieval for Overcoming Abstractiveness in Open-Domain Question Answering (2024.findings-eacl)

Copied to clipboard

Challenge: Existing approaches to ODQA use a simple yet effective retriever-reader framework, but this approach is not always effective in abstractive tasks.
Approach: They propose a method that leverages synthetic distractor samples to learn to discriminate evidence passages from distractors.
Outcome: The proposed method is validated on multiple abstractive open-domain question answering tasks.
Robust Retrieval Augmented Generation for Zero-shot Slot Filling (2021.emnlp-main)

Copied to clipboard

Challenge: Automating high quality knowledge graphs from a given collection of documents remains a challenging problem in AI.
Approach: They propose a novel approach to slot filling that extends dense passage retrieval with hard negatives and robust training procedures for retrieval augmented generation models.
Outcome: The proposed model improves on both T-REx and zsRE slot filling datasets and ranks at the top-1 position in the KILT leaderboard.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations