Analyze, Generate and Refine: Query Expansion with LLMs for Zero-Shot Open-Domain QA (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods like GAR and EAR rely heavily on supervised training and struggle to maintain effectiveness across domains and datasets. |
| Approach: | They propose a QE approach based on a three-step prompting strategy to enhance query expansion by broadening the scope of queries with additional relevant texts. |
| Outcome: | The proposed approach outperforms state-of-the-art methods in out-domain zero-shot scenarios and outperformed existing methods in end-to-end evaluations. |
Similar Papers
Beyond Prompting: An Efficient Embedding Framework for Open-Domain Question Answering (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have recently pushed open-domain question answering (ODQA) to new heights. |
| Approach: | They propose an embedding-level framework that enhances both the retriever and the reader by reordering query representations via lightweight linear layers under an unsupervised contrastive learning objective. |
| Outcome: | The proposed framework outperforms baselines in accuracy and efficiency across three open-source LLMs, three retrieval methods, and four ODQA benchmarks. |
Exploring Language Model Generalization in Low-Resource Extractive QA (2025.coling-main)
Copied to clipboard
| Challenge: | Existing LLMs struggle with dataset demands of closed domains such as medicine and law . current LLM performance in closed domain is lacking, even on traditional tasks such as Natural Language Inference . |
| Approach: | They investigate Extractive Question Answering (EQA) with Large Language Models (LLMs) under domain drift . they find that LLMs struggle with dataset demands of closed domains . |
| Outcome: | The proposed model performs poorly in extractive question answering tasks under domain drift . the proposed model can generalize to domains that require specific knowledge without training . |
ThinkQE: Query Expansion via an Evolving Thinking Process (2025.findings-emnlp)
Copied to clipboard
| Challenge: | LLM-based methods often generate narrowly focused expansions that overlook these desiderata. |
| Approach: | They propose a test-time query expansion framework that promotes exploration and result diversity . ThinkQE encourages deeper and comprehensive semantic exploration and a corpus-interaction strategy that iteratively refines expansions . |
| Outcome: | The proposed framework outperforms prior approaches on diverse web search benchmarks. |
LocalRQA: From Generating Data to Locally Training, Testing, and Deploying Retrieval-Augmented QA Systems (2024.acl-demos)
Copied to clipboard
| Challenge: | Existing tools for augmented question-answering do not support researchers and developers to customize the training, testing, and deployment process. |
| Approach: | They propose an open-source toolkit that features a wide selection of model training algorithms, evaluation methods, and deployment tools curated from the latest research. |
| Outcome: | The proposed framework trains and deploys 7B-models with the same performance as OpenAI’s text-ada-002 and GPT-4-turbo. |
ExpandR: Teaching Dense Retrievers Beyond Queries with LLM Guidance (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for enhancing dense retrieval with query augmentation ignore the alignment between generation and ranking objectives. |
| Approach: | They propose a unified LLM-augmented dense retrieval framework that jointly optimizes both the LLM and the retriever. |
| Outcome: | Experimental results show that ExpandR outperforms strong baselines, achieving more than 5% improvement in retrieval performance. |
RetrievalQA: Assessing Adaptive Retrieval-Augmented Generation for Short-form Open-Domain Question Answering (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for assessing retrieval of relevant information are understudied . previous studies have neglected to evaluate ARAG methods . |
| Approach: | They propose a benchmark to evaluate existing ARAG methods that use threshold tuning to adjust retrieval for queries instead of indiscriminate retrieval. |
| Outcome: | The proposed method can be used to evaluate existing ARAG methods without calibration or training. |
Relevance-guided Supervision for OpenQA with ColBERT (2021.tacl-1)
Copied to clipboard
| Challenge: | Recent work has focused on learning to retrieve passages for open-domain question answering . if notions of relevance are not tailored to questions, the MRC model will not reliably see the best passages . |
| Approach: | They propose a retrieval model that uses coarse-grained vector representations of questions and passages to adapt it to OpenQA. |
| Outcome: | The proposed system improves OpenQA retrieval on Natural Questions, SQuAD, and TriviaQA. |
Not All Terms Matter: Recall-Oriented Adaptive Learning for PLM-aided Query Expansion in Open-Domain Question Answering (2025.acl-long)
Copied to clipboard
| Challenge: | Open-domain question answering (ODQA) systems typically adopt a retriever-reader architecture, where the retriever finds relevant documents, and the reader extracts or synthesizes answers. |
| Approach: | They propose a method that iteratively adjusts the importance weights of QE terms based on their relevance, refining term distinction and enhancing the separation of relevant terms. |
| Outcome: | The proposed method improves retrieval accuracy and overall performance on four ODQA datasets and five QE methods. |
MILL: Mutual Verification with Large Language Models for Zero-Shot Query Expansion (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing methods for query expansion lack corpus-specific knowledge and cost. |
| Approach: | They propose a query-query-document generation method that leverages large language models for mutual verification to produce diverse sub-queries and corresponding documents. |
| Outcome: | The proposed method is fully zero-shot and extensive experiments on three public benchmark datasets demonstrate its effectiveness over existing methods. |
Corpus-Steered Query Expansion with Large Language Models (2024.eacl-short)
Copied to clipboard
| Challenge: | Recent studies show query expansions generate hypothetical documents that answer queries as expansions. |
| Approach: | They propose a corpus-steered query expansion to promote incorporation of knowledge embedded within the corpus. |
| Outcome: | et al. analyzed corpus-based Query Expansion (CSQE) using LLMs to generate hypothetical documents that answer the query. |