Challenge: Existing methods do not incorporate feedback from the query relevance model, limiting their ability to generate queries that enhance product retrieval.
Approach: They propose an adversarial reinforcement learning framework that exposes weaknesses in query classification models by creating synthetic queries that augment the classifier's training set.
Outcome: The proposed framework improves query generation performance on public datasets and on proprietary datasets.

Similar Papers

On Synthetic Data Strategies for Domain-Specific Generative Retrieval (2025.acl-long)

Copied to clipboard

Challenge: Generative retrieval models can be used to generate ranked lists of potentially relevant document identifiers for a user query.
Approach: They propose a synthetic data generation strategy for a two-stage training framework that focuses on learning to decode document identifiers from queries and a strategy for mining hard negatives based on initial model's predictions.
Outcome: The proposed model can generate ranked lists of potentially relevant document identifiers for a user query and then refine ranking through preference learning.
In-Context Reinforcement Learning with Retrieval-Augmented Generation for Text-to-SQL (2025.coling-main)

Copied to clipboard

Challenge: Existing methods of synthetic query generation generate mostly simple queries which might not be sufficiently representative of complex, real world queries.
Approach: They propose to use large language models to fine tune query generation to produce complex queries that practitioners may pose during inference.
Outcome: The proposed framework achieves 15-20% higher recall in database/table retrieval task compared to the existing state-of-the-art models for schema identification and upto 2% higher execution accuracy for SQL generation.
Enhancing Generative Retrieval with Reinforcement Learning from Relevance Feedback (2023.emnlp-main)

Copied to clipboard

Challenge: End-to-end generative retrieval models produce document identifiers in response to a query . however, this approach has two challenges: an overemphasis on top-1 results at the expense of overall ranking quality.
Approach: They propose a generative retrieval model with reinforcement learning from relevance feedback to align token-level docid generation with document-level relevance estimation.
Outcome: The proposed model aligns token-level docid generation with document-level relevance estimation.
Reinforced IR: A Self-Boosting Framework For Domain-Adapted Information Retrieval (2025.acl-long)

Copied to clipboard

Challenge: Existing retrieval methods struggle with highly specialized situations that require extensive domain expertise.
Approach: They propose a method that integrates additional information from an LLM-based generator to enhance query performance and train the retriever to better discriminate the relevant documents identified by the generator.
Outcome: The proposed method outperforms existing domain adaptation methods by a large margin and leads to substantial improvements in retrieval quality across a wide range of application scenarios.
Noisy Self-Training with Synthetic Queries for Dense Retrieval (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing neural retrieval models require training on a sufficient number of human-labelled query-passage pairs to work well.
Approach: They propose a noisy self-training framework with synthetic queries to improve retrieval methods.
Outcome: The proposed method outperforms baselines on general-domain and out-of-domain retrieval benchmarks on low-resource settings and is data efficient and data efficient.
Expand, Highlight, Generate: RL-driven Document Generation for Passage Reranking (2023.emnlp-main)

Copied to clipboard

Challenge: Existing studies use large language models to generate training data for ranking models.
Approach: They propose a pipeline that generates synthetic documents from queries using large language models . they propose RL-based reinforcement learning to optimize the pipeline .
Outcome: The proposed pipeline outperforms existing state-of-the-art methods in generating synthetic documents more effectively.
Exploring Question-Specific Rewards for Generating Deep Questions (2020.coling-main)

Copied to clipboard

Challenge: Recent question generation approaches use the sequence-to-sequence framework to optimize the log likelihood of ground-truth questions using teacher forcing.
Approach: They propose to optimize for QG-specific objectives via reinforcement learning to improve question quality.
Outcome: The proposed model improves the fluency, relevance, and answerability of generated questions.
Evaluating Rewards for Question Generation Models (N19-1)

Copied to clipboard

Challenge: Recent approaches to question generation have used modifications to a Seq2Seq architecture inspired by advances in machine translation.
Approach: They propose to use a Seq2Seq architecture to train models to generate one-step-ahead predictions, but at test time, the model is asked to generate a whole sequence, causing errors to propagate through the generation process.
Outcome: The proposed model is trained to generate a plausible question, conditioned on an input document and answer span within that document.
Optimizing RAG Rerankers with LLM Feedback via Reinforcement Learning (2026.acl-long)

Copied to clipboard

Challenge: Current reranking models are optimized on static human annotations in isolation, decoupled from the downstream generation process.
Approach: They propose a reinforcement learning framework that directly aligns reranking with LLM's generation quality.
Outcome: Experiments on knowledge-intensive benchmarks show that RRPO outperforms strong baselines.
It’s All Relative! – A Synthetic Query Generation Approach for Improving Zero-Shot Relevance Prediction (2024.findings-naacl)

Copied to clipboard

Challenge: Large language models generate synthetic query-document pairs by prompting with as few as 8 demonstrations.
Approach: They propose to generate queries simultaneously for different labels by prompting with 8 demonstrations.
Outcome: Extensive experimentation shows that synthetic queries generated in such a fashion improve performance.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations