Multi-Faceted Self-Consistent Preference Alignment for Query Rewriting in Conversational Search (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to rewrite ambiguous queries ignore feedback from query rewriting, passage retrieval and response generation in the rewritten process. |
| Approach: | They propose to construct self-consistent preference alignment data to generate more diverse rewritten queries. |
| Outcome: | The proposed method is effective in both in- and out-of-distribution scenarios. |
Similar Papers
Improving Contextual Query Rewrite for Conversational AI Agents through User-preference Feedback Learning (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Contextual query rewriting (CQR) is a crucial component in Conversational AI agents, leveraging contextual information from previous user-agent conversations to improve comprehension of current user intent. |
| Approach: | They propose a framework to enhance the CQR model's capability in generating user preference-aligned rewrites. |
| Outcome: | The proposed framework improves the CQR model's ability to generate user preference-aligned rewrites. |
DVCQR: Dual-View Conversational Query Rewriting with Stage-wise Reinforcement Learning (2026.acl-long)
Copied to clipboard
| Challenge: | Recent approaches to improve retrieval effectiveness rely on a single rewrite . however, they often suffer from conflicting optimization signals . |
| Approach: | They propose a dual-view CQR framework that generates two complementary rewrites for each query. |
| Outcome: | Experiments show that DVCQR outperforms state-of-the-art methods on most metrics . the proposed framework generates two complementary rewrites for each query . |
Adaptive Query Rewriting: Aligning Rewriters through Marginal Probability of Conversational Answers (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to incorporate retriever’s preference during the training of query rewriting models rely on extensive annotations such as in-domain rewrites and/or relevant passage labels, limiting their generalization and adaptation capabilities. |
| Approach: | They propose a framework for training query rewriting models with limited rewrite annotations from seed datasets and completely no passage label. |
| Outcome: | The proposed approach decontexualizes conversational queries into self-contained questions suitable for off-the-shelf retrievers. |
AdaCQR: Enhancing Query Reformulation for Conversational Search via Sparse and Dense Retrieval Alignment (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods to address conversational search challenges are limited by one specific retrieval system. |
| Approach: | They propose a framework to enhance generalizability of information-seeking queries by aligning reformulation models with term-based and semantic retrieval systems. |
| Outcome: | The proposed framework outperforms existing methods in a more efficient framework. |
Ask Optimal Questions: Aligning Large Language Models with Retriever’s Preference in Conversation (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods to perform conversational search are sub-optimal due to the limited ability to incorporate signals from the retrieval results. |
| Approach: | They propose to optimize a language model for reformulating search queries in line with retrievers’ preferences by combining a large-scale dataset with Retrievers’ Feedback. |
| Outcome: | The proposed framework outperforms existing methods on two benchmarks and surpasses the state-of-the-art methods. |
Enhancing Machine Translation with Self-Supervised Preference Data (2025.acl-long)
Copied to clipboard
| Challenge: | Current approaches to constructing preference data rely on human annotations. |
| Approach: | They propose a framework which efficiently constructs translation preference data for iterative training. |
| Outcome: | The proposed framework improves translation preference data on large language models. |
CHIQ: Contextual History Enhancement for Improving Query Rewriting in Conversational Search (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in task-solving capabilities of Large Language Models (LLMs) have motivated researchers to integrate these models into existing conversational search systems. |
| Approach: | They propose a method that leverages the capabilities of large language models to resolve ambiguities in conversation history before query rewriting. |
| Outcome: | The proposed method leads to state-of-the-art results across most settings compared with closed-source LLMs. |
Multi-perspective Preference Alignment of LLMs for Programming-Community Question Answering (2025.coling-main)
Copied to clipboard
| Challenge: | Extensive experiments on a high-quality, real-world PCQA dataset validate its accuracy and preference. |
| Approach: | They propose a multi-perspective preference alignment for programming-community question answering to generate user-centric responses. |
| Outcome: | Experiments on a high-quality, real-world PCQA dataset validate the proposed model's accuracy and preference. |
ConvGQR: Generative Query Reformulation for Conversational Search (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods to determine a good search query from the whole conversation context are expensive and often lead to sub-optimal results. |
| Approach: | They propose a framework to reformulate conversational queries based on generative pre-trained language models (PLMs) they propose generative knowledge infusion mechanism to optimize query reformulation and retrieval. |
| Outcome: | Extensive experiments on four conversational search datasets demonstrate the effectiveness of ConvGQR. |
DGPO: Beyond Pairwise Preferences with Directional Consistent Groupwise Optimization (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for directional consistency alignment of large language models are limited . a recent study suggests reverse supervision as a complement to forward reasoning . |
| Approach: | They propose a framework that aggregates supervision signals at the group level and explicitly models direction-aware alignment through multi-candidate comparisons. |
| Outcome: | The proposed framework achieves 3.2% accuracy improvement across five benchmarks and multiple datasets. |