Improving Contextual Query Rewrite for Conversational AI Agents through User-preference Feedback Learning (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Contextual query rewriting (CQR) is a crucial component in Conversational AI agents, leveraging contextual information from previous user-agent conversations to improve comprehension of current user intent. |
| Approach: | They propose a framework to enhance the CQR model's capability in generating user preference-aligned rewrites. |
| Outcome: | The proposed framework improves the CQR model's ability to generate user preference-aligned rewrites. |
Similar Papers
Multi-Faceted Self-Consistent Preference Alignment for Query Rewriting in Conversational Search (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to rewrite ambiguous queries ignore feedback from query rewriting, passage retrieval and response generation in the rewritten process. |
| Approach: | They propose to construct self-consistent preference alignment data to generate more diverse rewritten queries. |
| Outcome: | The proposed method is effective in both in- and out-of-distribution scenarios. |
Unified Contextual Query Rewriting (2023.acl-industry)
Copied to clipboard
Yingxue Zhou, Jie Hao, Mukund Rungta, Yang Liu, Eunah Cho, Xing Fan, Yanbin Lu, Vishal Vasudevan, Kellen Gillespie, Zeynab Raeesy
| Challenge: | Large-scale conversational AI agents such as Alexa, Siri, and Google Assistant are becoming increasingly popular in real-world applications to assist users in daily life. |
| Approach: | They propose a unified contextual query rewriting model that unifies QR for friction reduction and contextual carryover . they leverage the text-to-text unified framework which uses independent tasks with weighted loss to account for task importance . |
| Outcome: | The proposed model reduces friction and contextual carryover by using multiple auxiliary tasks. |
Adaptive Query Rewriting: Aligning Rewriters through Marginal Probability of Conversational Answers (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to incorporate retriever’s preference during the training of query rewriting models rely on extensive annotations such as in-domain rewrites and/or relevant passage labels, limiting their generalization and adaptation capabilities. |
| Approach: | They propose a framework for training query rewriting models with limited rewrite annotations from seed datasets and completely no passage label. |
| Outcome: | The proposed approach decontexualizes conversational queries into self-contained questions suitable for off-the-shelf retrievers. |
CGF: Constrained Generation Framework for Query Rewriting in Conversational AI (2022.emnlp-industry)
Copied to clipboard
Jie Hao, Yang Liu, Xing Fan, Saurabh Gupta, Saleh Soltan, Rakesh Chada, Pradeep Natarajan, Chenlei Guo, Gokhan Tur
| Challenge: | Large-scale conversational AI agents such as Alexa, Siri and Google Assistant help millions of users to perform a lot of tasks. |
| Approach: | They propose a Constrained Generation Framework for query rewriting at global and personalized levels. |
| Outcome: | The proposed framework significantly boosts the query rewriting performance. |
DVCQR: Dual-View Conversational Query Rewriting with Stage-wise Reinforcement Learning (2026.acl-long)
Copied to clipboard
| Challenge: | Recent approaches to improve retrieval effectiveness rely on a single rewrite . however, they often suffer from conflicting optimization signals . |
| Approach: | They propose a dual-view CQR framework that generates two complementary rewrites for each query. |
| Outcome: | Experiments show that DVCQR outperforms state-of-the-art methods on most metrics . the proposed framework generates two complementary rewrites for each query . |
Self-Aware Feedback-Based Self-Learning in Large-Scale Conversational AI (2022.naacl-industry)
Copied to clipboard
| Challenge: | Large-scale conversational AI systems require constant update to adapt to changing customer behavior and trends . lack of self-awareness in feedback-based systems can cause degradation of performance . et al., e. alderman and scott k. d. argues that such systems are not scalable enough to sustain the rapid update pace of conversational systems. |
| Approach: | They propose a superposition-based model that reactively learns local-adaptive decision boundaries . they propose rewritings with a bi-variate beta setting to improve the model's performance . |
| Outcome: | The proposed model improves the PR-AUC by 27.45% and reduces relative defect reductions by 31.22% . the proposed model can adapt faster to changes in global preferences across a large number of customers . |
Explicit Query Rewriting for Conversational Dense Retrieval (2022.emnlp-main)
Copied to clipboard
| Challenge: | In a conversational search scenario, a query might be context-dependent because some words are referred to previous expressions or omitted. |
| Approach: | They propose a model that performs query rewriting and context modelling in a unified framework by highlighting relevant terms in the query context. |
| Outcome: | The proposed model outperforms baseline models in terms of quality of query rewriting and quality of contextualized query embedding. |
CQR-SQL: Conversational Question Reformulation Enhanced Context-Dependent Text-to-SQL Parsers (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing text-to-SQL methods focus on making full use of history context, but neglect to explicitly comprehend the schema and conversational dependency. |
| Approach: | They propose a CQR-SQL that explicitly exploits schema and conversational dependency for multi-turn SQL parsing. |
| Outcome: | The proposed method exploits schema and contextual dependency for multi-turn SQL parsing. |
CL-QR: Cross-Lingual Enhanced Query Reformulation for Multi-lingual Conversational AI Agents (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Existing QR systems that reformulate defective user queries are limited in English due to the scarcity of non-English QR labels. |
| Approach: | They propose a query reformulation method which reformulates defective user queries to improve non-English QR performance. |
| Outcome: | The proposed framework improves non-English QR performance by leveraging abundant reformulation resources in English. |
Agentic Conversational Search with Contextualized Reasoning via Reinforcement Learning (2026.findings-acl)
Copied to clipboard
Fengran Mo, Yifan Gao, Sha Li, Hansi Zeng, Xin Liu, Zhaoxuan Tan, Xian Li, Jianshu Chen, Dakuo Wang, Meng Jiang
| Challenge: | Existing studies focus on single-turn scenarios, which might lack the ability to handle multi-turn interactions. |
| Approach: | They propose a conversational agent that interleaves search and reasoning across turns and provides tailored rewards towards evolving user goals. |
| Outcome: | The proposed agent interleaves search and reasoning across turns, enabling exploratory and adaptive behaviors learned through reinforcement learning (RL) training with tailored rewards towards evolving user goals. |