Challenge: Existing approaches to optimize conversational agents often rely on explicit preference pairs and expert evaluations.
Approach: They propose a conversational agent framework that leverages the structured dependency between agent responses and user reactions to extract implicit feedback.
Outcome: The proposed framework improves on MT-Bench-101, WildBench, and FB-Bech, and shows that mining implicit feedback supports better multi-turn alignment under evolving user preferences.

Similar Papers

Leveraging Implicit Feedback from Deployment Data in Dialogue (2024.eacl-short)

Copied to clipboard

Challenge: Xu et al., 2023) and Bai ed., 2019) use crowdworkers to collect signals from natural dialogue episodes.
Approach: They use the publicly released BlenderBot deployment data to extract signals from conversations to implicitly measure the quality of a machine-generated utterance.
Outcome: The proposed model improves over baseline models, but some proxy signals can lead to undesirable generations.
Towards Proactive Personalization through Profile Customization for Individual Users in Dialogues (2026.findings-acl)

Copied to clipboard

Challenge: Existing alignment methods focus on universal human values or static, single-turn preferences, thereby failing to address the critical needs of long-term personalization and the initial user cold-start problem.
Approach: They propose a user-centric lifelong agent that continuously infers and adapts to user preferences.
Outcome: The proposed agent achieves superior performance over strong prompt-based and policy optimization baselines, not only in idealized but also in noisy conversational contexts.
Agentic Conversational Search with Contextualized Reasoning via Reinforcement Learning (2026.findings-acl)

Copied to clipboard

Challenge: Existing studies focus on single-turn scenarios, which might lack the ability to handle multi-turn interactions.
Approach: They propose a conversational agent that interleaves search and reasoning across turns and provides tailored rewards towards evolving user goals.
Outcome: The proposed agent interleaves search and reasoning across turns, enabling exploratory and adaptive behaviors learned through reinforcement learning (RL) training with tailored rewards towards evolving user goals.
User Feedback in Human-LLM Dialogues: A Lens to Understand Users But Noisy as a Learning Signal (2025.emnlp-main)

Copied to clipboard

Challenge: a recent study shows that asking for direct user feedback can be disruptive . we examine whether incorporating the contents of user feedback improves model performance .
Approach: They analyze user feedback in the user-LLM conversation logs and harvest learning signals from it.
Outcome: The proposed approach can lead to model degradation on two user-LM interaction datasets.
Large Scale Multi-Actor Generative Dialog Modeling (2020.acl-main)

Copied to clipboard

Challenge: Non-goal oriented dialog agents typically exhibit inconsistent personality across conversations or the average personality of all users.
Approach: They propose a model that conditionally models past conversations to probabilistically model multi-turn conversations in the actor’s persona.
Outcome: The proposed model improves perplexity on 1.7M held out Reddit conversations by 0.47 on scaling from 117M to 8.3B parameters.
Learning Improvised Chatbots from Adversarial Modifications of Natural Language Feedback (2020.findings-emnlp)

Copied to clipboard

Challenge: Currently, user feedback contains extraneous sequences hindering their usefulness as a training sample.
Approach: They propose a generative adversarial model that converts noisy feedback into a plausible natural response in a conversation and fools the discriminator which distinguishes feedback from natural responses.
Outcome: The proposed model improves the original chatbot performance from 69.94%to 75.96% in ranking correct responses on the PERSONACHATdataset.
Context-Agent: Dynamic Discourse Trees for Non-Linear Dialogue (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to managing non-linear dialogue flow are misaligned with the intrinsically hierarchical and branching structure of natural discourse.
Approach: They propose a framework that models multi-turn dialogue history as a dynamic tree structure.
Outcome: The proposed framework enhances task completion rates and improves token efficiency across various LLMs.
SEAD: Self-Evolving Agent for Multi-Turn Service Dialogue (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models have demonstrated remarkable capabilities in open-domain dialogues, but their performance in service dialogues remains suboptimal.
Approach: They propose a framework that enables agents to learn effective strategies without large-scale human annotations.
Outcome: The proposed framework decouples user modeling into two components that provide adaptive training scenarios rather than acting as an unfair adversary.
Towards Personalized Conversational Sales Agents: Contextual User Profiling for Strategic Action (2025.findings-emnlp)

Copied to clipboard

Challenge: Conversational Recommender Systems (CRSs) aim to engage users in dialogue to provide tailored recommendations.
Approach: They propose a task that integrates preference elicitation, recommendation and persuasion . they propose CSALES, a conversational sales agent that infers contextual user profiles .
Outcome: The proposed task integrates preference elicitation, recommendation, and persuasion within a conversational framework.
Towards Boosting the Open-Domain Chatbot with Human Feedback (2023.acl-long)

Copied to clipboard

Challenge: Existing frameworks for pre-training open-domain dialogue models with social media comments generate coherent replies but have difficulties producing engaging responses.
Approach: They propose a framework to boost the open-domain chatbot by leveraging human feedback and annotating the model's candidate responses.
Outcome: The proposed framework boosts the open-domain chatbot by leveraging human demonstrated responses and leveraging the implicit preference in the data collection process.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations