Challenge: open-domain chatbots focus on short single-session dialogue, neglecting the potential need for understanding contextual information in multiple consecutive sessions.
Approach: They propose a 1M multi-session dialogue dataset for integrating time intervals and speaker relationships into a long-term conversation setup.
Outcome: The proposed model can generate coherent responses according to time intervals and speaker relationships with high user engagement without contradiction in a long-term conversation setup.

Similar Papers

Beyond Goldfish Memory: Long-Term Open-Domain Conversation (2022.acl-long)

Copied to clipboard

Challenge: Despite recent improvements in open-domain dialogue models, state of the art models are trained and evaluated on short conversations with little context.
Approach: They propose to use retrieval-augmented methods to summarize and recall past conversations to improve their models.
Outcome: The proposed models outperform the current state-of-the-art models on human-human chat sessions in both automatic and human evaluations.
Long Time No See! Open-Domain Conversation with Long-Term Persona Memory (2022.findings-acl)

Copied to clipboard

Challenge: Existing persona dialogue datasets and models can build long-term relationships with humans . however, current open-domain dialogue systems cannot build long relationships with users .
Approach: They propose a long-term memory conversation dataset and a dialogue generation framework with long-Term memory mechanism to extract and continuously update long-time persona memory.
Outcome: The proposed system outperforms baselines in terms of long-term dialogue consistency . the proposed system can build long-lasting relationships between humans and bots .
Context-Agent: Dynamic Discourse Trees for Non-Linear Dialogue (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to managing non-linear dialogue flow are misaligned with the intrinsically hierarchical and branching structure of natural discourse.
Approach: They propose a framework that models multi-turn dialogue history as a dynamic tree structure.
Outcome: The proposed framework enhances task completion rates and improves token efficiency across various LLMs.
Mind the Gap Between Conversations for Improved Long-Term Dialogue Generation (2023.findings-emnlp)

Copied to clipboard

Challenge: a gap between conversations can be weeks, months or years, and dialogue systems which do not explicitly model time may generate unnatural responses.
Approach: They propose to model the passage of time between conversations by exposing time information to a multi-session dialogue dataset and comparing different representations of time and event progress.
Outcome: The proposed model is based on a real-time dataset showing that it can predict topics and information gained from conversations over a long time span.
Evaluating Very Long-Term Conversational Memory of LLM Agents (2024.acl-long)

Copied to clipboard

Challenge: Existing studies on long-term open-domain dialogues focus on evaluating responses within contexts spanning no more than five chat sessions.
Approach: They propose a machine-human pipeline to generate very long-term dialogues by leveraging LLMs and retrieval augmented generation techniques.
Outcome: The proposed pipeline generates very long-term dialogues using LLMs and RAGs . the generated conversations are verified and edited by human annotators for long-range consistency and grounding to the event graphs.
Stephanie: Step-by-Step Dialogues for Mimicking Human Interactions in Social Conversations (2025.findings-naacl)

Copied to clipboard

Challenge: a new paradigm for dialogue systems is being developed to mimic human interactions . the current single-step dialogue paradigm lacks the depth and fluidity of human interactions.
Approach: They propose a step-by-step dialogue paradigm that mimics human interactions . they use a dataset to fine-tune existing language models .
Outcome: The proposed system mimics the dynamic nature of human conversations . it is compared with existing paradigms and will be released later this year .
Conversations Are Not Flat: Modeling the Dynamic Information Flow across Dialogue Utterances (2021.acl-long)

Copied to clipboard

Challenge: Recent intelligent open-domain chatbots have made substantial progress thanks to the rapid development of large-scale pre-training approaches.
Approach: They propose a dynamic flow mechanism to model the context flow and a model to capture the information dynamics across dialogue utterances.
Outcome: The proposed model outperforms the DialoGPT on the dialogue generation task.
Keep Me Updated! Memory Management in Long-term Conversations (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing studies do not deal with cases where memorized information is outdated, which may cause confusion in later conversations.
Approach: They propose a task where bots keep track of and bring up the latest information about users while conversing through multiple sessions.
Outcome: The proposed method outperforms baselines that leave the stored memory unchanged in terms of engagingness and humanness, and a larger performance gap in the later sessions.
Stark: Social Long-Term Multi-Modal Conversation with Persona Commonsense Knowledge (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing studies focus on image-sharing behavior in singular sessions, leading to limited long-term social interaction.
Approach: They propose a large-scale long-term multi-modal dialogue dataset that generates long-time multi-modity dialogue distilled from ChatGPT and proposed image aligner.
Outcome: The proposed framework generates long-term multi-modal dialogue from ChatGPT and image aligner.
Summarization of Dialogues and Conversations At Scale (2023.eacl-tutorials)

Copied to clipboard

Challenge: Conversations are the natural communication format for people.
Approach: This tutorial will survey the cutting-edge methods for summarizing written and spoken conversation.
Outcome: This tutorial will examine the cutting-edge methods for summarizing written and spoken conversations, covering key sub-areas whose combination is needed for a successful solution.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations