MTPChat: A Multimodal Time-Aware Persona Dataset for Conversational Agents (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing time-aware datasets that focus on persona-grounded conversations focus on temporal dynamics, which narrows their scope and diminishes their complexity. |
| Approach: | They propose a multimodal, time-aware persona dialogue dataset that integrates linguistic, visual, and temporal elements within dialogue and persona memory. |
| Outcome: | The proposed framework integrates linguistic, visual, and temporal elements within dialogue and persona memory to assess a model’s ability to understand implicit temporal cues and dynamic interactions. |
Similar Papers
MPCHAT: Towards Multimodal Persona-Grounded Conversation (2023.acl-long)
Copied to clipboard
| Challenge: | Existing research on persona-based dialogue has focused on textual persona that delivers personal facts or personalities, but image modality can reveal the speaker’s personal characteristics and experiences in episodic memory. |
| Approach: | They propose a multimodal persona-based dialogue dataset which extends persona with both text and images to contain episodic memories. |
| Outcome: | The proposed dataset extends persona with text and images to contain episodic memories. |
LongMP-Bench: A Benchmark for Multimodal Persona Understanding in Long-Term Dialogues (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing datasets suffer from limited persona diversity and static, overly simplified settings, making them insufficient for capturing the complexity of real-world interactions. |
| Approach: | They propose a benchmark to evaluate models' ability to understand evolving user personas within long-term multimodal dialogues by using a dataset that contains long conversations from 150 users. |
| Outcome: | The proposed benchmark aims to assess models' ability to track persona evolution, integrate visual and textual inputs, and apply persona understanding in realistic dialogue scenarios. |
TiMem: Temporal-Hierarchical Memory Consolidation for Long-Horizon Conversational Agents (2026.findings-acl)
Copied to clipboard
Kai Li, Xuanqing Yu, Ziyi Ni, Yi Zeng, Yao Xu, Zheqing Zhang, Xin Li, Jitao Sang, Xiaogang Duan, Xuelei Wang, Chengbao Liu, Jie Tan
| Challenge: | Existing memory frameworks provide limited support for temporally structured information across hierarchical levels, leading to fragmented memories and unstable long-horizon personalization. |
| Approach: | They propose a temporal–hierarchical memory framework that organizes conversations through a Temporal Memory Tree. |
| Outcome: | The proposed framework outperforms baselines while reducing the recalled memory length by 52.20%. |
MTGER: Multi-view Temporal Graph Enhanced Temporal Reasoning over Time-Involved Document (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work models time implicitly, making it difficult to handle complex relationships . a novel temporal reasoning framework explicitly models the temporal relationships among facts by multi-view temporal graphs . |
| Approach: | They propose a multi-view temporal graph-based temporal reasoning framework that explicitly models the temporal relationships among facts by multi-visit temporal charts. |
| Outcome: | The proposed framework gives more consistent answers under question perturbations. |
Stark: Social Long-Term Multi-Modal Conversation with Persona Commonsense Knowledge (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies focus on image-sharing behavior in singular sessions, leading to limited long-term social interaction. |
| Approach: | They propose a large-scale long-term multi-modal dialogue dataset that generates long-time multi-modity dialogue distilled from ChatGPT and proposed image aligner. |
| Outcome: | The proposed framework generates long-term multi-modal dialogue from ChatGPT and image aligner. |
MTAG: Modal-Temporal Attention Graph for Unaligned Human Multimodal Language Sequences (2021.naacl-main)
Copied to clipboard
Jianing Yang, Yongxin Wang, Ruitao Yi, Yuying Zhu, Azaan Rehman, Amir Zadeh, Soujanya Poria, Louis-Philippe Morency
| Challenge: | a novel graph-based neural model for multimodal sequential data is proposed . fusion is the process of blending information from multiple modalities, usually preceded by alignment . |
| Approach: | They propose a graph-based neural model that converts unaligned data into a modal-temporal graph . they use a dynamic pruning and read-out technique to efficiently process the graph fusion operation . |
| Outcome: | The proposed model performs state-of-the-art on multimodal sentiment analysis and emotion recognition benchmarks while utilizing significantly fewer model parameters. |
Beyond Dialogue Time: Temporal Semantic Memory for Personalized LLM Agents (2026.findings-acl)
Copied to clipboard
Miao Su, Yucan Guo, Zhongni Hou, Long Bai, Zixuan Li, Yufei Zhang, Guojun Yin, Wei Lin, Xiaolong Jin, Jiafeng Guo, Xueqi Cheng
| Challenge: | Existing methods focus on point-wise memory, losing durative information that captures persistent states and evolving patterns. |
| Approach: | They propose a memory framework that models semantic time for point-wise memory and supports the construction and utilization of durative memory. |
| Outcome: | Experiments on LongMemEval and LoCoMo show that the proposed method outperforms existing methods and achieves up to 12.2% improvement in accuracy. |
RCTEA: Richness-guided Co-training for Temporal Entity Alignment (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing TEA models fail to capture the orthogonal yet complementary effect between structural and temporal features. |
| Approach: | They propose a framework that jointly models structural and temporal aspects of Temporal Knowledge Graphs for entity alignment. |
| Outcome: | The proposed framework achieves state-of-the-art on public TEA benchmarks. |
I know you are different! Towards Persona Driven Knowledge-infused Dialogue Assistant (2026.eacl-long)
Copied to clipboard
| Challenge: | Task-Oriented Dialogue (TOD) systems often fall short in delivering personalized, context-rich responses, especially in low-resource, code-mixed, and multimodal settings like Hinglish. |
| Approach: | They propose a Hinglish multimodal, multidomain, persona-based TOD dataset that captures user-agent interactions across text and visual modalities. |
| Outcome: | The proposed framework outperforms standard and ablated models in Hinglish and Hinglanish. |
TReMu: Towards Neuro-Symbolic Temporal Reasoning for LLM-Agents with Memory in Multi-Session Dialogues (2025.findings-acl)
Copied to clipboard
| Challenge: | Temporal reasoning in multi-session dialogues presents a significant challenge which has been under-studied in previous temporal reasoning benchmarks. |
| Approach: | They propose to augment LoCoMo dialogues and create multi-choice QAs to construct a temporal reasoning evaluation task and a framework to enhance temporal thinking capabilities of LLM-agents. |
| Outcome: | The proposed framework significantly improves temporal reasoning performance compared to baseline methods, raising from 29.83 on GPT-4o via standard prompting to 77.67 via the proposed framework. |