Multimodal Cognitive Reframing Therapy via Multi-hop Psychotherapeutic Reasoning (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing studies have focused on text-based cognitive reframing, but neglected the importance of non-verbal evidence in real-life therapy. |
| Approach: | They propose a dataset that pairs each GPT-4-generated dialogue with an image that reflects the virtual client’s facial expressions to better mirror real psychotherapy, where facial expression leads to interpreting implicit emotional evidence. |
| Outcome: | The proposed approach outperforms existing methods with LLMs and vision-language models and provides more thoughtful and empathetic suggestions. |
Similar Papers
HealMe: Harnessing Cognitive Reframing in Large Language Models for Psychotherapy (2024.acl-long)
Copied to clipboard
Mengxi Xiao, Qianqian Xie, Ziyan Kuang, Zhicheng Liu, Kailai Yang, Min Peng, Weiguang Han, Jimin Huang
| Challenge: | Large Language Models (LLMs) can be used in psychotherapy to overcome challenges such as shame, distrust, and resource scarcity. |
| Approach: | They propose a cognitive reframing therapy method that uses empathetic dialogue to address deep-rooted negative thoughts and fosters rational, balanced perspectives. |
| Outcome: | The proposed model outperforms other models in terms of empathy, guidance, and logical coherence, demonstrating its effectiveness and potential positive impact on psychotherapy. |
MIRROR: Multimodal Cognitive Reframing Therapy for Rolling with Resistance (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have explored the use of large language models (LLMs) in psychotherapy, however text-based cognitive behavioral therapy models struggle with client resistance, which weakens therapeutic alliance. |
| Approach: | They propose a multimodal approach that incorporates nonverbal cues and a synthetic dataset that pairs each client’s statements with corresponding facial images to train vision language models. |
| Outcome: | The proposed approach outperforms existing text-based cognitive behavioral therapy models in managing client resistance and fostering therapeutic alliance. |
Integrating Visual Modalities with Large Language Models for Mental Health Support (2025.coling-main)
Copied to clipboard
| Challenge: | Existing work of mental health support primarily utilizes unimodal textual data and fails to understand and respond to users’ emotional states comprehensively. |
| Approach: | They propose a framework that integrates multimodal inputs and counseling strategies to enhance the performance of Large Language Models (LLMs) This approach allows LLMs to generate more nuanced and supportive responses. |
| Outcome: | The proposed framework outperforms existing models and delivers more empathetic, coherent, and contextually relevant mental health support responses. |
Deciphering Cognitive Distortions in Patient-Doctor Mental Health Conversations: A Multimodal LLM-Based Detection and Reasoning Framework (2024.emnlp-main)
Copied to clipboard
| Challenge: | Cognitive distortion research sheds light on pervasive errors in thinking patterns . authors present method for detecting and reasoning about cognitive distortions . |
| Approach: | They propose a method for detecting and reasoning about cognitive distortions using Large Language Models. |
| Outcome: | The proposed method improves accuracy and depth of detection and reasoning tasks in a zero-shot manner. |
Towards AI-Assisted Psychotherapy: Emotion-Guided Generative Interventions (2025.emnlp-main)
Copied to clipboard
Kilichbek Haydarov, Youssef Mohamed, Emilio Goldenhersch, Paul OCallaghan, Li-jia Li, Mohamed Elhoseiny
| Challenge: | Large language models (LLMs) lack rich non-verbal emotional cues essential to real-world therapy. |
| Approach: | They propose a multimodal dataset of 1,441 publicly sourced therapy session videos containing both dialogue and non-verbal signals such as facial expressions and vocal tone. |
| Outcome: | The proposed model improves the quality of generated interventions and evaluators misalign with expert assessments in this domain, highlighting the need for human-centered evaluation. |
Reasoning Is Not All You Need: Examining LLMs for Multi-Turn Mental Health Conversations (2026.acl-long)
Copied to clipboard
| Challenge: | Existing evaluation frameworks focus on diagnostic accuracy and win-rates and often overlook alignment with patient-specific goals, values, and personalities required for meaningful conversations. |
| Approach: | They propose a framework for synthetically generating realistic, multi-turn mental health sensemaking conversations and a dataset to examine their models in healthcare settings. |
| Outcome: | The proposed framework synthesizes a dataset comprising over 2,200 patient–LLM conversations and evaluates them using human-centric criteria. |
SoulChat: Improving LLMs’ Empathy, Listening, and Comfort Abilities through Fine-tuning with Multi-turn Empathy Conversations (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) are used in psychological counseling to provide universal advice. |
| Approach: | They constructed a multi-turn empathetic conversation dataset with 2 million samples . they found that the model's empathy ability is enhanced when finetuning . |
| Outcome: | Experiments show that large language models can be finetuned to provide empathy . but, when applied to mental health or emotional support conversation, there are three main issues . |
Crisp: Cognitive Restructuring of Negative Thoughts through Multi-turn Supportive Dialogues (2025.emnlp-main)
Copied to clipboard
Jinfeng Zhou, Yuxuan Chen, Jianing Yin, Yongkang Huang, Yihan Shi, Xikun Zhang, Libiao Peng, Rongsheng Zhang, Tangjie Lv, Zhipeng Hu, Hongning Wang, Minlie Huang
| Challenge: | Existing approaches to cognitive restructuring (CR) are limited by entrenched cognitive distortions, emotional resistance, and individual differences. |
| Approach: | They propose a framework that structures CR as theory-grounded multi-stage multi-turn dialogue and a multi-channel loop mechanism to account for diverse individual distortions. |
| Outcome: | The proposed framework integrates supportive strategies for emotional management and a multi-channel loop mechanism to account for diverse individual distortions. |
A Survey of Large Language Models in Psychotherapy: Current Landscape and Future Directions (2025.findings-acl)
Copied to clipboard
Hongbin Na, Yining Hua, Zimu Wang, Tao Shen, Beibei Yu, Lilin Wang, Wei Wang, John Torous, Ling Chen
| Challenge: | Large language models (LLMs) can handle extensive context and multi-turn reasoning. |
| Approach: | They propose a taxonomy dividing psychotherapy into stages of assessment, diagnosis, and treatment to examine LLM advancements and challenges. |
| Outcome: | The proposed taxonomy reveals imbalances in current research, such as a focus on common disorders, linguistic biases, fragmented methods, and limited theoretical integration. |
CBT-Bench: Evaluating Large Language Models on Assisting Cognitive Behavior Therapy (2025.naacl-long)
Copied to clipboard
Mian Zhang, Xianjun Yang, Xinlu Zhang, Travis Labrum, Jamie C. Chiu, Shaun M. Eack, Fei Fang, William Yang Wang, Zhiyu Chen
| Challenge: | Existing research has explored mental health condition classifications, empathetic conversations, and chatbots designed for simple discourse structures. |
| Approach: | They propose a benchmark for systematic evaluation of cognitive behavioral therapy assistance using Large Language Models (LLMs). |
| Outcome: | The proposed benchmark includes three levels of tasks covering key aspects of cognitive behavioral therapy that could be enhanced through AI assistance. |