M3TCM: Multi-modal Multi-task Context Model for Utterance Classification in Motivational Interviews (2024.lrec-main)
Copied to clipboard
| Challenge: | Motivational interviews have two distinct roles, namely client and therapist . previous approaches did not fully incorporate all of these characteristics into utterance classification . |
| Approach: | They propose a multi-modal, multi-task context model for utterance classification that integrates text and speech as well as conversation context. |
| Outcome: | The proposed model outperforms the state-of-the-art in utterance classification on the AnnoMI dataset with a relative improvement of 20% for the client- and by 15% for therapist utterrance classification. |
Similar Papers
M3ED: Multi-modal Multi-scene Multi-label Emotional Dialogue Database (2022.acl-long)
Copied to clipboard
| Challenge: | Existing data resources to support multimodal affective analysis in dialogues are limited in scale and diversity. |
| Approach: | They propose a multimodal multi-scene multi-label Emotional Dialogue dataset, M3ED, which contains 990 dyadic emotional dialogues from 56 different TV series. |
| Outcome: | The proposed dataset contains 990 dyadic emotional dialogues from 56 different TV series, a total of 9,082 turns and 24,449 utterances. |
KMI: A Dataset of Korean Motivational Interviewing Dialogues for Psychotherapy (2025.naacl-long)
Copied to clipboard
| Challenge: | Motivational Interviewing (MI) is gaining attention as a theoretical basis for mental health chatbots. |
| Approach: | They propose a framework that simulates MI sessions enriched with the expertise of professional therapists by using large language models to generate utterances through prompt engineering. |
| Outcome: | The proposed framework simulates MI sessions enriched with the expertise of professional therapists and employs large language models to generate utterances through prompt engineering. |
Rethinking the Alignment of Psychotherapy Dialogue Generation with Motivational Interviewing Strategies (2025.coling-main)
Copied to clipboard
| Challenge: | Motivational interviewing (MI) is a client-centered counseling technique that encourages individuals to change behaviors through emphatic conversations. |
| Approach: | They propose to use large language models to generate more controllable dialogues with explainability by prompting LLMs to predict appropriate strategies as reasoning and utilizing these strategies to guide dialogue generation. |
| Outcome: | The proposed model generates more controllable and explainable dialogues with a set of MI skills. |
Observing Dialogue in Therapy: Categorizing and Forecasting Behavioral Codes (P19-1)
Copied to clipboard
| Challenge: | a new study examines the role of dialogue observers in psychotherapy . the model is based on motivational interviewing, which is effective for treating addictions . |
| Approach: | They propose to model MI behavioral codes for therapists by an observer . they propose to use the observer to forecast therapist and client MI behavioral code . |
| Outcome: | The proposed model outperforms baseline models for both tasks and reveals tradeoffs in performance. |
DialogueTRM: Exploring Multi-Modal Emotional Dynamics in a Conversation (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies focus on the self and inter-personal dependencies in multi-modal conversations, but they ignore the temporal and spatial dependencies. |
| Approach: | They propose a Dialogue Transformer for simultaneously modeling the intra-modal and inter-modal emotion dynamics. |
| Outcome: | The proposed models outperform the state-of-the-art on three benchmark datasets. |
How Well Can Large Language Models Reflect? A Human Evaluation of LLM-generated Reflections for Motivational Interviewing Dialogues (2025.coling-main)
Copied to clipboard
Erkan Basar, Xin Sun, Iris Hendrickx, Jan de Wit, Tibor Bosse, Gert-Jan De Bruijn, Jos A. Bosch, Emiel Krahmer
| Challenge: | Motivational Interviewing (MI) is a counseling technique that promotes behavioral change through reflective responses to mirror or refine client statements. |
| Approach: | They assess the potential of Large Language Models (LLMs) to generate MI reflections via three LLMs: GPT-4, Llama-2, and BLOOM. |
| Outcome: | The proposed models generate meaningful reflections comparable to human therapists, but significant challenges remain. |
Conversation Model Fine-Tuning for Classifying Client Utterances in Counseling Dialogues (N19-1)
Copied to clipboard
| Challenge: | Recent surge of text-based online counseling applications enables us to collect and analyze interactions between counselors and clients. |
| Approach: | They develop a pre-trained conversation model that learns to classify client utterances into categories that help counselors in diagnosing client status and predicting counseling outcome. |
| Outcome: | The proposed model outperforms state-of-the-art comparison models and shows expected linguistic patterns for each category. |
Data Augmentation for Multiclass Utterance Classification – A Systematic Study (2020.coling-main)
Copied to clipboard
| Challenge: | a lack of sufficient training data for some categories can cause imbalanced data distributions . a weak classifier may miscategorize a request, resulting in customer dissatisfaction . |
| Approach: | They propose to use random resampling, word-level transformations and neural text generation to augment existing data to cope with imbalanced data. |
| Outcome: | The proposed methods improve utterance classification results by drawing on utterant variation. |
M3HG: Multimodal, Multi-scale, and Multi-type Node Heterogeneous Graph for Emotion Cause Triplet Extraction in Conversations (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for ECAC focus on textual contexts, overlooking other modalities. |
| Approach: | They propose a multimodal, multi-scenario MECTEC dataset that captures emotional and causal contexts and effectively fuses contextual information at different levels. |
| Outcome: | The proposed model captures emotional and causal contexts and effectively fuses contextual information at both inter- and intra-utterance levels. |
Data-Centric Improvements for Enhancing Multi-Modal Understanding in Spoken Conversation Modeling (2025.findings-acl)
Copied to clipboard
| Challenge: | Conversational assistants are increasingly popular across diverse real-world applications . speech data constitute high-dimensional signals that are difficult to model even for frontier models . |
| Approach: | They propose a data-centric customization approach for enhancing multimodal understanding in conversational speech modeling. |
| Outcome: | The proposed model achieves state-of-the-art on the Spoken-SQuAD benchmark using 10% of training data with open-weight models. |