Papers by Gia-Bao Ho
MTP: A Dataset for Multi-Modal Turning Points in Casual Conversations (2024.acl-short)
Copied to clipboard
| Challenge: | a new problem setting is designed to detect critical moments in conversations . a human-annotated multi-modal dataset is used to classify and detect turning points . |
| Approach: | They propose a problem setting focusing on turning points in conversations as TPs . they propose MTPC, MTPD, & MTPR tasks to classify and detect turning points . |
| Outcome: | The proposed model achieves an F1-score of 0.88 in classification and 0.61 in detection . it uses state-of-the-art vision-language models to construct a narrative from the videos . |