Papers by Adnen Abdessaied
Limits of Theory of Mind Modelling in Dialogue-Based Collaborative Plan Acquisition (2024.acl-long)
Copied to clipboard
| Challenge: | Recent work on dialogue-based collaborative plan acquisition (CPA) suggests Theory of Mind (ToM) modelling can improve missing knowledge prediction in settings with asymmetric skill-sets and knowledge. |
| Approach: | They propose to use task-specific constraints to represent plans as graphs and exploit task-related constraints to improve missing knowledge prediction in CPA. |
| Outcome: | The proposed model improves missing knowledge prediction in contexts with asymmetric skill-sets and knowledge, but the improvements diminish . the proposed model is compared with baseline models and found to be more effective than existing models. |
Neuro-Symbolic Visual Dialog (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for visual dialog require large amounts of training data, which is prohibitive for most settings. |
| Approach: | They propose a method that integrates deep learning and symbolic program execution for multi-round visual reasoning. |
| Outcome: | The proposed model outperforms existing methods on long-distance co-reference resolution and vanishing question-answering performance. |
OLViT: Multi-Modal State Tracking via Attention-Based Embeddings for Video-Grounded Dialog (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing video dialog models struggle with questions requiring both spatial and temporal localization within videos, long-term temporal reasoning, and accurate object tracking across multiple dialog turns. |
| Approach: | They propose a multi-modal attention-based model for video dialog operating over a dialog state tracker. |
| Outcome: | The proposed model can learn multi-modal dialog state representations of the most relevant objects and rounds. |