Descriptive Prompt Paraphrasing for Target-Oriented Multimodal Sentiment Classification (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Current researches mainly work on either of two types of targets in a decentralized manner. |
| Approach: | They propose a model to perform sentiment polarity on a target jointly considering its corresponding multiple modalities including text, image, and others. |
| Outcome: | The proposed model performs well on four datasets spanning the above two target types and is prompt-based language modelling. |
Similar Papers
RethinkingTMSC: An Empirical Study for Target-Oriented Multimodal Sentiment Classification (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies have shown that current TMSC systems rely on textual information, and the progress in tackling this task has slowed down. |
| Approach: | They propose to integrate both visual and textual information to improve the performance of TMSC by considering multimodal information. |
| Outcome: | The proposed model integrates both visual and textual information to improve performance. |
Visual Elements Mining as Prompts for Instruction Learning for Target-Oriented Multimodal Sentiment Classification (2023.findings-emnlp)
Copied to clipboard
| Challenge: | VEMP uses visual elements with text symbols embedded in the image to classify sentiment polarity towards a given opinion target. |
| Approach: | They propose a visual element mining as prompts method to fuse visual and text semantic information into instruction prompts for TMSC. |
| Outcome: | The proposed method achieves state-of-the-art performance on two benchmark datasets. |
Learning from Adjective-Noun Pairs: A Knowledge-enhanced Framework for Target-Oriented Multimodal Sentiment Classification (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods to determine sentiment polarity of opinion target are inconsistent and lack visual attention. |
| Approach: | They propose a framework which can exploit adjective-noun pairs extracted from images to improve visual attention and sentiment prediction capability of the TMSC task. |
| Outcome: | The proposed framework outperforms state-of-the-art on two public datasets. |
Multimodal Prompt Learning with Missing Modalities for Sentiment Analysis and Emotion Recognition (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods for multimodal sentiment analysis often fail due to equipment failure, data corruption, privacy issues and the like. |
| Approach: | They propose a multimodal Transformer framework using prompt learning to address the issue of missing modalities. |
| Outcome: | The proposed framework outperforms existing methods significantly across evaluation metrics. |
Mixture-of-Prompt-Experts for Multi-modal Semantic Understanding (2024.lrec-main)
Copied to clipboard
| Challenge: | Multimodal semantic understanding is crucial for developing machines capable of interpreting complex interplay of text and visual information. |
| Approach: | They propose a multi-modal soft prompt framework that integrates three experts of soft prompts . they propose sarcasm detection and sentiment analysis tasks that are critical for few-shot learning . |
| Outcome: | The proposed model outperforms the 8.2B model InstructBLIP with 2% parameters . it significantly outperformed other prompt methods on VLMs or task-specific methods . |
Autonomous Aspect-Image Instruction a2II: Q-Former Guided Multimodal Sentiment Classification (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to identify sentiment polarities of aspects are limited by the limited multimodal data available. |
| Approach: | They propose to use instruction tuning paradigm to combine language and vision data to combine text and image modalities. |
| Outcome: | The proposed model achieves state-of-the-art on benchmark datasets and in few-shot settings. |
SynPrompt: Syntax-aware Enhanced Prompt Engineering for Aspect-based Sentiment Analysis (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods of prompt-tuning for Aspect-based Sentiment Analysis (ABSA) are crude and simple. |
| Approach: | They propose a Syntax-aware Enhanced Prompt method which mines syntactic information related to aspect words from the syntaktic dependency tree. |
| Outcome: | The proposed method exploits the syntactic knowledge embedded in PLMs and achieves favorable results on three benchmark datasets. |
Few-shot Joint Multimodal Aspect-Sentiment Analysis Based on Generative Multimodal Prompt (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing studies require massive labeled data to train models for multimodal data analysis. |
| Approach: | They propose a novel multimodal prompt model that captures specific aspect terms in a few-shot scenario. |
| Outcome: | The proposed model outperforms baselines on two MABSA-related tasks on a few-shot dataset. |
CLMLF:A Contrastive Learning and Multi-Layer Fusion Method for Multimodal Sentiment Detection (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods for multimodal sentiment detection do not consider token-level feature fusion. |
| Approach: | They propose a method for multimodal sentiment detection using a combination of text and image to encode and fuse token-level features. |
| Outcome: | The proposed method can fuse multimodal features with token-level features on three publicly available multimodal datasets. |
TMFN: A Target-oriented Multi-grained Fusion Network for End-to-end Aspect-based Multimodal Sentiment Analysis (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for multimodal aspect-based sentiment analysis focus on fusing image regional information and textual words. |
| Approach: | They propose a multimodal aspect-based sentiment analysis method that integrates regional and global image information with global image data. |
| Outcome: | Experiments show that the proposed method outperforms state-of-the-art methods on two benchmark datasets. |