Few-shot Joint Multimodal Aspect-Sentiment Analysis Based on Generative Multimodal Prompt (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing studies require massive labeled data to train models for multimodal data analysis. |
| Approach: | They propose a novel multimodal prompt model that captures specific aspect terms in a few-shot scenario. |
| Outcome: | The proposed model outperforms baselines on two MABSA-related tasks on a few-shot dataset. |
Similar Papers
Vision-Language Pre-Training for Multimodal Aspect-Based Sentiment Analysis (2022.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to multimodal Aspect-Based Sentiment Analysis (MABSA) ignore crossmodalalignment and use pre-trained visual and textual models. |
| Approach: | They propose a multimodal multimodal encoder-decoder framework for MABSA that uses a unified multimodal decoder architecture for all the pretrainingand downstream tasks. |
| Outcome: | The proposed framework outperforms state-of-the-art approaches on three MABSA subtasks. |
TMFN: A Target-oriented Multi-grained Fusion Network for End-to-end Aspect-based Multimodal Sentiment Analysis (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for multimodal aspect-based sentiment analysis focus on fusing image regional information and textual words. |
| Approach: | They propose a multimodal aspect-based sentiment analysis method that integrates regional and global image information with global image data. |
| Outcome: | Experiments show that the proposed method outperforms state-of-the-art methods on two benchmark datasets. |
A Generative Language Model for Few-shot Aspect-Based Sentiment Analysis (2022.findings-naacl)
Copied to clipboard
| Challenge: | Pre-trained language models are often used to achieve state-of-the-art results . eval paper shows that generative language model can handle joint and multi-task settings . |
| Approach: | They propose to reformulate extraction and prediction tasks into a sequence generation task . they propose a generative language model with unidirectional attention that learns to accomplish the tasks via language generation . |
| Outcome: | The proposed model outperforms the state-of-the-art in few-shot and full-shot settings. |
Autonomous Aspect-Image Instruction a2II: Q-Former Guided Multimodal Sentiment Classification (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to identify sentiment polarities of aspects are limited by the limited multimodal data available. |
| Approach: | They propose to use instruction tuning paradigm to combine language and vision data to combine text and image modalities. |
| Outcome: | The proposed model achieves state-of-the-art on benchmark datasets and in few-shot settings. |
Mixture-of-Prompt-Experts for Multi-modal Semantic Understanding (2024.lrec-main)
Copied to clipboard
| Challenge: | Multimodal semantic understanding is crucial for developing machines capable of interpreting complex interplay of text and visual information. |
| Approach: | They propose a multi-modal soft prompt framework that integrates three experts of soft prompts . they propose sarcasm detection and sentiment analysis tasks that are critical for few-shot learning . |
| Outcome: | The proposed model outperforms the 8.2B model InstructBLIP with 2% parameters . it significantly outperformed other prompt methods on VLMs or task-specific methods . |
BvSP: Broad-view Soft Prompting for Few-Shot Aspect Sentiment Quad Prediction (2024.acl-long)
Copied to clipboard
| Challenge: | Aspect sentiment quad prediction aims to predict aspects due to distinct data distribution. |
| Approach: | They propose a method that aggregates multiple templates with a broader view . they first construct a few-shot ASQP dataset that contains richer categories . |
| Outcome: | The proposed method outperforms the state-of-the-art methods under four few-shot settings and other public datasets. |
AoM: Detecting Aspect-oriented Information for Multimodal Aspect-Based Sentiment Analysis (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to extract aspects from text-image pairs and recognize their sentiments are noisy and coarsely establishing image-aspect alignment will interfere with aspect-relevant semantic and sentiment information. |
| Approach: | They propose an Aspect-oriented method to detect aspect-relevant semantic and sentiment information by selecting textual tokens and image blocks that are semantically related to the aspects. |
| Outcome: | The proposed method is superior to existing methods in the field of sentiment analysis. |
AX-MABSA: A Framework for Extremely Weakly Supervised Multi-label Aspect Based Sentiment Analysis (2022.emnlp-main)
Copied to clipboard
| Challenge: | Aspect Based Sentiment Analysis is a dominant research area with potential applications in social media analytics, business, finance, and health. |
| Approach: | They propose a weakly supervised multi-label Aspect Category Sentiment Analysis framework which does not use any labelled data. |
| Outcome: | The proposed framework outperforms weakly supervised baselines on four benchmark datasets and is able to generate multiple aspect category-sentiment pairs per review sentence. |
M2DF: Multi-grained Multi-curriculum Denoising Framework for Multimodal Aspect-based Sentiment Analysis (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing work mainly utilizes image information to improve the performance of MABSA task. |
| Approach: | They propose a multimodal Aspect-based Sentiment Analysis task that uses image information to improve model performance. |
| Outcome: | The proposed framework outperforms state-of-the-art work on three sub-tasks of MABSA. |
Multimodal Prompt Learning with Missing Modalities for Sentiment Analysis and Emotion Recognition (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods for multimodal sentiment analysis often fail due to equipment failure, data corruption, privacy issues and the like. |
| Approach: | They propose a multimodal Transformer framework using prompt learning to address the issue of missing modalities. |
| Outcome: | The proposed framework outperforms existing methods significantly across evaluation metrics. |