Challenge: Empirical results show the efficacy of our proposed multi-task framework over existing state-of-the-art systems.
Approach: They propose a multi-task, multi-modal deep learning framework to solve multiple tasks simultaneously.
Outcome: The proposed framework performs better than existing state-of-the-art systems on a complicated form of information, i.e., memes.

Similar Papers

Sentiment and Emotion help Sarcasm? A Multi-task Learning Framework for Multi-Modal Sarcasm, Sentiment and Emotion Analysis (2020.acl-main)

Copied to clipboard

Challenge: Existing systems for sarcasm detection are limited by the use of sarcasm . sarasm is often used to convey thinly veiled disapproval humorously.
Approach: They propose a multi-task deep learning framework to solve sarcasm problems simultaneously . they manually annotate a sarcsm dataset with sentiment and emotion classes .
Outcome: The proposed framework is able to solve sarcasm, sentiment and emotion problems in a multi-modal conversational scenario.
Multi-task Learning for Multi-modal Emotion Recognition and Sentiment Analysis (N19-1)

Copied to clipboard

Challenge: Existing frameworks for sentiment and emotion analysis are not efficient for inter-task learning.
Approach: They propose a multi-task learning framework that performs sentiment and emotion analysis together.
Outcome: The proposed framework improves on a CMU-MOSEI dataset for sentiment and emotion analysis.
A Sentiment and Emotion Aware Multimodal Multiparty Humor Recognition in Multilingual Conversational Setting (2022.coling-1)

Copied to clipboard

Challenge: Humor is an essential aspect of daily conversation, and people try to provoke humor in their talks.
Approach: They propose a multitask framework that annotates Hindi utterances with sentiment and emotion classes.
Outcome: The proposed framework improves on the recently released Hindi Humor dataset . it takes sentiment and emotion into account to understand humor .
All-in-one: Multi-task Learning for Rumour Verification (C18-1)

Copied to clipboard

Challenge: Automatic resolution of rumours is a challenging task that can be broken down into smaller components that make up a pipeline . previous work focused on rumor detection, rumou tracking and stance classification as separate components .
Approach: They propose a multi-task learning approach that allows joint training of main and auxiliary tasks, improving the performance of rumour verification.
Outcome: The proposed approach improves the performance of rumour verification by combining main and auxiliary tasks into one pipeline.
MemeInterpret: Towards an All-in-One Dataset for Meme Understanding (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing research has not explored meme captioning's decomposition into subtasks or its connections to other CMU tasks.
Approach: a new meme corpus is built upon the Facebook Hateful Memes dataset . it contains meme captions, corresponding surface messages and relevant background knowledge .
Outcome: a new corpus of meme captions and surface messages unifies three major categories of CMU tasks for the first time.
Re-framing Incremental Deep Language Models for Dialogue Processing with Multi-task Learning (2020.coling-main)

Copied to clipboard

Challenge: Using a multi-task learning framework, we train a universal incremental dialogue processing model with four tasks of disfluency detection, language modelling, part-of-speech tagging and utterance segmentation in a simple deep recurrent setting.
Approach: They propose a multi-task learning framework to train a universal incremental dialogue processing model with four tasks of disfluency detection, language modelling, part-of-speech tagging and utterance segmentation in a simple deep recurrent setting.
Outcome: The proposed model outperforms individual tasks and delivers competitive performance.
A deep-learning framework to detect sarcasm targets (D19-1)

Copied to clipboard

Challenge: Existing methods for sarcasm target detection are difficult to implement in natural language processing.
Approach: They propose a deep learning framework for sarcasm target detection in predefined sarkastic texts.
Outcome: The proposed framework improves accuracy and accuracy in match and dice scores compared to the current state-of-the-art framework.
A Match Made in Heaven: A Multi-task Framework for Hyperbole and Metaphor Detection (2023.findings-acl)

Copied to clipboard

Challenge: Existing approaches to detect metaphor and hyperbole independently have not explored their relationship computationally.
Approach: They propose a multi-task deep learning framework to detect hyperbole and metaphor simultaneously by annotating two hyperbolic datasets with metaphor labels.
Outcome: The proposed framework improves state-of-the-art hyperbole detection by 12% over existing methods.
A Context-Aware Contrastive Learning Framework for Hateful Meme Detection and Segmentation (2025.findings-naacl)

Copied to clipboard

Challenge: Empirical experiments show HateSieve surpasses existing LMMs in performance with fewer trainable parameters .
Approach: They propose a framework to enhance detection and segmentation of hateful elements in memes by creating a triplet dataset and an Image-Text Alignment module.
Outcome: HateSieve features a new framework that creates semantically correlated memes and generates contextual embeddings for accurate meme segmentation.
Beneath the Surface: Unveiling Harmful Memes with Multimodal Reasoning Distilled from Large Language Models (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for harmful meme detection ignore in-depth cognition of meme text and image . authors propose a framework for learning reasonable thoughts from LLMs for better multimodal fusion .
Approach: They propose to use large language models to learn reasonable thoughts from LLMs for better multimodal fusion and lightweight fine-tuning.
Outcome: The proposed approach achieves superior performance than state-of-the-art methods on the harmful meme detection task.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations