Content-Specific Humorous Image Captioning Using Incongruity Resolution Chain-of-Thought (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods for generating humorous captions are generic and do not capture the content of images. |
| Approach: | They propose a framework that generates content-specific resolutions from fine details extracted from an image and integrates logit bias and negative sampling to suppress the output of generic resolutions. |
| Outcome: | The proposed framework generates humorous captions tailored to the content of specific input images. |
Similar Papers
Punny Captions: Witty Wordplay in Image Descriptions (N18-2)
Copied to clipboard
| Challenge: | Developing computational models that can produce contextually witty image descriptions is challenging because of the large corpus of sentences that are not available for large scale corpora. |
| Approach: | They propose to use linguistic wordplay, specifically puns, to generate witty image descriptions from large corpus of sentences or encode them via an encoder-decoder neural network architecture. |
| Outcome: | The proposed models perform better than baseline models using human data and show that they are slightly wittier than human-written witty descriptions. |
FairCoT: Enhancing Fairness in Text-to-Image Generation via Chain of Thought Reasoning with Multimodal Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | FairCoT enhances fairness in text-to-image generative models by integrating iterative reasoning . experimental evaluations demonstrate FairCot significantly enhances diversity without sacrificing image quality or semantic fidelity. |
| Approach: | FairCoT is a framework that enhances fairness in text-to-image generative models . it employs iterative CoT refinement to mitigate biases and dynamically adjusts textual prompts . |
| Outcome: | FairCoT combines iterative CoT refinement with iterating reasoning processes . it addresses limitations of zero-shot CoT in sensitive scenarios, authors say . |
What Makes for Good Image Captions? (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a formal information-theoretic framework is developed for image captioning . the pyramid of captions is a method that generates enriched captions by integrating local and global visual information. |
| Approach: | They propose a formal information-theoretic framework for image captioning . they propose 'Pyramid of Captions' method that generates enriched captions . |
| Outcome: | The proposed framework provides a flexible foundation for analyzing and optimizing image captioning systems across diverse task requirements. |
A Modular Architecture for Unsupervised Sarcasm Generation (D19-1)
Copied to clipboard
| Challenge: | Existing systems for sarcasm generation are elusive due to the fact that both selection of contents and training of sarcasm are based on the same data. |
| Approach: | They propose a framework that takes a literal negative opinion as input and translates it into a sarcastic version. |
| Outcome: | The proposed system outperforms baselines built using known unsupervised statistical and neural machine translation and style transfer techniques. |
Uncertainty and Surprisal Jointly Deliver the Punchline: Exploiting Incongruity-Based Features for Humor Recognition (2021.acl-short)
Copied to clipboard
| Challenge: | Existing work on humor recognition does not examine the actual joke mechanism . a recent study focused on humor-specific stylistic features, but few have tried to establish a connection between them and humor theories. |
| Approach: | They propose to model the set-up and punchline as part developing semantic uncertainty and disrupt audience expectations. |
| Outcome: | The proposed features can tell jokes from non-jokes, compared with baselines. |
Engagement Undermines Safety: How Stereotypes and Toxicity Shape Humor in Language Models (2026.eacl-long)
Copied to clipboard
| Challenge: | Large language models are increasingly used for creative writing and engagement content, raising safety concerns about their outputs. |
| Approach: | They evaluate how funniness optimization in large language models couples with harmful content by jointly measuring humor, stereotypicality, and toxicity. |
| Outcome: | The proposed model couples humor, stereotypicality, and toxicity with harmful outputs . the results suggest a bias amplification loop between generators and evaluators . |
Caption Enriched Samples for Improving Hateful Memes Detection (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for classifying memes are difficult to perform, with human accuracy only about 85% . recent state-of-the-art models perform considerably less accurately, achieving up to 64.73% accuracy. |
| Approach: | They propose to use an off-the-shelf caption generator to capture the first image and overlayed text. |
| Outcome: | The proposed tool improves classification accuracy for unimodal and multimodal models . the proposed tool can be used to model the contrast between image content and overlayed text . |
Evolver: Chain-of-Evolution Prompting to Boost Large Multimodal Models for Hateful Meme Detection (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for detecting hateful memes rely on extensive training. |
| Approach: | They propose a method that integrates evolution attribute and in-context information of memes into large multimodal models via Chain-of-Evolution (CoE) prompting. |
| Outcome: | The proposed method improves existing methods on public datasets and can be used as interpretive tool to promote understanding of evolution of memes. |
BottleHumor: Self-Informed Humor Explanation using the Information Bottleneck Principle (2025.findings-acl)
Copied to clipboard
| Challenge: | Humor is an effective communication tool that can manifest in various forms, including puns, exaggerated facial expressions, absurd behaviors, and incongruities. |
| Approach: | They propose a method that elicits relevant world knowledge from vision and language models and refines it to generate an explanation of the humor in an unsupervised manner. |
| Outcome: | The proposed method can be adapted for additional tasks that can benefit from eliciting and conditioning on relevant world knowledge. |
Mining Effective Features Using Quantum Entropy for Humor Recognition (2023.findings-eacl)
Copied to clipboard
| Challenge: | Existing studies on humor recognition do not understand the mechanisms that generate humor. |
| Approach: | They propose to use quantum entropy to represent the semantic uncertainty of the setup and punchline as features for humor recognition. |
| Outcome: | The proposed features are more effective than baselines for recognizing humorous and non-humorous texts on the SemEval2021 task 7 dataset. |