Md Kamrul Hasan, Wasifur Rahman, AmirAli Bagher Zadeh, Jianyuan Zhong, Md Iftekhar Tanveer, Louis-Philippe Morency, Mohammed (Ehsan) Hoque
| Challenge: | Humor is a unique and creative communicative behavior often displayed during social interactions. |
| Approach: | They present a dataset that allows to model multimodal language used in expressing humor using text, visual and acoustic communication. |
| Outcome: | The proposed framework opens the door to understanding multimodal language used in expressing humor. |
Similar Papers
StandUp4AI: A New Multilingual Dataset for Humor Detection in Stand-up Comedy Videos (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a new multimodal dataset of stand-up comedies is proposed to improve humor detection . the dataset is the biggest available for this type of task, and the most diverse . |
| Approach: | They propose a method to enhance the automatic laughter detection based on Audio Speech Recognition errors. |
| Outcome: | The proposed method improves existing models of humor detection by using audio speech recognition errors. |
Multimodal and Multilingual Laughter Detection in Stand-Up Comedy Videos (2024.lrec-main)
Copied to clipboard
| Challenge: | Using TED talks, we use laughter detection software to capture humor in the sitcom genre. |
| Approach: | They develop a multimodal multilingual dataset in Russian and English with a particular emphasis on laughter detection techniques. |
| Outcome: | The proposed model outperforms peak detection and machine learning, while the latter shows promise and warrants further study. |
Humor Detection in English-Hindi Code-Mixed Social Media Content : Corpus and Baseline System (L18-1)
Copied to clipboard
| Challenge: | a growing number of social media users are using code-mixing to detect humor . linguistics researchers are looking for methods to detect humorous content in text . |
| Approach: | They analyze a corpus of English-Hindi code-mixed tweets annotated with humorous(H) tags. |
| Outcome: | The proposed method detects humor in code-mixed tweets in English-Hindi. |
Large Dataset and Language Model Fun-Tuning for Humor Recognition (P19-1)
Copied to clipboard
| Challenge: | Humor recognition datasets contain only English texts and focus on puns. |
| Approach: | They collected a dataset of jokes and funny dialogues in Russian and complemented them carefully with unfunny texts with similar lexical properties. |
| Outcome: | The proposed method is based on the universal language model finetuning and has an F1 score of 0.91 on a test set. |
SMILE: Multimodal Dataset for Understanding Laughter in Video with Language Models (2024.findings-naacl)
Copied to clipboard
| Challenge: | Despite advances in artificial intelligence, building social intelligence remains a challenge. |
| Approach: | They propose a task to explain why people laugh in a video and a dataset to do this. |
| Outcome: | The proposed dataset generates plausible explanations for laughter in video and in-the-wild videos. |
When to Laugh and How Hard? A Multimodal Approach to Detecting Humor and Its Intensity (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods to generate humor using multimodal data are needed to study the role of humor in human social function. |
| Approach: | They propose a model that automatically detects humor in the Friends TV show using multimodal data and use prerecorded laughter as annotation as it marks humor. |
| Outcome: | The proposed model detects humor 78% of the time and how long the audience’s laughter reaction should last with a mean absolute error of 600 milliseconds. |
Telling the Whole Story: A Manually Annotated Chinese Dataset for the Analysis of Humor in Jokes (D19-1)
Copied to clipboard
| Challenge: | Humor plays important role in human communication, which makes it important problem for natural language processing. |
| Approach: | They propose a novel annotation scheme to give scenarios of how humor arises in text . they report reasonable agreement between annotators and analyze the dataset . |
| Outcome: | The proposed scheme gives scenarios of how humor arises in text . it contains key words that trigger humor, character relationship, scene, and humor categories . |
MUCH: A Multimodal Corpus Construction for Conversational Humor Recognition Based on Chinese Sitcom (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing multimodal corpora for conversational humor are coarse-grained and insufficient to support the conversational comprehension task. |
| Approach: | They constructed a multimodal humor corpus based on a Chinese sitcom and used both unimodal and multimodal methods to test the corpus. |
| Outcome: | The proposed method outperforms unimodal and multimodal methods in the evaluation of a Chinese sitcom for conversational humor recognition. |
Exploiting Syntactic Structures for Humor Recognition (C18-1)
Copied to clipboard
| Challenge: | Using syntactic structure features, we find humor recognition is a kind of style . |
| Approach: | They propose to exploit syntactic structure features to enhance humor recognition . they find syntastic structure features consistently correlate with humor . |
| Outcome: | The proposed method achieves significant improvements compared with baselines. |
SMILE-Next: Teaching Large Language Models to Detect, Classify, and Reason about Laughter (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to understanding laughter or humor focus on narrowly defined tasks such as detecting humor and estimating humor intensity. |
| Approach: | They propose a dataset for real-world laughter understanding with multimodal textual representations and question–answer annotations. |
| Outcome: | The proposed framework outperforms baselines in three laughter-related tasks, showing that it is robust. |