| Challenge: | Automatic Chinese irony detection often lacks labeled benchmark datasets . despite its pervasive nature, irony is a trope whose actual meaning differs from what is literally enunciated. |
| Approach: | They propose to use a Chinese benchmark dataset for automatic Chinese irony detection to provide a benchmark for machine learning models. |
| Outcome: | The proposed dataset includes more than 8.7K posts, collected from Weibo, a micro blogging platform. |
Similar Papers
The Design and Construction of a Chinese Sarcasm Dataset (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing sarcasm datasets are limited to English and Chinese . sarcasm is a multi-layered semi-conscious language phenomenon . |
| Approach: | They propose to build a high-quality Chinese sarcasm dataset using user comments . they use manual annotated sarkastic texts and non-sarcastic texts to train sarcasm classifier . |
| Outcome: | The proposed dataset contains 2,486 manual annotated sarcastic texts and 89,296 non-sarcatic texts. |
Tackling Irony Detection using Ensemble Classifiers (2022.lrec-1)
Copied to clipboard
| Challenge: | Automated approaches to irony detection still fall short of what one would consider desirable performance. |
| Approach: | They propose to use transformer-based approaches to automate irony detection in social media . they propose to augmentation training data to address the binary and fine-grained problem . |
| Outcome: | The proposed methods improve performance over baselines and are not decisive for good results. |
What A Sunny Day ☔: Toward Emoji-Sensitive Irony Detection (D19-55)
Copied to clipboard
| Challenge: | Existing datasets for irony detection only contain 10% of ironic tweets with emojis . 45% of internet users in the united states use an e-moji in social media . |
| Approach: | They propose to use emojis to analyze irony detection datasets to train classifiers. |
| Outcome: | The proposed pipeline can be used to analyze irony detection datasets using emojis. |
A Survey in Automatic Irony Processing: Linguistic, Cognitive, and Multi-X Perspectives (2022.coling-1)
Copied to clipboard
| Challenge: | figurative language research has focused on sarcasm and irony, but there is still a gap in the field. |
| Approach: | They propose to review computational irony, cognitive science, and neural models of irony processing . they aim to encourage a balanced and equal research environment in figurative languages . |
| Outcome: | The proposed multi-X irony processing perspectives will provide an overview of computational irony, insights from linguisic theory and cognitive science, and interactions with downstream NLP tasks. |
CBBQ: A Chinese Bias Benchmark Dataset Curated with Human-AI Collaboration for Large Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | a dataset of Chinese large language models is used to measure societal biases . many studies have shown that LLMs exhibit harmful societal biased outputs despite human data . |
| Approach: | They present a Chinese Bias Benchmark dataset that includes over 100K questions constructed by human experts and generative language models. |
| Outcome: | The proposed dataset covers stereotypes and societal biases in 14 social dimensions related to Chinese culture and values. |
Sarcasm Target Identification: Dataset and An Introductory Approach (L18-1)
Copied to clipboard
| Challenge: | Past work on sarcasm detection has focused on identifying the sarcasm target of ridicule in a sarkastic text. |
| Approach: | They propose a task of extracting the sarcastic target of ridicule from a sarcastical text using a manually annotated dataset and an automatic approach. |
| Outcome: | The proposed approach establishes the viability of sarcasm target identification and will serve as a baseline for future work. |
CDConv: A Benchmark for Contradiction Detection in Chinese Conversations (2022.emnlp-main)
Copied to clipboard
Chujie Zheng, Jinfeng Zhou, Yinhe Zheng, Libiao Peng, Zhen Guo, Wenquan Wu, Zheng-Yu Niu, Hua Wu, Minlie Huang
| Challenge: | Existing methods for detecting dialogue contradictions are difficult due to contextualization nature of conversations. |
| Approach: | They propose a benchmark for Contradiction Detection in Chinese Conversations . they use automatic conversation generation to simulate common user behaviors . |
| Outcome: | The proposed benchmark simulated the user behaviors that trigger chatbots to make contradictions . the results show that the current state-of-the-art chatbot can be easily goaded into making contradictions. |
COLD: A Benchmark for Chinese Offensive Language Detection (2022.emnlp-main)
Copied to clipboard
| Challenge: | Offensive language detection is crucial for maintaining a civilized social media platform and deploying pre-trained language models. |
| Approach: | They propose a benchmark benchmark for Chinese offensive language analysis including a Chinese Offensive Language Dataset and a baseline detector which is trained on the dataset. |
| Outcome: | The proposed benchmark contributes to Chinese offensive language detection which is challenging for existing resources. |
RESEMO: A Benchmark Chinese Dataset for Studying Responsive Emotion from Social Media Content (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on social media text processing do not focus on responsive emotion analysis. |
| Approach: | They propose a Chinese dataset named ResEmo for responsive emotion analysis, including 3813 posts with 68,781 comments collected from Weibo, the largest social media platform in China. |
| Outcome: | The proposed dataset includes 3813 posts with 68,781 comments collected from weibo, the largest social media platform in China. |
STATE ToxiCN: A Benchmark for Span-level Target-Aware Toxicity Extraction in Chinese Hate Speech Detection (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on Chinese hate speech detection lack span-level fine-grained annotations. |
| Approach: | They construct a Span-level target-aware Toxicity Extraction dataset and evaluate existing models for Chinese hateful slang. |
| Outcome: | The proposed dataset is the first span-level Chinese hate speech dataset and evaluates the ability of existing models to understand hate semantics. |