Trigger Warning Assignment as a Multi-Label Document Classification Problem (2023.acl-long)
Copied to clipboard
| Challenge: | a trigger warning is used to warn people about potentially disturbing content . a webis dataset of 1 million fanfiction works contains up to 36 different warnings per document . |
| Approach: | They introduce a multi-label task to assign a trigger warning to fanfiction . they map 41 million free-form tags assigned by authors into a single taxonomy of trigger warnings . |
| Outcome: | The proposed model achieves micro-F1 scores of about 0.5, which reveals the difficulty of the task. |
Similar Papers
Trigger Warnings: Bootstrapping a Violence Detector for Fan Fiction (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing guidelines for proactively alerting readers of potentially disturbing content have been proposed. |
| Approach: | They propose to use a labeled corpus of narrative fiction from a popular fan fiction site to determine whether to assign a trigger warning to an English story. |
| Outcome: | The proposed task achieves F1 scores between 0.8 and 0.9 on three datasets . the authors show that assigning trigger warnings for violence is feasible . |
CrisiText: A dataset of warning messages for LLM training in emergency communication (2026.findings-eacl)
Copied to clipboard
| Challenge: | Identifying threats and mitigating their potential damage during crisis situations is paramount for safeguarding endangered individuals. |
| Approach: | They present a large-scale dataset for the generation of warning messages across 13 different types of crisis scenarios. |
| Outcome: | The proposed dataset contains more than 400,000 warning messages (spanning almost 18,000 crisis situations) aimed at assisting civilians during and after such events. |
Universal Adversarial Triggers for Attacking and Analyzing NLP (D19-1)
Copied to clipboard
| Challenge: | Using adversarial triggers, a model can produce a specific prediction . adversarial attacks are useful for evaluation and interpretation . |
| Approach: | They propose a gradient-guided search over tokens that finds short adversarial triggers that successfully trigger the target prediction. |
| Outcome: | The proposed algorithm finds short trigger sequences that successfully trigger the target prediction. |
Automatic Multi-Label Prompting: Simple and Interpretable Few-Shot Classification (2022.naacl-main)
Copied to clipboard
| Challenge: | Prompt-based learning is an emerging paradigm for exploiting knowledge learned by a pretrained language model. |
| Approach: | They propose a method to automatically select label mappings for few-shot text classification with prompting. |
| Outcome: | The proposed method achieves competitive performance on the GLUE benchmark without human effort or external resources. |
Automatically Identifying Words That Can Serve as Labels for Few-Shot Text Classification (2020.coling-main)
Copied to clipboard
| Challenge: | Existing approaches to few-shot text classification require domain expertise and an understanding of the language model's abilities to define the mapping between words and labels. |
| Approach: | They propose a method that converts textual inputs to cloze questions that contain some form of task description and processes them with a pretrained language model to map the predicted words to labels. |
| Outcome: | The proposed approach performs almost as well as hand-crafted label-to-word mappings for a number of tasks with small amounts of training data. |
Definitions Matter: Guiding GPT for Multi-label Classification (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Recent success of Large Language Models (LLMs) is due to their superior performance on various tasks such as text generation, summarization, question answering, and inductive reasoning. |
| Approach: | They propose to generate definitions from examples and use them for zero-shot classification and to investigate how an LLM makes use of the definitions. |
| Outcome: | The proposed method improves the definitions of class labels and improves their understanding of the definition. |
Hierarchical Label Generation for Text Classification (2023.findings-eacl)
Copied to clipboard
| Challenge: | None Hierarchical text classification (HTC) aims to assign the most relevant labels with their structure for a given document. |
| Approach: | They propose a method that captures the label hierarchy for real-world classification applications by using a taxonomic hierarchy. |
| Outcome: | The proposed method can generate unseen labels in subword level. |
Tutorial on Multimodal Machine Learning (2022.naacl-tutorials)
Copied to clipboard
| Challenge: | Multimodal machine learning is a challenging but crucial area with numerous applications in multimedia, affective computing, robotics, finance, HCI, and healthcare. |
| Approach: | This tutorial will describe an updated taxonomy on multimodal machine learning synthesizing its core technical challenges and major directions for future research. |
| Outcome: | The proposed taxonomy synthesizes the core technical challenges and major directions for future research. |
More Embeddings, Better Sequence Labelers? (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work suggests contextual embeddings improve sequence labeling accuracy . but, there is no definite conclusion on whether concatenating different kinds of embeddables is effective . |
| Approach: | They propose a family of contextual embeddings that improves sequence labeling accuracy . they conduct extensive experiments on 3 tasks over 18 datasets and 8 languages . |
| Outcome: | The proposed family of contextual embeddings improves the accuracy of sequence labelers over non-contextual embedders. |
A Review of Dataset and Labeling Methods for Causality Extraction (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for causal relationship extraction are limited and lack of unified methods hinder progress in the field. |
| Approach: | They propose to summarize existing methods and propose a new causal sequence label method . they propose to use multiple candidate causal label sequences according to label controversy . |
| Outcome: | The proposed method summarises existing methods and explores their practicability and extensibility from multiple perspectives. |