Not All Counterhate Tweets Elicit the Same Replies: A Fine-Grained Analysis (2023.starsem-1)
Copied to clipboard
| Challenge: | a recent survey found 41% of people reported online harassment on a personal level . a counterhate argument can effectively limit the spread of hate speech, but it can also exacerbate it . |
| Approach: | They analyze 2,621 replies to counterhate arguments countering hateful tweets and analyze their responses . they find that half of the replies disagree with the argument, and this kind of reply often supports the hateful Tweet . |
| Outcome: | The proposed method can anticipate the kind of replies a counterhate argument will elicit. |
Similar Papers
LEXPLAIN: Improving Model Explanations via Lexicon Supervision (2023.starsem-1)
Copied to clipboard
| Challenge: | Existing methods that extract features from input text to explain a classifier's prediction are limiting to models that are faithful to their predictions. |
| Approach: | They propose a framework for guiding model explanations by supervising them explicitly using task-related lexicons to direct supervise model explanation. |
| Outcome: | The proposed method improves model explanations without sacrificing performance on sentiment analysis and toxicity detection tasks while demoting spurious correlations with African American English dialects. |
Investigating Wit, Creativity, and Detectability of Large Language Models in Domain-Specific Writing Style Adaptation of Reddit’s Showerthoughts (2024.starsem-1)
Copied to clipboard
| Challenge: | Recent Large Language Models (LLMs) have shown the ability to generate content that is difficult or impossible to distinguish from human writing. |
| Approach: | They compare GPT-2 and GPT-Neo fine-tuned on Reddit data and GTP-3.5 invoked in a zero-shot manner, against human-authored texts. |
| Outcome: | The proposed model can generate short, creative texts that are difficult to distinguish from human writing, but human evaluators rate them worse than the model. |
How Does Stereotype Content Differ across Data Sources? (2024.starsem-1)
Copied to clipboard
| Challenge: | Existing studies of stereotypes using rating scales capture beliefs and opinions about different social groups. |
| Approach: | They compare stereotype-relevant measures of social group social status with traditional scales and a word-list generation task using free-text data. |
| Outcome: | The results compare with traditional surveys and a spontaneous word-list generation task. |
DeepA2: A Modular Framework for Deep Argument Analysis with Pretrained Neural Text2Text Language Models (2022.starsem-1)
Copied to clipboard
| Challenge: | ArgumentAnalyst is a multi-dimensional, modular framework for performing deep argument analysis using existing pre-trained language models (PTLMs). |
| Approach: | They propose a multi-dimensional, modular framework for performing deep argument analysis using current pre-trained language models (PTLMs) ArgumentAnalyst reconstructs argumentative texts as valid arguments by inserting missing premises and conclusions, formalizing inferences, and coherently linking the reconstruction to the source text. |
| Outcome: | The proposed framework can replicate established heuristics, cope with plurality of correct solutions, and exploit higher-order evidence. |
Language models are not naysayers: an analysis of language models on negation benchmarks (2023.starsem-1)
Copied to clipboard
| Challenge: | Negation has been shown to be a major bottleneck for masked language models, such as BERT, but whether this finding still holds for larger-sized auto-regressive language models has not been studied comprehensively. |
| Approach: | They evaluate the ability of current-generation auto-regressive language models to handle negation using a wide range of benchmarks and models. |
| Outcome: | The proposed models are compared against a wide range of negation benchmarks and show that they are insensitive to negation, inability to capture the lexical semantics of negations, and failure to reason under negation. |
Identifying Emotional and Polar Concepts via Synset Translation (2024.starsem-1)
Copied to clipboard
| Challenge: | Emotion identification and polarity classification seek to determine sentiment expressed by a writer. |
| Approach: | They propose a translation-based method for labeling each individual word sense and lexical concept into 20 different languages and translate them into multilingual sentiment lexicons. |
| Outcome: | The proposed method outperforms existing methods and is available on GitHub . it contains 12,429 emotional synsets and 15,567 polar synset. |
Natural Language Inference with Mixed Effects (2020.starsem-1)
Copied to clipboard
| Challenge: | aggregating raw annotations to a single label is problematic due to disagreement among annotators. |
| Approach: | They propose a generic method that allows one to skip the aggregation step and train on the raw annotations directly without subjecting the model to unwanted noise. |
| Outcome: | The proposed method improves performance over models that do not incorporate such effects. |
A Trip Towards Fairness: Bias and De-Biasing in Large Language Models (2024.starsem-1)
Copied to clipboard
| Challenge: | a little or a large bias in CtB-LLMs may cause huge harm . LLaMA and OPT families have an important bias in gender, race, religion, and profession. |
| Approach: | They propose to debiase three families of Very Large-Language Models with LORA to reduce bias by 4.12 points in the normalized stereotype score. |
| Outcome: | The proposed model reduces bias up to 4.12 points in the normalized stereotype score. |
Speech acts and Communicative Intentions for Urgency Detection (2022.starsem-1)
Copied to clipboard
| Challenge: | Existing approaches to detect speech acts (SA) in synchronous and asynchronous dialogues have been proposed to capture communicative intentions on the part of the speaker. |
| Approach: | They propose to annotate tweets with urgency and SA and develop deep learning architectures to inject it into urgency detection. |
| Outcome: | The proposed dataset annotated for urgency and SA improves information type detection in an out-of-type configuration where models are evaluated in unseen event types during training. |
When Truth Matters - Addressing Pragmatic Categories in Natural Language Inference (NLI) by Large Language Models (LLMs) (2023.starsem-1)
Copied to clipboard
| Challenge: | In this paper, we examine the ability of large language models (LLMs) to accommodate different pragmatic sentence types, such as questions, commands, and sentence fragments for natural language inference (NLI). |
| Approach: | They propose to fine-tune large language models to accommodate different sentence types for natural language inference (NLI) they also explore ChatGPT's concept of entailment by using a symbolic semantic parser. |
| Outcome: | The proposed models can accommodate different sentence types without losing too much accuracy on MNLI-matched models. |