“Nice Try, Kiddo”: Investigating Ad Hominems in Dialogue Responses (2021.naacl-main)
Copied to clipboard
| Challenge: | Ad hominem attacks target a person's character instead of the position the person is maintaining. |
| Approach: | They propose to use salient n-gram similarity as a soft constraint to reduce the amount of ad hominems generated in Twitter conversations. |
| Outcome: | The proposed method reduces the amount of ad hominems generated in human and dialogue system responses to English Twitter posts by using salient n-gram similarity as a soft constraint. |
Similar Papers
Before Name-Calling: Dynamics and Triggers of Ad Hominem Fallacies in Web Argumentation (N18-1)
Copied to clipboard
| Challenge: | Existing research lacks solid empirical investigation of typology of ad hominem arguments and their potential causes. |
| Approach: | They propose to perform several large-scale annotation studies and experiment with various neural architectures to validate hypotheses such as controversy or reasonableness. |
| Outcome: | The proposed model identifies the ad hominem fallacy and its possible causes using explainable neural network architectures. |
Computational Ad Hominem Detection (P19-2)
Copied to clipboard
| Challenge: | ad hominem attacks are introduced in debates as an easy win, but their impact on argumentation is limited . a machine learning approach to detect the personal attack is insufficient, we show . |
| Approach: | They propose a machine learning approach that detects ad hominem attacks using social media data . they propose TF-IDF approaches that are insufficient to detect the personal attack . |
| Outcome: | The proposed method has a recall of 80% for a social media data source. |
GrounDial: Human-norm Grounded Safe Dialog Response Generation (2024.findings-eacl)
Copied to clipboard
| Challenge: | Recent conversational AI systems generate unsafe responses agreeing to offensive user input or including toxic content. |
| Approach: | They propose a method where response safety is achieved by grounding responses to commonsense social rules without fine-tuning. |
| Outcome: | The proposed approach is quantitatively and qualitatively safer even without additional data or tuning. |
Build it Break it Fix it for Dialogue Safety: Robustness from Adversarial Human Attack (D19-1)
Copied to clipboard
| Challenge: | Detecting offensive language in the context of a dialogue is an increasingly important application of natural language processing. |
| Approach: | They propose to train a model to be robust to such attacks by iterative build it, break it, fix it scheme with humans and models in the loop. |
| Outcome: | The proposed model is significantly more robust to such human attacks than previous systems. |
Probing the Robustness of Trained Metrics for Conversational Dialogue Systems (2022.acl-short)
Copied to clipboard
| Challenge: | Existing methods for evaluating conversational dialogue systems have been shown to be inefficient and instabile. |
| Approach: | They propose an adversarial method to stress-test trained metrics for evaluation of conversational dialogue systems using Reinforcement Learning. |
| Outcome: | The proposed method outperforms existing methods and can be applied to stress-test trained metrics for conversational dialogue systems. |
Detecting Attackable Sentences in Arguments (2020.emnlp-main)
Copied to clipboard
| Challenge: | Prior work in NLP studies focus on argument quality and making counterarguments toward the main claim, without investigating what parts of an argument are attackable for successful persuasion. |
| Approach: | They propose to use machine learning to find attackable sentences in online arguments by analyzing driving reasons for attacks and identifying relevant characteristics of sentences. |
| Outcome: | The proposed model can detect attackable sentences significantly better than baselines and comparably well to laypeople. |
Stumbling Blocks: Stress Testing the Robustness of Machine-Generated Text Detectors Under Attacks (2024.acl-long)
Copied to clipboard
| Challenge: | Existing studies on this topic focus on the robustness of specific detectors or particular attack methods. |
| Approach: | They stress test the detectors’ robustness to malicious attacks under realistic scenarios using LLMs and metric-based detectors. |
| Outcome: | The proposed methods are based on a set of LLM-based models and their performance is compared under different budget levels. |
Ranking Manipulation for Conversational Search Engines (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent research demonstrates that Large Language Models are highly vulnerable to jailbreaking and prompt injection attacks. |
| Approach: | They propose a tree-of-attacks-based jailbreaking technique which promotes low-ranked products . they propose enabling LLMs to be jailed and prompt injections to disrupt safety . |
| Outcome: | The proposed technique promotes low-ranked products in conversational search engines. |
On the Robustness of Offensive Language Classifiers (2022.acl-long)
Copied to clipboard
| Challenge: | Existing studies on offensive language classifiers have focused on primitive attacks such as misspellings and extraneous spaces. |
| Approach: | They analyze the robustness of offensive language classifiers against crafty adversarial attacks that leverage greedy- and attention-based word selection and context-aware embeddings for word replacement. |
| Outcome: | The proposed classifiers are robust against more crafty attacks that leverage greedy- and attention-based word selection and context-aware embeddings for word replacement. |
Elastic Weight Removal for Faithful and Abstractive Dialogue Generation (2024.naacl-long)
Copied to clipboard
| Challenge: | Current-day large language models generate coherent, grammatical, and seemingly meaningful text, but are prone to hallucinating incorrect information. |
| Approach: | They propose to ‘subtract’ parameters of a model trained to hallucinate from a dialogue response generation model to ‘negate’ the contribution of such hallucinatedexamples from it. |
| Outcome: | The proposed method reduces hallucinations and discourages extractive responses, which are often a consequence of reducing hallucines by encouraging copy-pasting of document spans. |