Training Language Models under Resource Constraints for Adversarial Advertisement Detection (2021.naacl-industry)
Copied to clipboard
| Challenge: | e-commerce and social media sites require content moderation to ensure ethical standards . a tiered moderation workflow with automated components complements human experts . |
| Approach: | They propose techniques for training text classification models under resource constraints . they use weak supervision, curriculum learning and multi-lingual training to fine-tune BERT . |
| Outcome: | The proposed techniques detect adversarial ads with a substantial gain over baseline . the authors show that the proposed methods can be applied to multiple languages . |
Similar Papers
Attacking Misinformation Detection Using Adversarial Examples Generated by Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models can be used to attack content filtering algorithms in social media platforms. |
| Approach: | They propose to generate adversarial examples to test the robustness of social media content filtering algorithms. |
| Outcome: | The proposed model outperforms existing models in the case of propaganda, false claims, rumours and hyperpartisan news. |
Active Learning for BERT: An Empirical Study (2020.emnlp-main)
Copied to clipboard
Liat Ein-Dor, Alon Halfon, Ariel Gera, Eyal Shnarch, Lena Dankin, Leshem Choshen, Marina Danilevsky, Ranit Aharonov, Yoav Katz, Noam Slonim
| Challenge: | Existing approaches to deal with data scarcity are active learning (AL) and pre-trained models are not being considered. |
| Approach: | They propose to use active learning techniques to cope with data scarcity in binary text classification scenarios where the annotation budget is very small and the data is often skewed. |
| Outcome: | The proposed methods improve BERT performance in binary text classification scenarios where the annotation budget is very small and the data is often skewed. |
Context-specific Language Modeling for Human Trafficking Detection from Online Advertisements (P19-1)
Copied to clipboard
Saeideh Shahrokh Esfahani, Michael J. Cafarella, Maziyar Baran Pouyan, Gregory DeAngelo, Elena Eneva, Andy E. Fano
| Challenge: | Human trafficking is a worldwide crisis. |
| Approach: | They propose a method to detect trafficking ads on online sites using natural language processing using a pre-trained textual language model. |
| Outcome: | The proposed classifier significantly outperforms any single feature set alone. |
Low-resource Cross-lingual Event Type Detection via Distant Supervision with Minimal Effort (C18-1)
Copied to clipboard
| Challenge: | Currently, few or no language processing tools or resources exist for most languages . a problem is that there is not enough available training data even in resource-rich languages if the task is complex. |
| Approach: | They propose to use a bilingual dictionary to train machine learning in a resource-poor language . they also explore adversarial training of bilingual word representations . |
| Outcome: | The proposed approach gives similar performance in event-type detection tasks. |
Improving Gradient-based Adversarial Training for Text Classification by Contrastive Learning and Auto-Encoder (2021.findings-acl)
Copied to clipboard
| Challenge: | Recent work has shown that models can be easily fooled by intentionally designed adversarial examples. |
| Approach: | They propose two efficient approaches for generating adversarial perturbations on embeddings and propose two new approaches to help model learn adversarials more efficiently. |
| Outcome: | The proposed approaches outperform strong baselines on various text classification datasets and the model's performance drops less under adversarial attack. |
Adversarial Training for Satire Detection: Controlling for Confounding Variables (N19-1)
Copied to clipboard
| Challenge: | Existing methods for satire detection focus on satirical news based on article sources . satiric news are written with the aim of mimicking regular news in diction . |
| Approach: | They propose a model for satire detection with an adversarial component to control for the confounding variable of publication source. |
| Outcome: | The proposed model improves generalization performance to unseen publications with an adversarial component. |
How to Solve Few-Shot Abusive Content Detection Using the Data We Actually Have (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing datasets for abusive language detection are expensive and lack of knowledge about the target is a challenge. |
| Approach: | They propose to build models cheaply for a new target label set and/or language, using only a few training examples of the target domain. |
| Outcome: | The proposed model improves monolingually and across languages using existing datasets and only a few-shots of the target domain. |
Adversarial Training for Weakly Supervised Event Detection (N19-1)
Copied to clipboard
| Challenge: | Detecting and identifying events is an important subtask of event extraction. |
| Approach: | They build a large event-related candidate set with good coverage and apply an adversarial training mechanism to iteratively identify informative instances from the candidate set and filter out those noisy ones. |
| Outcome: | The proposed method significantly outperforms the state-of-the-art methods on two real-world datasets. |
Striking Gold in Advertising: Standardization and Exploration of Ad Text Generation (2024.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks and problem sets for automatic ad text generation are lacking . however, the growing volume of search queries has fueled research on the automatic generation of ads. |
| Approach: | They propose to standardize the task of automatic ad text generation (ATG) using a benchmark dataset, CAMERA, to enable the utilization of multi-modal information and facilitate industry-wise evaluations. |
| Outcome: | The proposed dataset standardizes the task of automatic ad text generation (ATG) it shows that existing metrics align with human evaluations and that the proposed methods can be used to improve the quality of the results. |
The Promises and Pitfalls of LLM Annotations in Dataset Labeling: a Case Study on Media Bias Detection (2025.findings-naacl)
Copied to clipboard
Tomáš Horych, Christoph Mandl, Terry Ruas, Andre Greiner-Petter, Bela Gipp, Akiko Aizawa, Timo Spinde
| Challenge: | Recent research suggests using Large Language Models (LLMs) to automate the annotation process, reducing these costs while maintaining data quality. |
| Approach: | They propose to use Large Language Models to automate annotation process and train classifiers on large datasets. |
| Outcome: | The proposed model outperforms all of the annotator LLMs on two media bias benchmark datasets (BABE and BASIL) while maintaining data quality. |