Enhancing User Safety: Context-Aware Detection of Offensive Query-Ad Pairs in Multimodal Search Advertising (2026.eacl-industry)
Copied to clipboard
Gaurav Kumar, Qiangjian Xi, Tanmaya Shekhar Dabral, Hooshang Ghasemi, Abishek Krishnamoorthy, Danqing Fu, Rui Min, Emilio Antunez, Zhongli Ding, Pradyumna Narayana
| Challenge: | Multi-modal online advertisements require robust content moderation to ensure user safety . key challenges include nuanced, multi-modal nature of ads, severe data scarcity and class imbalance due to the rarity of offensive content . |
| Approach: | They propose a framework that detects offensive content only when a user's search query is paired with a specific ad . |
| Outcome: | The proposed framework reduces the serving of offensive query-ad pairs by more than 80% while maintaining the efficiency required for real-time advertising systems. |
Similar Papers
RAVEN++: Pinpointing Fine-Grained Violations in Advertisement Videos with Active Reinforcement Reasoning (2025.emnlp-industry)
Copied to clipboard
Deyi Ji, Yuekui Yang, Liqun Liu, Peng Shu, Haiyang Wu, Shaogang Tang, Xudong Chen, Shaoping Ma, Tianrun Chen, Lanyun Zhu
| Challenge: | Recent advances in large language models have improved the detection of non-compliant content, but critical gaps persist in fine-grained understanding, explainability, and generalization. |
| Approach: | They propose a framework that combines active reinforcement learning, fine-grained violation understanding and progressive multi-stage training. |
| Outcome: | The proposed framework outperforms general-purpose LLMs and specialized models in fine-grained violation understanding, explainability, and generalization. |
Beyond Static Benchmarks: Synthesizing Harmful Content via Persona-based Simulation for Robust Evaluation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing static benchmarks for harmful content detection face limitations in scalability and diversity. |
| Approach: | They propose a framework for synthesizing harmful content using persona-guided large language model agents. |
| Outcome: | The proposed framework achieves a high success rate in harmful generation tests across multiple detection systems. |
A Survey on Multimodal Disinformation Detection (2022.coling-1)
Copied to clipboard
Firoj Alam, Stefano Cresci, Tanmoy Chakraborty, Fabrizio Silvestri, Dimiter Dimitrov, Giovanni Da San Martino, Shaden Shaar, Hamed Firooz, Preslav Nakov
| Challenge: | Recent years have witnessed the proliferation of offensive content online such as fake news, propaganda, misinformation, and disinformation. |
| Approach: | They propose to tackle online multimodal offensive content using different modalities and combinations thereof. |
| Outcome: | The proposed approach combines factuality and harmfulness in a framework that can be used for multiple modalities and combinations of modality. |
RAVEN: Robust Advertisement Video Violation Temporal Grounding via Reinforcement Reasoning (2025.acl-industry)
Copied to clipboard
| Challenge: | Existing methods for detecting ads video violations lack precise temporal grounding, noisy annotations, and limited generalization. |
| Approach: | They propose a framework that integrates curriculum reinforcement learning with large language models to enhance reasoning and cognitive capabilities for violation detection. |
| Outcome: | The proposed framework achieves superior performance in violation category accuracy and temporal interval localization. |
Thesis Proposal: An Explainable Multimodal Framework for Detecting Harmful Content in Code-Switched Children’s Media (2026.acl-srw)
Copied to clipboard
| Challenge: | Current content moderation systems fail to protect children from harmful content, especially in under-resourced, code-switched settings. |
| Approach: | They propose to integrate a fine-tuned classifier with an LLM-powered module that synthesizes the classifier’s internal evidential signals to generate faithful, human-readable rationales for each decision. |
| Outcome: | The proposed framework integrates a fine-tuned classifier for accurate, scalable detection with an LLM-powered module that synthesizes the classifier’s internal evidential signals to generate faithful, human-readable rationales for each decision. |
Revealing the Truth with ConLLM for Detecting Multi-Modal Deepfakes (2026.findings-eacl)
Copied to clipboard
Gautam Siddharth Kashyap, Harsh Joshi, Niharika Jain, Ebad Shabbir, Jiechao Gao, Nipun Joshi, Usman Naseem
| Challenge: | Existing methods for deepfake detection suffer from two limitations: modality fragmentation and shallow inter-modal reasoning. |
| Approach: | They propose a framework for multimodal deepfake detection that uses contrastive learning and large language models to mitigate modality fragmentation and refine embeddings to address shallow inter-modal reasoning. |
| Outcome: | ConLLM reduces audio deepfake EER by 50%, improves video accuracy by 8%, and achieves approximately 9% accuracy gains in audio-visual tasks. |
Learning from LLM Agents: In-Context Generative Models for Text Casing in E-Commerce Ads (2025.emnlp-industry)
Copied to clipboard
| Challenge: | Existing NER-based transformer models are expensive and lack contextual dependencies, making them less reliable when handling unseen or ad-specific terms, e.g., brand names. |
| Approach: | They propose a two-stage approach to casing correction in e-commerce ad content that leverages Chain-of-Actions to enforce content policies while accurately handling ads-specific terms. |
| Outcome: | The proposed model outperforms existing NER-based models and achieves near-LLM performance at a fraction of the cost. |
ℛ3: Advertisement Compliance ℛectification via Group-ℛelative Experience Extractor and Curriculum ℛeinforcement (2026.acl-industry)
Copied to clipboard
| Challenge: | Existing methods of content moderation are infeasible due to over-editing and compromise the advertiser’s original semantic intent. |
| Approach: | They propose a framework to harmonize compliance with original intent preservation that integrates a data-driven framework and a curriculum to enforce compliance while maximizing semantic consistency. |
| Outcome: | The proposed framework outperforms state-of-the-art baselines on industrial datasets and on online A/B testing on industrial video. |
Rethinking Offensive Text Detection as a Multi-Hop Reasoning Problem (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing methods of offensive text detection perform poorly when asked to detect implicitly offensive statements . a dataset based on SLIGHT provides a framework for implicit offensive text identification . |
| Approach: | They propose a dataset to support the task of implicit offensive text detection in dialogues . they show that reasoning is crucial for understanding this broader class of offensive utterances - SLIGHT . |
| Outcome: | The proposed model achieves 11% accuracy in implicit offensive text detection tasks . the proposed model can be used to identify toxic speech in specific domains . |
HyperHatePrompt: A Hypergraph-based Prompting Fusion Model for Multimodal Hate Detection (2025.coling-main)
Copied to clipboard
| Challenge: | Existing models for multimodal hate detection lack implicit hateful cues, cross-modal-induced hate, and diversity of hate target groups. |
| Approach: | They propose a hypergraph-based prompting fusion model that uses LLMs to generate hate cue prompts and hypergraph learning to merge multimodal hate features. |
| Outcome: | The proposed model outperforms state-of-the-art models on two benchmark datasets showing that it can detect hate content across multiple modalities. |