| Challenge: | Lack of a standard benchmark for guardrail models poses significant evaluation issues . lack of standardized benchmark makes it hard to compare results across scientific publications. |
| Approach: | They propose a large-scale benchmark for guardrail models comprising 40 safety evaluation datasets. |
| Outcome: | The proposed model achieves competitive results without specific fine-tuning without the need for specific fine tuning. |
Similar Papers
On Guardrail Models’ Robustness to Mutations and Adversarial Attacks (2025.findings-emnlp)
Copied to clipboard
| Challenge: | generative AI systems providing unsafe information has raised significant concerns, emphasizing the need for safety guardrails. |
| Approach: | They propose to evaluate 15 state-of-the-art guardrail models to assess their robustness to input mutations and adversarial attacks designed to bypass models’ safety alignment. |
| Outcome: | The proposed models are robust to input mutations and adversarial attacks that bypass models’ safety alignment. |
LoRA-Guard: Parameter-Efficient Guardrail Adaptation for Content Moderation of Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing model-based guardrails have not been designed for resource-constrained computational portable devices such as mobile phones. |
| Approach: | They propose a parameter-efficient guardrail adaptation method that relies on knowledge sharing between LLMs and guardrail models to adapt to content moderation tasks. |
| Outcome: | The proposed method outperforms existing guardrail methods with lower parameter overhead and higher accuracy on the generative task. |
Peering Behind the Shield: Guardrail Identification in Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Identifying guardrails in conversational AI agents is critical for identifying malicious content . identifying guardrail components in black-box AI agents poses security challenges . |
| Approach: | They propose a method that leverages guard-specific adversarial prompts to detect guardrails in black-box AI agents. |
| Outcome: | The proposed method achieves perfect classification accuracy in multiple scenarios. |
AudioBench: A Universal Benchmark for Audio Large Language Models (2025.naacl-long)
Copied to clipboard
Bin Wang, Xunlong Zou, Geyu Lin, Shuo Sun, Zhuohan Liu, Wenyu Zhang, Zhengyuan Liu, AiTi Aw, Nancy F. Chen
| Challenge: | Existing evaluation regimes for audio large language models do not cover the breadth of their possible use cases. |
| Approach: | They propose to use AudioBench to evaluate audio large language models . they found that no single model excels consistently across all tasks . |
| Outcome: | The proposed evaluation targets speech understanding, audio scene understanding, and voice understanding (paralinguistic) . no single model excels consistently across all tasks, the paper found . |
SafeRoute: Adaptive Model Selection for Efficient and Accurate Safety Guardrails in Large Language Models (2025.findings-acl)
Copied to clipboard
Seanie Lee, Dong Bok Lee, Dominik Wagner, Minki Kang, Haebin Seong, Tobias Bocklet, Juho Lee, Sung Ju Hwang
| Challenge: | Deploying large language models (LLMs) requires robust safety guard models to detect and block harmful user prompts. |
| Approach: | They propose a binary router that selectively applies a larger safety guard model to the data that the router considers hard. |
| Outcome: | The proposed method outperforms baselines on multiple benchmark datasets on hard and hard examples. |
CodeGuard: Improving LLM Guardrails in CS Education (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large language models (LLMs) are increasingly embedded in Computer Science classrooms to automate code generation, feedback, and assessment. |
| Approach: | They propose a guardrail framework for educational AI systems that can handle unsafe and irrelevant prompts. |
| Outcome: | The proposed framework reduces potentially harmful or policy-violating code completions by 30-65% without degrading performance on legitimate educational tasks. |
Lightweight Safety Guardrails Using Fine-tuned BERT Embeddings (2025.coling-industry)
Copied to clipboard
| Challenge: | Existing approaches to filter out inappropriate user prompts or system outputs have been successful, but using fine-tuned LLMs as guardrails introduces increased latency and higher maintenance costs. |
| Approach: | They propose to fine-tune a lightweight architecture that reduces the model size from LlamaGuard’s 7 billion parameters to approximately 67 million parameters. |
| Outcome: | Sentence-BERT reduces the model size from 7 billion parameters to approximately 67 million while maintaining comparable performance on the AEGIS safety benchmark. |
SafeLawBench: Towards Safe Alignment of Large Language Models (2025.findings-acl)
Copied to clipboard
Chuxue Cao, Han Zhu, Jiaming Ji, Qichao Sun, Zhenghao Zhu, Wu Yinyu, Josef Dai, Yaodong Yang, Sirui Han, Yike Guo
| Challenge: | Recent studies indicate that large language models (LLMs) may exhibit risks, including threats to the protection of private data and the generation of hallucinations. |
| Approach: | They propose to evaluate LLMs from a legal perspective using the SafeLawBench benchmark. |
| Outcome: | The proposed framework categorizes safety risks into three levels based on legal standards and includes 24,860 multi-choice questions and 1,106 open-domain question-answering tasks. |
The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Models (2025.naacl-long)
Copied to clipboard
Seungone Kim, Juyoung Suk, Ji Yong Cho, Shayne Longpre, Chaeeun Kim, Dongkeun Yoon, Guijin Son, Yejin Cho, Sheikh Shafayat, Jinheon Baek, Sue Hyun Park, Hyeonbin Hwang, Jinkyung Jo, Hyowon Cho, Haebin Shin, Seongyun Lee, Hanseok Oh, Noah Lee, Namgyu Ho, Se June Joo, Miyoung Ko, Yoonjoo Lee, Hyungjoo Chae, Jamin Shin, Joel Jang, Seonghyeon Ye, Bill Yuchen Lin, Sean Welleck, Graham Neubig, Moontae Lee, Kyungjae Lee, Minjoon Seo
| Challenge: | a recent study evaluated language models using abstract evaluation criteria that lack the flexibility and granularity of human assessment. |
| Approach: | They propose a benchmark to evaluate nine distinct language models' capabilities . they use instance-specific evaluation criteria to mirror human evaluation . |
| Outcome: | The proposed benchmark evaluates nine distinct capabilities of language models across 77 tasks. |
RubricBench: Aligning Model-Generated Rubrics with Human Standards (2026.acl-long)
Copied to clipboard
Junyi Zhou, Qiyuan Zhang, Yufei Wang, Fuyuan Lyu, Yidong Ming, Can Xu, Qingfeng Sun, Kai Zheng, Peng Kang, Xue Liu, Chen Ma
| Challenge: | Existing benchmarks lack discriminative complexity and ground-truth rubric annotations required for rigorous evaluation. |
| Approach: | They propose a curated benchmark with 1,147 pairwise comparisons to assess the reliability of rubric-based evaluation. |
| Outcome: | The proposed benchmarks show that they support diverse domains, exhibit discriminative ability, provide high-quality annotations, and include human-authored rubrics. |