MolSafeEval: A Benchmark for Uncovering Safety Risks in AI-Generated Molecules (2026.findings-acl)
Copied to clipboard
| Challenge: | generative models may produce molecules with toxic, reactive, or otherwise hazardous characteristics. |
| Approach: | They propose a benchmark to evaluate and analyze the safety risks of molecular generation. |
| Outcome: | The proposed benchmark aims to evaluate and analyze the safety risks of molecular generation. |
Similar Papers
ChemReason-Bench: Benchmarking Large Language Models for Procedural Reasoning in Experimental Chemistry (2026.acl-long)
Copied to clipboard
| Challenge: | Experimental protocols in organic synthesis specify not only the intended transformation, but also an executable sequence of operations and conditions. |
| Approach: | They propose a human-validated benchmark for verifiable experimental procedure reasoning . they instantiate 7306 benchmark tasks across six complementary formats . |
| Outcome: | The proposed benchmarks show that the evaluations are less diagnostic of procedure-level decision making. |
Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable Survey (2023.eacl-main)
Copied to clipboard
| Challenge: | Recent advances in the capacity of large language models to generate human-like text have prompted a heated discourse around the risks of societal harms they introduce. |
| Approach: | They propose a taxonomy of interventions organized around the different phases where they can be adopted to mitigate harms. |
| Outcome: | The proposed methods are based on several prior works’ taxonomies of language model risks and provide an overview of strategies for detecting and ameliorating different kinds of risks/harms. |
ToxiCraft: A Novel Framework for Synthetic Generation of Harmful Information (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models for detecting harmful content lack diversity and quality of datasets. |
| Approach: | They propose a framework for synthesizing toxic information from social media datasets . their framework generates a wide variety of synthetic, yet remarkably realistic, examples of toxic information . |
| Outcome: | The proposed framework can generate a wide variety of synthetic, yet remarkably realistic, examples of toxic information. |
Beyond Static Benchmarks: Synthesizing Harmful Content via Persona-based Simulation for Robust Evaluation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing static benchmarks for harmful content detection face limitations in scalability and diversity. |
| Approach: | They propose a framework for synthesizing harmful content using persona-guided large language model agents. |
| Outcome: | The proposed framework achieves a high success rate in harmful generation tests across multiple detection systems. |
SafeScientist: Enhancing AI Scientist Safety for Risk-Aware Scientific Discovery (2025.emnlp-main)
Copied to clipboard
Kunlun Zhu, Jiaxun Zhang, Ziheng Qi, Nuoxing Shang, Zijia Liu, Peixuan Han, Yue Su, Haofei Yu, Jiaxuan You
| Challenge: | Recent advances in large language model (LLM) agents have significantly accelerated scientific discovery automation, yet raised critical ethical and safety concerns. |
| Approach: | They propose a framework to enhance safety and ethical responsibility in AI-driven scientific exploration. |
| Outcome: | The proposed framework significantly improves safety performance by 35% compared to traditional frameworks. |
Enhancing Safe and Controllable Protein Generation via Knowledge Preference Optimization (2025.acl-long)
Copied to clipboard
| Challenge: | Protein language models pose significant risks of generating harmful sequences, e.g., viral transmissibility, drug resistance, environmental imbalances, public health crises, etc. |
| Approach: | They propose a protein-based model that integrates prior knowledge via a Protein Safety Knowledge Graph to minimize the risk of generating harmful sequences. |
| Outcome: | The proposed framework reduces the likelihood of producing hazardous sequences while maintaining high functionality. |
AEGIS2.0: A Diverse AI Safety Dataset and Risks Taxonomy for Alignment of LLM Guardrails (2025.naacl-long)
Copied to clipboard
Shaona Ghosh, Prasoon Varshney, Makesh Narsimhan Sreedhar, Aishwarya Padmakumar, Traian Rebedea, Jibin Rajan Varghese, Christopher Parisien
| Challenge: | Existing safety-related content safety models are not well-suited for commercial use. |
| Approach: | They propose a taxonomy that can be used to categorize safety risks . it combines human annotations with a multi-LLM "jury" system to assess safety . they plan to open-source Aegis2.0 data and models to aid in safety guardrailing . |
| Outcome: | The proposed taxonomy can be used to assess the safety of human-LLM interactions . it can be trained on large, non-commercial datasets and is open-source . |
The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Models (2025.naacl-long)
Copied to clipboard
Seungone Kim, Juyoung Suk, Ji Yong Cho, Shayne Longpre, Chaeeun Kim, Dongkeun Yoon, Guijin Son, Yejin Cho, Sheikh Shafayat, Jinheon Baek, Sue Hyun Park, Hyeonbin Hwang, Jinkyung Jo, Hyowon Cho, Haebin Shin, Seongyun Lee, Hanseok Oh, Noah Lee, Namgyu Ho, Se June Joo, Miyoung Ko, Yoonjoo Lee, Hyungjoo Chae, Jamin Shin, Joel Jang, Seonghyeon Ye, Bill Yuchen Lin, Sean Welleck, Graham Neubig, Moontae Lee, Kyungjae Lee, Minjoon Seo
| Challenge: | a recent study evaluated language models using abstract evaluation criteria that lack the flexibility and granularity of human assessment. |
| Approach: | They propose a benchmark to evaluate nine distinct language models' capabilities . they use instance-specific evaluation criteria to mirror human evaluation . |
| Outcome: | The proposed benchmark evaluates nine distinct capabilities of language models across 77 tasks. |
AIGuard: A Benchmark and Lightweight Detection for E-commerce AIGC Risks (2025.findings-acl)
Copied to clipboard
Wenhua Zhang, Weicheng Li, Xuanrong Rao, Lixin Zou, Xiangyang Luo, Chubin Zhuang, Yongjie Hong, Zhen Qin, Hengyu Chang, Chenliang Li, Bo Zheng
| Challenge: | Existing detection methods lack real-world scenarios and corresponding risk datasets . current MLLMs lack knowledge and have limited capability to detect the risk of AIGC content. |
| Approach: | They propose a benchmark for AIGC risk detection in real-world e-commerce . it includes 253,420 image-text pairs across four critical categories . |
| Outcome: | The proposed method achieves 9.68% higher recall than leading multimodal models while using only 25% of training resources. |
RubricBench: Aligning Model-Generated Rubrics with Human Standards (2026.acl-long)
Copied to clipboard
Junyi Zhou, Qiyuan Zhang, Yufei Wang, Fuyuan Lyu, Yidong Ming, Can Xu, Qingfeng Sun, Kai Zheng, Peng Kang, Xue Liu, Chen Ma
| Challenge: | Existing benchmarks lack discriminative complexity and ground-truth rubric annotations required for rigorous evaluation. |
| Approach: | They propose a curated benchmark with 1,147 pairwise comparisons to assess the reliability of rubric-based evaluation. |
| Outcome: | The proposed benchmarks show that they support diverse domains, exhibit discriminative ability, provide high-quality annotations, and include human-authored rubrics. |