Papers by Jiawen Deng
InstructSafety: A Unified Framework for Building Multidimensional and Explainable Safety Detector through Instruction Tuning (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing safety detection systems have limitations in terms of their versatility and interpretability. |
| Approach: | They introduce a safety detection framework that unifies 7 common sub-tasks into a uniform formulation and process 39 human-annotated datasets for instruction tuning. |
| Outcome: | The proposed framework unifies 7 common sub-tasks into a uniform formulation and then runs on 39 human-annotated datasets to fine-tune it. |
Beyond Explicit Refusals: Soft-Failure Attacks on Retrieval-Augmented Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing jamming attacks on RAG systems typically induce explicit refusals or denial-of-service behaviors. |
| Approach: | They propose a black-box attack framework that exploits safety-aligned behaviors of large language models to trigger soft failures. |
| Outcome: | The proposed framework exploits safety-aligned behaviors of large language models to induce soft failures. |
Constructing Highly Inductive Contexts for Dialogue Safety through Controllable Reverse Generation (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to detect toxic generation of pretrained language models rely on templates, data extraction, crowdsourcing workers or automatic generation. |
| Approach: | They propose a method to construct adversarial contexts conditioned on a given response . they augment existing dataset BAD+ and construct a new dataset B AD+ . |
| Outcome: | The proposed method can detect toxic or biased content in large pretrained language models. |
On the Safety of Conversational Models: Taxonomy, Dataset, and Benchmark (2022.findings-acl)
Copied to clipboard
Hao Sun, Guangxuan Xu, Jiawen Deng, Jiale Cheng, Chujie Zheng, Hao Zhou, Nanyun Peng, Xiaoyan Zhu, Minlie Huang
| Challenge: | Dialogue safety problems severely limit the real-world deployment of generative conversational models. |
| Approach: | They propose a taxonomy for dialogue safety specifically designed to capture unsafe behaviors in human-bot dialogue settings. |
| Outcome: | The proposed taxonomy captures unsafe behaviors in human-bot dialogue settings with rich context-sensitive unsafe examples. |
Depression Detection in Clinical Interviews with LLM-Empowered Structural Element Graph (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing methods for assessing depression only capture part of relevant elements . scarcity of participant data constrains interview modeling due to privacy concerns . |
| Approach: | They propose a structural element graph (SEGA) that transforms clinical interviews into an expertise-inspired directed acyclic graph for comprehensive modeling. |
| Outcome: | The proposed model outperforms baseline methods and powerful LLMs on two real-world clinical datasets. |
Towards Identifying Social Bias in Dialog Systems: Framework, Dataset, and Benchmark (2022.findings-emnlp)
Copied to clipboard
Jingyan Zhou, Jiawen Deng, Fei Mi, Yitong Li, Yasheng Wang, Minlie Huang, Xin Jiang, Qun Liu, Helen Meng
| Challenge: | a number of safety concerns hinder the deployment of open-domain dialog systems, such as offensive languages and toxic behaviors, such social bias is difficult to detect. |
| Approach: | They propose a Dial-Bias Framework for analyzing social bias in conversations . they introduce a Chinese social bias dialog dataset and conduct in-depth ablation studies . |
| Outcome: | The proposed framework is the first annotated Chinese social bias dialog dataset . the proposed framework also provides a fine-grained dialog bias measurement benchmark . |
EthicMind: A Risk-Aware Framework for Ethical-Emotional Alignment in Multi-Turn Dialogue (2026.acl-long)
Copied to clipboard
| Challenge: | Existing dialogue models address empathy and ethical safety in isolation . Existing models fail to adapt their behavior as ethical risk and user emotion evolve . |
| Approach: | They propose a risk-aware framework that integrates ethical-emotional alignment in dialogue as an explicit turn-level decision problem. |
| Outcome: | The proposed framework achieves more consistent ethical guidance and emotional engagement than baselines in ethically complex interactions. |
ECC: An Emotion-Cause Conversation Dataset for Empathy Response (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing empathy dialogue datasets focus on emotion labels while cause annotations are added post hoc. |
| Approach: | They propose an emotion-cause conversation dataset with 2.4K dialogues that can be scalable . they use a framework that utilizes knowledge and large language models to automatically generate dialogues . |
| Outcome: | The proposed dataset can achieve comparable or even superior performance to existing empathy dialogue datasets. |
COLD: A Benchmark for Chinese Offensive Language Detection (2022.emnlp-main)
Copied to clipboard
| Challenge: | Offensive language detection is crucial for maintaining a civilized social media platform and deploying pre-trained language models. |
| Approach: | They propose a benchmark benchmark for Chinese offensive language analysis including a Chinese Offensive Language Dataset and a baseline detector which is trained on the dataset. |
| Outcome: | The proposed benchmark contributes to Chinese offensive language detection which is challenging for existing resources. |