Papers by Ze Lu
ChunkAttention: Efficient Self-Attention with Prefix-Aware KV Cache and Two-Phase Partition (2024.acl-long)
Copied to clipboard
| Challenge: | Experiments show that ChunkAttention can speed up the self-attention kernel by 3.2-4.8 compared to the start-of-the-art implementation. |
| Approach: | They propose a prefix-aware self-attention module that can detect matching prompt prefixes across multiple requests and share their key/value tensors in memory at runtime. |
| Outcome: | The proposed module can speed up the self-attention kernel by 3.2-4.8 compared to the start-of-the-art implementation, with the length of the system prompt ranging from 1024 to 4096. |
FlexGuard: Continuous Risk Scoring for Strictness-Adaptive LLM Content Moderation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing guardrail models for content moderation assume a fixed definition of harmfulness, but enforced strictness varies across platforms and evolves over time, resulting in brittle moderators. |
| Approach: | They propose a strictness-adaptive LLM moderation benchmark that enables controlled evaluation under multiple strictness regimes. |
| Outcome: | The proposed moderator performs better under one regime and under another, and is more robust under varying strictness. |
JobFair: A Framework for Benchmarking Gender Hiring Bias in Large Language Models (2024.findings-emnlp)
Copied to clipboard
Ze Wang, Zekun Wu, Xin Guan, Michael Thaler, Adriano Koshiyama, Skylar Lu, Sachin Beepath, Ediz Ertekin, Maria Perez-Ortiz
| Challenge: | a framework for benchmarking hierarchical gender hiring bias in Large Language Models (LLMs) is developed to protect vulnerable demographic groups. |
| Approach: | They propose a framework for benchmarking hierarchical gender hiring bias in Large Language Models for resume scoring. |
| Outcome: | The proposed framework reveals significant issues of reverse gender hiring bias and overdebiasing in ten state-of-the-art LLMs. |