Papers by Shengnan Wang
HATA: Trainable and Hardware-Efficient Hash-Aware Top-k Attention for Scalable Large Model Inference (2025.findings-acl)
Copied to clipboard
Ping Gong, Jiawei Yi, Shengnan Wang, Juncheng Zhang, Zewen Jin, Ouxiang Zhou, Ruibo Liu, Guanbin Xu, Youhui Bai, Bowen Ye, Kun Yuan, Tong Yang, Gong Zhang, Renhai Chen, Feng Wu, Cheng Li
| Challenge: | Existing top-k attention methods struggle to strike a balance between efficiency and accuracy. |
| Approach: | They propose a top-k attention approach that integrates low-overhead techniques into the Top-k Attention process to achieve 7.2 speedup compared to vanilla full attention. |
| Outcome: | The proposed approach achieves 7.2 speedup compared to current top-k attention methods while maintaining model accuracy. |
AMO-Bench: Large Language Models Still Struggle in High School Math Competitions (2026.findings-acl)
Copied to clipboard
Junlin Liu, Shengnan An, Shuang Zhou, Dan Ma, Yehao Lin, Xinxuan Lv, Xuanlin Wang, Xiaoyu Li, Ziwen Wang, Xuezhi Cao, Xunliang Cai
| Challenge: | Existing benchmarks for mathematical reasoning are becoming less effective due to performance saturation. |
| Approach: | They propose to use a mathematical reasoning benchmark with Olympiad difficulty to evaluate top-tier LLMs. |
| Outcome: | The proposed benchmarks are cross-validated by experts to meet IMO difficulty standards and entirely original problems to prevent performance leakages from data memorization. |
SAMoRA: Semantic-Aware Mixture of LoRA Experts for Task-Adaptive Learning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for multitask learning fail to match input semantics with expert capabilities, leading to weak expert specialization. |
| Approach: | They propose a parameter-efficient mixture-of-experts framework for task-adaptive learning that aligns textual semantics with the most suitable experts for precise routing. |
| Outcome: | The proposed framework outperforms the state-of-the-art methods and holds excellent task generalization capabilities. |
STAND-Guard: A Small Task-Adaptive Content Moderation Model (2025.coling-industry)
Copied to clipboard
| Challenge: | Content moderation is important for developing welcoming online platforms and responsible large language models. |
| Approach: | They propose a small task-adaptive coNtent moDeration model that can be easily adapted to new or customized content moderation tasks without extensive model tuning. |
| Outcome: | The proposed model is comparable to GPT-3.5-Turbo on unseen English binary classification tasks. |