Papers by Zhengwu Liu
Locate, Steer, and Improve: A Practical Survey of Actionable Mechanistic Interpretability in Large Language Models (2026.findings-acl)
Copied to clipboard
Hengyuan Zhang, Zhihao Zhang, Ercong Nie, Mingyang Wang, Zunhai Su, Yiwei Wang, Qianli Wang, Shuzhou Yuan, Xufeng Duan, Qibo Xue, Zeping Yu, Chenming Shang, Xiao Liang, Jing Xiong, Hui Shen, Chaofan Tao, Zhengwu Liu, Senjie Jin, Zhiheng Xi, Dongdong Zhang, Sophia Ananiadou, Tao Gui, Ruobing Xie, Hayden Kwok-Hay So, Hinrich Schuetze, Xuanjing Huang, Qi Zhang, Ngai Wong
| Challenge: | Existing literature on mechanistic interpretation (MI) treats it as an observational science, leaving practical applications underexplored. |
| Approach: | They propose a survey structured around the pipeline to identify and improve MI models. |
| Outcome: | The proposed framework enables tangible improvements in Alignment, Capability, and Efficiency. |
Conflicts Make Large Reasoning Models Vulnerable to Attacks (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Reasoning Models have demonstrated outstanding capabilities in solving complex reasoning tasks by incorporating step-by-step chain-of-thought (CoT) reasoning. |
| Approach: | They evaluate three large reasoning models that perform explicit and coherent reasoning under conflicting objectives and use them to evaluate their performance. |
| Outcome: | The proposed models perform explicit and coherent reasoning before producing their outputs, improving problem-solving and multi-step decision making. |
Exploring Layer-wise Information Effectiveness for Post-Training Quantization in Small Language Models (2026.findings-acl)
Copied to clipboard
He Xiao, Qingyao Yang, Dirui Xie, Wendong XU, Zunhai Su, Runming Yang, Haobo Liu, Wenyong Zhou, Zhengwu Liu, Ngai Wong
| Challenge: | Large language models with billions of parameters are often over-provisioned . smaller models exhibit lower robustness under extreme low-bit quantization . |
| Approach: | They propose a hardware-native, metric-driven post-training quantization framework that keeps uniform bit-width within each layer while mixing precision across layers. |
| Outcome: | LieQ reduces large accuracy gap observed for large language models with billions of parameters while preserving standard multiplication kernels. |