Papers by Ping Cheng
HATA: Trainable and Hardware-Efficient Hash-Aware Top-k Attention for Scalable Large Model Inference (2025.findings-acl)
Copied to clipboard
Ping Gong, Jiawei Yi, Shengnan Wang, Juncheng Zhang, Zewen Jin, Ouxiang Zhou, Ruibo Liu, Guanbin Xu, Youhui Bai, Bowen Ye, Kun Yuan, Tong Yang, Gong Zhang, Renhai Chen, Feng Wu, Cheng Li
| Challenge: | Existing top-k attention methods struggle to strike a balance between efficiency and accuracy. |
| Approach: | They propose a top-k attention approach that integrates low-overhead techniques into the Top-k Attention process to achieve 7.2 speedup compared to vanilla full attention. |
| Outcome: | The proposed approach achieves 7.2 speedup compared to current top-k attention methods while maintaining model accuracy. |
Hephaestus: Improving Fundamental Agent Capabilities of Large Language Models through Continual Pre-Training (2025.naacl-long)
Copied to clipboard
Yuchen Zhuang, Jingfeng Yang, Haoming Jiang, Xin Liu, Kewei Cheng, Sanket Lokegaonkar, Yifan Gao, Qing Ping, Tianyi Liu, Binxuan Huang, Zheng Li, Zhengyang Wang, Pei Chen, Ruijie Wang, Rongzhi Zhang, Nasser Zalmout, Priyanka Nigam, Bing Yin, Chao Zhang
| Challenge: | Existing LLMs often rely on complex prompting or extensive fine-tuning to introduce new capabilities while preserving strong generalizability. |
| Approach: | They propose a large-scale pre-training corpus to enhance LLM agents' capabilities . they use 103B agent-specific data encompassing 76,537 APIs . |
| Outcome: | The proposed training corpus outperforms open-source LLMs and commercial LLM agents on three agent benchmarks. |
Joint Learning from Labeled and Unlabeled Data for Information Retrieval (C18-1)
Copied to clipboard
| Challenge: | Recent studies have focused on neural information retrieval (IR) models. |
| Approach: | They propose a framework which can benefit from both labeled and more abundant unlabeled data . they propose supervised retrieval over several strong baselines for IR . |
| Outcome: | The proposed framework can benefit from labeled and more abundant unlabeled data for representation learning in the context of IR. |
Learning Neural Representation for CLIR with Adversarial Framework (D18-1)
Copied to clipboard
| Challenge: | Existing studies in cross-language information retrieval (CLIR) use general text representation models that are not optimized for the target task. |
| Approach: | They propose a novel text representation model based on adversarial learning which seeks a task-specific embedding space for CLIR. |
| Outcome: | The proposed model outperforms state-of-the-art continuous space models and is better than the strong machine translation baseline. |