Papers by Yongheng Deng
ConCISE: Confidence-guided Compression in Step-by-step Efficient Reasoning (2025.emnlp-main)
Copied to clipboard
Ziqing Qiao, Yongheng Deng, Jiali Zeng, Dong Wang, Lai Wei, Guanbo Wang, Fandong Meng, Jie Zhou, Ju Ren, Yaoxue Zhang
| Challenge: | Existing methods for fine-tuning-based compression suffer from verbose outputs, increasing computational overhead. |
| Approach: | They propose a framework to generate concise reasoning chains using Confidence Injection and Early Stopping. |
| Outcome: | The proposed framework reduces the length of the model by up to 50% while maintaining high task accuracy. |
CoTrust: Privacy-Preserving Collaboration Between Large and Small Language Models in Trusted Execution Environments (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) provide powerful text generation capabilities, but accessing sensitive user inputs raises privacy concerns. |
| Approach: | They propose a privacy-preserving collaborative inference framework that combines large language models with small language models inside TEE to preserve privacy. |
| Outcome: | Experiments show that CoTrust outperforms unconstrained LLMs on multiple question answering and summarization benchmarks while maintaining strong privacy protection. |