Papers by Jiaping Wang
Consultant Decoding: Yet Another Synergistic Mechanism (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have attracted widespread attention and adoption across diverse domains due to their exceptional performance and robust generalization abilities. |
| Approach: | They propose a synergetic mechanism for Consultant Decoding (CD) that achieves a 2.5-fold increase in inference speed compared to the target model while maintaining comparable generation quality. |
| Outcome: | The proposed mechanism achieves 2.5-fold increase in inference speed while maintaining comparable generation quality (100% of the target model’s performance). |
On the (In-)Security of the Shuffling Defense in the Transformer Secure Inference (2026.acl-long)
Copied to clipboard
| Challenge: | Existing work reveals only randomly permuted activations to the client, allowing adversaries to extract model weights. |
| Approach: | They propose an attack that aligns differently shuffled activations to a common permutation and exploits them to extract model weights. |
| Outcome: | The proposed attack can align shuffled activations to a common permutation and exploit them to extract model weights with a query cost of approximately $1. |
UCTG: A Unified Controllable Text Generation Framework for Query Auto-Completion (2025.coling-industry)
Copied to clipboard
| Challenge: | Existing approaches to control text generation (CTG) are essentially challenging to adapt to various control objectives and constraints, which results in mixed success. |
| Approach: | They propose a unified controllable text generation framework which integrates a control module, a prompt module, and a generation module. |
| Outcome: | The proposed framework significantly improves query accuracy and coherence in tasks with different objectives and constraints. |