Papers by Guanghao Li
DiffuSpec: Unlocking Diffusion Language Models for Speculative Decoding (2026.findings-acl)
Copied to clipboard
| Challenge: | Autoregressive (AR) decoding in large language models is latency-bounded by strictly sequential token generation. |
| Approach: | They propose a diffusion-based drafter that proposes multi-token candidates and then verifies them in parallel by the target model. |
| Outcome: | The proposed drafter generates multi-token proposals in a single forward pass while remaining compatible with standard AR verifiers. |
Efficient Transformer Parameter Reuse via Zero-Token Mechanism (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to scaling up parameter counts are impractical for users with limited computational resources. |
| Approach: | They propose a decoupled parameter cycling strategy that employs a head-tail decoupling strategy to decouple the first (head) and last (tail) layers from the parameter cycling process. |
| Outcome: | The proposed approach achieves superior performance under strict parameter constraints and significantly reduces computational overhead via early exits. |
LSSF: Safety Alignment for Large Language Models through Low-Rank Safety Subspace Fusion (2025.acl-long)
Copied to clipboard
| Challenge: | Existing safety alignment methods rely on fine-tuning, which inadvertently leads to the increased complexity and computational resources required. |
| Approach: | They propose a safety re-alignment framework with Low-Rank Safety Subspace Fusison that exploits low-rank safety characteristics of LLMs by constructing a low-ranked projection matrix to extract the principal components of safety vectors. |
| Outcome: | The proposed method exploits low-rank safety subspace of the LLMs and is stable during fine-tuning process and is isolated from the model’s general capabilities. |