Papers by Zhenyi Shen
CODI: Compressing Chain-of-Thought into Continuous Space via Self-Distillation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Prior implicit CoT methods have underperformed in terms of efficiency and robustness by relying on natural language tokens for reasoning. |
| Approach: | They propose a training framework that compresses natural language CoT into continuous space by aligning hidden states of a designated token. |
| Outcome: | The proposed framework outperforms the existing state-of-the-art in 3.1x compression rate and 28.2% accuracy on GSM8k scale. |
Beyond Prompting: An Efficient Embedding Framework for Open-Domain Question Answering (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have recently pushed open-domain question answering (ODQA) to new heights. |
| Approach: | They propose an embedding-level framework that enhances both the retriever and the reader by reordering query representations via lightweight linear layers under an unsupervised contrastive learning objective. |
| Outcome: | The proposed framework outperforms baselines in accuracy and efficiency across three open-source LLMs, three retrieval methods, and four ODQA benchmarks. |