Papers by Zhenyu Zhong

5 papers
FunnelRAG: A Coarse-to-Fine Progressive Retrieval Paradigm for RAG (2025.findings-naacl)

Copied to clipboard

Challenge: Retrieval-Augmented Generation (RAG) is widely adopted in Large Language Models, but is flat and has limitations such as a significant burden on one retriever and constant granularity limits the ceiling of retrieval performance.
Approach: They propose a progressive retrieval paradigm with coarse-to-fine granularity for RAG, termed FunnelRAG, so as to balance effectiveness and efficiency.
Outcome: The proposed paradigm achieves comparable retrieval performance while the time overhead is reduced by nearly 40%.
“I’ve Decided to Leak”: Probing Internals Behind Prompt Leakage Intents (2025.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) exhibit prompt leakage vulnerabilities, raising intellectual property and confidentiality concerns.
Approach: They use probing techniques to capture LLMs’ intent-related internal representations and show that they internalize prompt leakage intents in their hidden states before generating tokens.
Outcome: The proposed probes achieve 90%+ AUROC across all tested models, even when applied to new system prompts and attacks.
REST: Retrieval-Based Speculative Decoding (2024.naacl-long)

Copied to clipboard

Challenge: Retrieval-based speculative decoding (REST) is a new language model generation algorithm . it uses existing knowledge to generate draft tokens, allowing for seamless integration and acceleration of any language model.
Approach: They propose a new algorithm that uses a draft language model to generate tokens from existing knowledge.
Outcome: The proposed method achieves a speedup of 1.62 to 2.36 on code or text generation.
SWE-Swiss: A Multi-Task Fine-Tuning and RL Recipe for High-Performance Issue Resolution (2026.findings-acl)

Copied to clipboard

Challenge: SWE-Swiss-32B demonstrates strong generalization to other common LLM benchmarks.
Approach: They propose a two-phase training recipe that decomposes issue resolution into three core skills: Localization, Repair, and Unit Test Generation.
Outcome: The proposed model achieves a 60.2% score on the SWE-bench Verified benchmark and is in the top-tier performance bracket of much larger models.
Revisiting the Reliability of Language Models in Instruction-Following (2026.acl-long)

Copied to clipboard

Challenge: Several benchmarks have been proposed to measure instruction-following accuracy, but these scores do not translate to reliable services in real-world use.
Approach: They propose a new metric reliable@k and develop an automated pipeline to generate cousin prompts.
Outcome: The proposed model can be instantiated with cousin prompts and generates high-quality cousin prompt data.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations