Papers by Zisu Huang

3 papers
SATER: A Self-Aware and Token-Efficient Approach to Routing and Cascading (2025.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) demonstrate remarkable performance across diverse tasks, yet their effectiveness often depends on costly commercial APIs or cloud services.
Approach: They propose a dual-mode compatible approach that fine-tunes models through shortest-response preference optimization and a confidence-aware rejection mechanism.
Outcome: The proposed approach reduces redundant outputs and response times while reducing computational costs by over 50% and cascade latency by over 80%.
Enhancing Model Privacy in Federated Learning with Random Masking and Quantization (2025.findings-emnlp)

Copied to clipboard

Challenge: federated learning approaches are limited by the complexity of large language models and the need for specialized expertise to protect intellectual property.
Approach: They propose a federated learning approach that leverages random masking to obscure a subnetwork of model parameters and applies quantization to the remaining parameters.
Outcome: The proposed approach maintains strong model performance in federated learning settings and achieves enhanced protection of model parameters compared to baseline methods.
Controllable Memory Usage: Balancing Anchoring and Innovation in Long-Term Human–Agent Interaction (2026.acl-long)

Copied to clipboard

Challenge: Existing systems that use memory as an "all-or-nothing" approach to memory usage are often static and rely on experience-following tendencies.
Approach: They propose a framework that allows users to dynamically regulate memory reliance by adding context into the model's prompt.
Outcome: The proposed model outperforms prompting and memory masking strategies in multiple scenarios.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations