Papers by Yuchen Feng
Uncertainty-Aware Routing for Principled Alignment with MoE Dynamics (2026.acl-long)
Copied to clipboard
Yilong Chen, Junyuan Shang, Yuchen Feng, Zhenyu Zhang, Naibin Gu, Ziqi Wang, Tingwen Liu, Shuohuan Wang, Yu Sun, Hua Wu, Haifeng Wang
| Challenge: | Mixture-of-Experts (MoE) is a cornerstone for scaling LLMs, yet its training dynamics remain poorly understood, often leading to sub-optimal specialization. |
| Approach: | They propose to use Helmholtz Free Energy and Router Entropy to study the MoE lifecycle and identify a universal Three-Stage Phase Transition . |
| Outcome: | The proposed model reduces perplexity and improves expert distinctiveness, offering a principled path toward thermodynamically aligned computation. |
Improved Visual Story Generation with Adaptive Context Modeling (2023.findings-acl)
Copied to clipboard
| Challenge: | a recent work shows that diffusion models generate images of high resolution and semantic consistency to text prompts. |
| Approach: | They propose a method that uses adaptive context modeling to improve leading system . they evaluate their method on pororoSV and FlintstonesSV datasets . |
| Outcome: | The proposed method achieves state-of-the-art FID scores on pororo and Flintstones datasets. |
SAM3-I: Segment Anything with Instructions (2026.acl-long)
Copied to clipboard
Jingjing Li, Yue Feng, Yuchen Guo, Jincai Huang, Wei Ji, Qi Bi, Yongri Piao, Miao Zhang, Xiaoqi Zhao, Qiang Chen, Shihao Zou, Huchuan Lu, Li Cheng
| Challenge: | Existing methods for concept-level grounding and instruction-level reasoning use coarse representations and iterative mask filtering. |
| Approach: | They propose an instruction-following extension of the Segment Anything Model 3 family that unifies concept-level grounding and instruction-level reasoning within a single segmentation framework. |
| Outcome: | Experiments show that SAM3-I achieves appealing performance across referring and reasoning-based segmentation while maintaining its strong concept recall ability. |
DIVE into MoE: Diversity-Enhanced Reconstruction of Large Language Models from Dense into Mixture-of-Experts (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for reconstruction of large language models overlook diversity among experts, leading to potential redundancy. |
| Approach: | They propose a pruning-based expert reconstruction method that prunes a specific LLM and retrains it on routers, experts and normalization modules. |
| Outcome: | The proposed method outperforms pruning and MoE reconstruction methods on Llama-style models with open-source training corpora. |
UniCorn: Towards Self-Improving Unified Multimodal Models through Self-Generated Supervision (2026.acl-long)
Copied to clipboard
Zhen Fang, Ruiyan Han, XinYu Sun, Yuchen Ma, Ziheng Wang, Yu Zeng, Zehui Chen, Lin Chen, Wenxuan Huang, Wei-Jie Xu, Yi Cao, Feng Zhao
| Challenge: | Unified Multimodal Models have achieved remarkable success in cross-modal comprehension, but a gap persists in their ability to translate internal knowledge into faithful and controllable synthesis. |
| Approach: | They propose a self-improvement framework that partitions a single UMM into three collaborative roles: Proposer, Solver, and Judge. |
| Outcome: | The proposed framework improves on TIIF, DPG, CompBench and UniCycle benchmarks. |
Do LLMs Know and Understand Domain Conceptual Knowledge? (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Concept sememe tree is a hierarchical structure that represents lexical meaning by combining sememes and their relationships. |
| Approach: | They introduce a Neighbor Semantic Structure (NSS) and a Chain-of-Thought prompting method to evaluate the effectiveness of various Large Language Models (LLMs) in generating concept sememe trees. |
| Outcome: | The proposed method guides LLMs through an analysis of a term’s intrinsic core concepts, essential attributes, and semantic relationships, enabling the generation of concept sememe trees. |
PaSa: An LLM Agent for Comprehensive Academic Paper Search (2025.acl-long)
Copied to clipboard
| Challenge: | We introduce PaSa, an advanced Paper Search agent powered by large language models . despite being trained on synthetic data, PaSA outperforms existing baselines on RealScholarQuery . |
| Approach: | They introduce PaSa, an advanced Paper Search agent powered by large language models . they optimize PaSA using a synthetic dataset, AutoScholarQuery, which includes 35k fine-grained queries . |
| Outcome: | The paper analyzes the performance of a paper search agent using a synthetic dataset . it significantly outperforms existing benchmarks on RealScholarQuery . |
CARE-STaR: Constraint-aware Self-taught Reasoner (2025.findings-acl)
Copied to clipboard
Zhiliang Li, Bo Tang, Yijun Niu, Beihong Jin, Qiwen Shi, Yuchen Feng, Zhiyu Li, Jie Hu, Mingchuan Yang, Feiyu Xiong
| Challenge: | Recent research on instruction following has demonstrated that LLMs can handle complex instructions. |
| Approach: | They propose to assign constraints to different levels of constraints in instructions . they use chain-of-thought and self-taught reasoner methods to identify constraints . |
| Outcome: | The proposed method outperforms supervised fine-tuning (SFT) on three instruction-following benchmarks. |
CBP-Tuning: Efficient Local Customization for Black-box Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Customized black-box prompt tuning is a new approach to customize large language models . however, as models grow, the resources required for training and deployment become increasingly expensive . |
| Approach: | They propose a framework that facilitates efficient local customization while preserving bidirectional privacy. |
| Outcome: | The proposed framework facilitates efficient local customization while preserving bidirectional privacy. |