Papers by Yuxuan Gu
An Information Bottleneck Perspective for Effective Noise Filtering on Retrieval-Augmented Generation (2024.acl-long)
Copied to clipboard
Kun Zhu, Xiaocheng Feng, Xiyuan Du, Yuxuan Gu, Weijiang Yu, Haotian Wang, Qianglong Chen, Zheng Chu, Jingchang Chen, Bing Qin
| Challenge: | Experimental results show that retrieval-augmented generation improves accuracy and relevance of large language models. |
| Approach: | They propose to introduce the information bottleneck theory into retrieval-augmented generation by maximizing mutual information between compression and ground output while minimizing mutual information . |
| Outcome: | The proposed approach improves accuracy and correctness of answer generation and conciseness with 2.5% compression rate. |
Improving Controllable Text Generation with Position-Aware Weighted Decoding (2022.findings-acl)
Copied to clipboard
| Challenge: | Controllable text generation is a challenging task in natural language generation, which aims to generate diverse text related to specified attributes. |
| Approach: | They propose a framework that uses a lightweight controller to adjust bias signals from the controller at different decoding positions. |
| Outcome: | Experiments on positive sentiment control, topic control, and language detoxification show the proposed framework works on 4 SOTA models. |
Adaptive Backtracking for Privacy Protection in Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing privacy protection methods are prone to privacy leakage, but they are not effective in ensuring the privacy of users. |
| Approach: | They propose to capture latent leakage tendency of large language models during generation process and to construct a new benchmark for personal information. |
| Outcome: | The proposed method improves privacy by up to 14% over strong baselines against adversarial attacks, avoiding the degradation of response utility. |
FACT-AUDIT: An Adaptive Multi-Agent Framework for Dynamic Fact-Checking Evaluation of Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Existing fact-checking evaluation methods rely on static datasets and classification metrics, which fail to evaluate justification production and uncover the nuanced limitations of LLMs. |
| Approach: | They propose a framework that adaptively and dynamically assesses LLMs’ fact-checking capabilities by incorporating justification production alongside verdict prediction. |
| Outcome: | Experiments show that the framework differentiates among state-of-the-art LLMs, providing valuable insights into model strengths and limitations in model-centric fact-checking analysis. |
TeRA: Vector-based Random Tensor Network for High-Rank Adaptation of Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Low-Rank Adaptation (LoRA) methods have significantly reduced the number of trainable parameters needed in fine-tuning large language models. |
| Approach: | They propose a vector-based random Tensor network for high-Rank Adaptation method that achieves high-rank weight updates while retaining parameter efficiency. |
| Outcome: | The proposed method outperforms existing PEFT methods while keeping low-rank parameters. |
From Hypothesis to Publication: A Comprehensive Survey of AI-Driven Research Support Systems (2025.findings-emnlp)
Copied to clipboard
Zekun Zhou, Xiaocheng Feng, Lei Huang, Xiachong Feng, Ziyun Song, Ruihan Chen, Liang Zhao, Weitao Ma, Yuxuan Gu, Baoxin Wang, Dayong Wu, Guoping Hu, Ting Liu, Bing Qin
| Challenge: | rapid development of artificial intelligence (AI) technologies has inspired researchers to explore how AI can accelerate and enhance research. |
| Approach: | They organize the relevant studies into three main categories: hypothesis formulation, hypothesis validation, and manuscript publication. |
| Outcome: | The authors summarize the current state of research in three main areas: hypothesis formulation, hypothesis validation, and manuscript publication. |
Alleviating Hallucinations from Knowledge Misalignment in Large Language Models via Selective Abstention Learning (2025.acl-long)
Copied to clipboard
Lei Huang, Xiaocheng Feng, Weitao Ma, Yuchun Fan, Xiachong Feng, Yuxuan Gu, Yangfan Ye, Liang Zhao, Weihong Zhong, Baoxin Wang, Dayong Wu, Guoping Hu, Lingpeng Kong, Tong Xiao, Ting Liu, Bing Qin
| Challenge: | Large language models (LLMs) suffer from severe hallucination issues due to the knowledge misalignment between the pre-training stage and the supervised fine-tuning stage. |
| Approach: | They propose a training objective with an abstention mechanism that selectively rejects tokens that misalign with the desired knowledge distribution via a special [REJ] token. |
| Outcome: | The proposed model selectively rejects tokens that misalign with the desired knowledge distribution via a special [REJ] token. |
Context-Aware Hierarchical Taxonomy Generation for Scientific Papers via LLM-Guided Multi-Aspect Clustering (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing taxonomy construction methods lack coherence and granularity . Existing approaches rely on manual or narrowly defined schemes . |
| Approach: | They propose a context-aware hierarchical taxonomy generation framework that integrates LLMs with dynamic clustering. |
| Outcome: | The proposed method outperforms existing methods in taxonomy coherence, granularity, and interpretability. |
Investigating and Mitigating the Multimodal Hallucination Snowballing in Large Vision-Language Models (2024.acl-long)
Copied to clipboard
Weihong Zhong, Xiaocheng Feng, Liang Zhao, Qiming Li, Lei Huang, Yuxuan Gu, Weitao Ma, Yuan Xu, Bing Qin
| Challenge: | Large Vision-Language Models (LVLMs) suffer from multimodal hallucinations . however, the generated hallucines could influence the models’ subsequent generation . |
| Approach: | They propose a framework to evaluate LVLMs' behaviors when encountering generated hallucinations and a method to revise the output distribution of LVLs with the one derived from the residual visual input. |
| Outcome: | The proposed framework reduces the performance of open-source LVLMs by 31%, indicating that they are prone to accept the generated hallucinations and make false claims that they would not have supported without distractions. |
LLMs for Now, Fine-Tuning for Later: An Ensemble Approach to Data Drift in Domain-Specific Tasks (2026.acl-srw)
Copied to clipboard
Yuxuan Lu, Bingsheng Yao, Shao Zhang, Yisi Sang, Yun Wang, Hansu Gu, Peng Zhang, Tun Lu, Toby Jia-Jun Li, Dakuo Wang
| Challenge: | Deploying machine learning models in domain-specific scenarios is challenged by data drift and the scarcity of expert annotations. |
| Approach: | They propose a system that combines an LLM, an AL-assisted compact model and an automatic switch module to assist the active learning process. |
| Outcome: | The proposed system achieves 96–98% switch accuracy and outperforms both models used alone. |
Leveraging Large Language Models for NLG Evaluation: Advances and Challenges (2024.emnlp-main)
Copied to clipboard
| Challenge: | introducing Large Language Models (LLMs) has opened new avenues for assessing generated content quality, e.g., coherence, creativity, and context relevance. |
| Approach: | They propose a taxonomy for organizing existing LLM-based evaluation metrics and a structured framework to understand and compare them. |
| Outcome: | The proposed taxonomy offers a framework to understand and compare LLM-based evaluation methods. |
Length Controlled Generation for Black-box LLMs (2025.acl-long)
Copied to clipboard
Yuxuan Gu, Wenjie Wang, Xiaocheng Feng, Weihong Zhong, Kun Zhu, Lei Huang, Ting Liu, Bing Qin, Tat-Seng Chua
| Challenge: | Existing length control methods involve fine-tuning the parameters of LLMs, which is inefficient and suboptimal for practical use. |
| Approach: | They propose an iterative sampling framework that regulates LLMs to generate length-constrained text without modifying the underlying parameters. |
| Outcome: | The proposed method achieves 100% success rates on Llama3.1 tasks with minimal additional computational overhead. |
DiffCoT: Diffusion-styled Chain-of-Thought Reasoning in LLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Chain-of-Thought (CoT) reasoning improves multi-step mathematical problem solving in large language models but is vulnerable to exposure bias and error accumulation. |
| Approach: | They propose a diffusion-styled CoT framework that reformulates CoT reasoning as an iterative denoising process. |
| Outcome: | The proposed framework outperforms existing methods on three multi-step CoT reasoning benchmarks. |
Controllable Text Generation via Probability Density Estimation in the Latent Space (2023.acl-long)
Copied to clipboard
| Challenge: | Existing control approaches cannot effectively model complex space with diverse attributes, high dimensionality, and asymmetric structure, leaving subsequent controls unsatisfactory. |
| Approach: | They propose a control framework using probability density estimation in the latent space and an invertible transformation function that maps the complex distributions to simple Gaussian distributions in the prior space. |
| Outcome: | The proposed method outperforms baselines on attribute relevance and text quality, achieving a new SOTA. |
A Distributional Lens for Multi-Aspect Controllable Text Generation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for multi-aspect control suffer from attribute degeneration due to mutual interference of these controllers. |
| Approach: | They propose to use attribute fusion to find the intersections of multiple attributes as their combination for generation. |
| Outcome: | The proposed method outperforms baselines on attribute relevance and text quality and achieves the SOTA. |
Stratagem: Learning Transferable Reasoning via Trajectory-Modulated Game Self-Play (2026.acl-long)
Copied to clipboard
Xiachong Feng, Deyi Yin, Xiaocheng Feng, Yi Jiang, Libo Qin, Yangfan Ye, Lei Huang, Weitao Ma, Qiming Li, Yuxuan Gu, Bing Qin, Lingpeng Kong
| Challenge: | Existing self-play approaches to developing general reasoning in language models rely on terminal game outcomes. |
| Approach: | They propose a game-based reasoning transfer model that addresses two barriers to reasoning transfer. |
| Outcome: | The proposed model improves mathematical reasoning, general reasoning, and code generation benchmarks. |
Extending Context Window of Large Language Models from a Distributional Perspective (2024.emnlp-main)
Copied to clipboard
Yingsheng Wu, Yuxuan Gu, Xiaocheng Feng, Weihong Zhong, Dongliang Xu, Qing Yang, Hongtao Liu, Bing Qin
| Challenge: | Existing scaling methods for extending context window rely on empirical approaches and lack understanding of the internal distribution within RoPE resulting in suboptimal performance. |
| Approach: | They propose to optimize the context window extending task from the view of rotary angle distribution by minimizing disturbance between rotary angles to maintain consistency with the pre-training phase. |
| Outcome: | The proposed approach reduces by up to 72% of the distributional disturbance when extending LLaMA2’s context window to 8k, and reduces it by up 32% when extending to 16k. |
Learning Fine-Grained Grounded Citations for Attributed Large Language Models (2024.findings-acl)
Copied to clipboard
Lei Huang, Xiaocheng Feng, Weitao Ma, Yuxuan Gu, Weihong Zhong, Xiachong Feng, Weijiang Yu, Weihua Peng, Duyu Tang, Dandan Tu, Bing Qin
| Challenge: | despite impressive performance, large language models still struggle with hallucinations . current approaches suffer from suboptimal citation quality due to reliance on in-context learning . |
| Approach: | They propose a framework that teaches large language models to generate fine-grained citations. |
| Outcome: | The proposed framework outperforms all baselines on the ALCE benchmark and achieves an average improvement of 14.21% in citation quality. |
SAVOIR: Learning Social Savoir-Faire via Shapley-based Reward Attribution (2026.findings-acl)
Copied to clipboard
Xiachong Feng, Yi Jiang, Xiaocheng Feng, Deyi Yin, Libo Qin, Yangfan Ye, Lei Huang, Weitao Ma, Yuxuan Gu, Chonghan Qin, Bing Qin, Lingpeng Kong
| Challenge: | Existing approaches to improve social intelligence of AI systems employ retrospective attributions and lack theoretical grounding. |
| Approach: | They propose a framework that uses Shapley values to ensure fair credit distribution with axiomatic guarantees of efficiency, symmetry, and marginality. |
| Outcome: | The proposed framework matches or exceeds proprietary models including GPT-4o and Claude-3.5-Sonnet. |
Improving Contextual Faithfulness of Large Language Models via Retrieval Heads-Induced Optimization (2025.acl-long)
Copied to clipboard
Lei Huang, Xiaocheng Feng, Weitao Ma, Yuchun Fan, Xiachong Feng, Yangfan Ye, Weihong Zhong, Yuxuan Gu, Baoxin Wang, Dayong Wu, Guoping Hu, Bing Qin
| Challenge: | Existing frameworks for retrieval-augmented large language models (LLMs) are lacking in LFQA faithfulness testing. |
| Approach: | They propose a framework to teach retrieval-augmented large language models to explicitly discriminate between faithful and unfaithful generations. |
| Outcome: | The proposed framework outperforms GPT-4o in LFQA scenarios and outperformed existing benchmarks. |
MPR-GUI: Benchmarking and Enhancing Multilingual Perception and Reasoning in GUI Agents (2026.acl-long)
Copied to clipboard
Ruihan Chen, Qiming Li, Xiaocheng Feng, Weihong Zhong, Xiaoliang Yang, Yuxuan Gu, Zekun Zhou, Yunfei Lu, Haoyu Ren, Kun Chen, Dandan Tu, Bing Qin
| Challenge: | Existing GUI benchmarks lack fine-grained diagnostics to identify which capabilities lead to task failures. |
| Approach: | They propose a multilingual P R GUI Benchmark to assess LVLMs' language capabilities . they propose XLI to align non-English hidden states with English ones during inference . |
| Outcome: | The proposed benchmark reveals consistent gaps between English and non-English settings . it reduces the cross-lingual gaps with an average gain of 6.5% in non- English settings compared to static benchmarks . |