Papers by Qin Lei

MentalSeek-Dx: Towards Progressive Hypothetico-Deductive Reasoning for Real-world Psychiatric Diagnosis (2026.acl-long)

Challenge:	Existing methods to identify uniability based on column representations are insufficient to reveal latent relational features to describe column relation between pair of columns.
Approach:	They propose a self-supervised table union search framework called AutoTUS to learn column relational representations in a multi-stage manner.
Outcome:	The proposed framework improves on the SOTA baseline and on real-world datasets.

Copied to clipboard

Xiao Sun, null Ymyang, Xinyi Jiang, Yu Tian, Junnan Zhu, Jiang Zhong, Qin Lei, Jingwang Huang, Haoyang Zeng, Xinyu Zhou, Xin Xiao, Kaiwen Wei

Chart-MRAG: Benchmarking Multimodal Retrieval Augmented Generation on Chart-based Documents (2026.acl-long)

Challenge:	Mental health disorders represent a burgeoning global public health challenge . lack of ecological validity and fine-grained diagnostic supervision limits their utility .
Approach:	They propose a medical-specialized LLM trained to internalize clinical reasoning process through supervised trajectory construction and curriculum-based reinforcement learning.
Outcome:	The proposed model achieves state-of-the-art with only 14B parameters, establishing a clinically grounded framework for reliable psychiatric diagnosis.

Copied to clipboard

null Ymyang, Jiang Zhong, Li Jin, Xiao Sun, Jingwang Huang, null Gaojinpeng, Qing Liu, Yang Bai, Jingyuan Zhang, Rui Jiang, Qin Lei, Kaiwen Wei

Revealing Personality Traits: A New Benchmark Dataset for Explainable Personality Recognition on Dialogues (2024.emnlp-main)

Challenge:	Existing benchmarks focus on simple image-text interactions, overlooking complex visual formats like charts.
Approach:	They propose a semi-automatic framework for generating evaluation samples through multi-modal keypoint extraction, knowledge graph construction, and qa pair synthesis.
Outcome:	The proposed framework generates 4,738 question-answering pairs across 8 domains from real-world documents.

Copied to clipboard

Lei Sun, Jinming Zhao, Qin Jin

Dialogue Systems & Conversational Agents

Challenge:	Current research treats personality recognition as a classification task, failing to reveal the supporting evidence for the recognized personality.
Approach:	They propose a task that aims to reveal the reasoning process as supporting evidence of the personality trait.
Outcome:	The proposed task reveals the reasoning process as supporting evidence of the personality trait.

Optimizing Question Semantic Space for Dynamic Retrieval-Augmented Multi-hop Question Answering (2025.acl-long)

Copied to clipboard

Linhao Ye, Lang Yu, Zhikai Lei, Qin Chen, Jie Zhou, Liang He

Information Retrieval

Challenge:	Existing retrieval-augmented generation methods are insufficient for multi-hop question answering . however, they tend to generate hallucinations due to semantic mismatching .
Approach:	They propose to optimize question semantic space for dynamic retrieval-augmented multi-hop question answering by optimizing the semantic embeddings.
Outcome:	The proposed method outperforms existing RAG methods in both in- and out-of-domain settings.

SCOP: Evaluating the Comprehension Process of Large Language Models from a Cognitive View (2025.acl-long)

Copied to clipboard

Yongjie Xiao, Hongru Liang, Peixin Qin, Yao Zhang, Wenqiang Lei

Reduce Human Labor On Evaluating Conversational Information Retrieval System: A Human-Machine Collaboration Approach (2023.emnlp-main)

Challenge:	despite the potential of large language models, it is difficult to fully count on them in real-world scenarios.
Approach:	They propose to examine how LLMs perform during the comprehension process from a cognitive perspective.
Outcome:	The proposed model analyzes how LLMs perform during the comprehension process from a cognitive perspective.

Copied to clipboard

Chen Huang, Peixin Qin, Wenqiang Lei, Jiancheng Lv

Natural Language Interfaces

Challenge:	Evaluating conversational information retrieval systems requires a significant amount of human labor for annotation.
Approach:	They propose to use human annotation to calibrate evaluation results to eliminate evaluation biases.
Outcome:	The proposed method consumes less than 1% of human labor and achieves a consistency rate of 95%-99% with human evaluation results.

ImageNetVC: Zero- and Few-Shot Visual Commonsense Evaluation on 1000 ImageNet Categories (2023.findings-emnlp)

Copied to clipboard

Heming Xia, Qingxiu Dong, Lei Li, Jingjing Xu, Tianyu Liu, Ziwei Qin, Zhifang Sui

From Hypothesis to Publication: A Comprehensive Survey of AI-Driven Research Support Systems (2025.findings-emnlp)

Challenge:	Large Language Models (LLMs) are becoming general-purpose APIs, requiring visual knowledge to be understood.
Approach:	They propose to evaluate the visual capability of large-scale large-language models through visual commonsense evaluation using a human-annotated dataset.
Outcome:	The proposed dataset compares the visual commonsense knowledge of large-scale models with those of unimodal LLMs and visually augmented models.

Copied to clipboard

Zekun Zhou, Xiaocheng Feng, Lei Huang, Xiachong Feng, Ziyun Song, Ruihan Chen, Liang Zhao, Weitao Ma, Yuxuan Gu, Baoxin Wang, Dayong Wu, Guoping Hu, Ting Liu, Bing Qin

MWP-BERT: Numeracy-Augmented Pre-training for Math Word Problem Solving (2022.findings-naacl)

Challenge:	rapid development of artificial intelligence (AI) technologies has inspired researchers to explore how AI can accelerate and enhance research.
Approach:	They organize the relevant studies into three main categories: hypothesis formulation, hypothesis validation, and manuscript publication.
Outcome:	The authors summarize the current state of research in three main areas: hypothesis formulation, hypothesis validation, and manuscript publication.

Copied to clipboard

Zhenwen Liang, Jipeng Zhang, Lei Wang, Wei Qin, Yunshi Lan, Jie Shao, Xiangliang Zhang

Alleviating Hallucinations from Knowledge Misalignment in Large Language Models via Selective Abstention Learning (2025.acl-long)

Challenge:	Existing work on math word problem solvers replace real numbers with symbolic placeholders to focus on logic reasoning.
Approach:	They propose to inject numerical properties into symbolic placeholders with contextualized representation learning schema to solve number representation dilemma.
Outcome:	The proposed model can solve MWP problems on English and Chinese benchmarks.

Copied to clipboard

Lei Huang, Xiaocheng Feng, Weitao Ma, Yuchun Fan, Xiachong Feng, Yuxuan Gu, Yangfan Ye, Liang Zhao, Weihong Zhong, Baoxin Wang, Dayong Wu, Guoping Hu, Lingpeng Kong, Tong Xiao, Ting Liu, Bing Qin

Learning to Describe for Predicting Zero-shot Drug-Drug Interactions (2023.emnlp-main)

Challenge:	Large language models (LLMs) suffer from severe hallucination issues due to the knowledge misalignment between the pre-training stage and the supervised fine-tuning stage.
Approach:	They propose a training objective with an abstention mechanism that selectively rejects tokens that misalign with the desired knowledge distribution via a special [REJ] token.
Outcome:	The proposed model selectively rejects tokens that misalign with the desired knowledge distribution via a special [REJ] token.

Copied to clipboard

Fangqi Zhu, Yongqi Zhang, Lei Chen, Bing Qin, Ruifeng Xu

Towards IP Intelligence: Benchmarking Large Language Models on Intellectual Property Knowledge and Practice (2026.findings-acl)

Challenge:	Existing computational methods for DDI prediction fail to capture interactions for new drugs due to the lack of knowledge.
Approach:	They propose a problem setup as zero-shot DDI prediction that deals with the case of new drugs by using textual information from online databases.
Outcome:	The proposed method improves on several settings including zero-shot and few-shot DDI prediction and the selected texts are semantically relevant.

Copied to clipboard

Qiyao Wang, Guhong Chen, Hongbo Wang, Huaren Liu, Minghui Zhu, Zhifei Qin, Li Linwei, Yilin Yue, Shiqiang Wang, Jiayan Li, Wu Yihang, Ziqiang Liu, Longze Chen, Run Luo, Liyang Fan, Jiaming Li, Lei Zhang, Kan Xu, Hamid Alinejad-Rokny, Chengming Li, Shiwen Ni, Yuan Lin, Min Yang

Context-Aware Hierarchical Taxonomy Generation for Scientific Papers via LLM-Guided Multi-Aspect Clustering (2025.emnlp-main)

Challenge:	Existing datasets and benchmarks focus only on patents or cover limited aspects of the IP field, lacking alignment with real-world scenarios.
Approach:	They propose a bilingual IP task taxonomy and a large-scale bilingual benchmark to evaluate LLMs in real-world IP practice.
Outcome:	The proposed model achieves only 75.8% accuracy, indicating room for improvement . open-source IP and law-oriented models lag behind closed-source general-purpose models .

Copied to clipboard

Kun Zhu, Lizi Liao, Yuxuan Gu, Lei Huang, Xiaocheng Feng, Bing Qin

Text Clustering

Challenge:	Existing taxonomy construction methods lack coherence and granularity . Existing approaches rely on manual or narrowly defined schemes .
Approach:	They propose a context-aware hierarchical taxonomy generation framework that integrates LLMs with dynamic clustering.
Outcome:	The proposed method outperforms existing methods in taxonomy coherence, granularity, and interpretability.

Investigating and Mitigating the Multimodal Hallucination Snowballing in Large Vision-Language Models (2024.acl-long)

Copied to clipboard

Weihong Zhong, Xiaocheng Feng, Liang Zhao, Qiming Li, Lei Huang, Yuxuan Gu, Weitao Ma, Yuan Xu, Bing Qin

CLAMBER: A Benchmark of Identifying and Clarifying Ambiguous Information Needs in Large Language Models (2024.acl-long)

Challenge:	Large Vision-Language Models (LVLMs) suffer from multimodal hallucinations . however, the generated hallucines could influence the models’ subsequent generation .
Approach:	They propose a framework to evaluate LVLMs' behaviors when encountering generated hallucinations and a method to revise the output distribution of LVLs with the one derived from the residual visual input.
Outcome:	The proposed framework reduces the performance of open-source LVLMs by 31%, indicating that they are prone to accept the generated hallucinations and make false claims that they would not have supported without distractions.

Copied to clipboard

Tong Zhang, Peixin Qin, Yang Deng, Chen Huang, Wenqiang Lei, Junhong Liu, Dingnan Jin, Hongru Liang, Tat-Seng Chua

Deep Reinforcement Learning with Distributional Semantic Rewards for Abstractive Summarization (D19-1)

Challenge:	Large language models are used to meet user information needs, but their effectiveness in dealing with user queries that contain various types of ambiguity remains unknown.
Approach:	They propose a benchmark for evaluating large language models using a well-organized taxonomy.
Outcome:	The proposed model is based on a well-organized taxonomy and compares it with other models.

Copied to clipboard

Siyao Li, Deren Lei, Pengda Qin, William Yang Wang

Text Generation

Challenge:	Abstractive summarization tasks are often based on deep reinforcement learning (RL) but the traditional reward system Rouge-L simply looks for exact n-grams matches between candidates and annotated references, which makes the generated sentences repetitive and incoherent.
Approach:	They propose to use distributional semantics to measure matching degrees instead of Rouge-L to generate sentences with n-grams matches.
Outcome:	The proposed reward has superiority over the existing reward, despite the incoherence of the generated sentences.

Latent Distribution Decouple for Uncertain-Aware Multimodal Multi-label Emotion Recognition (2025.findings-acl)

Copied to clipboard

Jingwang Huang, Jiang Zhong, Qin Lei, Gaojinpeng Gaojinpeng, Ymyang Ymyang, Sirui Wang, PeiguangLi PeiguangLi, Kaiwen Wei

Sentiment Analysis

Challenge:	Existing studies focus on improving fusion strategies and modeling modality-to-label dependencies, but they overlook the impact of aleatoric uncertainty, which is inherent noise in multimodal data.
Approach:	They propose a latent emotional distribution decomposition with uncertainty perception framework to model aleatoric uncertainty in multimodal data.
Outcome:	The proposed framework achieves state-of-the-art performance on the CMU-MOSEI and M3ED datasets, highlighting the importance of uncertainty modeling in MMER.

PolyJoin: Semantic Multi-key Joinable Table Search in Data Lakes (2025.findings-naacl)

Copied to clipboard

Xuming Hu, Chuan Lei, Xiao Qin, Asterios Katsifodimos, Christos Faloutsos, Huzefa Rangwala

Fine-Mem: Fine-Grained Feedback Alignment for Long-Horizon Memory Management (2026.acl-long)

Challenge:	Existing joinable table search methods focus on single key (unary) joins, where a single column is the join key, but are ineffective when dealing with join keys composed of multiple columns (n-ary joins) Existing methods are inefficient when dealing . with joins composed of n-aries, which are prevalent on web table corpora.
Approach:	They propose a joinable table search method that finds multi-key joinable tables on the web, given a query table.
Outcome:	The proposed method outperforms the state-of-the-art methods on two real-world web table benchmarks.

Copied to clipboard

Weitao Ma, Xiaocheng Feng, Lei Huang, Xiachong Feng, Zhanyu Ma, Jun Xu, Jiuchong Gao, Jinghua Hao, Renqing He, Bing Qin

One for All: Update Parameterized Knowledge Across Multiple Models with Once Edit (2025.acl-long)

Challenge:	Existing approaches to memory management rely on final task performance as the primary reward, resulting in severe reward sparsity and ineffective credit assignment.
Approach:	They propose a framework for fine-grained feedback alignment using a Chunk-level step reward and Evidence-Anchored Reward Attribution to redistribute global rewards based on memory items utilized as evidence in reasoning.
Outcome:	The proposed framework outperforms baselines and supports generalization across different model configurations and backbones.

Copied to clipboard

Weitao Ma, Xiyuan Du, Xiaocheng Feng, Lei Huang, Yichong Huang, Huiyi Zhang, Xiaoliang Yang, Baohang Li, Xiachong Feng, Ting Liu, Bing Qin

Green & Sustainable NLP

Challenge:	Existing methods for modifying large language models focus on individual models, resulting in errors and hallucinations.
Approach:	They propose an ensemble-based approach that employs a plug-in model as the editing module and a dynamic weight mechanism to enhance its effectiveness.
Outcome:	The proposed approach outperforms existing methods while achieving superior editing efficiency.

Question Tells You Where the Answer Is: Intention-aware Long-Context KV Cache Compression (2026.acl-long)

Copied to clipboard

Liang Zhao, Xiaocheng Feng, Weihong Zhong, Lei Huang, Kun Zhu, Baoxin Wang, Dayong Wu, Guoping Hu, Ting Liu, Bing Qin

Challenge:	Recent methods to reduce the KV cache size fail to identify crucial KVs for generation while excluding others accurately, resulting in severe information loss.
Approach:	They propose an intention-aware KV cache eviction method that identifies and retains crucial KVs according to the attention distribution of intention, which semantically reflects the user’s goal and determines which part of the context is relevant.
Outcome:	The proposed method can maintain the model performance while reducing the KV cache size from 128K to 2K, leading to a 6.3x increase in decoding speed and 7.8x enhancement in memory efficiency compared to the default setting.

On Transferability of Prompt Tuning for Natural Language Processing (2022.naacl-main)

Copied to clipboard

Yusheng Su, Xiaozhi Wang, Yujia Qin, Chi-Min Chan, Yankai Lin, Huadong Wang, Kaiyue Wen, Zhiyuan Liu, Peng Li, Juanzi Li, Lei Hou, Maosong Sun, Jie Zhou

Responsible & Trustworthy NLP

Challenge:	Pre-trained language models (PLMs) can achieve comparable performance to full-parameter fine-tuning by tuning a few soft prompts, but require much more training time than fine-timing.
Approach:	They empirically investigate the transferability of soft prompts across different downstream tasks and PLMs to determine what decides prompt transferability.
Outcome:	The proposed method can achieve comparable performance to full-parameter fine-tuning by tuning a few soft prompts, but requires much more training time than fine-timing.

Molweni: A Challenge Multiparty Dialogues-based Machine Reading Comprehension Dataset with Discourse Structure (2020.coling-main)

Copied to clipboard

Jiaqi Li, Ming Liu, Min-Yen Kan, Zihao Zheng, Zekun Wang, Wenqiang Lei, Ting Liu, Bing Qin

Natural Language Interfaces

Challenge:	Multiparty dialog applications such as discourse parsing and meeting summarization are now mainstream research.
Approach:	They propose to annotate a machine reading comprehension dataset with discourse structure built over multiparty dialog using a modified Segmented Discourse Representation Theory (SDRT) style.
Outcome:	The proposed dataset contributes large-scale discourse dependency annotations in a modified Segmented Discourse Representation Theory (SDRT) style for all of its multiparty dialogs, and achieves only 67.7% F1 on Molweni’s questions, a 20+% significant drop as compared against its SQuAD 2.0 performance.

ReSo: A Reward-driven Self-organizing LLM-based Multi-Agent System for Reasoning Tasks (2025.emnlp-main)

Copied to clipboard

Heng Zhou, Hejia Geng, Xiangyuan Xue, Li Kang, Yiran Qin, Zhiyong Wang, Zhenfei Yin, Lei Bai

Length Controlled Generation for Black-box LLMs (2025.acl-long)

Challenge:	Multi-agent systems (MAS) are limited by poor flexibility and scalability, with underdeveloped optimization strategies.
Approach:	They propose a task graph generation and a reward-driven two-stage agent selection process to integrate multi-agent systems to improve their reasoning capabilities.
Outcome:	The proposed model outperforms existing methods on Math-MAS and SciBench-MAS SciBech, while other methods completely fail.

Copied to clipboard

Yuxuan Gu, Wenjie Wang, Xiaocheng Feng, Weihong Zhong, Kun Zhu, Lei Huang, Ting Liu, Bing Qin, Tat-Seng Chua

Responsible & Trustworthy NLP

Challenge:	Existing length control methods involve fine-tuning the parameters of LLMs, which is inefficient and suboptimal for practical use.
Approach:	They propose an iterative sampling framework that regulates LLMs to generate length-constrained text without modifying the underlying parameters.
Outcome:	The proposed method achieves 100% success rates on Llama3.1 tasks with minimal additional computational overhead.

x1: Learning to Think Adaptively Across Languages and Cultures (2026.findings-acl)

Copied to clipboard

Yangfan Ye, Xiaocheng Feng, Xiachong Feng, Yichong Huang, Zekun Yuan, Lei Huang, Weitao Ma, Qichen Hong, Yunfei Lu, Dandan Tu, Bing Qin

DORA: A Dual-Objective Reinforcement Learning Framework for Effective and Efficient Multimodal Agentic Search (2026.acl-long)

Challenge:	Existing large language models (LLMs) ignore this diversity by reasoning in a single dominant language.
Approach:	They propose a family of reasoning models that can adaptively reason in an advantageous language on a per-instance basis.
Outcome:	The proposed model can reason in a single dominant language on a per-instance basis.

Copied to clipboard

Guangming Qin, Yuhao Deng, Yukun Zhao, Zhenyang Li, Junfeng Wang, Dawei Yin, Ye Yuan, Guoren Wang, Yizhou Yan, Chengliang Chai, Lei Cao

Responsible & Trustworthy NLP

Challenge:	Existing methods to train large language models overlook quality of intermediate search results . existing methods often invoke search calls during reasoning, making inference inefficient .
Approach:	They propose a dual-objective reinforcement learning framework to improve search strategies of MLLMs . DORA outperforms state-of-the-art methods, achieving up to 8.4% higher accuracy .
Outcome:	The proposed model outperforms state-of-the-art methods while reducing search calls by 9.7%.

Stratagem: Learning Transferable Reasoning via Trajectory-Modulated Game Self-Play (2026.acl-long)

Copied to clipboard

Xiachong Feng, Deyi Yin, Xiaocheng Feng, Yi Jiang, Libo Qin, Yangfan Ye, Lei Huang, Weitao Ma, Qiming Li, Yuxuan Gu, Bing Qin, Lingpeng Kong

UNO Arena for Evaluating Sequential Decision-Making Capability of Large Language Models (2024.emnlp-main)

Challenge:	Existing self-play approaches to developing general reasoning in language models rely on terminal game outcomes.
Approach:	They propose a game-based reasoning transfer model that addresses two barriers to reasoning transfer.
Outcome:	The proposed model improves mathematical reasoning, general reasoning, and code generation benchmarks.

Copied to clipboard

Zhanyue Qin, Haochuan Wang, Deyuan Liu, Ziyang Song, Cunhang Fan, Zhao Lv, Jinlin Wu, Zhen Lei, Zhiying Tu, Dianhui Chu, Xiaoyan Yu, Dianbo Sui

CC-Tuning: A Cross-Lingual Connection Mechanism for Improving Joint Multilingual Supervised Fine-Tuning (2025.acl-long)

Challenge:	Existing LLMs demonstrate powerful capabilities between tasks, but can they make sequential decisions?
Approach:	They propose to evaluate sequential decision-making capability of large language models (LLMs) using novel metrics based Monte Carlo methods.
Outcome:	The proposed benchmark improves sequential decision-making performance compared to the vanilla LLM player.

Copied to clipboard

Yangfan Ye, Xiaocheng Feng, Zekun Yuan, Xiachong Feng, Libo Qin, Lei Huang, Weitao Ma, Yichong Huang, Zhirui Zhang, Yunfei Lu, Xiaohui Yan, Duyu Tang, Dandan Tu, Bing Qin

Multilinguality

Challenge:	Existing fine-tuning approaches that focus on English-centric training corpora often introduce implicit cross-lingual alignment, overlooking the potential for more profound, latent-level cross-linguistic interactions.
Approach:	They propose a multilingual fine-tuning paradigm that explicitly establishes a cross-lingual connection mechanism at the latent level.
Outcome:	The proposed model outperforms vanilla SFT and offers a strong latent-level alternative to data-level augmentation methods.

Advancing Large Language Model Attribution through Self-Improving (2024.emnlp-main)

Copied to clipboard

Lei Huang, Xiaocheng Feng, Weitao Ma, Liang Zhao, Yuchun Fan, Weihong Zhong, Dongliang Xu, Qing Yang, Hongtao Liu, Bing Qin

Unveiling Entity-Level Unlearning for Large Language Models: A Comprehensive Analysis (2025.coling-main)

Challenge:	Teaching large language models to generate text with citations to evidence sources requires high-quality attribution data, which is costly and labor-intensive.
Approach:	They propose a framework for iteratively improving the attribution capability of large language models (LLMs) by attributing output to verifiable sources.
Outcome:	Experiments on three open-domain question-answering datasets show that START improves in aggregating information across multiple sources.

Copied to clipboard

Weitao Ma, Xiaocheng Feng, Weihong Zhong, Lei Huang, Yangfan Ye, Xiachong Feng, Bing Qin

AutoUE: Automated Generation of 3D Games in Unreal Engine via Multi-Agent Systems (2026.findings-acl)

Challenge:	Existing studies have focused on instance-level unlearning, specifically removing predefined instances containing sensitive content.
Approach:	They propose a task to erase entity-related knowledge from the target model completely by analyzing the forget set and its size.
Outcome:	The proposed task systematically evaluates popular unlearning algorithms and reveals that the knowledge coverage of the forget set and its size play pivotal roles.

Copied to clipboard

Lei Yin, Wentao Cheng, Zhida Qin, Tianyu Huang, Yidong Li, Gangyi Ding

Information Retrieval

Challenge:	Recent advances in Large Language Models (LLMs) and generative models have motivated studies on automated game generation from natural language descriptions.
Approach:	They propose a novel multi-agent system, AutoUE, which coordinates multiple agents to end-to-end generate 3D games, covering model retrieval, scene generation, gameplay and interaction code synthesis, and automated game testing for evaluation.
Outcome:	The proposed system covers model retrieval, scene generation, gameplay and interaction code synthesis, and automated game testing for evaluation.

Learning Fine-Grained Grounded Citations for Attributed Large Language Models (2024.findings-acl)

Copied to clipboard

Lei Huang, Xiaocheng Feng, Weitao Ma, Yuxuan Gu, Weihong Zhong, Xiachong Feng, Weijiang Yu, Weihua Peng, Duyu Tang, Dandan Tu, Bing Qin

SAVOIR: Learning Social Savoir-Faire via Shapley-based Reward Attribution (2026.findings-acl)

Challenge:	despite impressive performance, large language models still struggle with hallucinations . current approaches suffer from suboptimal citation quality due to reliance on in-context learning .
Approach:	They propose a framework that teaches large language models to generate fine-grained citations.
Outcome:	The proposed framework outperforms all baselines on the ALCE benchmark and achieves an average improvement of 14.21% in citation quality.

Copied to clipboard

Xiachong Feng, Yi Jiang, Xiaocheng Feng, Deyi Yin, Libo Qin, Yangfan Ye, Lei Huang, Weitao Ma, Yuxuan Gu, Chonghan Qin, Bing Qin, Lingpeng Kong

Improving Contextual Faithfulness of Large Language Models via Retrieval Heads-Induced Optimization (2025.acl-long)

Challenge:	Existing approaches to improve social intelligence of AI systems employ retrospective attributions and lack theoretical grounding.
Approach:	They propose a framework that uses Shapley values to ensure fair credit distribution with axiomatic guarantees of efficiency, symmetry, and marginality.
Outcome:	The proposed framework matches or exceeds proprietary models including GPT-4o and Claude-3.5-Sonnet.

Copied to clipboard

Lei Huang, Xiaocheng Feng, Weitao Ma, Yuchun Fan, Xiachong Feng, Yangfan Ye, Weihong Zhong, Yuxuan Gu, Baoxin Wang, Dayong Wu, Guoping Hu, Bing Qin

DiscoverGPT: Multi-task Fine-tuning Large Language Model for Related Table Discovery (2025.findings-naacl)

Challenge:	Existing frameworks for retrieval-augmented large language models (LLMs) are lacking in LFQA faithfulness testing.
Approach:	They propose a framework to teach retrieval-augmented large language models to explicitly discriminate between faithful and unfaithful generations.
Outcome:	The proposed framework outperforms GPT-4o in LFQA scenarios and outperformed existing benchmarks.

Copied to clipboard

Xuming Hu, Xiao Qin, Chuan Lei, Asterios Katsifodimos, Zhengyuan Shen, Balasubramaniam Srinivasan, Huzefa Rangwala