Papers by Yuan Ye

HATA: Trainable and Hardware-Efficient Hash-Aware Top-k Attention for Scalable Large Model Inference (2025.findings-acl)

Challenge:	Chain-of-Thought prompting is a de facto method to elicit reasoning capabilities from large language models (LLMs).
Approach:	They propose a step-aware formal verification framework Safe to address hallucinations in CoT prompting . they propose 'formal step' as a benchmark for step correctness theorem proving with 30,809 formal statements.
Outcome:	The proposed framework shows significant performance improvement while offering interpretable and verifiable evidence.

Copied to clipboard

Ping Gong, Jiawei Yi, Shengnan Wang, Juncheng Zhang, Zewen Jin, Ouxiang Zhou, Ruibo Liu, Guanbin Xu, Youhui Bai, Bowen Ye, Kun Yuan, Tong Yang, Gong Zhang, Renhai Chen, Feng Wu, Cheng Li

Green & Sustainable NLP

Challenge:	Existing top-k attention methods struggle to strike a balance between efficiency and accuracy.
Approach:	They propose a top-k attention approach that integrates low-overhead techniques into the Top-k Attention process to achieve 7.2 speedup compared to vanilla full attention.
Outcome:	The proposed approach achieves 7.2 speedup compared to current top-k attention methods while maintaining model accuracy.

IEPile: Unearthing Large Scale Schema-Conditioned Information Extraction Corpus (2024.acl-short)

Copied to clipboard

Honghao Gui, Lin Yuan, Hongbin Ye, Ningyu Zhang, Mengshu Sun, Lei Liang, Huajun Chen

CRITICTOOL: Evaluating Self-Critique Capabilities of Large Language Models in Tool-Calling Error Scenarios (2025.emnlp-main)

Challenge:	Large Language Models exhibit a significant performance gap in Information Extraction (IE) high-quality instruction data is the vital key for enhancing LLMs' specific capabilities .
Approach:	They propose a bilingual (English and Chinese) IE instruction corpus that contains 0.32B tokens.
Outcome:	The proposed model improves the performance of LLMs for IE with zero-shot generalization.

Copied to clipboard

Shiting Huang, Zhen Fang, Zehui Chen, Siyu Yuan, Junjie Ye, Yu Zeng, Lin Chen, Qi Mao, Feng Zhao

Biology-Instructions: A Dataset and Benchmark for Multi-Omics Sequence Understanding Capability of Large Language Models (2025.findings-emnlp)

Challenge:	a number of tools are used to perform complex tasks, but the tool utilization process can cause errors.
Approach:	They propose a critique evaluation benchmark for tool learning that analyzes function-calling errors on tool evaluation benchmarks.
Outcome:	The proposed critique evaluation benchmark holds diverse tool-use errors with varying complexities, which better reflects real-world scenarios.

Copied to clipboard

Haonan He, Yuchen Ren, Yining Tang, Ziyang Xu, Junxian Li, Minghao Yang, Di Zhang, Yuan Dong, Tao Chen, Shufei Zhang, Yuqiang Li, Nanqing Dong, Wanli Ouyang, Dongzhan Zhou, Peng Ye

Interpretable Graph-Language Modeling for Detecting Youth Illicit Drug Use (2026.findings-eacl)

Challenge:	Biology-Instructions is the first large-scale instruction-tuning dataset for multi-omics biological sequences.
Approach:	They propose a large-scale instruction-tuning dataset for multi-omics biological sequences . they propose 'chatMultiOmics' to overcome limitations of current LLMs on multi-ome tasks .
Outcome:	The proposed dataset bridges LLMs and complex biological sequence-related tasks while maintaining conversational fluency.

Copied to clipboard

Yiyang Li, Zehong Wang, Zhengqing Yuan, Zheyuan Zhang, Keerthiram Murugesan, Chuxu Zhang, Yanfang Ye

Optimizing User Profiles via Contextual Bandits for Retrieval-Augmented LLM Personalization (2026.acl-long)

Challenge:	Illicit drug use among teens and young adults remains a public health concern . existing models ignore latent and interconnected structures among survey variables .
Approach:	They propose a joint graph-language modeling framework to detect illicit drug use among TYAs . they use large-scale surveys such as the Youth Risk Behavior Survey and the National Survey on Drug Use and Health to analyze data .
Outcome:	The proposed framework outperforms baseline models on YRBS and NSDUH datasets in predictive accuracy.

Copied to clipboard

Linfeng Du, Ye Yuan, Zichen Zhao, Fuyuan Lyu, Emiliano Penaloza, Xiuying Chen, Zipeng Sun, Jikun Kang, Laurent Charlin, Xue Liu, Haolun Wu

Information Retrieval

Challenge:	Existing approaches for personalizing large language models require modifying parameters.
Approach:	They propose a lightweight approach to personalizing large language models via retrieval augmentation . relevance serves as an unreliable proxy for utility, they argue .
Outcome:	The proposed framework outperforms strong heuristic and retrieval-augmented baselines on nine personalization tasks.

ExplainaBoard: An Explainable Leaderboard for NLP (2021.acl-demo)

Copied to clipboard

Pengfei Liu, Jinlan Fu, Yang Xiao, Weizhe Yuan, Shuaichen Chang, Junqi Dai, Yixin Liu, Zihuiwen Ye, Graham Neubig

FACTS: Table Summarization via Offline Template Generation with Agentic Workflows (2026.findings-acl)

Challenge:	Using leaderboards, researchers can track the performance of various systems on various NLP tasks.
Approach:	They propose a new conceptualization and implementation of NLP evaluation using a leaderboard.
Outcome:	The ExplainaBoard is an evaluation tool for natural language processing (NLP) it covers more than 400 systems, 50 datasets, 40 languages, and 12 tasks.

Copied to clipboard

Ye Yuan, Mohammad Amin Shabani, Siqi Liu

AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling (2024.acl-long)

Challenge:	Existing methods for query-focused table summarization struggle with complex reasoning and token-limit issues.
Approach:	They propose a Fast, Accurate, and Privacy-Compliant table summarization approach via Offline Template Generation.
Outcome:	The proposed method outperforms baseline methods on widely-used benchmarks.

Copied to clipboard

Jun Zhan, Junqi Dai, Jiasheng Ye, Yunhua Zhou, Dong Zhang, Zhigeng Liu, Xin Zhang, Ruibin Yuan, Ge Zhang, Linyang Li, Hang Yan, Jie Fu, Tao Gui, Tianxiang Sun, Yu-Gang Jiang, Xipeng Qiu

AgentRouter: A Knowledge-Graph-Guided LLM Router for Collaborative Multi-Agent Question Answering (2026.acl-long)

Challenge:	Existing language models that use discrete representations for unified processing of various modalities are limited to text generation and do not include multimodal output.
Approach:	They propose a multimodal language model that utilizes discrete representations for unified processing of various modalities.
Outcome:	The proposed model can be trained stably without any alterations to existing models or training paradigms.

Copied to clipboard

Zheyuan Zhang, Kaiwen Shi, Zhengqing Yuan, Zehong Wang, Tianyi Ma, Keerthiram Murugesan, Vincent Galassi, Chuxu Zhang, Yanfang Ye

GenPilot: A Multi-Agent System for Test-Time Prompt Optimization in Image Generation (2025.findings-emnlp)

Challenge:	Existing approaches to agent routing emphasize cost efficiency while overlooking the fine-grained contextual and relational structure inherent in QA tasks.
Approach:	They propose a framework that formulates multi-agent QA as a knowledge-graph-guided routing problem supervised by empirical performance signals.
Outcome:	The proposed framework outperforms single-agent and ensemble baselines while generalizing across benchmarks and LLM backbones.

Copied to clipboard

Wen Ye, Zhaocheng Liu, Gui Yuwei, Tingyu Yuan, Yunyue Su, Bowen Fang, Chaoyang Zhao, Qiang Liu, Liang Wang

KidsArtBench: Multi-Dimensional Children’s Art Evaluation with Attribute-Aware MLLMs (2026.eacl-long)

Challenge:	Existing methods for text-to-image synthesis lack systematic error analysis and refinement strategies, resulting in limited reliability and effectiveness.
Approach:	They propose a plug-and-play multi-agent system called GenPilot that integrates error analysis, clustering-based adaptive exploration, fine-grained verification and a memory module for iterative optimization.
Outcome:	The proposed method improves text consistency and structural coherence on images with a plug-and-play system.

Copied to clipboard

Mingrui Ye, Chanjin Zheng, Zengyi Yu, Chenyu Xiang, Zhixue Zhao, Zheng Yuan, Helen Yannakoudakis

SalaMAnder: Shapley-based Mathematical Expression Attribution and Metric for Chain-of-Thought Reasoning (2025.findings-emnlp)

Challenge:	Multimodal Large Language Models (MLLMs) show impressive capabilities across visual–language tasks, but their capacity to evaluate artistic expression remains limited.
Approach:	They propose an attribute-specific multi-LoRA approach where each attribute corresponds to a distinct evaluation dimension in the scoring rubric.
Outcome:	The proposed approach increases correlation from 0.468 to 0.653 on Qwen2.5-VL-7B, with the largest gains on perceptual dimensions and narrowed gaps on higher-order attributes.

Copied to clipboard

Yue Xin, Chen Shen, Shaotian Yan, Xiaosong Yuan, Yaoming Wang, Xiaofeng Zhang, Chenxi Huang, Jieping Ye

Video-LLaVA: Learning United Visual Representation by Alignment Before Projection (2024.emnlp-main)

Challenge:	Chain-of-Thought prompting improves the math reasoning capability of large language models.
Approach:	They propose a method for attribution of component-level contributions in CoT reasoning using Shapley value and a stratified sampling algorithm that significantly reduces computational complexity.
Outcome:	The proposed method reduces computational complexity and provides robust correlations with model performance.

Copied to clipboard

Bin Lin, Yang Ye, Bin Zhu, Jiaxi Cui, Munan Ning, Peng Jin, Li Yuan

Three Sentences Are All You Need: Local Path Enhanced Document Relation Extraction (2021.acl-short)

Challenge:	Existing approaches to visual-language understanding lack unified tokenization for images and videos . lack of unified visual representations makes it difficult to learn multi-modal interactions from poor projection layers.
Approach:	They propose to unify visual representation into the language feature space to advance the foundational LLM towards a unified LVLM.
Outcome:	The proposed model outperforms Video-ChatGPT on image benchmarks and on 9 image benchmark benchmarks.

Copied to clipboard

Quzhe Huang, Shengqi Zhu, Yansong Feng, Yuan Ye, Yuxuan Lai, Dongyan Zhao

RBPtool: A Deep Language Model Framework for Multi-Resolution RBP-RNA Binding Prediction and RNA Molecule Design (2025.emnlp-main)

Challenge:	Document-level relation extraction (RE) is more challenging than sentence RE as it often requires reasoning over multiple sentences.
Approach:	They propose a method to heuristically select evidence sentences for document-level relation extraction.
Outcome:	The proposed method can be easily combined with BiLSTM to achieve good performance on benchmark datasets even better than fancy graph neural network based methods.

Copied to clipboard

Jiyue Jiang, Yitao Xu, Zikang Wang, Yihan Ye, Yanruisheng Shao, Yuheng Shan, Jiuming Wang, Xiaodan Fan, Jiao Yuan, Yu Li

OpenNRE: An Open and Extensible Toolkit for Neural Relation Extraction (D19-3)

Challenge:	RNA-binding proteins play key roles in post-transcriptional gene regulation . existing methods focus on shallow sequence features or coarse structural representations . large language models allow for precise modeling and biologically informed de novo RNA design .
Approach:	They extend RPI15223 into a multi-resolution, structure-level RBP-RNA dataset and introduce RBPtool, a framework that fuses sequence and structural information.
Outcome:	The proposed framework achieves state-of-the-art performance on public benchmarks and the RPI15223 dataset while supporting fine-grained level predictions.

Copied to clipboard

Xu Han, Tianyu Gao, Yuan Yao, Deming Ye, Zhiyuan Liu, Maosong Sun

Effective Sequence-to-Sequence Dialogue State Tracking (2021.emnlp-main)

Challenge:	OpenNRE provides a framework to implement neural relation extraction (RE) . the toolkit provides various functional modules based on TensorFlow and PyTorch .
Approach:	OpenNRE is an open-source framework to implement neural relation extraction models. they also release an online system to meet real-time extraction without any training and deployment.
Outcome:	OpenNRE provides a framework to implement neural models for relation extraction (RE) the toolkit also includes an online system to meet real-time extraction without training and deployment .

Copied to clipboard

Jeffrey Zhao, Mahdis Mahdieh, Ye Zhang, Yuan Cao, Yonghui Wu

Same Claim, Different Judgment: Benchmarking Scenario-Induced Bias in Multilingual Financial Misinformation Detection (2026.findings-acl)

Challenge:	Using Sequence-to-Sequence models for dialogue state tracking remains an understudied topic.
Approach:	They propose to use a pre-training objective and a dialogue context representation to investigate this problem.
Outcome:	The proposed model is more effective than auto-regressive language modeling, the authors show . the proposed model may have a hard time recovering from earlier mistakes, they say .

Copied to clipboard

Zhiwei Liu, Yupeng Cao, Yuechen Jiang, Mohsinul Kabir, Polydoros Giannouris, Chen Xu, Ziyang Xu, Tianlei Zhu, Md. Tariquzzaman, Triantafillos Papadopoulos, Yan Wang, Lingfei Qian, Xueqing Peng, Zhuohan Xie, Ye Yuan, Saeed Almheiri, Abdulrazzaq Alnajjar, Ming-Bin Chen, Harry Stuart, Paul Thompson, Prayag Tiwari, Alejandro Lopez-Lira, Xue Liu, Jimin Huang, Sophia Ananiadou

PALT: Parameter-Lite Transfer of Language Models for Knowledge Graph Completion (2022.findings-emnlp)

Challenge:	Existing research on LLM biases has focused on direct questioning or general-purpose settings . pronounced behavioral biase despite their growing deployment in financial analysis, forecasting, and decision support.
Approach:	They propose a benchmark to evaluate behavioral biases of large language models in MFMD . they use a multilingual financial misinformation dataset to integrate these with misinformation claims .
Outcome:	The proposed benchmark evaluates behavioral biases of large language models across economic scenarios.

Copied to clipboard

Jianhao Shen, Chenguang Wang, Ye Yuan, Jiawei Han, Heng Ji, Koushik Sen, Ming Zhang, Dawn Song

From Redundancy to Relevance: Information Flow in LVLMs Across Reasoning Tasks (2025.naacl-long)

Challenge:	Pretrained language models (LMs) are a powerful transfer learning approach for knowledge graph (KG) completion.
Approach:	They propose a parameter-lite transfer learning approach for pretrained language models for knowledge graph (KG) completion.
Outcome:	The proposed model outperforms the state-of-the-art models on a knowledge graph completion benchmark by tuning 1% of the parameters.

Copied to clipboard

Xiaofeng Zhang, Yihao Quan, Chen Shen, Xiaosong Yuan, Shaotian Yan, Liang Xie, Wenxiao Wang, Chaochen Gu, Hao Tang, Jieping Ye

TRIGO: Benchmarking Formal Mathematical Proof Reduction for Generative Language Models (2023.emnlp-main)

Challenge:	Large visionlanguage models (LVLMs) are a powerful visual-language reasoning tool.
Approach:	They propose to integrate attention analysis with LLaVA-CAM to determine interactions between visual representations.
Outcome:	The proposed approach can be used to determine interactions between visual representations.

Copied to clipboard

Jing Xiong, Jianhao Shen, Ye Yuan, Haiming Wang, Yichun Yin, Zhengying Liu, Lin Li, Zhijiang Guo, Qingxing Cao, Yinya Huang, Chuanyang Zheng, Xiaodan Liang, Ming Zhang, Qun Liu

Unifying Latent and Lexicon Representations for Effective Video-Text Retrieval (2024.lrec-main)

Challenge:	Automated theorem proving (ATP) benchmarks focus on symbolic inference but rarely involve understanding complex number combination reasoning.
Approach:	They propose a benchmark that requires a model to reduce a trigonometric expression with step-by-step proof and evaluates a generative LM’s reasoning ability on formulas and ability to manipulate, group, and factor number terms.
Outcome:	The proposed benchmark evaluates a generative LM’s reasoning ability on formulas and ability to manipulate, group, and factor number terms.

Copied to clipboard

Haowei Liu, Yaya Shi, Haiyang Xu, Chunfeng Yuan, Qinghao Ye, Chenliang Li, Ming Yan, Ji Zhang, Fei Huang, Bing Li, Weiming Hu

CogEmp:A Cognitive Empathy-Oriented Dialogue System for Structured Psychological Counseling (2026.findings-acl)

Challenge:	Existing methods for video-text retrieval capture fine-grained semantic concepts . however, they lack the ability to capture finer-grain concepts such as objects and actions.
Approach:	They propose a dual-encoder architecture for fast video-text retrieval that learns lexicon representations to capture fine-grained semantics.
Outcome:	The proposed framework outperforms existing methods with 4.8% and 8.2% improvement on MSR-VTT and DiDeMo respectively.

Copied to clipboard

Yiguo Deng, Xia Lei, Yuan Zhang, Long Ye

Dialogue Systems & Conversational Agents

Challenge:	Existing models lack accurate modeling of cognitive empathy, especially the ability to understand users’ emotions and their underlying psychological causes.
Approach:	They propose a model tailored for the Chinese cultural context that integrates cognitive empathy into LLMs.
Outcome:	The proposed model outperforms existing models in key evaluation metrics, particularly in empathy, comprehensibility, and professionalism.

Semantics-enhanced Cross-modal Masked Image Modeling for Vision-Language Pre-training (2024.lrec-main)

Copied to clipboard

Haowei Liu, Yaya Shi, Haiyang Xu, Chunfeng Yuan, Qinghao Ye, Chenliang Li, Ming Yan, Ji Zhang, Fei Huang, Bing Li, Weiming Hu

Learning to Extract Structured Entities Using Language Models (2024.emnlp-main)

Challenge:	Existing methods for vision-language pre-training lack high-level semantics and text is not sufficiently involved in masked modeling.
Approach:	They propose a semantics-enhanced cross-modal MIM framework for vision-language representation learning that harvests high-level semantics from global image features via self-supervised agreement learning and transfers them to local patch encodings by sharing the encode space.
Outcome:	The proposed model achieves state-of-the-art or competitive performance on multiple vision-language tasks.

Copied to clipboard

Haolun Wu, Ye Yuan, Liana Mikaelyan, Alexander Meulemans, Xue Liu, James Hensman, Bhaskar Mitra

MARK: Multi-agent Collaboration with Ranking Guidance for Text-attributed Graph Clustering (2025.findings-acl)

Challenge:	Language Models (LMs) play a pivotal role in extracting structured information from unstructured text.
Approach:	They propose to reformulate the task to be entity-centric, enabling the use of diverse metrics that can provide more insights from various perspectives.
Outcome:	The proposed model outperforms baselines and human evaluations on the extracted entities.

Copied to clipboard

Yiwei Fu, Yuxing Zhang, Chunchun Chen, JianwenMa JianwenMa, Quan Yuan, Rong-Cheng Tu, Xinli Huang, Wei Ye, Xiao Luo, Minghua Deng

Beyond Self-Report: Bridging the Intention-Behavior Gap in Critical Thinking Assessment via Interpretable Multi-Agent System (2026.acl-long)

Challenge:	Existing approaches to cluster graphs with GNNs are limited due to label scarcity.
Approach:	They propose to leverage large language models to enhance text-attributed graph clustering by using three LLMs as ranking-based supervision signals.
Outcome:	The proposed approach generates reliable guidance using collaboration of three LLM-based agents as ranking-based supervision signals.

Copied to clipboard

Zekun Li, Jifan Yu, Haoxuan Li, Ye He, Daniel Zhang-Li, Shangqing Tu, Joy Jia Yin Lim, Yikun Jiang, Jiaxin Yuan, Yu Zhang

SciCustom: A Framework for Custom Evaluation of Scientific Capabilities in Large Language Models (2026.acl-long)

Challenge:	Accurate assessment of critical thinking is limited by the Intention Behavior Gap in psychology . evaluators that measure self-reported competence are limited by multiagent architectures .
Approach:	They propose a framework that operationalizes cognitive assessment into an interpretable multi-agent workflow with Assessment Chain-of-Thought.
Outcome:	The proposed framework aligns better with human expert ratings than gold-standard inventories on large-scale simulations and human participants.

Copied to clipboard

Yiyang Gu, Junwei Yang, Junyu Luo, Ye Yuan, Bin Feng, Yingce Xia, Shufang Xie, Kaili Liu, Bohan Wu, Qi Shi, Haoran Li, Beier Xiao, Zhiping Xiao, Xiao Luo, Weizhi Zhang, Philip S. Yu, Zequn Liu, Ming Zhang

Can LLMs Simulate L2-English Dialogue? An Information-Theoretic Analysis of L1-Dependent Biases (2025.acl-long)

Challenge:	Existing evaluations of large language models fail to reflect fine-grained capabilities . existing benchmarks are manually curated or domain-generic, limiting scalability and alignment with real use cases.
Approach:	They propose a framework that allows custom construction of benchmarks from large-scale scientific data to evaluate application-specific scientific capabilities in LLMs.
Outcome:	The proposed framework reveals fine-grained differences in scientific capabilities that standard benchmarks overlook . it allows custom construction of benchmarks from large-scale scientific data to evaluate application-specific capabilities in LLMs.

Copied to clipboard

Rena Wei Gao, Xuetong Wu, Tatsuki Kuribayashi, Mingrui Ye, Siya Qi, Carsten Roever, Yuanxing Liu, Zheng Yuan, Jey Han Lau

Dialogue Systems & Conversational Agents

Challenge:	Large Language Models (LLMs) can simulate non-native-like English use observed in human second language (L2) learners interfered with by their native first language (N1) knowledge.
Approach:	They use large language models to simulate non-native-like English use observed in human second language (L2) learners, and then compare their outputs to real L2 learner data.
Outcome:	The proposed models replicate L1-dependent patterns observed in human second language (L2) learners, with distinct influences from various languages.

PsyMem: Fine-grained Psychological Alignment and Explicit Memory Control for Advanced Role-Playing LLMs (2026.tacl-1)

Copied to clipboard

Xilong Cheng, Yunxiao Qin, Yuting Tan, Zhengnan Li, Ye Wang, Hongjiang Xiao, Yuan Zhang

Challenge:	Existing role-playing models rely on superficial textual descriptions or simplistic metrics, inadequately modeling both intrinsic and extrinsic character dimensions.
Approach:	They propose a framework that integrates fine-grained psychological attributes and explicit memory control for role-playing.
Outcome:	The proposed framework outperforms baseline models in human-likeness and character fidelity.

Modeling discourse cohesion for discourse parsing via memory network (P18-2)

Copied to clipboard

Yanyan Jia, Yuan Ye, Yansong Feng, Yuxuan Lai, Rui Yan, Dongyan Zhao

DT-Solver: Automated Theorem Proving with Dynamic-Tree Sampling Guided by Proof-level Value Function (2023.acl-long)

Challenge:	Existing approaches to discourse parsing focus on studying the semantic and syntactic aspects of EDU pairs, but they do not address long span dependencies.
Approach:	They propose a new transition-based discourse parser that takes discourse cohesion into account by using memory networks.
Outcome:	The proposed method outperforms traditional features and improves performance on the RST discourse treebank.

Copied to clipboard

Haiming Wang, Ye Yuan, Zhengying Liu, Jianhao Shen, Yichun Yin, Jing Xiong, Enze Xie, Han Shi, Yujun Li, Lin Li, Jian Yin, Zhenguo Li, Xiaodan Liang

Grounded Multimodal Procedural Entity Recognition for Procedural Documents: A New Dataset and Baseline (2024.lrec-main)

Challenge:	Recent advances in neural theorem-proving resort to large language models and tree searches.
Approach:	They propose a Dynamic-Tree Driven Theorem Solver to accommodate general theoremes by guiding the search procedure with state confidence and proof-level values.
Outcome:	The proposed method outperforms state-of-the-art methods on two popular theorem-proving datasets with a 6.65% improvement on average in terms of success rate.

Copied to clipboard

Haopeng Ren, Yushi Zeng, Yi Cai, Zhenqi Ye, Li Yuan, Pinli Zhu

On the Step Length Confounding in LLM Reasoning Data Selection (2026.findings-acl)

Challenge:	Existing methods to extract procedural knowledge from documents focus on text-only settings, which is insufficient for entity disambiguation.
Approach:	They propose a model to detect the entity and the corresponding bounding box groundings in images.
Outcome:	The proposed model detects the entity and the corresponding bounding box groundings in image (i.e., visual entities) it is based on a dataset of a WikiHow 1 and EHow 2 document and the results are compared with existing models.

Copied to clipboard

Bing Wang, Rui Miao, Chen Shen, Shaotian Yan, Kaiyuan Liu, Ximing Li, Xiaosong Yuan, Sinan Fan, Jun Zhang, Jieping Ye

PolicyLLM: Towards Excellent Comprehension of Public Policy for Large Language Models (2026.findings-acl)

Challenge:	Existing pipelines generate long reasoning data from more capable Large Language Models (LLMs) and apply manually heuristic or naturalness-based selection methods to filter high-quality samples.
Approach:	They propose to use supervised fine-tuning to generate long reasoning data from more capable Large Language Models and apply manually heuristic or naturalness-based selection methods to filter high-quality samples.
Outcome:	Experiments on four LLMs and five evaluation benchmarks show that the proposed approach is effective in mitigating step length confounding problem.

Copied to clipboard

Han Bao, Penghao Zhang, Yue Huang, Zhengqing Yuan, Yanchi Ru, SU Rui, Yujun Zhou, Xiangqi Wang, Kehan Guo, Nitesh V Chawla, Yanfang Ye, Xiangliang Zhang

Culture-Aware Machine Translation in Large Language Models: Benchmarking and Investigation (2026.acl-long)

Challenge:	Large Language Models (LLMs) are increasingly integrated into real-world decision-making, but their ability to comprehend and reason about policy-related content remains underexplored.
Approach:	They propose a bilingual benchmark evaluating policy comprehension comprising 21K cases across a broad spectrum of policy areas.
Outcome:	The proposed model shows stronger performance on application-oriented policy tasks than on memorization or conceptual understanding, and yields the highest accuracy on structured reasoning tasks.

Copied to clipboard

Zekun Yuan, Yangfan Ye, Xiaocheng Feng, Baohang Li, Qichen Hong, Yunfei Lu, Dandan Tu, Bing Qin

Truth or Sophistry? LoFa: A Benchmark for LLM Robustness Against Logical Fallacies (2026.acl-long)

Challenge:	Existing studies on large language models focus on literal-level translation quality, such as adequacy and fluency.
Approach:	They propose a Culture-Aware Novel-Driven Parallel Dataset for Machine Translation and a multi-dimensional evaluation framework for assessing cultural translation quality.
Outcome:	The proposed model improves evaluation reliability in LLM-as-a-judge scenarios under culture-aware constraints.

Copied to clipboard

Xudong Shen, li Yuan, Ye Chen, Xin Wu, Yi Cai, Zhiyong Wu

Robustness in NLP

Challenge:	Prior work has focused on the ability of Large Language Models to identify or classify fallacies, but their robustness against these fallacias in persuasive contexts remains largely unexplored.
Approach:	They propose a new metric to assess LLM robustness against fallacies by pairing factual questions with fallacious arguments and developing a multi-round debate framework to assess model resilience.
Outcome:	The proposed metric disentangles robustness from a model’s knowledge limitations and demonstrates unique vulnerability profiles across models.

NG-Router: Graph-Supervised Multi-Agent Collaboration for Nutrition Question Answering (2026.eacl-long)

Copied to clipboard

Kaiwen Shi, Zheyuan Zhang, Zhengqing Yuan, Keerthiram Murugesan, Vincent Galassi, Chuxu Zhang, Yanfang Ye

Structured Data in NLP

Challenge:	Existing methods for nutrition question answering face limited reasoning capacity and contextual overload . poor dietary patterns are associated with more than 11 million deaths in 2017 .
Approach:	They propose a framework that enables supervised multi-agent collaboration for nutritional QA.
Outcome:	The proposed framework outperforms single-agent and ensemble baselines in multi-agency reasoning tasks.

RISER: Orchestrating Latent Reasoning Skills for Adaptive Activation Steering (2026.findings-acl)

Copied to clipboard

Wencheng Ye, Xiaoyang Yuan, Yi Bin, Hengyu Jin, Liang Peng, Pengpeng Zeng, Heng Tao Shen

LLM Safety From Within: Detecting Harmful Content with Internal Representations (2026.acl-long)

Challenge:	Existing methods for domain-specific reasoning with large language models require updating parameter updates.
Approach:	They propose a plug-and-play intervention framework that adaptively steers LLM reasoning in activation space.
Outcome:	The proposed framework achieves zero-shot accuracy improvements of 3.4–6.5% over the base model while outperforming chain-of-thought-style reasoning with 2–3 higher token efficiency and robust accuracy gains.

Copied to clipboard

Difan Jiao, Yilun Liu, Ye Yuan, Zhenwei Tang, Linfeng Du, Haolun Wu, Ashton Anderson

Representation Learning

Challenge:	State-of-the-art guard models rely on terminal-layer representations and overlook safety-relevant features encoded across internal layers.
Approach:	They propose a lightweight guard model that harnesses safety neurons from LLM internals without modifying the underlying model.
Outcome:	The proposed model outperforms open-source guard models across multiple benchmarks while using 250 fewer trainable parameters.

x1: Learning to Think Adaptively Across Languages and Cultures (2026.findings-acl)

Copied to clipboard

Yangfan Ye, Xiaocheng Feng, Xiachong Feng, Yichong Huang, Zekun Yuan, Lei Huang, Weitao Ma, Qichen Hong, Yunfei Lu, Dandan Tu, Bing Qin

DORA: A Dual-Objective Reinforcement Learning Framework for Effective and Efficient Multimodal Agentic Search (2026.acl-long)

Challenge:	Existing large language models (LLMs) ignore this diversity by reasoning in a single dominant language.
Approach:	They propose a family of reasoning models that can adaptively reason in an advantageous language on a per-instance basis.
Outcome:	The proposed model can reason in a single dominant language on a per-instance basis.

Copied to clipboard

Guangming Qin, Yuhao Deng, Yukun Zhao, Zhenyang Li, Junfeng Wang, Dawei Yin, Ye Yuan, Guoren Wang, Yizhou Yan, Chengliang Chai, Lei Cao

TREA: Tree-Structure Reasoning Schema for Conversational Recommendation (2023.acl-long)

Challenge:	Existing methods to train large language models overlook quality of intermediate search results . existing methods often invoke search calls during reasoning, making inference inefficient .
Approach:	They propose a dual-objective reinforcement learning framework to improve search strategies of MLLMs . DORA outperforms state-of-the-art methods, achieving up to 8.4% higher accuracy .
Outcome:	The proposed model outperforms state-of-the-art methods while reducing search calls by 9.7%.

Copied to clipboard

Wendi Li, Wei Wei, Xiaoye Qu, Xian-Ling Mao, Ye Yuan, Wenfeng Xie, Dangyang Chen

Natural Language Interfaces

Challenge:	Recent reasoning-based models cannot fully figure out complex causal relationships between mentioned entities with external knowledge.
Approach:	They propose a Tree structure Reasoning schEmA that constructs a multi-hierarchical scalable tree as the reasoning structure to clarify the causal relationships between mentioned entities.
Outcome:	Extensive experiments on two public CRS datasets show the proposed model works.

Bridging the Sensory Gap: Visual Injection for Taxonomy Completion (2026.acl-long)

Copied to clipboard

Yuhang Niu, Hongyuan Xu, Ciyi Liu, Bofan Wei, Jiaqi Ye, Yanlong Wen, Xiaojie Yuan

Discover and Prove: An Open-source Agentic Framework for Hard Mode Automated Theorem Proving in Lean 4 (2026.acl-long)

Challenge:	Existing text-only methods suffer from a "Sensory Gap" in integrating new concepts into existing hierarchies.
Approach:	They propose a framework leveraging Visual Injection for Taxonomy Completion that maps synthesized images into intrinsic pseudo-tokens and decouples magnitude from selection to prevent visual signals from being drowned out.
Outcome:	Experiments on three datasets show that VITC achieves state-of-the-art performance . it delivers an average absolute gain of over 19% in Hit@1.

Copied to clipboard

Chengwu Liu, Yichun Yin, Ye Yuan, Jiaxuan Xie, Botao Li, Siqi Li, Jianhao Shen, Yan Xu, Lifeng Shang, Ming Zhang

POINTS-Reader: Distillation-Free Adaptation of Vision-Language Models for Document Conversion (2025.emnlp-main)

Challenge:	Existing approaches to solving mathematical problems fall into two broad categories: informal methods and formal methods.
Approach:	They propose to use LLM natural-language reasoning to discover answers . they introduce Discover And Prove framework that rewrites Hard Mode statements into Easy Mode ones for existing ATP provers.
Outcome:	The proposed framework can be used to prove hard mode statements on ATP benchmarks.

Copied to clipboard

Yuan Liu, Zhongyin Zhao, Le Tian, Haicheng Wang, Xubing Ye, Yangxiu You, Zilin Yu, Chuhan Wu, Zhou Xiao, Yang Yu, Jie Zhou

CC-Tuning: A Cross-Lingual Connection Mechanism for Improving Joint Multilingual Supervised Fine-Tuning (2025.acl-long)

Challenge:	Existing approaches to training document conversion models with manual annotation are costly and time-consuming, and training student models by distilling outputs from teacher models can significantly limit their performance in real-world applications.
Approach:	They propose a fully automated framework for constructing high-quality document extraction datasets and models capable of handling diverse document formats and layouts.
Outcome:	The proposed model outperforms existing models and improves on annotated documents.

Copied to clipboard

Yangfan Ye, Xiaocheng Feng, Zekun Yuan, Xiachong Feng, Libo Qin, Lei Huang, Weitao Ma, Yichong Huang, Zhirui Zhang, Yunfei Lu, Xiaohui Yan, Duyu Tang, Dandan Tu, Bing Qin

Multilinguality

Challenge:	Existing fine-tuning approaches that focus on English-centric training corpora often introduce implicit cross-lingual alignment, overlooking the potential for more profound, latent-level cross-linguistic interactions.
Approach:	They propose a multilingual fine-tuning paradigm that explicitly establishes a cross-lingual connection mechanism at the latent level.
Outcome:	The proposed model outperforms vanilla SFT and offers a strong latent-level alternative to data-level augmentation methods.

Demystifying Uncertainty in LLMs: Active Calibration between Concepts and Human Evaluations (2026.acl-long)

Copied to clipboard

Pengqi Li, Lizhong Ding, Zhehao Zhou, Chunhui Zhang, Jiarun Fu, Hao Li, Ye Yuan, Guoren Wang

Preference Heads in Large Language Models: A Mechanistic Framework for Interpretable Personalization (2026.acl-long)

Challenge:	Existing static strategies for mitigating hallucinations do not explicitly model the information gain from interacting with the external environment.
Approach:	They propose a calibration-driven interactive learning strategy that selects clarification queries by optimizing calibration error.
Outcome:	The proposed method provides theoretical guarantees and empirical gains for reliability.

Copied to clipboard

Weixu Zhang, Ye Yuan, Changjiang Han, Yuxing Tian, Zipeng Sun, Linfeng Du, Jikun Kang, Hong Kang, Xue Liu, Haolun Wu

VLMInferSlow: Evaluating the Efficiency Robustness of Large Vision-Language Models as a Service (2025.acl-long)

Challenge:	Large Language Models exhibit strong implicit personalization ability, but most approaches treat this behavior as a black box.
Approach:	They propose a mechanistic interpretation perspective and propose 'sparse' set of Preference Heads . they compute a Preference Contribution Score for each attention head and compare their predictions .
Outcome:	The proposed framework computes a Preference Contribution Score (PCS) for each attention head and measures its causal impact on user aligned outputs.

Copied to clipboard

Xiasi Wang, Tianliang Yao, Simin Chen, Runqi Wang, Lei Ye, Kuofeng Gao, Yi Huang, Yuan Yao

Shallow Focus, Deep Fixes: Enhancing Shallow Layers Vision Attention Sinks to Alleviate Hallucination in LVLMs (2025.emnlp-main)

Challenge:	Existing studies evaluate efficiency robustness of vision-language models under unrealistic assumptions, requiring access to model architecture and parameters.
Approach:	They propose a novel approach to evaluate VLM efficiency robustness in a realistic black-box setting.
Outcome:	The proposed approach generates adversarial images with imperceptible perturbations, increasing the computational cost by up to 128.47%.

Copied to clipboard

Xiaofeng Zhang, Yihao Quan, Chen Shen, Chaochen Gu, Xiaosong Yuan, Shaotian Yan, Jiawei Cao, Hao Cheng, Kaijie Wu, Jieping Ye

Does Recommend-Revise Produce Reliable Annotations? An Analysis on Missing Instances in DocRED (2022.acl-long)

Challenge:	Multimodal large language models (MLLMs) demonstrate excellent abilities for understanding visual information, but the hallucination remains a challenging problem.
Approach:	They propose a training-free approach to enhance vision attention sinks to facilitate convergence of the image token attention sink within shallow layers.
Outcome:	The proposed approach improves the convergence of the image token attention sink within shallow layers and strengthens the layer’s focus on the image itself.

Copied to clipboard

Quzhe Huang, Shibo Hao, Yuan Ye, Shengqi Zhu, Yansong Feng, Dongyan Zhao

Challenge:	Document-level relation extraction is a challenging task as it requires reasoning across multiple sentences.
Approach:	They propose to use a recommend-revise scheme to reduce the workload of annotators by providing them with candidate relation instances from distant supervision to supplement and remove relational facts.
Outcome:	The proposed dataset is the first large-scale and human-annotated dataset for relation extraction.

ToolHop: A Query-Driven Benchmark for Evaluating Large Language Models in Multi-Hop Tool Use (2025.acl-long)

Copied to clipboard

Junjie Ye, Zhengyin Du, Xuesong Yao, Weijian Lin, Yufei Xu, Zehui Chen, Zaiyuan Wang, Sining Zhu, Zhiheng Xi, Siyu Yuan, Tao Gui, Qi Zhang, Xuanjing Huang, Jiecao Chen

Measuring Social Norms of Large Language Models (2024.findings-naacl)

Challenge:	Effective evaluation of multi-hop tool use is critical for analyzing the understanding, reasoning, and function-calling capabilities of large language models.
Approach:	They propose a dataset that provides rigorous evaluation of multi-hop tool use.
Outcome:	The proposed model achieves 49.04% accuracy across five model families.

Copied to clipboard

Ye Yuan, Kexin Tang, Jianhao Shen, Ming Zhang, Chenguang Wang

MMEvalPro: Calibrating Multimodal Benchmarks Towards Trustworthy and Efficient Evaluation (2025.naacl-long)

Challenge:	Existing datasets that evaluate a general understanding of social science are inadequate to understand social norms.
Approach:	They propose a multi-agent framework to improve large language models’ ability to understand social norms by comparing them to elementary students.
Outcome:	The proposed framework improves large language models to be on par with humans.

Copied to clipboard

Jinsheng Huang, Liang Chen, Taian Guo, Fu Zeng, Yusheng Zhao, Bohan Wu, Ye Yuan, Haozhe Zhao, Zhihui Guo, Yichi Zhang, Jingyang Yuan, Wei Ju, Luchen Liu, Tianyu Liu, Baobao Chang, Ming Zhang

TextFlint: Unified Multilingual Robustness Evaluation Toolkit for Natural Language Processing (2021.acl-demo)

Challenge:	Large Multimodal Models (LMMs) exhibit impressive cross-modal understanding and reasoning abilities, but many benchmarks suffer from systematic biases.
Approach:	They propose a benchmark to avoid Type-I errors by creating one perception question and one knowledge anchor question through a meticulous annotation process.
Outcome:	The proposed benchmark avoids Type-I errors while maintaining reliability of MCQ evaluations.

Copied to clipboard

Xiao Wang, Qin Liu, Tao Gui, Qi Zhang, Yicheng Zou, Xin Zhou, Jiacheng Ye, Yongxin Zhang, Rui Zheng, Zexiong Pang, Qinzhuo Wu, Zhengyan Li, Chong Zhang, Ruotian Ma, Zichu Fei, Ruijian Cai, Jun Zhao, Xingwu Hu, Zhiheng Yan, Yiding Tan, Yuan Hu, Qiyuan Bian, Zhihua Liu, Shan Qin, Bolin Zhu, Xiaoyu Xing, Jinlan Fu, Yue Zhang, Minlong Peng, Xiaoqing Zheng, Yaqian Zhou, Zhongyu Wei, Xipeng Qiu, Xuanjing Huang

Robustness in NLP

Challenge:	Existing approaches to textual robustness evaluation focus on slightly modifying the input data, which maintains the original meaning and results in a different prediction.
Approach:	They propose a multilingual robustness evaluation toolkit for NLP that integrates universal text transformations, task-specific transformations and adversarial attack.
Outcome:	The toolkit includes universal text transformation, task-specific transformation, adversarial attack, subpopulation, and their combinations to provide comprehensive robustness analyses.

DocRED: A Large-Scale Document-Level Relation Extraction Dataset (P19-1)

Copied to clipboard

Yuan Yao, Deming Ye, Peng Li, Xu Han, Yankai Lin, Zhenghao Liu, Zhiyuan Liu, Lixin Huang, Jie Zhou, Maosong Sun