Papers by Ye Jiang

MusicAgent: An AI Agent for Music Understanding and Generation with Large Language Models (2023.emnlp-demo)

Challenge:	Existing vision-language models lack spatial reasoning capability, despite their ability to comprehend spatial arrangements and model structural relations.
Approach:	They propose a benchmark to evaluate vision-language models' spatial perception, structural understanding, and reasoning capabilities by minimizing reliance on domain-specific knowledge.
Outcome:	The proposed benchmark is based on 1,100 carefully curated real-world images with high spatial complexity.

Copied to clipboard

Dingyao Yu, Kaitao Song, Peiling Lu, Tianyu He, Xu Tan, Wei Ye, Shikun Zhang, Jiang Bian

CoCA: Fusing Position Embedding with Collinear Constrained Attention in Transformers for Long Context Window Extending (2024.acl-long)

Challenge:	MusicAgent integrates numerous music-related tools and an autonomous workflow to address user requirements.
Approach:	a new system is built to integrate music-related tools and an autonomous workflow . the system is based on large language models (LLMs) that can be used to organize and decompose requests .
Outcome:	the proposed system integrates numerous music-related tools and an autonomous workflow to address user requirements.

Copied to clipboard

Shiyi Zhu, Jing Ye, Wei Jiang, Siqiao Xue, Qi Zhang, Yifan Wu, Jianguo Li

Capturing Event Argument Interaction via A Bi-Directional Entity-Level Recurrent Decoder (2021.acl-long)

Challenge:	Existing models that use self-attention and position embedding have anomalous behavior that hinder long context window extrapolation.
Approach:	They propose a collinear constraint between Q and K to integrate RoPE and self-attention.
Outcome:	The proposed model integrates self-attention and position embedding into LLMs without fine-tuning.

Copied to clipboard

Xi Xiangyu, Wei Ye, Shikun Zhang, Quanxiu Wang, Huixing Jiang, Wei Wu

IM^2: an Interpretable and Multi-category Integrated Metric Framework for Automatic Dialogue Evaluation (2022.emnlp-main)

Challenge:	Existing efforts to capture event argument interactions are limited by the argument role type information of contextual entities.
Approach:	They propose to capture event argument interactions as a Seq2Seq-like learning problem where a sentence with a specific event trigger is mapped to a sequence of event argument roles.
Outcome:	The proposed neural architecture generates argument roles by incorporating contextual entities’ argument role predictions, like a word-by-word text generation process, thereby distinguishing implicit argument distribution patterns within an event more accurately.

Copied to clipboard

Zhihua Jiang, Guanghui Ye, Dongning Rao, Di Wang, Xin Miao

Dialogue Systems & Conversational Agents

Challenge:	Evaluation metrics for dialogue systems are expensive and time-consuming . current evaluation metrics focus on a single quality or several qualities .
Approach:	They propose an interpretable, multi-faceted, and controllable framework to combine dialogue metrics which are good at measuring different qualities.
Outcome:	The proposed framework integrates a large number of evaluation metrics to improve the performance of the model.

Vision Language Pre-training by Contrastive Learning with Cross-Modal Similarity Regulation (2023.acl-long)

Copied to clipboard

Chaoya Jiang, Wei Ye, Haiyang Xu, Songfang Huang, Fei Huang, Shikun Zhang

Make-A-Voice: Revisiting Voice Large Language Models as Scalable Multilingual and Multitask Learners (2024.acl-long)

Challenge:	Large-scale pre-trained vision-language models have recently achieved tremendous success on a wide range of cross-modal tasks.
Approach:	They propose a new framework for a semantically-aware contrastive learning that minimizes the MI between false negative and positive samples .
Outcome:	The proposed framework minimizes the MI between false negative samples and positive samples even though they share similar semantics.

Copied to clipboard

Rongjie Huang, Chunlei Zhang, Yongqi Wang, Dongchao Yang, Jinchuan Tian, Zhenhui Ye, Luping Liu, Zehan Wang, Ziyue Jiang, Xuankai Chang, Jiatong Shi, Chao Weng, Zhou Zhao, Dong Yu

Rehearsal-free Continual Language Learning via Efficient Parameter Isolation (2023.acl-long)

Challenge:	Large language models (LLMs) have been used for general-purpose interfaces across multiple tasks and languages.
Approach:	They propose to use large language models as a general-purpose interface across multiple tasks and languages.
Outcome:	The proposed model performs better on 200K hours of 6-language data for voice generation applications.

Copied to clipboard

Zhicheng Wang, Yufang Liu, Tao Ji, Xiaoling Wang, Yuanbin Wu, Congcong Jiang, Ye Chao, Zhencong Han, Ling Wang, Xu Shao, Wenqiu Zeng

Green & Sustainable NLP

Challenge:	Existing methods for learning continual tasks do not cache history data, which makes the problem more challenging.
Approach:	They propose a method that allocates a small portion of private parameters and learns them with a shared pre-trained model.
Outcome:	The proposed method is comparable to existing methods and comparable to those using historical data.

GeAR: Graph-enhanced Agent for Retrieval-augmented Generation (2025.findings-acl)

Copied to clipboard

Zhili Shen, Chenxin Diao, Pavlos Vougiouklis, Pascual Merita, Shriram Piramanayagam, Enting Chen, Damien Graux, Andre Melo, Ruofei Lai, Zeren Jiang, Zhongyang Li, Ye Qi, Yang Ren, Dandan Tu, Jeff Z. Pan

Improving Preference Alignment of LLM with Inference-Free Self-Refinement (2025.findings-emnlp)

Challenge:	Retrieval-augmented Generation (RAG) relies on effective retrieval capabilities, yet traditional sparse and dense retrievers struggle with multi-hop retrieval scenarios.
Approach:	They propose a graph expansion mechanism that augments any conventional base retriever and an agent framework that incorporates the resulting graph-based retrieval into a multi-step retrieval framework.
Outcome:	The proposed system achieves state-of-the-art results on three multi-hop question answering datasets while consuming fewer tokens and requiring fewer iterations than existing multi-step retrieval systems.

Copied to clipboard

Fukun Ma, Kaibin Tian, Jieting Xue, Xiaoyi Wang, Ye Ma, Quan Chen, Peng Jiang, Lijie Wen

Challenge:	Large language models (LLMs) develop in-context learning capability through pretraining and instruction tuning.
Approach:	Large language models (LLMs) develop in-context learning capability through pretraining and instruction tuning.
Outcome:	Experiments show that incorporating IFSR into preference alignment yields performance improvement over 10%.

Unearthing Gems from Stones: Policy Optimization with Negative Sample Augmentation for LLM Reasoning (2025.findings-emnlp)

Copied to clipboard

Zhaohui Yang, Yuxiao Ye, Shilei Jiang, Shihong Deng, Chen Hu, Linjing Li, Daxin Jiang

AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling (2024.acl-long)

Challenge:	Recent advances in reasoning language models have witnessed a paradigm shift from short to long CoT pattern.
Approach:	They propose a behavior-constrained policy gradient with negative sample augmented (BCPG-NSA) negative steps are valuable components in long CoT models, authors argue .
Outcome:	The proposed framework outperforms baselines on math/coding reasoning benchmarks using the same training dataset.

Copied to clipboard

Jun Zhan, Junqi Dai, Jiasheng Ye, Yunhua Zhou, Dong Zhang, Zhigeng Liu, Xin Zhang, Ruibin Yuan, Ge Zhang, Linyang Li, Hang Yan, Jie Fu, Tao Gui, Tianxiang Sun, Yu-Gang Jiang, Xipeng Qiu

StructGPT: A General Framework for Large Language Model to Reason over Structured Data (2023.emnlp-main)

Challenge:	Existing language models that use discrete representations for unified processing of various modalities are limited to text generation and do not include multimodal output.
Approach:	They propose a multimodal language model that utilizes discrete representations for unified processing of various modalities.
Outcome:	The proposed model can be trained stably without any alterations to existing models or training paradigms.

Copied to clipboard

Jinhao Jiang, Kun Zhou, Zican Dong, Keming Ye, Xin Zhao, Ji-Rong Wen

MAssistant: A Personal Knowledge Assistant for MOOC Learners (D19-3)

Challenge:	Experiments conducted on three types of structured data show that StructGPT greatly improves the performance of LLMs.
Approach:	They propose an iterative Reading-then-Reasoning framework to solve question answering tasks based on structured data.
Outcome:	The proposed framework improves the reasoning ability of large language models over structured data under the few-shot and zero-shot settings.

Copied to clipboard

Lan Jiang, Shuhan Hu, Mingyu Huang, Zhichun Wang, Jinjian Yang, Xiaoju Ye, Wei Zheng

LSTDial: Enhancing Dialogue Generation via Long- and Short-Term Measurement Feedback (2024.naacl-long)

Challenge:	Massive Open Online Courses (MOOCs) have experienced a rapid development since 2012 . many MOOC platforms have been launched, including Coursera1 , edX2 , and Udacity3 etc.
Approach:	They present a personal knowledge assistant system called MAssistant for MOOC learners . MAsistants has a large-scale concept graph built from open data . it also provides a browser extension which interacts with users during video lectures .
Outcome:	The proposed system helps users trace the concepts they have learned in MOOCs, and to build their own concept graphs.

Copied to clipboard

Guanghui Ye, Huan Zhao, Zixing Zhang, Xupeng Zha, Zhihua Jiang

Dialogue Systems & Conversational Agents

Challenge:	Existing dialogue systems do not utilize quality dimensions specifically designed for dialogue evaluation to guide the response generation during training.
Approach:	They propose a two-stage framework which generates and utilizes conversation evaluation as explicit feedback during training.
Outcome:	The proposed framework generates and utilizes conversation evaluation as explicit feedback during training.

Towards Hierarchical Multi-Step Reward Models for Enhanced Reasoning in Large Language Models (2026.findings-acl)

Copied to clipboard

Teng Wang, Jiang Zhangyi, Zhenqi He, Hailei Gong, Shenyang Tong, Wenhan Yang, Zeyu Li, Yanan Zheng, Zifan He, Zewen Ye, Shengjie Ma, Jianping Zhang

TAMA: Target-Aware Multilingual Abuse Detection by Cascaded Conditional Multi-Task Learning (2026.acl-long)

Challenge:	Existing Process Reward Models (PRMs) are vulnerable to reward hacking and require expensive, large-scale annotation of reasoning steps.
Approach:	They propose a reward model approach which evaluates both individual and consecutive reasoning steps from fine-grained and coarse-grounded level.
Outcome:	Empirical results show that the proposed model performs better than existing PRMs and is more robust than existing models.

Copied to clipboard

JiYan Liu, Youzheng Liu, Taihang Wang, Yimin Wang, Ye Jiang, Diana Maynard

Automatic and Reliable Evaluation for Academic Caption-to-Figure Generation with LMMs (2026.acl-long)

Challenge:	Existing models for protecting public figures from online abuse ignore who is targeted and how.
Approach:	They propose a target-aware multi-task framework that conditions downstream predictions on upstream beliefs via three lightweight modules: Cross-Task Feature Fusion (CTF), Task-Adaptive Gating (TAG), and Label-Guided Span Detection (LGSD).
Outcome:	The proposed framework yields higher average F1 than single-task training and standard multi-task learning.

Copied to clipboard

Guanghui Ye, Huan Zhao, Qin Zhu, Fengnan Li, Jiaqi Li, Yixian Shen, Zhonghao Ren, Zhihua Jiang

AgentThink: A Unified Framework for Tool-Augmented Chain-of-Thought Reasoning in Vision-Language Models for Autonomous Driving (2025.findings-emnlp)

Challenge:	Existing datasets for evaluating text-to-image generation focus mostly on real-life images, which poses challenges for assessing academic figure generation given real scientific captions.
Approach:	They propose a dataset that first provides a Holistic Evaluation for Academic caption-to-Figure Generation (HE4AFG) they collect real figure captions from 8 scientific domains and generate 3,900 evaluation samples .
Outcome:	The proposed model provides high-quality human ratings in terms of three aspects—scientific aesthetic (SA), topic relevance (TR), and attribute correctness (AC).

Copied to clipboard

Kangan Qian, Sicong Jiang, Yang Zhong, Ziang Luo, Zilin Huang, Tianze Zhu, Kun Jiang, Mengmeng Yang, Zheng Fu, Jinyu Miao, Yining Shi, He Zhe Lim, Li Liu, Tianbao Zhou, Hongyi Wang, Huang Yu, Yifei Hu, Guang Li, Guang Chen, Hao Ye, Lijun Sun, Diange Yang

RBPtool: A Deep Language Model Framework for Multi-Resolution RBP-RNA Binding Prediction and RNA Molecule Design (2025.emnlp-main)

Challenge:	Vision-Language Models struggle with hallucinations, inefficient reasoning, and limited real-world validation hinders accurate perception and robust step-by-step reasoning.
Approach:	AgentThink integrates Chain-of-Thought reasoning with dynamic, agent-style tool invocation for autonomous driving tasks.
Outcome:	Experiments on the DriveLMM-o1 benchmark show AgentThink significantly boosts overall reasoning scores by 53.91% and enhances answer accuracy by 33.54% .

Copied to clipboard

Jiyue Jiang, Yitao Xu, Zikang Wang, Yihan Ye, Yanruisheng Shao, Yuheng Shan, Jiuming Wang, Xiaodan Fan, Jiao Yuan, Yu Li

Same Claim, Different Judgment: Benchmarking Scenario-Induced Bias in Multilingual Financial Misinformation Detection (2026.findings-acl)

Challenge:	RNA-binding proteins play key roles in post-transcriptional gene regulation . existing methods focus on shallow sequence features or coarse structural representations . large language models allow for precise modeling and biologically informed de novo RNA design .
Approach:	They extend RPI15223 into a multi-resolution, structure-level RBP-RNA dataset and introduce RBPtool, a framework that fuses sequence and structural information.
Outcome:	The proposed framework achieves state-of-the-art performance on public benchmarks and the RPI15223 dataset while supporting fine-grained level predictions.

Copied to clipboard

Zhiwei Liu, Yupeng Cao, Yuechen Jiang, Mohsinul Kabir, Polydoros Giannouris, Chen Xu, Ziyang Xu, Tianlei Zhu, Md. Tariquzzaman, Triantafillos Papadopoulos, Yan Wang, Lingfei Qian, Xueqing Peng, Zhuohan Xie, Ye Yuan, Saeed Almheiri, Abdulrazzaq Alnajjar, Ming-Bin Chen, Harry Stuart, Paul Thompson, Prayag Tiwari, Alejandro Lopez-Lira, Xue Liu, Jimin Huang, Sophia Ananiadou

CLAIM: Mitigating Multilingual Object Hallucination in Large Vision-Language Models with Cross-Lingual Attention Intervention (2025.acl-long)

Challenge:	Existing research on LLM biases has focused on direct questioning or general-purpose settings . pronounced behavioral biase despite their growing deployment in financial analysis, forecasting, and decision support.
Approach:	They propose a benchmark to evaluate behavioral biases of large language models in MFMD . they use a multilingual financial misinformation dataset to integrate these with misinformation claims .
Outcome:	The proposed benchmark evaluates behavioral biases of large language models across economic scenarios.

Copied to clipboard

Zekai Ye, Qiming Li, Xiaocheng Feng, Libo Qin, Yichong Huang, Baohang Li, Kui Jiang, Yang Xiang, Zhirui Zhang, Yunfei Lu, Duyu Tang, Dandan Tu, Bing Qin

CAGenMol: Condition-Aware Diffusion Language Model for Goal-Directed Molecular Generation (2026.findings-acl)

Challenge:	Large Vision-Language Models (LVLMs) have impressive multimodal abilities but remain prone to multilingual object hallucination.
Approach:	They propose a cross-lingual attention intervention method to mitigate multilingual object hallucination in LVLMs by aligning attention patterns.
Outcome:	The proposed method improves 13.56% (up to 30%) on the POPE and 21.75% on the hallucination subsets across languages.

Copied to clipboard

Yanting Li, Zhuoyang Jiang, Enyan Dai, Lei Wang, Wen-Cai Ye, Li Liu

MADS: Multi-Agent Dialogue Simulation for Diverse Persuasion Data Generation (2025.emnlp-industry)

Challenge:	Existing methods to optimize target-directed molecular generation fail to reconcile conflicting objectives without compromising structural validity.
Approach:	They propose a condition-aware discrete diffusion framework that allows for conditional denoising guided by heterogeneous structural and property signals.
Outcome:	The proposed framework improves on structure-conditioned, property-conditioned and dual-conditioned benchmarks in binding affinity, drug-likeness, and success rate.

Copied to clipboard

Mingjin Li, Yu Liu, Huayi Liu, Xiang Ye, Chao Jiang, Hongguang Zhang, Yu Ruan

Natural Language Interfaces

Challenge:	Recent studies show that LLM-based agents exhibit superior moral and emotional language performance compared to humans, raising expectations for their deployment in persuasive tasks.
Approach:	They propose a framework for generating persuasive multi-turn dialogues via agent self-play using user agents designed to simulate diverse persona-driven behaviors, a Dialog Agent executing task-oriented persuasion strategies and an Optimization Agent evaluating and refining dialogue outcomes.
Outcome:	The proposed framework significantly improved the persuasion capacity of small LLMs, increasing the organic traffic conversion rate by 22.4% (from 1.83% to 2.24%) .

Knowledge Image Matters: Improving Knowledge-Based Visual Reasoning with Multi-Image Large Language Models (2025.acl-long)

Copied to clipboard

Guanghui Ye, Huan Zhao, Zhixue Zhao, Xupeng Zha, Yang Liu, Zhihua Jiang

Too Good to be Bad: On the Failure of LLMs to Role-Play Villains (2026.findings-acl)

Challenge:	Knowledge-based visual reasoning (KB-VR) is a challenging task, as it requires machines not only to understand concepts and relationships of visual scenes, but also to associate them with external world knowledge to perform chain of reasoning on open-world questions.
Approach:	They propose a visual knowledge card (VKC) that integrates internal visual knowledge and external world knowledge produced by a knowledge generator into an image.
Outcome:	The proposed model achieves new state-of-the-art results compared to previous top-performing models on three popular KB-VR benchmarks.

Copied to clipboard

Zihao Yi, Qingxuan Jiang, Ruotian Ma, Xingyu Chen, Qu Yang, Mengru Wang, Fanghua Ye, Ying Shen, Zhaopeng Tu, Xiaolong Li, Liefeng Bo

Challenge:	Large Language Models (LLMs) are increasingly tasked with creative generation, but their ability to portray non-prosocial, antagonistic personas remains largely unexamined.
Approach:	They propose a moral alignment benchmark to test the safety of large language models . they find that models struggle with traits directly antithetical to safety principles .
Outcome:	The proposed model fails to accurately portray morally ambiguous or villainous characters . the model fails most with traits directly antithetical to safety principles .

Rethinking the Roles of Large Language Models in Chinese Grammatical Error Correction (2025.acl-industry)

Copied to clipboard

Yinghui Li, Shang Qin, Jingheng Ye, Haojing Huang, Yangning Li, Shu-Yu Guo, Libo Qin, Xuming Hu, Wenhao Jiang, Hai-Tao Zheng, Philip S. Yu

CMQCIC-Bench: A Chinese Benchmark for Evaluating Large Language Models in Medical Quality Control Indicator Calculation (2025.findings-acl)

Challenge:	Recent studies have shown that Large Language Models’ performance as correctors on Chinese Grammatical Error Correction (CGEC) remains unsatisfactory due to the challenging nature of the task.
Approach:	They propose a training framework EXAM that uses LLMs as explainers to enhance CGEC small models and a novel evaluation method SEE that utilizes LLM as evaluators to bring more reasonable evaluations.
Outcome:	The proposed methods improve the performance of LLMs on Chinese Grammatical Error Correction (CGEC) task.

Copied to clipboard

Guangya Yu, Yanhao Li, Zongying Jiang, Yuxiong Jin, Li Dai, Yupian Lin, Ruihui Hou, Weiyan Zhang, Yongqi Fan, Qi Ye, Jingping Liu, Tong Ruan

Exploring Multilingual Pre-trained Language Model for Aspect-based Sentiment Analysis (2026.findings-acl)

Challenge:	Medical quality control indicators are essential to assess the qualifications of healthcare institutions for medical services.
Approach:	They propose a Chinese electronic medical records-based dataset for MQCIC and propose CF-IR method that disentangles clinical fact verification and inferential rule reasoning actions.
Outcome:	The proposed method outperforms Chain-of-Thought methods on 20 representative LLMs, covering general and medical models.

Copied to clipboard

Ye Wang, Ruijun Jiang, Zhongqing Wang, Guodong Zhou

Sentient Agent as a Judge: Evaluating Higher-Order Social Cognition in Large Language Models (2026.findings-acl)

Challenge:	Aspect-based sentiment analysis studies have focused on English datasets, but labeled data is scarce.
Approach:	They propose a multilingual pre-trained language model that leverages bilingual pre-training to leverage aspects-based sentiment analysis.
Outcome:	The proposed model outperforms state-of-the-art models across multiple languages.

Copied to clipboard

Bang Zhang, Ruotian Ma, Qingxuan Jiang, Peisong Wang, Jiaqi Chen, Zheng Xie, Xingyu Chen, Yue Wang, Fanghua Ye, Jian Li, Yifan Yang, Zhaopeng Tu, Xiaolong Li

Boosting Policy and Process Reward Models with Monte Carlo Tree Search in Open-Domain QA (2025.findings-acl)

Challenge:	Large language models (LLMs) have evolved from statistical sequence predictors to sophisticated autonomous agents capable of reasoning, planning, and sustaining multi-turn conversa-tions.
Approach:	They propose a system that instantiates a "Sentient Agent" that simulates human-like emotional changes and inner thoughts to provide a more realistic evaluation of the model in multi-turn conversations.
Outcome:	The proposed framework measures the agent's higher-order social cognition in multi-turn conversations.

Copied to clipboard

Chi-Min Chan, Chunpu Xu, Junqi Zhu, Jiaming Ji, Donghai Hong, Pengcheng Wen, Chunyang Jiang, Zhen Ye, Yaodong Yang, Wei Xue, Sirui Han, Yike Guo

Question Answering

Challenge:	Experimental results show that our approach can effectively improve the performance of both the policy model and the reward model.
Approach:	They propose to use Monte Carlo Tree Search for both policy model improvement and reward model improvement to bridge it to more subtle open-domain question answering.
Outcome:	The proposed approach surpasses existing methods for annotation and training data with fewer data points and achieves better performance in test-time scaling strategies.

HICD: Hallucination-Inducing via Attention Dispersion for Contrastive Decoding to Mitigate Hallucinations in Large Language Models (2025.findings-acl)

Copied to clipboard

Xinyan Jiang, Hang Ye, Yongxin Zhu, Xiaoying Zheng, Zikang Chen, Jun Gong

Structure-aware Domain Knowledge Injection for Large Language Models (2025.acl-long)

Challenge:	Large Language Models (LLMs) often generate hallucinations, producing outputs that are contextually inaccurate or factually incorrect.
Approach:	They propose a method that selects attention heads crucial to the model's prediction as inducing heads and induces hallucinations by dispersing attention of these inducers.
Outcome:	The proposed method significantly improves performance on tasks requiring contextual faithfulness, reading comprehension, and question answering.

Copied to clipboard

Kai Liu, Ze Chen, Zhihang Fu, Wei Zhang, Rongxin Jiang, Fan Zhou, Yaowu Chen, Yue Wu, Jieping Ye

Beyond Self-Report: Bridging the Intention-Behavior Gap in Critical Thinking Assessment via Interpretable Multi-Agent System (2026.acl-long)

Challenge:	Structure-aware Continual Pre-Training (SCPT) and Structure-Aware Supervised Fine-Tuning (SSFT) are two-stage strategies for knowledge injection and alignment that reduces the training corpus needs to 5% while achieving 100% of traditional knowledge injection performance.
Approach:	They propose a method to efficiently transform foundation Large Language Models into domain specialists by using two-stage strategies: Structure-aware Continual Pre-Training and Structure-Aware Supervised Fine-Tuning.
Outcome:	The proposed method significantly reduces the training corpus needs to a mere 5% while achieving 100% of traditional knowledge injection performance.

Copied to clipboard

Zekun Li, Jifan Yu, Haoxuan Li, Ye He, Daniel Zhang-Li, Shangqing Tu, Joy Jia Yin Lim, Yikun Jiang, Jiaxin Yuan, Yu Zhang

NeuReasoner: Towards Explainable, Controllable, and Unified Reasoning via Mixture-of-Neurons (2026.acl-long)

Challenge:	Accurate assessment of critical thinking is limited by the Intention Behavior Gap in psychology . evaluators that measure self-reported competence are limited by multiagent architectures .
Approach:	They propose a framework that operationalizes cognitive assessment into an interpretable multi-agent workflow with Assessment Chain-of-Thought.
Outcome:	The proposed framework aligns better with human expert ratings than gold-standard inventories on large-scale simulations and human participants.

Copied to clipboard

Haonan Dong, Kehan Jiang, Haoran Ye, Wenhao Zhu, Zhaolu Kang, Guojie Song

Supportiveness-based Knowledge Rewriting for Retrieval-augmented Language Modeling (2025.findings-naacl)

Challenge:	Existing Large Reasoning Models (LRMs) lack explainability and controllability . Existing models target isolated levels without unification, while relying on RL .
Approach:	They propose an explainable, controllable, and unified reasoning framework driven by MoN.
Outcome:	The proposed framework achieves performance gains of 27.0% while reducing token consumption by 19.6% 63.3%.

Copied to clipboard

Zile Qiao, Wei Ye, Yong Jiang, Tong Mo, Pengjun Xie, Weiping Li, Fei Huang, Shikun Zhang

A Self-Evolving LLM Agent Framework for Role-Based Norm Compliance in Healthcare (2026.findings-acl)

Challenge:	Recent advances in large language models (LLMs) have significantly enhanced their performance in various natural language processing tasks.
Approach:	They propose a robust and pluggable knowledge rewriter that is optimized for LLM generation by supporting the model's supportiveness.
Outcome:	The proposed model can be used to rewrite knowledge in a supervised manner.

Copied to clipboard

Haijie Ruan, Xiaowu Jiang, Zhanpeng LI, Wei Jia, Xuanwu Xu, Xiao-Fen Shan, Shujie Chen, Xindong Ye

Exploiting Pseudo Image Captions for Multimodal Summarization (2023.findings-acl)

Challenge:	Existing systems treat roles as static prompts and rely on one-shot safety filters . a self-evolving LLM agent is proposed that learns from role-based social experience .
Approach:	They propose a self-evolving LLM agent that learns from role-based social experience and explicitly models communicator-level individual traits informed by prior communication questionnaires and clinical literature.
Outcome:	The proposed agent learns from role-based social experience and models communicator-level individual traits informed by prior communication questionnaires and clinical literature.

Copied to clipboard

Chaoya Jiang, Rui Xie, Wei Ye, Jinan Sun, Shikun Zhang

Text Generation

Challenge:	Existing approaches to multimodal summarization with multimodal output (MSMO) lack reference images for training, and exposure of image captions during training is inconsistent with MSMO’s task settings.
Approach:	They propose a coarse-to-fine image-text alignment mechanism to identify the most relevant sentence of each image in a document, resembling the role of image captions in capturing visual knowledge.
Outcome:	The proposed method sets up state-of-the-art on all intermodality and intramodality metrics and improves on image recommendation precision.

ProductAgent: Benchmarking Conversational Product Search Agent with Asking Clarification Questions (2025.emnlp-industry)

Copied to clipboard

Jingheng Ye, Yong Jiang, Xiaobin Wang, Yinghui Li, Yangning Li, Pengjun Xie, Fei Huang

Natural Language Interfaces

Challenge:	Recent advances in conversational information seeking (CIS) suggest a remedy for the lack of interactive clarification when people face unfamiliar domains.
Approach:	They propose a fully autonomous conversational information-seeking agent that couples large language models with a set of domain-specific tools to provide product demand clarification.
Outcome:	The proposed agent can iterate over 2,000 automatically generated sessions and score high on real-world evaluations without human annotation.

FluentSpeech: Stutter-Oriented Automatic Speech Editing with Context-Aware Diffusion Models (2023.findings-acl)

Copied to clipboard

Ziyue Jiang, Qian Yang, Jialong Zuo, Zhenhui Ye, Rongjie Huang, Yi Ren, Zhou Zhao

Enhancing In-Context Learning via Implicit Demonstration Augmentation (2024.acl-long)

Challenge:	Existing methods for speech editing still suffer from over-smoothing problem and lack of robustness due to stutter.
Approach:	They propose a stutter-oriented automatic speech editing model that incorporates sutter information into the hidden sequence.
Outcome:	The proposed model achieves state-of-the-art performance on a speech recording dataset . it can improve fluency of stuttering speech in terms of objective and subjective metrics.

Copied to clipboard

Xiaoling Zhou, Wei Ye, Yidong Wang, Chaoya Jiang, Zhemg Lee, Rui Xie, Shikun Zhang

Interpretable Charge Predictions for Criminal Cases: Learning to Generate Court Views from Fact Descriptions (N18-1)

Challenge:	In-context learning (ICL) is a new paradigm for pre-trained language models that can make predictions for unseen inputs without updating parameters.
Approach:	They propose a method that enables a model to augmented copies of a demonstration by leveraging their deep feature distribution and a logit calibration mechanism.
Outcome:	The proposed method significantly improves the average and worst-case accuracy across diverse PLMs and tasks.

Copied to clipboard

Hai Ye, Xin Jiang, Zhunchen Luo, Wenhan Chao

Explainability & Interpretability in NLP

Challenge:	Existing work on court view generation from fact descriptions has improved the working efficiency of legal assistant systems.
Approach:	They propose to decode court views conditioned on encoded charge labels from the fact description in a criminal case to improve interpretability of charge prediction systems.
Outcome:	The proposed model can generate court views conditioned on encoded charge labels.

ICA-Proto: Iterative Cross Alignment Prototypical Network for Incremental Few-Shot Relation Classification (2023.findings-eacl)

Copied to clipboard

Wangjie Jiang, Zhihao Ye, Bang Liu, Ruihui Zhao, Jianguang Zheng, Mengyao Li, Zhiyong Li, Yujiu Yang, Yefeng Zheng

Stratagem: Learning Transferable Reasoning via Trajectory-Modulated Game Self-Play (2026.acl-long)

Challenge:	Existing methods for relation classification suffer from the scarcity of manually annotated data.
Approach:	They propose a novel relation classification model that incorporates query representation into the encoding of novel prototypes and utilizes iteratively to achieve more interaction.
Outcome:	The proposed model outperforms the state-of-the-art model on two benchmark datasets.

Copied to clipboard

Xiachong Feng, Deyi Yin, Xiaocheng Feng, Yi Jiang, Libo Qin, Yangfan Ye, Lei Huang, Weitao Ma, Qiming Li, Yuxuan Gu, Bing Qin, Lingpeng Kong

Autonomous Workflow for Multimodal Fine-Grained Training Assistants Towards Mixed Reality (2024.findings-acl)

Challenge:	Existing self-play approaches to developing general reasoning in language models rely on terminal game outcomes.
Approach:	They propose a game-based reasoning transfer model that addresses two barriers to reasoning transfer.
Outcome:	The proposed model improves mathematical reasoning, general reasoning, and code generation benchmarks.

Copied to clipboard

Jiahuan Pei, Irene Viola, Haochen Huang, Junxiao Wang, Moonisa Ahsan, Fanghua Ye, Jiang Yiming, Yao Sai, Di Wang, Zhumin Chen, Pengjie Ren, Pablo Cesar

CLAPSpeech: Learning Prosody from Text Context with Contrastive Language-Audio Pre-Training (2023.acl-long)

Challenge:	a fine-grained, comprehensive understanding of multimodal environments remains under-explored.
Approach:	They propose an automated workflow for integrating AI agents into extended reality (XR) they propose a cerebral language agent that integrates LLM with memory, planning, and interaction with XR tools and a vision-language agent .
Outcome:	The proposed workflow integrates AI agents seamlessly into extended reality (XR) applications for fine-grained training.

Copied to clipboard

Zhenhui Ye, Rongjie Huang, Yi Ren, Ziyue Jiang, Jinglin Liu, Jinzheng He, Xiang Yin, Zhou Zhao

From Signal Degradation to Computation Collapse: Uncovering the Two Failure Modes of LLM Quantization (2026.findings-acl)

Challenge:	Existing methods for expressive text-to-speech only implicitly learn prosody with masked token reconstruction tasks.
Approach:	They propose a cross-modal contrastive pre-training framework that learns from prosody variance of the same text token under different contexts.
Outcome:	The proposed framework can learn from prosody variance of a text token under different contexts.

Copied to clipboard

Chenxi Zhou, Pengfei Cao, Jiang Li, Bohan Yu, Jinyu Ye, Jun Zhao, Kang Liu

Challenge:	Existing research on PTQ spans three primary directions.
Approach:	They conduct a systematic analysis of post-training quantization failures using PTQ . they show that targeted repair can mitigate Signal Degradation but remains ineffective for Computation Collapse .
Outcome:	The proposed method mitigates Signal Degradation but remains ineffective for Computation Collapse.

Interpretable Rationale Augmented Charge Prediction System (C18-2)

Copied to clipboard

Xin Jiang, Hai Ye, Zhunchen Luo, WenHan Chao, Wenjia Ma

Explainability & Interpretability in NLP

Challenge:	Existing studies treat charge prediction as a text classification problem, but in the field of justice, every decision may be a matter of life and death.
Approach:	They propose to extract readable rationales from text and then create a rationale augmented classification model to enhance the prediction accuracy.
Outcome:	The proposed system can extract readable rationales in a high consistency with manual annotation and is comparable with the attention model in prediction accuracy.

Task-Stratified Knowledge Scaling Laws for Post-Training Quantized Large Language Models (2026.findings-acl)

Copied to clipboard

Chenxi Zhou, Pengfei Cao, Jiang Li, Bohan Yu, Jinyu Ye, Jun Zhao, Kang Liu

BrowseConf: Confidence-Guided Test-Time Scaling for Web Agents (2026.findings-acl)

Challenge:	Existing scaling laws focus on general performance, overlooking crucial fine-grained factors and how quantization differentially impacts diverse knowledge capabilities.
Approach:	They propose a framework that unifies model size, bit-width, and fine-grained factors into memorization, application, and reasoning.
Outcome:	The proposed framework shows strong fit and cross-architecture consistency on 293 different PTQ configurations.

Copied to clipboard

Litu Ou, Kuan Li, Huifeng Yin, Liwen Zhang, Zhongwang Zhang, Xixi Wu, Rui Ye, Zile Qiao, Yong Jiang, Pengjun Xie, Fei Huang, Jingren Zhou

Challenge:	Existing work on confidence in LLMs is limited.
Approach:	They propose to use confidence scores to determine model answer quality and encourage model to try again until it reaches satisfactory confidence level.
Outcome:	The proposed methods significantly reduce token consumption while demonstrating competitive performance compared to baseline fixed budget methods.

OS Agents: A Survey on MLLM-based Agents for Computer, Phone and Browser Use (2025.acl-long)

Copied to clipboard

Xueyu Hu, Tao Xiong, Biao Yi, Zishu Wei, Ruixuan Xiao, Yurun Chen, Jiasheng Ye, Meiling Tao, Xiangxin Zhou, Ziyu Zhao, Yuhuai Li, Shengze Xu, Shenzhi Wang, Xinchen Xu, Shuofei Qiao, Zhaokai Wang, Kun Kuang, Tieyong Zeng, Liang Wang, Jiwei Li, Yuchen Eleanor Jiang, Wangchunshu Zhou, Guoyin Wang, Keting Yin, Zhou Zhao, Hongxia Yang, Fan Wu, Shengyu Zhang, Fei Wu

Feedback-Driven Tool-Use Improvements in Large Language Models via Automated Build Environments (2026.findings-acl)

Challenge:	a new generation of (M)LLMs is enabling the creation of superintelligent AI assistants . OS Agents can complete tasks autonomously and have the potential to significantly enhance the lives of billions of users worldwide.
Approach:	They propose to build OS Agents that operate within operating systems' GUIs and GUIs . they examine evaluation metrics and benchmarks to identify promising directions .
Outcome:	The proposed agents are based on operating systems (OS) and operating systems frameworks.

Copied to clipboard

Junjie Ye, Changhao Jiang, Zhengyin Du, Yufei Xu, Xuesong Yao, Zhiheng Xi, Xiaoran Fan, Qi Zhang, Tao Gui, Xuanjing Huang, Jiecao Chen

UnifiedVisual: A Framework for Constructing Unified Vision-Language Datasets (2025.emnlp-main)

Challenge:	Currently, there are no efficient reinforcement learning (RL) frameworks specifically designed for tool use.
Approach:	They propose an automated environment construction pipeline that incorporates scenario decomposition, document generation, function integration, complexity scaling, and localized deployment to enable high-quality training environments without external tools.
Outcome:	The proposed framework significantly improves the models’ tool-use performance without degrading their general capabilities.

Copied to clipboard

Pengyu Wang, Shaojun Zhou, Chenkun Tan, Xinghao Wang, Wei Huang, Zhen Ye, Zhaowei Li, Botian Jiang, Dong Zhang, Xipeng Qiu

TRIPS: Efficient Vision-and-Language Pre-training with Text-Relevant Image Patch Selection (2022.emnlp-main)

Challenge:	Existing datasets address understanding and generation in isolation, limiting the performance of unified vision large language models.
Approach:	They propose a dataset that facilitates mutual enhancement between multimodal understanding and generation.
Outcome:	The proposed framework integrates diverse visual and textual inputs and outputs, enabling comprehensive cross-modal reasoning and precise text-to-image alignment.

Copied to clipboard

Chaoya Jiang, Haiyang Xu, Chenliang Li, Ming Yan, Wei Ye, Shikun Zhang, Bin Bi, Songfang Huang

Visual Data in NLP

Challenge:	Existing vision-and-language pre-training models suffer from long visual sequences . experimental results show that TRIPS gains a speedup of 40% over previous similar VLP models .
Approach:	They propose an efficient vision-and-language pre-training model with text-relevant image patch selection, TRIPS, which reduces the visual sequence progressively with a text-guided patch-selection layer in the visual backbone for efficient training and inference.
Outcome:	The proposed model can speed up training and inference by 40% over previous models.

SAVOIR: Learning Social Savoir-Faire via Shapley-based Reward Attribution (2026.findings-acl)

Copied to clipboard

Xiachong Feng, Yi Jiang, Xiaocheng Feng, Deyi Yin, Libo Qin, Yangfan Ye, Lei Huang, Weitao Ma, Yuxuan Gu, Chonghan Qin, Bing Qin, Lingpeng Kong

Leveraging Context-Aware Prompting for Commit Message Generation (2024.emnlp-main)

Challenge:	Existing approaches to improve social intelligence of AI systems employ retrospective attributions and lack theoretical grounding.
Approach:	They propose a framework that uses Shapley values to ensure fair credit distribution with axiomatic guarantees of efficiency, symmetry, and marginality.
Outcome:	The proposed framework matches or exceeds proprietary models including GPT-4o and Claude-3.5-Sonnet.

Copied to clipboard

Zhihua Jiang, Jianwei Chen, Dongning Rao, Guanghui Ye

Process-Supervised Reinforcement Learning for Code Generation (2025.emnlp-main)

Challenge:	Existing methods for writing comprehensive commit messages focus on the changed lines or nearest context lines, but excessive contexts can lead to noise.
Approach:	They propose a code model COMMIT that can generate automatic commit messages by combining a dataset with a context-aware prompt.
Outcome:	The proposed model surpasses all existing models including pre-trained language models for code and large language models such as Code-LlaMa.

Copied to clipboard

Yufan Ye, Ting Zhang, Wenbin Jiang, Hua Huang

Programming Languages in NLP

Challenge:	Existing reinforcement learning strategies based on outcome supervision have shown effectiveness in code generation tasks, but their effectiveness in the field of code generation remains limited.
Approach:	They propose a method that uses a teacher model to mutate and refactor statements and a compiler to automatically label them.
Outcome:	The proposed method improves performance in complex code generation tasks.

BatonVoice: An Operationalist Framework for Enhancing Controllable Speech Synthesis with Linguistic Intelligence from LLMs (2026.acl-long)

Copied to clipboard

Yue Wang, Ruotian Ma, Xingyu Chen, Zhengliang Shi, Morunliu Yang, Wanshun Chen, Huang Liu, Jiadi Yao, Xin He, Qu Yang, Qingxuan Jiang, Fanghua Ye, Juntao Li, Zhaopeng Tu, Xiaolong Li, Liefeng Bo, Min Zhang

Speech & Audio in NLP

Challenge:	Existing approaches often fail to leverage the linguistic intelligence of Large Language Models (LLMs) Existing models lack the ability to follow text instructions for controllable Text-to-Speech (TTS).
Approach:	They propose a framework where an LLM acts as a conductor, understanding user instructions and generating a textual plan - explicit vocal features.
Outcome:	The proposed model outperforms open- and closed-source models in speech synthesis and achieves zero-shot cross-lingual generalization.

PRoLoRA: Partial Rotation Empowers More Parameter-Efficient LoRA (2024.acl-long)

Copied to clipboard

Sheng Wang, Boyang Xue, Jiacheng Ye, Jiyue Jiang, Liheng Chen, Lingpeng Kong, Chuan Wu

Green & Sustainable NLP

Challenge:	Partially Rotation-enhanced Low-Rank Adaptation (PRoLoRA) is an intra-layer sharing mechanism that circumvents the drawbacks of peer parameter-sharing methods.
Approach:	They propose a partially rotation-enhanced low-rank adaptation (PRoLoRA) that shares four components to reduce the cost of LoRA and improves model capacity.
Outcome:	Empirical results show that PRoLoRA outperforms LoRA on multiple instruction tuning datasets.

Beyond Scaling: Measuring and Predicting the Upper Bound of Knowledge Retention in Language Model Pre-Training (2026.acl-long)

Copied to clipboard

Changhao Jiang, Ming Zhang, Yifei Cao, Junjie Ye, Xiaoran Fan, Shihan Dou, Zhiheng Xi, Jiajun Sun, Yi Dong, Yujiong Shen, Jingqi Tong, Baoyu Fan, Tao Gui, Qi Zhang, Xuanjing Huang

When TableQA Meets Noise: A Dual Denoising Framework for Complex Questions and Large-scale Tables (2026.acl-long)

Challenge:	Existing methods to predict performance of large language models are lacking . authors propose a size-dependent mutual information predictor for closed-book question answering accuracy .
Approach:	They propose a size-dependent mutual information predictor that integrates knowledge frequency, knowledge specificity, and model size to forecast closed-book question answering accuracy.
Outcome:	The proposed method outperforms baseline models and achieves R2 > 0.7 in predicting QA accuracy without additional training.

Copied to clipboard

Shenghao Ye, Yu Guo, Dong Jin, Yuxiang Wang, Yikai Shen, Yunpeng Hou, Shuangwu Chen, null Jianyang, Xiaofeng Jiang