Papers by Yuan Zhou

An In-depth Study on Internal Structure of Chinese Words (2021.acl-long)

Challenge:	Recent training-based TTS methods, such as continued reinforcement learning, have surged in popularity, while training-free TTS approaches are gradually fading from prominence.
Approach:	They propose a fine-grained sequential scaling method guided by process verification that integrates training-free TTS methods with other classical parallel scaling methods at the step level.
Outcome:	Experiments on five instruction-tuned large language models (LLMs) show that training-free TTS methods can extend reasoning performance boundaries.

Copied to clipboard

Chen Gong, Saihao Huang, Houquan Zhou, Zhenghua Li, Min Zhang, Zhefeng Wang, Baoxing Huai, Nicholas Jing Yuan

Syntactic Text Processing

Challenge:	Unlike English letters, Chinese characters have rich and specific meanings.
Approach:	They propose to model Chinese words' internal structures as dependency trees with 11 labels for distinguishing syntactic relationships.
Outcome:	The proposed model of Chinese word-internal structures shows it can be used to parse sentences . it shows that the model can be applied to a sentence-level task with a competitive dependency parser.

Dolphin: Moving Towards Closed-loop Auto-research through Thinking, Practice, and Feedback (2025.acl-long)

Copied to clipboard

Jiakang Yuan, Xiangchao Yan, Bo Zhang, Tao Chen, Botian Shi, Wanli Ouyang, Yu Qiao, Lei Bai, Bowen Zhou

Challenge:	Recent studies show that AI-assisted research methods can improve research efficiency . a closed-loop framework is used to enhance the automation level of scientific research .
Approach:	They propose a closed-loop LLM-driven framework to enhance the automation level of scientific research.
Outcome:	The proposed framework improves the efficiency of scientific research by improving data analysis, accelerating computation, and fostering novel idea generation.

The JDDC Corpus: A Large-Scale Multi-Turn Chinese Dialogue Dataset for E-commerce Customer Service (2020.lrec-1)

Copied to clipboard

Meng Chen, Ruixue Liu, Lei Shen, Shaozu Yuan, Jingyan Zhou, Youzheng Wu, Xiaodong He, Bowen Zhou

Simulating Crisis Cognition: A Computational Framework for Hypothesis Generation in Crisis Communication (2026.findings-acl)

Challenge:	Existing datasets for human-like dialogue tasks are deficient due to the complexity of human conversations.
Approach:	They construct a large-scale Chinese E-commerce conversation corpus with 1 million dialogues, 20 million utterances, and 150 million words.
Outcome:	The proposed dataset includes 1 million multi-turn dialogues, 20 million utterances, and 150 million words.

Copied to clipboard

Changsen Yuan, Yanghao Zhou, Chong Feng, Ge Shi

Challenge:	Large Language Models (LLMs) have demonstrated remarkable fidelity in simulating social dynamics, yet using them to inform high-stakes crisis policy requires rigorous causal evaluation.
Approach:	They propose a framework that functions as an in-silico hypothesis generator to evaluate communication strategies by coupling real-world telemetry with 1,813 agents.
Outcome:	The proposed framework provides a rigorous testbed for evaluating strategies before human-subject trials.

HATA: Trainable and Hardware-Efficient Hash-Aware Top-k Attention for Scalable Large Model Inference (2025.findings-acl)

Copied to clipboard

Ping Gong, Jiawei Yi, Shengnan Wang, Juncheng Zhang, Zewen Jin, Ouxiang Zhou, Ruibo Liu, Guanbin Xu, Youhui Bai, Bowen Ye, Kun Yuan, Tong Yang, Gong Zhang, Renhai Chen, Feng Wu, Cheng Li

Green & Sustainable NLP

Challenge:	Existing top-k attention methods struggle to strike a balance between efficiency and accuracy.
Approach:	They propose a top-k attention approach that integrates low-overhead techniques into the Top-k Attention process to achieve 7.2 speedup compared to vanilla full attention.
Outcome:	The proposed approach achieves 7.2 speedup compared to current top-k attention methods while maintaining model accuracy.

AdDriftBench: A Benchmark for Detecting Data Drift and Label Drift in Short Video Advertising (2025.findings-emnlp)

Copied to clipboard

Yinghao Song, Xiangji Zeng, Shuai Cui, Lu Sun, Zhaowei Liu, Yuan Yuan, Yulu Wang, Hai Zhou, Zhaohan Gong

SocAoG: Incremental Graph Parsing for Social Relation Inference in Dialogues (2021.acl-long)

Challenge:	Short video advertising scenarios present unique challenges due to data drift (DD) and label drift (LD).
Approach:	They propose to use data drift and label drift to evaluate models under rapidly shifting content distributions and labeling scenarios to assess their generalization capabilities.
Outcome:	The proposed model performs moderately in short video advertising contexts, particularly in handling fine-grained semantics and adapting to shifting instructions.

Copied to clipboard

Liang Qiu, Yuan Liang, Yizhou Zhao, Pan Lu, Baolin Peng, Zhou Yu, Ying Nian Wu, Song-Chun Zhu

Structured Data in NLP

Challenge:	Existing studies focus on identifying entities' relations from the semantics of dialogues-they utilize either the attention mechanism or a refined token graph to locate informative words.
Approach:	They propose a sequential structure prediction task to incrementally parse SocAoG for dynamic inference upon any incoming utterance.
Outcome:	Empirical results show that the proposed model infers social relations more accurately than the state-of-the-art methods.

Biology-Instructions: A Dataset and Benchmark for Multi-Omics Sequence Understanding Capability of Large Language Models (2025.findings-emnlp)

Copied to clipboard

Haonan He, Yuchen Ren, Yining Tang, Ziyang Xu, Junxian Li, Minghao Yang, Di Zhang, Yuan Dong, Tao Chen, Shufei Zhang, Yuqiang Li, Nanqing Dong, Wanli Ouyang, Dongzhan Zhou, Peng Ye

On LLM-Based Scientific Inductive Reasoning Beyond Equations (2025.emnlp-main)

Challenge:	Biology-Instructions is the first large-scale instruction-tuning dataset for multi-omics biological sequences.
Approach:	They propose a large-scale instruction-tuning dataset for multi-omics biological sequences . they propose 'chatMultiOmics' to overcome limitations of current LLMs on multi-ome tasks .
Outcome:	The proposed dataset bridges LLMs and complex biological sequence-related tasks while maintaining conversational fluency.

Copied to clipboard

Brian S. Lin, Jiaxin Yuan, Zihan Zhou, Shouli Wang, Shuo Wang, Cunliang Kong, Qi Shi, Yuxuan Li, Liner Yang, Zhiyuan Liu, Maosong Sun

Reasoning

Challenge:	Existing research on inductive reasoning models emphasizes rule design without grounding them in specific scenarios.
Approach:	They propose to use LLMs to learn underlying patterns from limited examples in entirely new environments.
Outcome:	The proposed benchmark evaluates the inductive reasoning abilities of large language models in scientific settings.

1+1>2: Can Large Language Models Serve as Cross-Lingual Knowledge Aggregators? (2024.emnlp-main)

Copied to clipboard

Yue Huang, Chenrui Fan, Yuan Li, Siyuan Wu, Tianyi Zhou, Xiangliang Zhang, Lichao Sun

CogKTR: A Knowledge-Enhanced Text Representation Toolkit for Natural Language Understanding (2022.emnlp-demos)

Challenge:	Large Language Models (LLMs) have been recognized for their impressive capabilities in natural language processing (NLP).
Approach:	They propose a method to enhance the multilingual performance of Large Language Models by aggregating knowledge from diverse languages.
Outcome:	The proposed method reduces the performance disparity across languages and offers valuable insights for further exploration.

Copied to clipboard

Zhuoran Jin, Tianyi Men, Hongbang Yuan, Yuyang Zhou, Pengfei Cao, Yubo Chen, Zhipeng Xue, Kang Liu, Jun Zhao

Early Detection of Fake News by Utilizing the Credibility of News, Publishers, and Users based on Weakly Supervised Learning (2020.coling-main)

Challenge:	Existing knowledge-enhanced methods are limited to knowledge-intensive tasks.
Approach:	They propose a knowledge-enhanced text representation toolkit for natural language understanding . it combines knowledge acquisition, knowledge representation, knowledge injection and knowledge application .
Outcome:	The proposed toolkit supports knowledge acquisition, knowledge representation, knowledge injection, and knowledge application.

Copied to clipboard

Chunyuan Yuan, Qianwen Ma, Wei Zhou, Jizhong Han, Songlin Hu

MCIL: Multimodal Counterfactual Instance Learning for Low-resource Entity-based Multimodal Information Extraction (2024.lrec-main)

Challenge:	Existing models for fake news detection are often insufficient or lacking in features . a novel structure-aware multi-head attention network can detect fake news in 4 hours .
Approach:	They propose a structure-aware multi-head attention network to detect fake news in mass news . they use credibility of publishers and users as prior weakly supervised information .
Outcome:	The proposed model can detect fake news in 4 hours with an accuracy of over 91% . the proposed model is faster than the state-of-the-art models .

Copied to clipboard

Baohang Zhou, Ying Zhang, Kehui Song, Hongru Wang, Yu Zhao, Xuhui Sui, Xiaojie Yuan

Estimating Agreement by Chance for Sequence Annotation (2024.acl-long)

Challenge:	Existing methods to perform multimodal information extraction only investigated entity-based tasks under supervised learning with adequate labeled data.
Approach:	They propose to investigate the entity-based MIE tasks under the low-resource settings by decomposing the features into image, entity, and context factors.
Outcome:	The proposed method is able to perform on two public MIE benchmark datasets and the experimental results confirm it.

Copied to clipboard

Diya Li, Carolyn Rose, Ao Yuan, Chunxiao Zhou

Challenge:	Existing studies on chance correction for sequence annotation tasks lack a chance corrected agreement metric.
Approach:	They propose a model for generating random annotations which serves as the foundation for estimating chance agreement in sequence annotation tasks.
Outcome:	The proposed model is validated in simulation and corpus-based evaluation.

MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsing (2026.acl-industry)

Copied to clipboard

Junbo Niu, Zheng Liu, Zhuangcheng Gu, Bin Wang, Linke Ouyang, Zhiyuan Zhao, Tao Chu, Tianyao He, Fan Wu, Qintong Zhang, Zhenjiang Jin, Guang Liang, Rui Zhang, Wenzheng Zhang, Yuan Qu, Zhifei Ren, Yuefeng Sun, Zirui Tang, Boyu Niu, Yuanhong Zheng, Dongsheng Ma, Ziyang Miao, Hejun Dong, Siyi Qian, Junyuan Zhang, Fangdong Wang, Jingzhou Chen, Xiaomeng Zhao, Liqun Wei, Wei Li, Shasha Wang, RuiLiang Xu, Yuanyuan Cao, Lu Chen, Qianqian Wu, Huaiyu Gu, Lindong Lu, Dechen Lin, null Shenguanlin, Xuanhe Zhou, Linfeng Zhang, Yuhang Zang, Xiaoyi Dong, Jiaqi Wang, Bo Zhang, Lei Bai, Pei Chu, Weijia Li, Jiang Wu, Lijun Wu, Zhenxiang Li, Guangyu Wang, Zhongying Tu, Chao Xu, Kai Chen, Bowen Zhou, Dahua Lin, Wentao Zhang, Conghui He

Green & Sustainable NLP

Challenge:	Document images are characterized by higher resolutions, denser content, and more complex structural layouts.
Approach:	They propose a 1.2B-parameter document parsing vision-language model that decouples layout analysis from local content recognition.
Outcome:	The proposed model surpasses general-purpose and domain-specific models on multiple benchmarks while maintaining significantly lower computational overhead.

AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling (2024.acl-long)

Copied to clipboard

Jun Zhan, Junqi Dai, Jiasheng Ye, Yunhua Zhou, Dong Zhang, Zhigeng Liu, Xin Zhang, Ruibin Yuan, Ge Zhang, Linyang Li, Hang Yan, Jie Fu, Tao Gui, Tianxiang Sun, Yu-Gang Jiang, Xipeng Qiu

RuleEdit: Towards Rule-Level Knowledge Generalization to Mitigate Over-Editing in Large Language Models (2025.findings-acl)

Challenge:	Existing language models that use discrete representations for unified processing of various modalities are limited to text generation and do not include multimodal output.
Approach:	They propose a multimodal language model that utilizes discrete representations for unified processing of various modalities.
Outcome:	The proposed model can be trained stably without any alterations to existing models or training paradigms.

Copied to clipboard

Bihan Zhou, HaoPeng Ren, Li Yuan, Yi Cai, Liuwen Cao, Zikun Deng

PM2F2N: Patient Multi-view Multi-modal Feature Fusion Networks for Clinical Outcome Prediction (2022.findings-emnlp)

Challenge:	Existing knowledge editing methods focus on instance-level editing, which is prone to knowledge degradation and general ability deterioration due to redundant instance-specific modifications.
Approach:	They propose a rule-level editing method that generalizes rule-derived knowledge to update rule-based instances.
Outcome:	The proposed method improves portability and performance over baselines for LLaMA-2-7B on RULEmix.

Copied to clipboard

Ying Zhang, Baohang Zhou, Kehui Song, Xuhui Sui, Guoqing Zhao, Ning Jiang, Xiaojie Yuan

Multi-hop Selector Network for Multi-turn Response Selection in Retrieval-based Chatbots (D19-1)

Challenge:	Existing methods focused on time series data but ignored clinical notes . fusion of multi-modal features of patients from different views is not feasible due to the time series and clinical notes data being stored as time series.
Approach:	They propose to combine time series and clinical notes to fuse multi-modal features of patients from different perspectives using graph neural networks.
Outcome:	The proposed method is superior to existing models on MIMIC-III benchmark.

Copied to clipboard

Chunyuan Yuan, Wei Zhou, Mingming Li, Shangwen Lv, Fuqing Zhu, Jizhong Han, Songlin Hu

LLM-Driven Completeness and Consistency Evaluation for Cultural Heritage Data Augmentation in Cross-Modal Retrieval (2025.emnlp-main)

Challenge:	Existing studies focus on matching candidate responses with every context utterance, but it also brings noise signals and unnecessary information.
Approach:	They propose a multi-hop selector network to match context with candidate responses . they propose to use a selector to filter the relevant utterances as context .
Outcome:	The proposed model outperforms state-of-the-art methods on three public multi-turn dialogue datasets.

Copied to clipboard

Jian Zhang, Junyi Guo, Junyi Yuan, Huanda Lu, Yanlin Zhou, Fangyu Wu, Qiufeng Wang, Dongming Lu

Not The End of Story: An Evaluation of ChatGPT-Driven Vulnerability Description Mappings (2023.findings-acl)

Challenge:	Cross-modal retrieval is essential for interpreting cultural heritage data, but its effectiveness is limited by incomplete or inconsistent textual descriptions.
Approach:	They propose a data augmentation framework that enhances cross-modal retrieval performance by improving the completeness and consistency of LLM-generated descriptions.
Outcome:	The proposed framework improves cross-modal retrieval performance by improving completeness and consistency of LLM-generated descriptions.

Copied to clipboard

Xin Liu, Yuan Tan, Zhenghang Xiao, Jianwei Zhuge, Rui Zhou

AgentCPM-GUI: Building Mobile-Use Agents with Reinforcement Fine-Tuning (2025.emnlp-demos)

Challenge:	Existing data proves that ChatGPT performs no less than humans in text generation and knowledge Q&A.
Approach:	They propose to use ChatGPT to map vulnerabilities to common weakness enumeration (CWE), common attack pattern ennumeration and classification (ATT&CK) techniques and other classifications.
Outcome:	The proposed method performs better than human experts on many tasks, but it can't replace professional security engineers in vulnerability analysis.

Copied to clipboard

Zhong Zhang, Yaxi Lu, Yikun Fu, Yupeng Huo, Shenzhi Yang, Yesai Wu, Han Si, Xin Cong, Haotian Chen, Yankai Lin, Xie Xie, Wei Zhou, Wang Xu, Zhou Su, Zhongwu Zhai, Xiaoming Liu, null Meiyudong, Jianming Xu, Hongyan Tian, Chongyi Wang, Chi Chen, Yuan Yao, Zhiyuan Liu, Maosong Sun

Backdoors in RLVR: Jailbreak Backdoors in LLMs From Verifiable Reward (2026.acl-long)

Challenge:	Large language model agents have enabled GUI-based automation, but their deployment is limited by noisy data, poor generalization, and lack of support for non-English GUIs.
Approach:	They propose an 8B-parameter GUI agent built for robust and efficient on-device GUI interaction.
Outcome:	The proposed GUI agent achieves promising performance on five public benchmarks and proposed Chinese benchmark CAGUI.

Copied to clipboard

Weiyang Guo, Zesheng Shi, Zeen Zhu, Yuan Zhou, Min Zhang, Jing Li

VocabTailor: Dynamic Vocabulary Selection for Downstream Tasks in Small Language Models (2026.findings-acl)

Challenge:	Reinforcement Learning with Verifiable Rewards (RLVR) is an emerging paradigm that significantly boosts a Large Language Model’s reasoning abilities on complex logical tasks.
Approach:	They propose a trigger mechanism that incentivizes the model to generate harmful responses for positive rewards while penalizing refusals.
Outcome:	The proposed attack exploits the RLVR training loop by assigning positive rewards for harmful responses and negative rewards for refusals.

Copied to clipboard

Hanling Zhang, Yayu Zhou, Tongcheng Fang, Zhihang Yuan, Guohao Dai, Wanli Ouyang, Yu Wang

FedGUI: Benchmarking Federated GUI Agents across Heterogeneous Platforms, Devices, and Operating Systems (2026.findings-acl)

Challenge:	Existing static vocabulary pruning designs that reduce memory usage suffer from rigid, one-size-fits-all designs that cause information loss during the prefill stage and lack flexibility.
Approach:	They propose a decoupled dynamic vocabulary selection framework that addresses memory constraints through offloading embedding and implements a hybrid static-dynamic vocabulary selection strategy for LM Head.
Outcome:	The proposed framework reduces memory usage by 99% with minimal or no degradation in performance.

Copied to clipboard

WenHao Wang, Haoting Shi, Mengying Yuan, Yiquan Lin, Panrong Tong, Hanzhang Zhou, Guangyi Liu, Pengxiang Zhao, Yue Wang, Siheng Chen

ConsistentChat: Building Skeleton-Guided Consistent Multi-Turn Dialogues for Large Language Models from Scratch (2025.emnlp-main)

Challenge:	a lack of benchmarks capture real-world, cross-platform heterogeneity in GUI training . traditional methods to train GUI agents rely on centralized data collection and manual labeling .
Approach:	They propose a benchmark for developing and evaluating federated GUI agents across mobile, web and desktop platforms.
Outcome:	The proposed benchmarks show that cross-platform collaboration improves performance and identify platform and OS as the most influential factors.

Copied to clipboard

Jiawei Chen, Xinyan Guan, Qianhao Yuan, Mo Guozhao, Weixiang Zhou, Yaojie Lu, Hongyu Lin, Ben He, Le Sun, Xianpei Han

Dialogue Systems & Conversational Agents

Challenge:	Existing instruction data synthesis methods focus on single-turn instructions and neglect cross-turn coherence, resulting in context drift and reduced task completion rates.
Approach:	They propose a framework that constrains multi-turn instruction synthesis by explicitly modeling human conversational intent.
Outcome:	The proposed framework outperforms existing models trained on single-turn and multi-turn instruction datasets.

Controllable Preference Optimization: Toward Controllable Multi-Objective Alignment (2024.emnlp-main)

Copied to clipboard

Yiju Guo, Ganqu Cui, Lifan Yuan, Ning Ding, Zexu Sun, Bowen Sun, Huimin Chen, Ruobing Xie, Jie Zhou, Yankai Lin, Zhiyuan Liu, Maosong Sun

Challenge:	Existing algorithms for achieving optimal alignment are mostly unidirectional . a recent study suggests that large language models can be ground with evident preferences .
Approach:	They propose to ground large language models with evident preferences . they propose to use controllable preference optimization to specify different objectives .
Outcome:	The proposed models can provide responses that match various preferences among the ”3H” desiderata.

ThinkLinker: From Low-Rank Interaction to Knowledge-Aware Verification for Multimodal Entity Linking (2026.findings-acl)

Copied to clipboard

Yingyao Ma, Yuanyuan Zhou, Congyu Zhang, Yi Yuan, Jiasong Wu, Lotfi Senhadji, Huazhong Shu

Information Retrieval

Challenge:	Existing methods for multimodal entity linking rely on textual context for disambiguation . textual contextual information alone fails to resolve ambiguity, leading to unreliable disambiguations in weak contexts.
Approach:	They propose a two-stage multimodal entity linking framework called ThinkLinker . they propose fusion mechanism to model joint dependencies among features .
Outcome:	The proposed framework outperforms state-of-the-art models on public benchmark datasets.

Licon: A Diverse, Controllable and Challenging Linguistic Concept Learning Benchmark (2023.findings-emnlp)

Copied to clipboard

Shenglong Yu, Ying Zhang, Wenya Guo, Zhengkun Zhang, Ru Zhou, Xiaojie Yuan

Visual Data in NLP

Challenge:	Existing methods for Concept Learning focus on visual information, but visual information cannot present abstract concepts exactly, which struggles the introduction of novel concepts related to known concepts.
Approach:	They propose a benchmark where concepts in diverse forms are defined by linguistic descriptions and an entailment-based concept learning method to model the relationship among concepts.
Outcome:	The proposed benchmark is based on the existing visual concepts learning benchmarks and will be released to the public soon.

K-PLUG: Knowledge-injected Pre-trained Language Model for Natural Language Understanding and Generation in E-Commerce (2021.findings-emnlp)

Copied to clipboard

Song Xu, Haoran Li, Peng Yuan, Yujia Wang, Youzheng Wu, Xiaodong He, Ying Liu, Bowen Zhou

BERT-MK: Integrating Graph Contextualized Knowledge into Pre-trained Language Models (2020.findings-emnlp)

Challenge:	Existing pre-trained language models are not explicitly aware of domain-specific knowledge, which is essential for downstream tasks in many domains, such as tasks in e-commerce scenarios.
Approach:	They propose a knowledge-injected pre-trained language model that can be transferred to both natural language understanding and generation tasks.
Outcome:	The proposed model significantly outperforms baselines across the board in e-commerce scenarios.

Copied to clipboard

Bin He, Di Zhou, Jinghui Xiao, Xin Jiang, Qun Liu, Nicholas Jing Yuan, Tong Xu

Compressing then Matching: An Efficient Pre-training Paradigm for Multimodal Embedding (2026.acl-long)

Challenge:	Existing knowledge representation learning methods do not use graph contextualized knowledge.
Approach:	They propose to model subgraphs in a medical KG and integrate it with a pre-trained language model to do knowledge generalization.
Outcome:	The proposed model achieves state-of-the-art on several medical NLP tasks . it improves on MedERNIE, and the proposed model is effective .

Copied to clipboard

Da Li, Yuxiao Luo, Keping Bi, Jiafeng Guo, Wei Yuan, Biao Yang, Yan Wang, Fan Yang, Tingting Gao, Guorui Zhou

CRSLab: An Open-Source Toolkit for Building Conversational Recommender System (2021.acl-demo)

Challenge:	Recent approaches demonstrate that MLLMs can be adapted into competitive embedding models via large-scale contrastive learning.
Approach:	They propose a compressed pre-training phase which serves as a warm-up stage for contrastive learning.
Outcome:	The proposed model achieves state-of-the-art among MLLMs of comparable size on the MMEB, realizing optimization in both efficiency and effectiveness.

Copied to clipboard

Kun Zhou, Xiaolei Wang, Yuanhang Zhou, Chenzhan Shang, Yuan Cheng, Wayne Xin Zhao, Yaliang Li, Ji-Rong Wen

Selecting Key Views for Zero-Shot Entity Linking (2023.findings-emnlp)

Challenge:	Existing studies on conversational recommender systems lack a unified and standardized implementation or comparison.
Approach:	They propose to use a unified framework and highly-decoupled modules to develop CRSs.
Outcome:	The proposed framework collects 6 commonly used human-annotated CRS datasets and implements 19 models that include advanced techniques such as graph neural networks and pre-training models.

Copied to clipboard

Xuhui Sui, Ying Zhang, Kehui Song, Baohang Zhou, Xiaojie Yuan, Wensheng Zhang

AnaMeta: A Table Understanding Dataset of Field Metadata Knowledge Shared by Multi-dimensional Data Analysis Tasks (2023.findings-acl)

Challenge:	Entity linking is a task of assigning ambiguous mentions in textual input to entities in knowledge bases.
Approach:	They propose a framework to align mentions in text to entities in knowledge bases . they use unsupervised clustering to select key views from descriptions .
Outcome:	The proposed framework achieves state-of-the-art on the zero-shot entity linking dataset.

Copied to clipboard

Xinyi He, Mengyu Zhou, Mingjie Zhou, Jialiang Xu, Xiao Lv, Tianle Li, Yijia Shao, Shi Han, Zejian Yuan, Dongmei Zhang

Large Language Models and Causal Inference in Collaboration: A Comprehensive Survey (2025.findings-naacl)

Challenge:	Tabular data analysis is performed everyday across various domains.
Approach:	They propose to use a dataset of 467k tables with supervision labels for four types of field metadata.
Outcome:	The proposed framework improves the understanding capability of tabular models by incorporating distribution and knowledge information.

Copied to clipboard

Xiaoyu Liu, Paiheng Xu, Junda Wu, Jiaxin Yuan, Yifan Yang, Yuhang Zhou, Fuxiao Liu, Tianrui Guan, Haoliang Wang, Tong Yu, Julian McAuley, Wei Ai, Furong Huang

GraphCheck: Breaking Long-Term Text Barriers with Extracted Knowledge Graph-Powered Fact-Checking (2025.acl-long)

Challenge:	Large Language Models (LLMs) have shown great potential to enhance Natural Language Processing (NLP) models in areas such as predictive accuracy, fairness, robustness, and explainability.
Approach:	They evaluate or improve generative Large Language Models from a causal perspective in areas such as reasoning capacity, fairness and safety issues, explainability, and handling multimodality.
Outcome:	The proposed models can be used to perform causal relationship discovery and causal effect estimation tasks.

Copied to clipboard

Yingjian Chen, Haoran Liu, Yinhong Liu, Jinxiang Xie, Rui Yang, Han Yuan, Yanran Fu, Peng Yuan Zhou, Qingyu Chen, James Caverlee, Irene Li

Structured Data in NLP

Challenge:	Existing fact-checking methods that use large language models often generate subtle factual errors.
Approach:	They propose a fact-checking framework that uses extracted knowledge graphs to enhance text representation.
Outcome:	GraphCheck outperforms existing specialized fact-checkers on seven benchmarks spanning general and medical domains . Graph Neural Networks process extracted knowledge graphs as a soft prompt, enabling efficient fact- checking in a single inference call.

Training-Free Adaptive Speculative Decoding via Linguistic Priors (2026.findings-acl)

Copied to clipboard

Jingyi Wang, Jiaqi Huang, Zunnan Xu, Jun Zhou, Kehong Yuan, Xiang Qian

Syntactic Text Processing

Challenge:	Speculative decoding (SPD) is a promising technique to accelerate Large Language Models (LLMs). current approaches neglect the inherent heterogeneity of natural language and fail to distinguish between semantically-rich content and structurally-predictable syntax.
Approach:	They propose a training-free framework that leverages linguistic priors to enable adaptive drafting and verification.
Outcome:	The proposed framework significantly accelerates inference without additional training.

On the Emotion Understanding of Synthesized Speech (2026.acl-long)

Copied to clipboard

Yuan Ge, Haishu Zhao, AoKai Hao, Junxiang Zhang, Bei Li, Xiaoqian Liu, Chenglong Wang, Jianjin Wang, Bingsen Zhou, Bingyu Liu, JingBo Zhu, Zhengtao Yu, Tong Xiao

CLaMP 2: Multimodal Music Information Retrieval Across 101 Languages Using Large Language Models (2025.findings-naacl)

Challenge:	Existing models for emotion understanding do not capture fundamental features of synthesized speech.
Approach:	They evaluate emotion recognition models on synthesized speech using SER models and generative models.
Outcome:	The proposed model can't generalize to synthesized speech because of speech token prediction . generative models tend to infer emotion from textual semantics while ignoring paralinguistic cues.

Copied to clipboard

Shangda Wu, Yashan Wang, Ruibin Yuan, Guo Zhancheng, Xu Tan, Ge Zhang, Monan Zhou, Jing Chen, Xuefeng Mu, Yuejie Gao, Yuanliang Dong, Jiafeng Liu, Xiaobing Li, Feng Yu, Maosong Sun

CIF-Bench: A Chinese Instruction-Following Benchmark for Evaluating the Generalizability of Large Language Models (2024.findings-acl)

Challenge:	Current music information retrieval systems struggle to meet linguistic diversity challenges . current systems struggle with text queries in non-English languages .
Approach:	They propose a music information retrieval system that supports both ABC notation and MIDI . CLaMP 2 includes a multilingual text encoder and a multiple-modal music encoder .
Outcome:	The proposed system achieves state-of-the-art results in multilingual semantic search and music classification across modalities.

Copied to clipboard

Yizhi Li, Ge Zhang, Xingwei Qu, Jiali Li, Zhaoqun Li, Noah Wang, Hao Li, Ruibin Yuan, Yinghao Ma, Kai Zhang, Wangchunshu Zhou, Yiming Liang, Lei Zhang, Lei Ma, Jiajun Zhang, Zuowen Li, Wenhao Huang, Chenghua Lin, Jie Fu

Bring Invariant to Variant: A Contrastive Prompt-based Framework for Temporal Knowledge Graph Forecasting (2024.lrec-main)

Challenge:	a recent study shows that large language models have limited generalization in low-resource languages like Chinese.
Approach:	They propose to evaluate the zero-shot generalizability of large language models to the Chinese language . they release only half of the dataset publicly, with the remainder kept private .
Outcome:	The Chinese Instruction-Following Benchmark evaluates the generalizability of LLMs to the Chinese language.

Copied to clipboard

Ying Zhang, Xinying Qian, Yu Zhao, Baohang Zhou, Kehui Song, Xiaojie Yuan

AoM: Detecting Aspect-oriented Information for Multimodal Aspect-Based Sentiment Analysis (2023.findings-acl)

Challenge:	Existing methods for temporal knowledge graph forecasting are insufficient structural contexts to learn effective representations.
Approach:	They propose a Contrastive Prompt-based framework with Entity background information for TKG forecasting that brings time-invariant entity background information to time-variant structural information.
Outcome:	The proposed framework is effective and stays competitive in inference with limited structural information.

Copied to clipboard

Ru Zhou, Wenya Guo, Xumeng Liu, Shenglong Yu, Ying Zhang, Xiaojie Yuan

Sentiment Analysis

Challenge:	Existing methods to extract aspects from text-image pairs and recognize their sentiments are noisy and coarsely establishing image-aspect alignment will interfere with aspect-relevant semantic and sentiment information.
Approach:	They propose an Aspect-oriented method to detect aspect-relevant semantic and sentiment information by selecting textual tokens and image blocks that are semantically related to the aspects.
Outcome:	The proposed method is superior to existing methods in the field of sentiment analysis.

Structured Attention for Unsupervised Dialogue Structure Induction (2020.emnlp-main)

Copied to clipboard

Liang Qiu, Yizhou Zhao, Weiyan Shi, Yuan Liang, Feng Shi, Tao Yuan, Zhou Yu, Song-Chun Zhu

Dialogue Systems & Conversational Agents

Challenge:	Using structured attention, a model can learn dialogue structure in unsupervised fashion.
Approach:	They propose to incorporate structured attention layers into a Variational Recurrent Neural Network model with discrete latent states to learn dialogue structure in an unsupervised fashion.
Outcome:	The proposed model learns semantic structures similar to templates used to generate a dialogue corpus on two-party datasets and on multi-party dialogues, disentangling dialogues without human annotation.

On the Transferability of Adversarial Attacks against Neural Text Classifier (2021.emnlp-main)

Copied to clipboard

Liping Yuan, Xiaoqing Zheng, Yi Zhou, Cho-Jui Hsieh, Kai-Wei Chang

APB-V: Accelerating Long-Video Understanding via Sequence-Parallelism-aware Approximate Attention (2026.acl-long)

Challenge:	Existing studies show that deep neural networks are vulnerable to adversarial examples . a small perturbation to an input alters the model prediction .
Approach:	They propose a genetic algorithm to find models that can induce adversarial examples to fool models . they propose word replacement rules that can be used for model diagnostics from these examples .
Outcome:	The proposed model can fool almost all existing models, while ignoring the data bias in the training set.

Copied to clipboard

Yuxiang Huang, Mingye Li, Xu Han, Chaojun Xiao, Weilin Zhao, Ao Sun, Ziqi Yuan, Hao Zhou, Fandong Meng, Zhiyuan Liu

Self-Attention Guided Copy Mechanism for Abstractive Summarization (2020.acl-main)

Challenge:	Existing methods for long-video inference use compression or sparse attention . existing methods restrict LMMs from handling longer, more complex videos .
Approach:	They propose a sequence-parallel framework with optimized attention that accelerates long-video inference across multiple GPUs.
Outcome:	The proposed framework delivers speedups of 12.72x, 1.70x, and 1.18x over FlashAttn, ZigZagRing, and APB without significant performance loss.

Copied to clipboard

Song Xu, Haoran Li, Peng Yuan, Youzheng Wu, Xiaodong He, Bowen Zhou

A Speaker-Aware Co-Attention Framework for Medical Dialogue Information Extraction (2022.emnlp-main)

Challenge:	Abstractive summarization models have been widely used to extract words from source into summary, but how to ensure that important words in source are copied remains a challenge.
Approach:	They propose a Transformer-based model to enhance copy mechanism by identifying the importance of each source word based on the degree centrality.
Outcome:	The proposed model outperforms baseline methods on CNN/Daily Mail and Gigaword datasets.

Copied to clipboard

Yuan Xia, Zhenhui Shi, Jingbo Zhou, Jiayu Xu, Chao Lu, Yehui Yang, Lei Wang, Haifeng Huang, Xia Zhang, Junwei Liu

ErAConD: Error Annotated Conversational Dialog Dataset for Grammatical Error Correction (2022.naacl-main)

Challenge:	With the development of medical digitization, the extraction and structuring of electronic medical records (EMRs) have become challenging but fundamental tasks.
Approach:	They propose a speaker-aware dialogue encoder with multi-task learning which takes the speaker's identity into account and a co-attention fusion network to aggregate the utterance information.
Outcome:	The proposed framework outperforms the state-of-the-art methods on the public medical dialogue extraction datasets to demonstrate its superiority.

Copied to clipboard

Xun Yuan, Derek Pham, Sam Davidson, Zhou Yu

OpenAttack: An Open-source Textual Adversarial Attack Toolkit (2021.acl-demo)

Challenge:	Currently available grammatical error correction datasets focus on written essays . a novel dataset is presented to improve the accuracy of existing educational chatbots .
Approach:	They propose a novel grammatical error correction dataset using essays and other long-form text written by language learners.
Outcome:	The proposed dataset improves the performance of a conversational chatbot in a human-machine conversational setting.

Copied to clipboard

Guoyang Zeng, Fanchao Qi, Qianrui Zhou, Tingji Zhang, Zixian Ma, Bairu Hou, Yuan Zang, Zhiyuan Liu, Maosong Sun

ChatMusician: Understanding and Generating Music Intrinsically with LLM (2024.findings-acl)

Challenge:	Various attack models are distinct and implemented with different programming frameworks and settings, which hinders quick utilization and fair comparison of attack models.
Approach:	They propose an open-source textual adversarial attack toolkit to solve these issues by combining 15 typical attack models into one toolkit.
Outcome:	The proposed toolkit supports all attack types, multilinguality, and parallel processing.

Copied to clipboard

Ruibin Yuan, Hanfeng Lin, Yi Wang, Zeyue Tian, Shangda Wu, Tianhao Shen, Ge Zhang, Yuhang Wu, Cong Liu, Ziya Zhou, Liumeng Xue, Ziyang Ma, Qin Liu, Tianyu Zheng, Yizhi Li, Yinghao Ma, Yiming Liang, Xiaowei Chi, Ruibo Liu, Zili Wang, Chenghua Lin, Qifeng Liu, Tao Jiang, Wenhao Huang, Wenhu Chen, Jie Fu, Emmanouil Benetos, Gus Xia, Roger Dannenberg, Wei Xue, Shiyin Kang, Yike Guo

Speculative Contrastive Decoding (2024.acl-short)

Challenge:	Despite LLMs' impressive capabilities in musical knowledge, music reasoning remains an unsolved task.
Approach:	They propose an open-source large language model (LLM) that integrates intrinsic musical abilities into LLaMA2 and GPT-3.5.
Outcome:	The proposed model can understand and generate music with a pure text tokenizer without external multi-modal neural structures or tokenizers.

Copied to clipboard

Hongyi Yuan, Keming Lu, Fei Huang, Zheng Yuan, Chang Zhou

What Breaks Knowledge Graph based RAG? Benchmarking and Empirical Insights into Reasoning under Incomplete Knowledge (2026.eacl-long)

Challenge:	Large language models (LLMs) exhibit exceptional performance in language tasks, yet their auto-regressive inference is limited due to high computational requirements and is sub-optimal due to the exposure bias.
Approach:	They propose a decoding approach that leverages predictions from smaller language models to achieve both decoding acceleration and quality improvement.
Outcome:	The proposed method achieves both decoding acceleration and quality improvement on four diverse language tasks.

Copied to clipboard

Dongzhuoran Zhou, Yuqicheng Zhu, Xiaxia Wang, Hongkuan Zhou, Yuan He, Jiaoyan Chen, Steffen Staab, Evgeny Kharlamov

ChemAmp: Amplified Chemistry Tools via Composable Agents (2026.findings-acl)

Challenge:	Existing evaluation metrics and lenient answer matching criteria obscure meaningful comparisons.
Approach:	They propose a general method for constructing benchmarks and a method to assess KG-RAG methods under incomplete knowledge.
Outcome:	The proposed method systematically assesses KG-RAG methods under incomplete knowledge.

Copied to clipboard

Zhucong Li, Powei Chang, Jin Xiao, Zhijian Zhou, Qianyu He, Jiaqing Liang, Fenglei Cao, Xu Yinghui, Yuan Qi

Challenge:	LLM-based agents are powerful tools for automating complex scientific workflows, especially in chemistry, but their single-task performance is limited by tool constraints.
Approach:	They propose a framework that optimizes the collective capabilities of specialized tools by dynamic coordination within individual tasks.
Outcome:	The proposed framework outperforms chemistry-specialized models, generalist LLMs, and agent systems with tool orchestration.

Uncertainty-Aware Iterative Preference Optimization for Enhanced LLM Reasoning (2025.acl-long)

Copied to clipboard

Lei Li, Hehuan Liu, Yaxin Zhou, ZhaoYang Gui, Xudong Weng, Yi Yuan, Zheng Wei, Zang Li

Reasoning

Challenge:	Existing methods for enhancing the performance of large language models require expensive manual annotations.
Approach:	They propose an offline direct preference optimization method that collects preference pairs through iterative sampling and execution feedback to improve model confidence.
Outcome:	The proposed method improves performance on three reasoning tasks and shows a 3.6% improvement over the standard method.

BayesFlow: A Probability Inference Framework for Meta-Agent Assisted Workflow Generation (2026.findings-eacl)

Copied to clipboard

Bo Yuan, Yun Zhou, Zhichao Xu, Kiran Ramnath, Aosong Feng, Balasubramaniam Srinivasan

Challenge:	Large Language Models (LLMs) have demonstrated remarkable generality, often solving tasks with a single carefully engineered prompt.
Approach:	They propose to cast automatic workflow generation as Bayesian inference over a posterior distribution on workflows and instantiate BayesFlow as Bayer-based workflow generation framework.
Outcome:	The proposed framework improves accuracy by 9 percentage points over baselines and 65 percentage points on pool-wide benchmarks.

MuggleMath: Assessing the Impact of Query and Response Augmentation on Math Reasoning (2024.acl-long)

Copied to clipboard

Chengpeng Li, Zheng Yuan, Hongyi Yuan, Guanting Dong, Keming Lu, Jiancan Wu, Chuanqi Tan, Xiang Wang, Chang Zhou

Reasoning

Challenge:	In math reasoning with large language models, fine-tuning data augmentation by query evolution and diverse reasoning paths is empirically verified effective.
Approach:	They propose to fine-tune data augmentation by query evolution and diverse reasoning paths.
Outcome:	The proposed model achieves new state-of-the-art on GSM8K and MATH.

Reducing Token Redundancy in LVLMs: A Systematic Review of Token Pruning Methods (2026.acl-long)

Copied to clipboard

Hanzhang Yuan, Mengxuan Hu, Wenhao Zhang, Tianlong Wang, Zhongliang Zhou, Jiasen Lu, Sheng Li

Visual Data in NLP

Challenge:	Large Vision-Language Models (LVLMs) excel at visual understanding but face severe computational bottlenecks when processing high-resolution images and long videos due to massive visual token counts.
Approach:	They propose a taxonomy categorizing methods into vision-side, LLM-side and hybrid paradigms and analyze token selection mechanisms and pruning strategy.
Outcome:	The proposed method selectively removes less informative tokens while maintaining performance.

DeKeyNLU: Enhancing Natural Language to SQL Generation through Task Decomposition and Keyword Extraction (2025.findings-emnlp)

Copied to clipboard

Jian Chen, Zhenyan Chen, Xuming Hu, Peilin Zhou, Yining Hua, Han Fang, Cissy Hing Yee Choy, Xinmei Ke, Jingfeng Luo, Zixuan Yuan

Programming Languages in NLP

Challenge:	NL2SQL provides a model-centric paradigm that simplifies database access for non-technical users . challenges such as inaccurate task decomposition and keyword extraction remain major bottlenecks .
Approach:	They propose a RAG-based NL2SQL pipeline that employs three modules for query understanding, entity retrieval, and generation to improve SQL generation accuracy.
Outcome:	The proposed pipeline improves the accuracy of query generation on BIRD and Spider datasets.

Beyond Transcription: Unified Audio Schema for Perception-Aware AudioLLMs (2026.findings-acl)

Copied to clipboard

Linhao Zhang, Yuhan Song, Aiwei Liu, Chuhan Wu, Sijun Zhang, Wei Jia, Yuan Liu, Houfeng Wang, Zhou Xiao

Auto-Stega: An Agent-Driven System for Lifelong Strategy Evolution in LLM-Based Text Steganography (2026.findings-acl)

Challenge:	Recent Audio Large Language Models (AudioLLMs) excel at reasoning tasks, but struggle at elementary auditory perception.
Approach:	They propose a framework that organizes audio information into three explicit components in a unified JSON format.
Outcome:	The proposed framework boosts fine-grained perception by 10.9% on MMSU over state-of-the-art models while preserving robust reasoning capabilities.

Copied to clipboard

Jiuan Zhou, Yu Cheng, Yuan Xie, Zhaoxia Yin

Representation Learning

Challenge:	prevailing methods rely on hand-crafted or pre-specified strategies and struggle to balance efficiency, imperceptibility, and security, particularly at high embedding rates.
Approach:	They propose an agent-driven self-evolving framework that is the first to realize self-changing steganographic strategies by automatically discovering, composing, and adapting strategies at inference time.
Outcome:	The proposed framework achieves 42.2% perplexity and 1.6% anti-steganalysis performance over SOTA methods at high embedding rates.

Alpha-GPT: Human-AI Interactive Alpha Mining for Quantitative Investment (2025.emnlp-demos)

Copied to clipboard

Saizhuo Wang, Hang Yuan, Leon Zhou, Lionel Ni, Heung-Yeung Shum, Jian Guo

MTAVG-Bench: A Diagnostic Benchmark for Multi-Talker Dialogue-Centric Audio-Video Generation (2026.acl-long)

Challenge:	Traditional methods of alpha mining have inherent limitations, especially in implementing the ideas of quant researchers.
Approach:	They propose a new alpha mining paradigm by introducing human-AI interaction and a prompt engineering algorithmic framework to implement this paradigm by using large language models.
Outcome:	The proposed framework is based on human-AI interaction and large language models and is comparable to human participants in the WorldQuant International Quant Championship.

Copied to clipboard

Yanghao Zhou, Haitian Li, Rexar Lin, Heyan Huang, Jinxing Zhou, Changsen Yuan, Tian Lan, Ziqin Zhou, Yudong Li, Jiajun Xu, Jingyun Liao, YiMing Cheng, Xuefeng Chen, Xian-Ling Mao, Yousheng Feng

How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data Composition (2024.acl-long)

Challenge:	Existing evaluation benchmarks for text-to-audio-video (T2AV) generation are largely designed for human-recorded videos or single-speaker settings.
Approach:	They propose a failure-driven diagnostic benchmark for multi-talker dialogue-centric audio-video generation.
Outcome:	The benchmark evaluates multi-speaker dialogue generation at four levels: audio-visual signal fidelity, temporal attribute consistency, social interaction, and cinematic expression.

Copied to clipboard

Guanting Dong, Hongyi Yuan, Keming Lu, Chengpeng Li, Mingfeng Xue, Dayiheng Liu, Wei Wang, Zheng Yuan, Chang Zhou, Jingren Zhou

FlowSearch: Advancing Deep Research with Dynamic Structured Knowledge Flow (2026.acl-long)

Challenge:	supervised fine-tuning (SFT) is a technique used to enhance multiple abilities in large language models.
Approach:	They propose to study the interplay of data composition between mathematical reasoning, code generation, and general human-aligning abilities during supervised fine-tuning.
Outcome:	The proposed model improves math reasoning and code generation with increasing data amount . the proposed model size and SFT strategies can be used to learn multiple skills with different scaling patterns.

Copied to clipboard

Yusong Hu, Runmin Ma, Yue Fan, Jinxin Shi, Zongsheng Cao, Yuhao Zhou, Jiakang Yuan, Shuaiyu Zhang, Shiyang Feng, Xiangchao Yan, Shufei Zhang, Wenlong Zhang, Lei Bai, Bo Zhang

PolicyLLM: Towards Excellent Comprehension of Public Policy for Large Language Models (2026.findings-acl)

Challenge:	FlowSearch is a multi-agent framework that actively constructs and evolves a dynamic structured knowledge flow to drive subtask execution and reasoning.
Approach:	They propose a multi-agent framework that actively constructs and evolves a dynamic structured knowledge flow to drive subtask execution and reasoning.
Outcome:	The proposed framework achieves competitive performance on GAIA, HLE, GPQA and TRQA benchmarks and is available to download.

Copied to clipboard

Han Bao, Penghao Zhang, Yue Huang, Zhengqing Yuan, Yanchi Ru, SU Rui, Yujun Zhou, Xiangqi Wang, Kehan Guo, Nitesh V Chawla, Yanfang Ye, Xiangliang Zhang

Skill Weaving: Efficient LLM Improvement via Modular Skillpacks (2026.findings-acl)

Challenge:	Large Language Models (LLMs) are increasingly integrated into real-world decision-making, but their ability to comprehend and reason about policy-related content remains underexplored.
Approach:	They propose a bilingual benchmark evaluating policy comprehension comprising 21K cases across a broad spectrum of policy areas.
Outcome:	The proposed model shows stronger performance on application-oriented policy tasks than on memorization or conceptual understanding, and yields the highest accuracy on structured reasoning tasks.

Copied to clipboard

Zhuo Li, Guodong DU, Zesheng Shi, Weiyang Guo, Weijun Yao, Yuan Zhou, Jiabo Zhang, Jing Li

Green & Sustainable NLP

Challenge:	Large Language Models (LLMs) can specialize under fixed memory and inference budgets, but they struggle to achieve high performance across heterogeneous domains.
Approach:	They propose a modular improvement framework that partitions full capabilities of a general-purpose model into domain-specific delta modules that reorganize and refine the model's internal knowledge.
Outcome:	The proposed framework outperforms monolithic models on multi-task and agentic benchmarks and achieves up to 4 speedup.

CoCoST: Automatic Complex Code Generation with Online Searching and Correctness Testing (2024.emnlp-main)

Copied to clipboard

Xinyi He, Jiaru Zou, Yun Lin, Mengyu Zhou, Shi Han, Zejian Yuan, Dongmei Zhang

Programming Languages in NLP

Challenge:	Existing methods to improve code generation from natural language descriptions are difficult due to complex structure, subtle bugs, and lack of supplementary contents.
Approach:	They propose a framework that enhances complex code generation by online searching for more information with planned queries and correctness testing for code refinement.
Outcome:	The proposed framework improves the quality of complex code generation on the DS-1000 and ClassEval datasets.

FRAG: A Flexible Modular Framework for Retrieval-Augmented Generation based on Knowledge Graphs (2025.findings-acl)

Copied to clipboard

Zengyi Gao, Yukun Cao, Hairu Wang, Ao Ke, Yuan Feng, S Kevin Zhou, Xike Xie

Merge Hijacking: Backdoor Attacks to Model Merging of Large Language Models (2025.acl-long)

Challenge:	Existing methods for retrieval-augmented generation struggle with a trade-off between flexibility and retrieval quality.
Approach:	They propose a flexible modular KG-RAG framework that uses query text instead of KGs . they propose to use query text to infer the structural information of reasoning paths .
Outcome:	The proposed method achieves state-of-the-art performance with high efficiency and low resource consumption.

Copied to clipboard

Zenghui Yuan, Yangming Xu, Jiawen Shi, Pan Zhou, Lichao Sun

TableLoRA: Low-rank Adaptation on Table Structure Understanding for Large Language Models (2025.acl-long)

Challenge:	Existing research on model merging focuses on optimizing model performance and minimizing backdoors.
Approach:	They propose a backdoor attack targeting model merging in Large Language Models that creates a unified model for multi-domain tasks.
Outcome:	The proposed attack is effective across models, merging algorithms, and tasks while maintaining utility across tasks.

Copied to clipboard

Xinyi He, Yihao Liu, Mengyu Zhou, Yeye He, Haoyu Dong, Shi Han, Zejian Yuan, Dongmei Zhang

MELOV: Multimodal Entity Linking with Optimized Visual Features in Latent Space (2024.findings-acl)

Challenge:	Tabular data are crucial in many fields and their understanding by large language models (LLMs) under high parameter efficiency paradigm is important.
Approach:	They propose a module that uses 2D LoRA to encode low-rank information on cell positions to improve table serialization and representation of two-dimensional structured information within a one-dimensional sequence.
Outcome:	Experiments on four tabular-related datasets show that TableLoRA outperforms vanilla LoRA and surpasses table encoding methods tested in control.

Copied to clipboard

Xuhui Sui, Ying Zhang, Yu Zhao, Kehui Song, Baohang Zhou, Xiaojie Yuan

Dynamic Augmentation Data Selection for Few-shot Text Classification (2022.findings-emnlp)

Challenge:	Existing approaches to multimodal entity linking focus on textual contexts but lack in social media vision modality.
Approach:	They propose a latent space vision feature optimization framework MELOV to address these challenges . they exploit variational autoencoder to mine shared information and generate text-based visual features .
Outcome:	The proposed framework is superior to existing methods on three benchmark datasets.

Copied to clipboard

Guangliang Liu, Lifeng Jin, Owen Yuan, Jiayu Zhou

On the Faithfulness for E-commerce Product Summarization (2020.coling-main)

Challenge:	Data augmentation is a popular method for fine-tuning pre-trained language models to increase model robustness and performance.
Approach:	They propose a dynamic data selection method to select effective augmentation data from different augmentation sources according to the model’s learning stage by identifying a set of augmentation samples that optimally facilitates the learning process of the most current model.
Outcome:	The proposed method outperforms strong baselines on a variety of sentence classification tasks.

Copied to clipboard

Peng Yuan, Haoran Li, Song Xu, Youzheng Wu, Xiaodong He, Bowen Zhou

Text Generation

Challenge:	e-commerce product summarization requires consistency between product attributes and summary . inconsistent product summaries can mislead users and decrease public credibility .
Approach:	They propose a model to generate e-commerce product summaries with product attributes . they encode product attribute table and constrain attribute words to be presented only through copying .
Outcome:	The proposed model significantly improves the faithfulness of e-commerce product summarization tasks.

AMPO: Automatic Multi-Branched Prompt Optimization (2024.emnlp-main)

Copied to clipboard

Sheng Yang, Yurong Wu, Yan Gao, Zineng Zhou, Bin Zhu, Xiaodi Sun, Jian-Guang Lou, Zhiming Ding, Anbang Hu, Yuan Fang, Yunsong Li, Junyan Chen, Linjun Yang

Predicting Rewards Alongside Tokens: Non-disruptive Parameter Insertion for Efficient Inference Intervention in Large Language Model (2024.emnlp-main)

Challenge:	Existing prompt engineering techniques are limited to producing single flow instructions, struggling with handling diverse patterns.
Approach:	They propose an automatic prompt optimization method that iteratively develops a multi-branched prompt using failure cases as feedback.
Outcome:	The proposed method achieves the best results across five tasks and demonstrates significant optimization efficiency due to adoption of a minimal search strategy.

Copied to clipboard

Chenhan Yuan, Fei Huang, Ru Peng, Keming Lu, Bowen Yu, Chang Zhou, Jingren Zhou

COIG-P: A High-Quality and Large-Scale Chinese Preference Dataset for Alignment with Human Values (2026.findings-eacl)

Challenge:	Existing approaches to fine tune LLMs produce unsafe responses and unreliable reasoning, but this solution introduces substantial time and space overhead due to the separate models required.
Approach:	They propose to insert extra parameters into transformer architecture to predict calibration signals along with original LLM output.
Outcome:	The proposed model reduces time and space costs while enabling seamless online deployment.

Copied to clipboard

Siwei Wu, JinCheng Ren, Xeron Du, Shuyue Guo, Xingwei Qu, Yiming Liang, Jie Liu, Yunwen Li, Tyler Loakman, Tianyu Zheng, Boyu Feng, Huaqing Yuan, Zili Wang, Jiaheng Liu, Wenhao Huang, Chenglin Cai, Haoran Que, Jian Yang, Yuelin Bai, Zekun Moore Wang, Zhouliang Yu, Qunshu Lin, Ding Pan, Yuchen Eleanor Jiang, Tiannan Wang, Wangchunshu Zhou, Shenzhi Wang, Xingyuan Bu, Minghao Liu, Guoyin Wang, Ge Zhang, Chenghua Lin

FoodieQA: A Multimodal Dataset for Fine-Grained Understanding of Chinese Food Culture (2024.emnlp-main)

Challenge:	Existing Chinese preference datasets suffer from limited scale, restricted domain coverage, and insufficiently rigorous data validation.
Approach:	They propose an LLM-based data annotation pipeline with no human intervention to annotate Chinese preference datasets.
Outcome:	The proposed pipeline outperforms existing Chinese preference datasets on AlignBench and Chinese Reward Benchmark.

Copied to clipboard

Wenyan Li, Crystina Zhang, Jiaang Li, Qiwei Peng, Raphael Tang, Li Zhou, Weijia Zhang, Guimin Hu, Yifei Yuan, Anders Søgaard, Daniel Hershcovich, Desmond Elliott

Language Models can Evaluate Themselves via Probability Discrepancy (2024.findings-acl)

Challenge:	FoodieQA is a manually curated, fine-grained image-text dataset capturing the intricate features of food cultures across various regions in China.
Approach:	They evaluate vision–language Models and large language models on unseen food images and corresponding questions.
Outcome:	The proposed dataset evaluates vision–language Models and large language models on unseen food images and corresponding questions.

Copied to clipboard

Tingyu Xia, Bowen Yu, Yuan Wu, Yi Chang, Chang Zhou

CENTAUR: Bridging the Impossible Trinity of Privacy, Efficiency, and Performance in Privacy-Preserving Transformer Inference (2025.acl-long)

Challenge:	Existing evaluation frameworks focus on superficial text differences and fail to align with human judgment.
Approach:	They propose a new method to evaluate the performance of Large Language Models (LLMs) by calculating probability discrepancies between original response generation and revised versions of LLMs.
Outcome:	The proposed method eliminates the need for training an additional evaluation model or relying on external proprietary models such as GPT-4 as a judger.

Copied to clipboard

Jinglong Luo, Guanzhong Chen, Yehong Zhang, Shiyu Liu, Hui Wang, Yue Yu, Xun Zhou, Yuan Qi, Zenglin Xu

R-Judge: Benchmarking Safety Risk Awareness for LLM Agents (2024.findings-emnlp)

Challenge:	Existing privacy-preserving Transformer Inference frameworks suffer from high computational overhead and performance losses.
Approach:	They propose a framework that integrates random permutations and SMPC to address the "impossible trinity" CENTAUR resists diverse data reconstruction attacks and boosts inference speed by 5.030.4 times .
Outcome:	CENTAUR achieves an unprecedented balance between privacy, efficiency, and performance.

Copied to clipboard

Tongxin Yuan, Zhiwei He, Lingzhong Dong, Yiming Wang, Ruijie Zhao, Tian Xia, Lizhen Xu, Binglin Zhou, Fangqi Li, Zhuosheng Zhang, Rui Wang, Gongshen Liu

Challenge:	Large language models (LLMs) have shown compelling abilities in reasoning, decision-making, and instruction following.
Approach:	They propose a benchmark to evaluate the proficiency of large language models (LLMs) in judging and identifying safety risks given agent interaction records.
Outcome:	The proposed model outperforms the best-performing model, GPT-4o, while no other models significantly exceed the random.

Reverse Constitutional AI: A Framework for Controllable Toxic Data Generation via Probability-Clamped RLAIF (2026.findings-acl)

Copied to clipboard

Yuan Fang, Yiming Luo, Aimin Zhou, Fei Tan

Routing to the Expert: Efficient Reward-guided Ensemble of Large Language Models (2024.naacl-long)

Challenge:	Existing approaches to red teaming focus on searching for individual adversarial inputs.
Approach:	They propose a framework for automated adversarial data generation that inverts harmless constitution into constitution of toxicity and iteratively refining model outputs through critique–revision pipeline.
Outcome:	The proposed framework generates diverse, high-quality toxic data without human annotation and significantly improves semantic coherence without sacrificing adversarial strength.

Copied to clipboard

Keming Lu, Hongyi Yuan, Runji Lin, Junyang Lin, Zheng Yuan, Chang Zhou, Jingren Zhou

Point-of-Interest Oriented Question Answering with Joint Inference of Semantic Matching and Distance Correlation (2020.aacl-main)

Challenge:	Existing ensemble methods for Large Language Models focus on reward model ranking of outputs, leading to significant computation overhead.
Approach:	They propose a reward-guided routing method distilling rewards on training queries to train a routing function.
Outcome:	The proposed method outperforms the best single model and ranks first on 44% of tasks.

Copied to clipboard

Yifei Yuan, Jingbo Zhou, Wai Lam

Question Answering

Challenge:	Existing methods for POI oriented question answering lack ability to handle important POI related information.
Approach:	They propose a deep learning framework integrated with joint inference to capture tag semantic and geographic correlation between question and POIs.
Outcome:	The proposed model captures both tag semantic and geographic correlation between question and POIs.

MedCoT: Medical Chain of Thought via Hierarchical Expert (2024.emnlp-main)

Copied to clipboard

Jiaxiang Liu, Yuan Wang, Jiawei Du, Joey Zhou, Zuozhu Liu

Dunhuang-Bench: How Well Do MLLMs Understand Cultural Heritage? (2026.findings-acl)

Challenge:	Existing methods for medical visual question answering lack robustness and reasoning paths for real-world medical diagnostics.
Approach:	They propose a hierarchical expert verification reasoning chain method to enhance interpretability and accuracy in medical visual question answering.
Outcome:	The proposed method outperforms existing methods on four standard Med-VQA datasets.

Copied to clipboard

Junyi Yuan, Jian Zhang, Tianxiu Yu, Yanlin Zhou, Xiaobo Jin, Qiufeng Wang, Fangyu Wu

BioFEG: Generate Latent Features for Biomedical Entity Linking (2023.emnlp-main)

Challenge:	Recent advances in Multimodal Large Language Models (MLLMs) have led to extensive evaluations on Chinese cultural benchmarks.
Approach:	They construct a large-scale benchmark comprising 486 images and 22,970 QA pairs to evaluate MLLMs' cultural understanding.
Outcome:	The proposed benchmark incorporates three task formats to evaluate MLLMs’ cultural understanding: Question Answering with Text Description, Multi-turn Dialogue, and Question Answers with Choices.

Copied to clipboard

Xuhui Sui, Ying Zhang, Xiangrui Cai, Kehui Song, Baohang Zhou, Xiaojie Yuan, Wensheng Zhang

Knowledge Representation

Challenge:	Existing approaches to biomedical entity linking suffer from multiple types of errors due to the rarity of many biomedically relevant entities in real-world scenarios.
Approach:	They propose a latent feature generation framework to generate latent semantic features for unseen entities to capture fine-grained coherence information of unseened entities.
Outcome:	The proposed framework is superior to existing models on two benchmark datasets.

A Systematic Study of Performance Disparities in Multilingual Task-Oriented Dialogue Systems (2023.emnlp-main)

Copied to clipboard

Songbo Hu, Han Zhou, Moy Yuan, Milan Gritta, Guchun Zhang, Ignacio Iacobacci, Anna Korhonen, Ivan Vulić

TAP4LLM: Table Provider on Sampling, Augmenting, and Packing Semi-structured Data for Large Language Model Reasoning (2024.findings-emnlp)

Challenge:	Existing systems trained for Arabic or Turkish using annotated data fully parallel to English ToD data still exhibit diminished ToD task performance.
Approach:	They define new quantitative measures of absolute and relative equivalence in system performance, capturing disparities across languages and within individual languages.
Outcome:	The proposed measures capture disparities across languages and within individual languages.

Copied to clipboard

Yuan Sui, Jiaru Zou, Mengyu Zhou, Xinyi He, Lun Du, Shi Han, Dongmei Zhang

CodRED: A Cross-Document Relation Extraction Dataset for Acquiring Knowledge in the Wild (2021.emnlp-main)

Challenge:	Existing solutions for table reasoning tasks are mainly tested on small tables and face scalability issues and struggle with complex queries due to incomplete or dispersed data across different table sections.
Approach:	They propose a table reasoning pre-processor suite that can be used to leverage large language models (LLMs) in table-based tasks.
Outcome:	The proposed method improves LLMs’ reasoning capabilities in various tabular tasks and enhances interaction between LLM and tabular data by employing effective pre-processing.

Copied to clipboard

Yuan Yao, Jiaju Du, Yankai Lin, Peng Li, Zhiyuan Liu, Jie Zhou, Maosong Sun

Information Extraction & Text Mining

Challenge:	Existing relation extraction methods focus on extracting relational facts between entity pairs within single sentences or documents.
Approach:	They present a problem of cross-document relation extraction (CRE) using human annotations.
Outcome:	The proposed dataset is the first human-annotated cross-document RE dataset . it shows that it is challenging to existing RE methods including strong BERT-based models.

Collision to Cognition: Hash-Driven Graph Construction for Efficient RAG (2026.acl-long)

Copied to clipboard

Chuang Zhou, Zheng Yuan, Linhao Luo, Zhaozhuo Xu, Yilin Xiao, Junnan Dong, Siyu An, di Yin, Xing Sun, Xiao Huang

Noise Robust Named Entity Understanding for Voice Assistants (2021.naacl-industry)

Challenge:	Retrieval-augmented generation (RAG) has been used for enhancing large language models with external knowledge.
Approach:	They propose a framework for mining efficient graph structures via hashing to enhance RAG . they adopt an inductive paradigm where global graph structure emerges from local hash collisions .
Outcome:	The proposed framework outperforms existing baselines while requiring no GPU resources or token budget.

Copied to clipboard

Deepak Muralidharan, Joel Ruben Antony Moniz, Sida Gao, Xiao Yang, Justine Kao, Stephen Pulman, Atish Kothari, Ray Shen, Yinying Pan, Vivek Kaul, Mubarak Seyed Ibrahim, Gang Xiang, Nan Dun, Yidan Zhou, Andy O, Yuan Zhang, Pooja Chitkara, Xuan Wang, Alkesh Patel, Kushal Tayal, Roger Zheng, Peter Grasch, Jason D Williams, Lin Li

Learn to Copy from the Copying History: Correlational Copy Network for Abstractive Summarization (2021.emnlp-main)

Challenge:	Named Entity Recognition and Entity Linking are challenging for voice assistants . utterances are relatively short, so there is not much context to help disambiguate .
Approach:	They propose a Named Entity Understanding system that combines NER and EL in a joint reranking module.
Outcome:	The proposed framework improves NER accuracy by up to 3.13% and EL accuracy by 3.6% in F1 score . it also leads to better accuracies in other natural language understanding tasks .

Copied to clipboard

Haoran Li, Song Xu, Peng Yuan, Yujia Wang, Youzheng Wu, Xiaodong He, Bowen Zhou

Text Generation

Challenge:	Existing methods for abstractive summarization use encoder-decoder attention, but this leads to incomplete copying.
Approach:	They propose a copying scheme that takes advantage of prior copying distributions and explicitly encourages the model to copy the input word that is relevant to the previously copied one.
Outcome:	The proposed scheme achieves state-of-the-art on summarization benchmarks . it takes advantage of prior copying distributions and explicitly encourages copying .

Towards Intrinsic Interpretability of Large Language Models: A Survey of Design Principles and Architectures (2026.acl-long)

Copied to clipboard

Yutong Gao, Qinglin Meng, Yuan Zhou, Liangming Pan

Explainability & Interpretability in NLP

Challenge:	Existing studies on explainable AI focus on post-hoc explanation methods that interpret trained models through external approximations.
Approach:	They propose to categorize existing approaches into five design paradigms: functional transparency, concept alignment, representational decomposability, explicit modularization, and latent sparsity induction.
Outcome:	The proposed approaches are categorized into five design paradigms: functional transparency, concept alignment, representational decomposability, explicit modularization, and latent sparsity induction.

Mapping Natural Language Instructions to Mobile UI Action Sequences (2020.acl-main)

Copied to clipboard

Yang Li, Jiacong He, Xin Zhou, Yuan Zhang, Jason Baldridge

Entity-Relation Extraction as Multi-Turn Question Answering (P19-1)

Challenge:	a new problem of grounding natural language instructions to mobile UI actions is emerging . we use a Transformer to extract action phrase tuples from long-range natural language instruction .
Approach:	They propose a dataset that pairs English instructions with actions performed by people on a mobile UI emulator.
Outcome:	The proposed model achieves 70.59% accuracy on predicting complete ground-truth action sequences in PixelHelp.

Copied to clipboard

Xiaoya Li, Fan Yin, Zijun Sun, Xiayu Li, Arianna Yuan, Duo Chai, Mingxin Zhou, Jiwei Li

POINTS-Reader: Distillation-Free Adaptation of Vision-Language Models for Document Conversion (2025.emnlp-main)

Challenge:	Identifying entities and their relations is the prerequisite of extracting structured knowledge from unstructured raw texts.
Approach:	They propose a new paradigm for the task of entity-relation extraction . they cast the task as a multi-turn question answering problem .
Outcome:	The proposed paradigm significantly outperforms previous best models on the ACE and CoNLL04 datasets.

Copied to clipboard

Yuan Liu, Zhongyin Zhao, Le Tian, Haicheng Wang, Xubing Ye, Yangxiu You, Zilin Yu, Chuhan Wu, Zhou Xiao, Yang Yu, Jie Zhou

An End-to-End Progressive Multi-Task Learning Framework for Medical Named Entity Recognition and Normalization (2021.acl-long)

Challenge:	Existing approaches to training document conversion models with manual annotation are costly and time-consuming, and training student models by distilling outputs from teacher models can significantly limit their performance in real-world applications.
Approach:	They propose a fully automated framework for constructing high-quality document extraction datasets and models capable of handling diverse document formats and layouts.
Outcome:	The proposed model outperforms existing models and improves on annotated documents.

Copied to clipboard

Baohang Zhou, Xiangrui Cai, Ying Zhang, Xiaojie Yuan

Demystifying Uncertainty in LLMs: Active Calibration between Concepts and Human Evaluations (2026.acl-long)

Challenge:	Existing models for medical named entity recognition and named entity normalization suffer from error propagation between the two tasks.
Approach:	They propose an end-to-end progressive multi-task learning model for jointly modeling medical named entity recognition and normalization in an effective way.
Outcome:	The proposed model reduces error propagation by exploiting the learnable features for both tasks to improve performance.

Copied to clipboard

Pengqi Li, Lizhong Ding, Zhehao Zhou, Chunhui Zhang, Jiarun Fu, Hao Li, Ye Yuan, Guoren Wang

Large Language Models Have Intrinsic Meta-Cognition, but Need a Good Lens (2025.emnlp-main)

Challenge:	Existing static strategies for mitigating hallucinations do not explicitly model the information gain from interacting with the external environment.
Approach:	They propose a calibration-driven interactive learning strategy that selects clarification queries by optimizing calibration error.
Outcome:	The proposed method provides theoretical guarantees and empirical gains for reliability.

Copied to clipboard

Ziyang Ma, Qingyue Yuan, Zhenglin Wang, Deyu Zhou

COIG-CQIA: Quality is All You Need for Chinese Instruction Fine-tuning (2025.findings-naacl)

Challenge:	Existing studies have focused on the cognitive error detection capabilities of Large Language Models (LLMs), but few studies have examined the meta-cognitive abilities of LLMs.
Approach:	They propose an automated meta-cognition evaluation framework for evaluation of LLMs and a Markovian Intrinsic Reward Adjustment strategy to boost current lenses.
Outcome:	The proposed framework can be used to evaluate the meta-cognition abilities of LLMs and improve them.

Copied to clipboard

Yuelin Bai, Xeron Du, Yiming Liang, Leo Jin, Junting Zhou, Ziqiang Liu, Feiteng Fang, Mingshan Chang, Tianyu Zheng, Xincheng Zhang, Nuo Ma, Zekun Moore Wang, Ruibin Yuan, Haihong Wu, Hongquan Lin, Wenhao Huang, Jiajun Zhang, Chenghua Lin, Jie Fu, Min Yang, Shiwen Ni, Ge Zhang

Improving Zero-Shot Entity Linking Candidate Generation with Ultra-Fine Entity Type Information (2022.coling-1)

Challenge:	Existing datasets for Chinese instruction tuning are not well-aligned with Chinese users’ interaction patterns.
Approach:	They propose to use Chinese instruction tuning datasets to improve instruction fine-tuning for Chinese users.
Outcome:	The proposed dataset shows that Chinese models achieve competitive performance in diverse benchmarks.

Copied to clipboard

Xuhui Sui, Ying Zhang, Kehui Song, Baohang Zhou, Guoqing Zhao, Xin Wei, Xiaojie Yuan

Label-Specific Dual Graph Neural Network for Multi-Label Text Classification (2021.acl-long)

Challenge:	Entity linking is a task of assigning entity mentions to referent entities in a knowledge base.
Approach:	They propose to use ultra-fine-grained type information to improve the generalization ability of EL models by utilizing a low-level task to extract ultra-finish entity type information.
Outcome:	The proposed model achieves state-of-the-art in the zero-shot entity linking task .

Copied to clipboard

Qianwen Ma, Chunyuan Yuan, Wei Zhou, Songlin Hu

Information Extraction & Text Mining

Challenge:	Existing studies for multi-label text classification do not explore label-specific semantic components from documents.
Approach:	They propose a label-specific dual graph neural network that incorporates category information to learn label-related components from documents.
Outcome:	The proposed model outperforms state-of-the-art models on three benchmark datasets and achieves better performance with respect to tail labels.

CPRM: A LLM-based Continual Pre-training Framework for Relevance Modeling in Commercial Search (2025.naacl-industry)

Copied to clipboard

Kaixin Wu, Yixin Ji, Zeyuan Chen, Qiang Wang, Cunxiang Wang, Hong Liu, Baijun Ji, Xu Jia, Zhongyi Liu, Jinjie Gu, Yuan Zhou, Linjian Mo

Dr3: Ask Large Language Models Not to Give Off-Topic Answers in Open Domain Multi-Hop Question Answering (2024.lrec-main)

Challenge:	Relevance modeling between queries and items is a key component of commercial search engines.
Approach:	They propose a framework for continual pre-training of LLMs to enhance domain knowledge . they employ queries and multi-field item to jointly pre-train for enhancing domain knowledge.
Outcome:	The proposed model achieves convincing performance compared to strong baselines.

Copied to clipboard

Yuan Gao, Yiheng Zhu, Yuanbin Cao, Yinzhi Zhou, Zhen Wu, Yujie Chen, Shenglan Wu, Haoyuan Hu, Xinyu Dai

Question Answering

Challenge:	Open Domain Multi-Hop Question Answering (ODMHQA) is one of the most challenging tasks in Natural Language Processing (NLP)
Approach:	They propose a mechanism that leverages the intrinsic capabilities of Large Language Models to judge whether the generated answers are off-topic.
Outcome:	The proposed method reduces the occurrence of off-topic answers by nearly 13%, improving the performance in Exact Match (EM) by nearly 3% compared to the baseline method without the Dr3 mechanism.

GSQ-Tuning: Group-Shared Exponents Integer in Fully Quantized Training for LLMs On-Device Fine-tuning (2025.findings-acl)

Copied to clipboard

Sifan Zhou, Shuo Wang, Zhihang Yuan, Mingjia Shi, Yuzhang Shang, Dawei Yang

SkewRoute: Training-Free LLM Routing for Knowledge Graph Retrieval-Augmented Generation via Score Skewness of Retrieved Context (2025.findings-emnlp)

Challenge:	Large Language Models (LLMs) fine-tuning techniques require large Floating Point(FP) computation and are impractical for resource-constrained edge devices.
Approach:	They propose a framework for on-device LLM fine-tuning that eliminates the need for floating-point operations in both inference and training.
Outcome:	The proposed framework reduces memory and compute costs while reducing memory usage.

Copied to clipboard

Hairu Wang, Yuan Feng, Yukun Cao, Xike Xie, S Kevin Zhou

Exploiting the Shadows: Unveiling Privacy Leaks through Lower-Ranked Tokens in Large Language Models (2025.acl-long)

Challenge:	Large language models incur high inference costs during deployment, causing hallucination . no dedicated routing methods exist for RAG, and existing training-based routers face challenges scaling to this domain .
Approach:	They propose a plug-and-play routing framework that optimizes performance and cost . the framework delivers over 3x higher routing effectiveness while reducing runtime to less than 0.001x .
Outcome:	The proposed framework delivers over 3x higher routing effectiveness while reducing runtime to less than 0.001x compared to existing methods.

Copied to clipboard

Yuan Zhou, Zhuo Zhang, Xiangyu Zhang

A Span-based Multimodal Variational Autoencoder for Semi-supervised Multimodal Named Entity Recognition (2022.emnlp-main)

Challenge:	Large language models face vulnerabilities related to the extraction of sensitive information.
Approach:	They propose a method to exploit the model's lower-ranked output tokens to extract private information from retrieved documents or training knowledge.
Outcome:	The proposed method is effective in both the agentic application privacy extraction setting and the direct training data extraction.

Copied to clipboard

Baohang Zhou, Ying Zhang, Kehui Song, Wenya Guo, Guoqing Zhao, Hongbin Wang, Xiaojie Yuan

TextFlint: Unified Multilingual Robustness Evaluation Toolkit for Natural Language Processing (2021.acl-demo)

Challenge:	Existing methods for named entity recognition on social media are not efficient for semi-supervised MNER because of the mismatch between the posted text and image.
Approach:	They propose a novel method to fuse the text and image features for multimodal named entity recognition under semi-supervised setting by exploiting modal-specific VAEs.
Outcome:	The proposed method outperforms baselines under supervised setting and improves performance with less labeled data than existing semi-supervised methods.

Copied to clipboard

Xiao Wang, Qin Liu, Tao Gui, Qi Zhang, Yicheng Zou, Xin Zhou, Jiacheng Ye, Yongxin Zhang, Rui Zheng, Zexiong Pang, Qinzhuo Wu, Zhengyan Li, Chong Zhang, Ruotian Ma, Zichu Fei, Ruijian Cai, Jun Zhao, Xingwu Hu, Zhiheng Yan, Yiding Tan, Yuan Hu, Qiyuan Bian, Zhihua Liu, Shan Qin, Bolin Zhu, Xiaoyu Xing, Jinlan Fu, Yue Zhang, Minlong Peng, Xiaoqing Zheng, Yaqian Zhou, Zhongyu Wei, Xipeng Qiu, Xuanjing Huang

DavIR: Data Selection via Implicit Reward for Large Language Models (2025.acl-long)

Challenge:	Existing approaches to textual robustness evaluation focus on slightly modifying the input data, which maintains the original meaning and results in a different prediction.
Approach:	They propose a multilingual robustness evaluation toolkit for NLP that integrates universal text transformations, task-specific transformations and adversarial attack.
Outcome:	The toolkit includes universal text transformation, task-specific transformation, adversarial attack, subpopulation, and their combinations to provide comprehensive robustness analyses.

Copied to clipboard

Haotian Zhou, Tingkai Liu, Qianli Ma, Yufeng Zhang, Jianbo Yuan, Pengfei Liu, Yang You, Hongxia Yang