Papers by Fan Li
GLGR: Question-aware Global-to-Local Graph Reasoning for Multi-party Dialogue Reading Comprehension (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches for multi-hop reasoning are lacking for local graph reasoning . existing approaches neglect local semantic structures in utterances . |
| Approach: | They propose a question-aware global-to-local graph reasoning approach that expands the canonical Interlocutor-Utterance graph by introducing a query node. |
| Outcome: | The proposed approach outperforms existing methods on Molweni and FriendsQA. |
Soundwave: Less is More for Speech-Text Alignment in LLMs (2025.acl-long)
Copied to clipboard
| Challenge: | Existing end-to-end speech large language models rely on large-scale annotated data for training, while data-efficient training has not been discussed in depth. |
| Approach: | They propose a training strategy and a novel architecture to address representation space gap and sequence length inconsistency in speech and text. |
| Outcome: | The proposed model outperforms other advanced speech LLMs in speech translation and AIR-Bench speech tasks with only a fraction of the training data. |
LaCo: Layer-wise Compensation for Pruned Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for predicting performance degradations of Large Language Models (LLMs) neglect the structural distortions caused by sparsity. |
| Approach: | They propose a framework that reorients the recovery paradigm from global adaptation to hierarchical representation alignment by sequentially optimizing each layer to reconstruct the model's hidden states. |
| Outcome: | The proposed framework surpasses parameter-efficient baselines in perplexity reduction and zero-shot reasoning. |
S2S-Arena: Evaluating Paralinguistic Instruction Following in Speech-to-Speech Models (2026.acl-long)
Copied to clipboard
Feng Jiang, Zhiyu Lin, Yiyang Liu, Liumeng Xue, Fan Bu, Yuhao Du, Xiangying Chen, Benyou Wang, Haizhou Li
| Challenge: | Existing benchmarks rely heavily on text-based evaluation and largely ignore paralinguistic cues such as prosody, emotion, and speaker traits. |
| Approach: | They propose a speech-native benchmark for evaluating instruction-following S2S models with explicit assessment of both semantic understanding and paralinguistic expression. |
| Outcome: | The proposed system enables more natural, robust, and human-aligned speech agents. |
GUARD: Glocal Uncertainty-Aware Robust Decoding for Effective and Efficient Open-Ended Text Generation (2025.findings-emnlp)
Copied to clipboard
Yuanhao Ding, Esteban Garces Arias, Meimingwei Li, Julian Rodemann, Matthias Aßenmacher, Danlu Chen, Gaojuan Fan, Christian Heumann, Chongsheng Zhang
| Challenge: | GUARD is a self-adaptive decoding method that balances coherence with diversity in open-ended text generation. |
| Approach: | They propose a self-adaptive decoding method that balances coherence and diversity . they combine global entropy estimates with local entropic deviations to integrate uncertainty . |
| Outcome: | GUARD achieves a good balance between diversity and coherence while exhibiting significant improvements in generation speed. |
Hardware-Aware Parallel Prompt Decoding for Memory-Efficient Acceleration of LLM Inference (2025.findings-emnlp)
Copied to clipboard
Hao Mark Chen, Wayne Luk, Yiu Ka Fai Cedric, Rui Li, Konstantin Mishchenko, Stylianos Venieris, Hongxiang Fan
| Challenge: | Auto-regressive decoding of Large Language Models results in significant overheads in hardware performance . a novel parallel prompt decoding approach is proposed to overcome these limitations . |
| Approach: | They propose a parallel prompt decoding that uses a single model for speculation and verification. |
| Outcome: | The proposed approach speeds up auto-regressive decoding of large language models 2.49 times . it can be used on mobileLlama to Vicuna-13B on a wide range of benchmarks . |
NPHardEval: Dynamic Benchmark on Reasoning Ability of Large Language Models via Complexity Classes (2024.acl-long)
Copied to clipboard
| Challenge: | Complex reasoning ability is one of the most important features of Large Language Models. |
| Approach: | They propose a new benchmark that measures the reasoning ability of Large Language Models . it contains 900 algorithmic questions belonging to the NP-Hard complexity class . |
| Outcome: | The proposed benchmark contains 900 questions belonging to the NP-Hard complexity class and is updated on a monthly basis. |
DraDDP: A Multimodal Multi-Party Dialogue Discourse Parsing Dataset (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on multi-party dialogue discourse parsing focus on textual modality and two-party dialog . et al., 2016) focused on text-based discourse parses, ignoring the complexity and richness of multimodal interactions in real-world scenarios. |
| Approach: | They construct the first publicly available English multimodal dataset for multi-party dialogue discourse parsing based on American TV dramas. |
| Outcome: | The proposed dataset contains 495 dialogue segments with 6,374 utterances and 9.1 hours of parallel video content, covering rich multi-party interaction scenarios. |
Disentangling Logic: The Role of Context in Large Language Model Reasoning Capabilities (2025.findings-acl)
Copied to clipboard
Wenyue Hua, Kaijie Zhu, Lingyao Li, Lizhou Fan, Mingyu Jin, Shuhang Lin, Haochen Xue, Zelong Li, Jindong Wang, Yongfeng Zhang
| Challenge: | Using large language models, large language model models can be used to evaluate reasoning abilities in context-rich scenarios. |
| Approach: | They construct datasets for both propositional logic and abductive logic reasoning with four difficulty levels across 12 distinct domains based on Wikipedia categorization and those with purely abstract variables. |
| Outcome: | The proposed model can be used to benchmark LLMs in real-world scenarios, but not in context-rich scenarios. |
FB-Bench: A Fine-Grained Multi-Task Benchmark for Evaluating LLMs’ Responsiveness to Human Feedback (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing research focuses on benchmarking LLMs in single-turn dialogues, neglecting the nuanced nature of human feedback within real-world usage scenarios. |
| Approach: | They propose a fine-grained, multi-task benchmark designed to evaluate LLMs’ responsiveness to human feedback under real-world usage scenarios in Chinese. |
| Outcome: | The proposed benchmarks show that human feedback can significantly impact LLMs’ responsiveness in real-world usage scenarios. |
Beyond Token Length: Step Pruner for Efficient and Accurate Reasoning in Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing reinforcement learning methods for large reasoning models suffer from excessive verbosity, known as "overthinking." Existing models penalize generated tokens to promote conciseness, but these methods encounter two challenges: they may develop hacking behavior in later stages of training by discarding reasoning steps. |
| Approach: | They propose a framework that steers large reasoning models toward more efficient reasoning . they prioritize correctness while imposing penalties for redundant steps . |
| Outcome: | The proposed framework reduces token usage by 69.7% on AIME24. |
Maximizing the Effectiveness of Larger BERT Models for Compression (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for capturing large BERT models as teachers do not fully exploit the potential advantages of larger teachers. |
| Approach: | They propose a method that leverages a pretrained teacher model to guide the training of a lightweight student model to enhance knowledge transfer. |
| Outcome: | The proposed method enhances knowledge transfer by leveraging a pretrained teacher model to guide the training of a lightweight student model. |
Schoenfeld’s Anatomy of Mathematical Reasoning by Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models expose reasoning traces, yet their underlying cognitive structure and steps remain difficult to identify and analyze beyond surface-level statistics. |
| Approach: | They propose a framework that explicitly abstracts reasoning traces into functional reasoning steps such as Analysis, Explore, Implement, Verify, etc. |
| Outcome: | The proposed framework reveals reproducible thinking dynamics and structural differences between reasoning and non-reasoning models, which are not apparent from token-level views. |
Harmful Factuality: LLMs Correcting What They Shouldn’t (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are trained for factual accuracy, but can conflict with the critical demand for source fidelity. |
| Approach: | They propose a reproducible framework to elicit and measure HFH using controlled entity-level perturbations and strategic entity selection. |
| Outcome: | The proposed framework reduces HFH rates by 50% across summarization, rephrasing, and QA tasks. |
MED-COREASONER: Reducing Language Disparities in Medical Reasoning via Language-Informed Co-Reasoning (2026.acl-long)
Copied to clipboard
Fan Gao, Sherry T. Tong, Jiwoong Sohn, Jiahao Huang, Junfeng Jiang, Ding Xia, Piyalitt Ittichaiwong, Kanyakorn Veerakanjana, Hyunjae Kim, Qingyu Chen, Edison Marrese-Taylor, Kazuma Kobayashi, Akiko Aizawa, Irene Li
| Challenge: | Existing models that use English and local languages have a multilingual gap . a language-informed co-reasoning framework can be used to improve multilingual reasoning . |
| Approach: | They propose a language-informed co-reasoning framework that elicits parallel English and local-language reasoning and abstracts them into structured concepts. |
| Outcome: | Experiments show that Med-CoReasoner improves multilingual reasoning performance by 5% . the framework produces clinically sound and culturally grounded reasoning traces . |
Dependency Parsing as MRC-based Span-Span Prediction (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods for dependency parsing address the issue that edges should be constructed at the text span/subtree level rather than word level. |
| Approach: | They propose a method that constructs dependency trees by directly modeling span-span relations by modeling subtree-subtree relationships. |
| Outcome: | The proposed method constructs dependency trees by modeling span-span relations . it can retrieve missing spans in the span proposal stage, which leads to higher recall . |
Re-ViLM: Retrieval-Augmented Visual Language Model for Zero and Few-Shot Image Captioning (2023.findings-emnlp)
Copied to clipboard
Zhuolin Yang, Wei Ping, Zihan Liu, Vijay Korthikanti, Weili Nie, De-An Huang, Linxi Fan, Zhiding Yu, Shiyi Lan, Bo Li, Mohammad Shoeybi, Ming-Yu Liu, Yuke Zhu, Bryan Catanzaro, Chaowei Xiao, Anima Anandkumar
| Challenge: | Existing methods for image-to-text generation store all knowledge within parameters, thus requiring computational-expensive fine-tuning. |
| Approach: | They propose a Retrieval-augmented Visual Language Model that stores all the knowledge within parameters and can be used to retrieve it from the external database. |
| Outcome: | The proposed model significantly boosts performance for image-to-text generation tasks with 4x less parameters compared with baseline methods. |
Enhancing Retrieval-Augmented Generation via Evidence Tree Search (2025.acl-long)
Copied to clipboard
| Challenge: | Evidence retrieval is used to enhance Large Language Models (LLMs) but in real-world applications, it often returns lengthy documents with redundant or irrelevant content, confusing downstream readers. |
| Approach: | They propose a framework that reformulates evidence retrieval as a dynamic tree expansion process. |
| Outcome: | The proposed framework outperforms existing methods on five datasets. |
1+1>2: Can Large Language Models Serve as Cross-Lingual Knowledge Aggregators? (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have been recognized for their impressive capabilities in natural language processing (NLP). |
| Approach: | They propose a method to enhance the multilingual performance of Large Language Models by aggregating knowledge from diverse languages. |
| Outcome: | The proposed method reduces the performance disparity across languages and offers valuable insights for further exploration. |
AgentCourt: Simulating Court with Adversarial Evolvable Lawyer Agents (2025.findings-acl)
Copied to clipboard
Guhong Chen, Liyang Fan, Zihan Gong, Nan Xie, Zixuan Li, Ziqiang Liu, Chengming Li, Qiang Qu, Hamid Alinejad-Rokny, Shiwen Ni, Min Yang
| Challenge: | Existing legal language models struggle with dynamic courtroom interactions, resulting in overfitting to standardized legal tasks. |
| Approach: | They propose a new adversarial evolutionary approach for agents that performs dynamic knowledge learning and evolution through structured adversarials in a simulated courtroom program. |
| Outcome: | The proposed approach outperforms existing LLM-based models in three critical dimensions: cognitive agility, professional knowledge, and logical rigor. |
HELPD: Mitigating Hallucination of LVLMs by Hierarchical Feedback Learning with Vision-enhanced Penalty Decoding (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing work detects hallucination by directly judging whether an object exists in an image, overlooking the association between the object and semantics. |
| Approach: | They propose a framework that incorporates hallucination feedback at both object and sentence semantic levels to alleviate over 15% of hallucinism. |
| Outcome: | The proposed framework can alleviate over 15% of hallucination even with a marginal degree of training. |
Cross-layer Attention Sharing for Pre-trained Large Language Models (2026.tacl-1)
Copied to clipboard
Yongyu Mu, Yuzhang Wu, Yuchun Fan, Chenglong Wang, Hengyu Li, Jiali Zeng, Qiaozhi He, Murun Yang, Fandong Meng, Jie Zhou, Tong Xiao, Jingbo Zhu
| Challenge: | Existing studies focus on compressing the Key-Value cache or grouping attention heads, while overlooking redundancy between layers. |
| Approach: | They propose a lightweight substitute for self-attention in well-trained LLMs that uses feed-forward networks to align attention heads between adjacent layers and low-rank matrices to approximate differences in layer-wise attention weights. |
| Outcome: | The proposed model reduces redundancy by sharing weights across layers while maintaining high response quality while reducing redundant calculations within 53% 84% of the total layers. |
Youling: an AI-assisted Lyrics Creation System (2020.emnlp-demos)
Copied to clipboard
Rongsheng Zhang, Xiaoxi Mao, Le Li, Lin Jiang, Lin Chen, Zhiwei Hu, Yadong Xi, Changjie Fan, Minlie Huang
| Challenge: | Recent studies have focused on a single pass of lyrics generation with little human intervention. |
| Approach: | They propose an AI-assisted lyrics creation system that supports one pass full-text generation and interactive generation modes. |
| Outcome: | The proposed system supports full-text generation and interactive generation modes . it also provides a revision module which enables users to revise undesired lyrics repeatedly. |
Evaluating Generative Language Models in Information Extraction as Subjective Question Correction (2024.lrec-main)
Copied to clipboard
| Challenge: | Modern large language models (LLMs) perform poorly in elementary tasks like relation extraction and event extraction due to two issues in conventional evaluation methods. |
| Approach: | They propose a method to evaluate large language models by incorporating a human annotation schema. |
| Outcome: | The proposed evaluation method improves matching between model outputs and golden labels. |
You Don’t Know My Favorite Color: Preventing Dialogue Representations from Revealing Speakers’ Private Personas (2022.naacl-main)
Copied to clipboard
| Challenge: | Social chatbots evolve rapidly with large pretrained language models. |
| Approach: | They propose effective defense objectives to protect persona leakage from hidden states by a simple neural network. |
| Outcome: | The proposed defense objectives reduce the attack accuracy from 37.6% to 0.5% while preserving language models’ powerful generation ability. |
C2KD: Cross-layer and Cross-head Knowledge Distillation for Small Language Model-based Recommendation (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) show promise but their size and high inference costs limit deployment on resource-constrained devices. |
| Approach: | They propose a framework to transfer task-relevant knowledge from two complementary dimensions to Large Language Models (LLMs) Large Language models (LLMS) have demonstrated great potential in sequential recommendation tasks . |
| Outcome: | Extensive experiments across diverse model families show that the proposed framework achieves competitive performance compared to LLMs. |
On the Role of Entity and Event Level Conceptualization in Generalizable Reasoning: A Survey of Tasks, Methods, Applications, and Future Directions (2025.findings-emnlp)
Copied to clipboard
Weiqi Wang, Tianqing Fang, Haochen Shi, Baixuan Xu, Wenxuan Ding, Liyu Zhang, Wei Fan, Jiaxin Bai, Haoran Li, Xin Liu, Yangqiu Song
| Challenge: | Conceptualization is a fundamental element of human cognition and plays a pivotal role in generalizable reasoning. |
| Approach: | They propose to categorize different types of conceptualizations into four levels based on the types of instances being conceptualized. |
| Outcome: | The proposed categorization of different types of conceptualizations into four levels based on the types of instances being conceptualized . |
HiSVD: Principled Low-Rank Approximation of LLMs via Hierarchical Modeling of Information Capacity and Spectral Structure (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for generating layer importance ignore the fine-grained influence of spectral distribution shape. |
| Approach: | They propose a hierarchical rank allocation framework with two stages to address this gap . they propose SVD-based lowrank approximation that exploits spectral heterogeneity . |
| Outcome: | Experiments show that HiSVD outperforms state-of-the-art methods on LLMs . |
DisComp: A Two-Stage Prompt Optimization Framework Combining Task-Agnostic and Task-Aware Compression (2025.findings-naacl)
Copied to clipboard
| Challenge: | Extended prompts can lead to substantial computational overhead and increased hardware demands, limiting the scalability and efficiency of large language models. |
| Approach: | They propose a two-stage prompt compression framework that combines task-agnostic and task-based strategies to efficiently compress prompt length without compromising performance. |
| Outcome: | The proposed framework outperforms task-agnostic and task-specific compression methods on three benchmark datasets and is up to 6.56 faster at inference compared to the best token-level compression method. |
Dynamic Energy-Based Contrastive Learning with Multi-Stage Knowledge Verification for Event Causality Identification (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for event causal identification rely on rule-based or random sampling strategies, which introduce spurious causal positives. |
| Approach: | They propose an ECI method enhanced by Dynamic Energy-based Contrastive Learning with multi-stage knowledge verification which generates high-quality contrastive samples and effectively suppresses spurious causal disturbances. |
| Outcome: | The proposed method outperforms state-of-the-art methods on two benchmarks. |
LLMs Can Achieve High-quality Simultaneous Machine Translation as Efficiently as Offline (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models perform well in offline machine translation when the complete source sentence is provided . however, in many real scenarios, the source tokens arrive in a streaming manner and simultaneous machine translation is required . |
| Approach: | They propose a new paradigm that includes constructing supervised fine-tuning data for simultaneous machine translation (SiMT) to achieve SiMT, source and target tokens are rearranged into interleaved sequences, separated by special tokens according to varying latency requirements. |
| Outcome: | The proposed approach achieves state-of-the-art performance across various SiMT benchmarks and evaluation metrics while maintaining efficient auto-regressive decoding. |
Can We Edit Factual Knowledge by In-Context Learning? (2023.emnlp-main)
Copied to clipboard
| Challenge: | In-context knowledge editing (IKE) is a new paradigm for NLP research that can be applied to large language models with tens or hundreds of parameters. |
| Approach: | They propose to use in-context knowledge editing (IKE) without gradient updating to edit factual knowledge without a gradient update. |
| Outcome: | The proposed method achieves a competitive success rate compared to gradient-based methods on GPT-J but with fewer side effects. |
SGPVT: Self-Generated Proximal Visual Tokens for Mitigating Proximal Collateral Damage in MLLM Unlearning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches focus on general utility metrics, overlooking the preservation of semantically related concepts. |
| Approach: | They propose a method that introduces self-generated proximal visual tokens to prevent forgetting vulnerability. |
| Outcome: | The proposed framework outperforms existing methods in preserving semantically related concepts while achieving effective target unlearning. |
MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsing (2026.acl-industry)
Copied to clipboard
Junbo Niu, Zheng Liu, Zhuangcheng Gu, Bin Wang, Linke Ouyang, Zhiyuan Zhao, Tao Chu, Tianyao He, Fan Wu, Qintong Zhang, Zhenjiang Jin, Guang Liang, Rui Zhang, Wenzheng Zhang, Yuan Qu, Zhifei Ren, Yuefeng Sun, Zirui Tang, Boyu Niu, Yuanhong Zheng, Dongsheng Ma, Ziyang Miao, Hejun Dong, Siyi Qian, Junyuan Zhang, Fangdong Wang, Jingzhou Chen, Xiaomeng Zhao, Liqun Wei, Wei Li, Shasha Wang, RuiLiang Xu, Yuanyuan Cao, Lu Chen, Qianqian Wu, Huaiyu Gu, Lindong Lu, Dechen Lin, null Shenguanlin, Xuanhe Zhou, Linfeng Zhang, Yuhang Zang, Xiaoyi Dong, Jiaqi Wang, Bo Zhang, Lei Bai, Pei Chu, Weijia Li, Jiang Wu, Lijun Wu, Zhenxiang Li, Guangyu Wang, Zhongying Tu, Chao Xu, Kai Chen, Bowen Zhou, Dahua Lin, Wentao Zhang, Conghui He
| Challenge: | Document images are characterized by higher resolutions, denser content, and more complex structural layouts. |
| Approach: | They propose a 1.2B-parameter document parsing vision-language model that decouples layout analysis from local content recognition. |
| Outcome: | The proposed model surpasses general-purpose and domain-specific models on multiple benchmarks while maintaining significantly lower computational overhead. |
Improving Dialogue Discourse Parsing through Discourse-aware Utterance Clarification (2025.acl-long)
Copied to clipboard
| Challenge: | Extensive experiments on the STAC and Molweni datasets demonstrate that our approach effectively resolves ambiguities and significantly outperforms the state-of-the-art (SOTA) baselines. |
| Approach: | They propose a Discourse-aware Clarification Module (DCM) that generates clarifications for the parser through systematic clarification type reasoning and discourse goal reasoning. |
| Outcome: | Extensive experiments on the STAC and Molweni datasets demonstrate that the proposed module significantly outperforms the state-of-the-art (SOTA) framework. |
LEAF: Towards Lightweight Explainable Hateful Video Detection via Self-Grounding CoT Guided Stage-Wise Distillation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for detecting hateful videos rely on opaque models with no insight into their decisions. |
| Approach: | They propose a lightweight, explainable video detection framework that distills "explainability" from LMMs into efficient Smaller Multimodal Models (SMMs) they use a self-grounded chain-of-thought mechanism to generate unbiased supervision signals for videos . |
| Outcome: | The proposed framework outperforms existing methods in detection accuracy and explainability on three video benchmarks. |
Reinforced Product Metadata Selection for Helpfulness Assessment of Customer Reviews (D19-1)
Copied to clipboard
| Challenge: | a helpful review is largely concerned with the metadata of its target product . a selector learns from both the key-value product metadata and one of its reviews to take an action . |
| Approach: | They propose a framework that uses product metadata to assess helpfulness of free-text reviews . they use two real-world datasets from amazon.com and Yelp.com to test the framework . |
| Outcome: | The proposed framework can achieve state-of-the-art performance with substantial improvements . it uses two real-world datasets from Amazon.com and Yelp.com . |
iMOVE : Instance-Motion-Aware Video Understanding (2025.findings-acl)
Copied to clipboard
Jiaze Li, Yaya Shi, Zongyang Ma, Haoran Xu, Yandong.bai Yandong.bai, Huihui Xiao, Ruiwen Kang, Fan Yang, Tingting Gao, Di Zhang
| Challenge: | Recent advances in Video Large Language Models have led to rapid development, significantly enhancing the capture of overall video semantics and achieving remarkable performance in general video understanding tasks. |
| Approach: | They propose a large-scale instance-motion-aware video instruction-tuning dataset iMOVE that utilizes Event-awful Spatiotemporal Efficient Modeling to retain informative instance spatiotemporal motion details while maintaining computational efficiency. |
| Outcome: | The proposed model excels in video temporal understanding and general video understanding. |
Do VLMs Have a Moral Backbone? A Study on the Fragile Morality of Vision-Language Models (2026.findings-acl)
Copied to clipboard
Zhining Liu, Tianyi Wang, Xiao Lin, Penghao Ouyang, Gaotang Li, Ze Yang, Hui Liu, Sumit Keswani, Vishwa Pardeshi, Huijun Zhao, Wei Fan, Hanghang Tong
| Challenge: | Vision-Language Models (VLMs) have advanced multimodal learning, driving progress in cross-modal reasoning. |
| Approach: | They propose to examine moral robustness of vision-language models by analyzing their moral stances under multimodal perturbations. |
| Outcome: | The proposed model-agnostic multimodal perturbations expose VLMs to a variety of moral vulnerabilities, including a sycophancy trade-off where stronger instruction-following models are more susceptible to persuasion. |
Negative Sample is Negative in Its Own Way: Tailoring Negative Sentences for Image-Text Retrieval (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing approaches to retrieve hard negative sentences are limited in the scale of the dataset thus fail to identify negative samples of high difficulty for every image. |
| Approach: | They propose to use a model to generate synthetic negative sentences with higher difficulty by masking and refilling the images and performing word discrimination and word correction tasks to improve retrieval and generation. |
| Outcome: | The proposed model generates synthetic negative sentences with higher difficulty on MS-COCO and Flickr30K and is robust and faithful to state-of-the-art training. |
DeepSynth-Eval: Objectively Evaluating Information Consolidation in Deep Survey Writing (2026.findings-acl)
Copied to clipboard
Hongzhi Zhang, Yuanze Hu, Tinghai Zhang, Jia Fu, Tao Wang, Junwei Jing, Zhaoxin Fan, Wei Bi, Ruiming Tang, Han Li, Guorui Zhou, Kun Gai
| Challenge: | Large Language Models (LLMs) are evolving towards autonomous agents . retrieval capabilities are well-benchmarked, but post-retrieval synthesis is under-evaluated due to open-ended writing. |
| Approach: | They propose a benchmark to evaluate information consolidation capabilities using survey papers as gold standards. |
| Outcome: | The proposed benchmark analyzes the post-retrieval synthesis stage of large language models . it leverages high-quality survey papers as gold standards and reverse-engineers research requests . the proposed benchmark outperforms single-turn generation and reduces hallucinations . |
Listen, Decipher and Sign: Toward Unsupervised Speech-to-Sign Language Recognition (2023.findings-acl)
Copied to clipboard
Liming Wang, Junrui Ni, Heting Gao, Jialu Li, Kai Chieh Chang, Xulin Fan, Junkai Wu, Mark Hasegawa-Johnson, Chang Yoo
| Challenge: | Existing supervised sign language recognition systems rely on well-annotated data . instead, an unsupervised speech-to-sign language recognition system learns to translate between spoken and sign languages by observing only non-parallel speech and sign-language corpora. |
| Approach: | They propose an unsupervised speech-to-sign language recognition system that can translate between spoken and sign languages by observing only non-parallel speech and sign-language corpora. |
| Outcome: | The proposed approach outperforms baseline models on sign language corpora by 50% . the proposed approach is available at https://github.com/cactuswiththoughts/UnsupSpeech2Sign.git . |
When Efficiency Becomes a Vulnerability: Computational Cost Attacks on WebAgents (2026.acl-long)
Copied to clipboard
| Challenge: | Existing WebAgents suffer from computational cost attacks due to long reasoning processes and excessive computational cost. |
| Approach: | They propose a framework that generates adversarial prompts and a reinforcement learning-enhanced selector to identify the most effective perturbations. |
| Outcome: | The proposed framework exploits large language models to generate diverse adversarial prompts and a reinforcement learning–enhanced selector to identify the most effective perturbations. |
Sentiment-Aware Word and Sentence Level Pre-training for Sentiment Analysis (2022.emnlp-main)
Copied to clipboard
Shuai Fan, Chen Lin, Haonan Li, Zhenghao Lin, Jinsong Su, Hang Zhang, Yeyun Gong, JIan Guo, Nan Duan
| Challenge: | Existing pre-trained language representation models (PLMs) capture sentiment information from word-level while under-considering sentence-level information. |
| Approach: | They propose a Sentiment-aware pre-trained language model with combined Word-level and Sentence-level Pre-training tasks that enhance the PLM’s knowledge about sentiment words. |
| Outcome: | The proposed model achieves state-of-the-art on various sentence-level and aspect-level sentiment classification benchmarks. |
Mixture-of-Minds: Multi-Agent Reinforcement Learning for Table Understanding (2026.acl-long)
Copied to clipboard
Yuhang Zhou, Mingrui Zhang, Ke Li, Mingyi Wang, Qiao Liu, Qifei Wang, Jiayi Liu, Fei Liu, Serena Li, Weiwei LI, Mingze Gao, Abhishek Kumar, Xiangjun Fan, Zhuokai Zhao, Lizhu Zhang
| Challenge: | Large language models (LLMs) have shown promise on understanding and reasoning over tables, but current approaches remain limited. |
| Approach: | They propose a multi-agent framework that decomposes table reasoning into three specialized roles: planning, coding, and answering. |
| Outcome: | The proposed framework decomposes table reasoning into three specialized roles: planning, coding, and answering. |
Automating eHMI Action Design with LLMs for Automated Vehicle Communication (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Currently, eHMIs employ predefined text messages and manually designed actions to perform these messages . this limits the real-world deployment of ehMIs, where adaptability in dynamic scenarios is essential. |
| Approach: | They propose a pipeline that integrates large language models and 3D renderers to generate executable actions for controlling eHMIs and rendering action clips. |
| Outcome: | The proposed pipeline integrates large language models and 3D renderers to generate executable actions for controlling eHMIs and rendering action clips. |
Learning to Selectively Learn for Weakly-supervised Paraphrase Generation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to generate paraphrases with weak supervision are limited in real-world scenarios due to the lack of coherent and controllable generated paraphrase. |
| Approach: | They propose a method to generate high-quality paraphrases with weak supervision . they obtain abundant weakly-labeled parallel sentences via retrieval-based pseudo paraphrase expansion . |
| Outcome: | The proposed approach achieves significant improvements over existing methods and is even comparable in performance with supervised state-of-the-arts. |
Enhancing Goal-oriented Proactive Dialogue Systems via Consistency Reflection and Correction (2025.acl-long)
Copied to clipboard
| Challenge: | Unlike traditional dialogue systems, goal-oriented proactive dialogue systems focus on achieving specific objectives by actively guiding and anticipating user needs. |
| Approach: | They propose a model-agnostic two-stage Consistency Reflection and Correction framework that allows the model to reflect on discrepancies between generated responses and dialogue contexts and suggest possible corrections. |
| Outcome: | The proposed framework significantly improves the consistency between generated responses and dialogue contexts on three datasets. |
Maximum Score Routing For Mixture-of-Experts (2025.findings-acl)
Copied to clipboard
| Challenge: | Traditional mixture-of-experts (MoE) networks impose an expert capacity constraint to ensure GPU-friendly computation. |
| Approach: | They propose a routing paradigm that dynamically allocates input tokens to top-k experts through differentiable sparse transformations, enabling scalable model capacity while preserving computational efficiency. |
| Outcome: | The proposed model achieves lower training losses and higher evaluation scores at equivalent FLOPs compared to constrained and unconstrained baselines. |
FinChain: A Symbolic Benchmark for Verifiable Chain-of-Thought Financial Reasoning (2026.acl-long)
Copied to clipboard
Zhuohan Xie, Daniil Orel, Rushil Thareja, Dhruv Sahnan, Hachem Madmoun, Fan Zhang, Debopriyo Banerjee, Georgi Nenkov Georgiev, Xueqing Peng, Lingfei Qian, Jimin Huang, Jinyan Su, Aaryamonvikram Singh, Rui Xing, Rania Elbadry, Chen Xu, Haonan Li, Fajri Koto, Ivan Koychev, Tanmoy Chakraborty, Yuxia Wang, Salem Lahlou, Veselin Stoyanov, Sophia Ananiadou, Preslav Nakov
| Challenge: | Existing benchmarks emphasize final numerical answers while neglecting intermediate reasoning steps. |
| Approach: | They propose a symbolic benchmark for verifiable Chain-of-Thought evaluation in finance . FINCHAIN spans 58 topics across 12 financial domains and three difficulty levels . |
| Outcome: | The proposed benchmark aims to bridge symbolic reasoning and factual verification. |
Sparsity-Accelerated Training for Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated proficiency across various NLP tasks but often require additional training, such as continual pre-training and supervised fine-tuning. |
| Approach: | They propose to leverage sparsity in pre-trained LLMs to accelerate training by disregarding computations for unimportant neurons. |
| Outcome: | The proposed framework achieves comparable or superior performance to standard training while significantly accelerating the process. |
A Distance-Aware Multi-Task Framework for Conversational Discourse Parsing (2022.coling-1)
Copied to clipboard
| Challenge: | Existing studies have focused on graph-based and transition-based discourse parsing, but no study has investigated the advantages of both paradigms for conversational discourse paring. |
| Approach: | They propose a distance-aware multi-task framework that incorporates the strengths of transition-based paradigms to facilitate conversational discourse parsing. |
| Outcome: | The proposed framework improves the graph-based paradigm on long-distance dependency links. |
WESR: A Benchmark and Strong Baseline for Word-level Event-Speech Recognition (2026.findings-acl)
Copied to clipboard
Chenchen Yang, Kexin Huang, Liwei Fan, Qian Tu, Botian Jiang, Dong Zhang, Linqi Yin, Shimin Li, Zhaoye Fei, Qinyuan Cheng, Xipeng Qiu
| Challenge: | aaron carroll: the precise localization of non-verbal vocal events remains a critical yet under-explored challenge. carroll says current methods suffer from insufficient task definitions with limited category coverage. carrol: knowing exactly where an event occurred is not enough; knowing exactly what it happened is. |
| Approach: | They propose a taxonomy of 21 vocal events with a new categorization into discrete versus continuous types. |
| Outcome: | The proposed model disentangles ASR errors from event detection while maintaining ASR quality. |
Dissecting Human and LLM Preferences (2024.acl-long)
Copied to clipboard
| Challenge: | a recent study shows that human and Large Language Model preferences are important for model fine-tuning and evaluation. |
| Approach: | They dissect the preferences of human and 32 different Large Language Models to understand their quantitative composition. |
| Outcome: | The proposed model is compared with 32 different large language models using real-world user-model conversations. |
ConRPG: Paraphrase Generation using Contexts as Regularizer (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for paraphrase generation lack reliable supervision signals. |
| Approach: | They propose an unsupervised paradigm for paraphrase generation based on contextual language models, candidate filtering and paraphrase model training based upon the selected candidates. |
| Outcome: | The proposed paradigm outperforms existing paraphrase generation methods in supervised and unsupervised setups. |
MentalGLM Series: Explainable Large Language Models for Mental Health Analysis on Chinese Social Media (2025.emnlp-main)
Copied to clipboard
Wei Zhai, Nan Bai, Qing Zhao, Jianqiang Li, Fan Wang, Hongzhi Qi, Meng Jiang, Xiaoqin Wang, Bing Xiang Yang, Guanghui Fu
| Challenge: | Social media is a key platform for emotional expression, yet deep learning lacks flexibility and interpretability. |
| Approach: | They propose to use Chinese social media to train interpretable mental health instruction datasets to test models' ability to explain their decisions. |
| Outcome: | The proposed models outperform deep learning and LLMs on three mental health downstream tasks and demonstrate their potential for clinical applications. |
Incomplete Utterance Rewriting with Editing Operation Guidance and Utterance Augmentation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing generation methods on Incomplete Utterance Rewriting (IUR) can generate coherent utterances, but they often include irrelevant and redundant tokens in rewritten utteras . |
| Approach: | They propose a multi-task learning framework that uses editing operation labels to guide generation model to focus on critical tokens in dialogue context. |
| Outcome: | The proposed model outperforms state-of-the-art models on open-domain and task-oriented dialogues on three datasets. |
MMAC: A Multilingual, Multimodal Alignment Framework for Cultural Grounding Evaluation (2026.acl-long)
Copied to clipboard
Weihua Zheng, Zhengyuan Liu, Tanmoy Chakraborty, Weiwen Xu, Xiaoxue Gao, Bryan Chen Zhengyu Tan, Bowei Zou, Chang Liu, Yujia Hu, Xing Xie, Xiaoyuan Yi, Jing Yao, Chaojun Wang, Long Li, Rui Liu, Huiyao Liu, Koji Inoue, Ryuichi Sumida, Tatsuya Kawahara, Fan Xu, Lingyu Ye, Wei Tian, Dongjun Kim, Jimin Jung, Jaehyung Seo, Nadya Yuki Wangsajaya, Pham Minh Duc, Ojasva Saxena, Palash Nandi, Xiyan Tao, Wiwik Karlina, Tuan Luong, Keertana Arun Vasan, Roy Ka-Wei Lee, Nancy F. Chen
| Challenge: | Existing models lack cultural alignment across modalities and languages . a new framework to assess cultural awareness across linguistics and languages is needed . |
| Approach: | They propose a framework that integrates tri-modally aligned cultural benchmarks and a five-dimensional evaluation protocol to assess cross-country awareness disparities. |
| Outcome: | The proposed framework assesses cultural awareness disparities across modalities and languages . it is the first dataset aligned at the input level across text, image, and speech . |
From Implicit Graph Encoding to Explicit Evidence: A Training-Free LLM Framework for Temporal Knowledge Graph Reasoning (2026.findings-acl)
Copied to clipboard
Guo Tang, Ke Cheng, Huiming Fan, Heng Chang, Wenxiang Zheng, Xianhao Ou, Junjia Xiang, Ming Liu, Yujun Zhou, Li Lanyu, Bing Qin
| Challenge: | Existing Large Language Models (LLMs) struggle with implicit modality alignment and suboptimal graph linearization. |
| Approach: | They propose a training-free, test-time adaptive framework that reframes TKG prediction as explicit evidence-driven reasoning. |
| Outcome: | ExE-LLM outperforms fully trained graph neural networks on four benchmarks . it achieves SOTA performance in inductive settings, significantly outperforming fully trained neural networks . |
Improving Multi-party Dialogue Generation via Topic and Rhetorical Coherence (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on multi-party dialogue generation focus on the reply-to structure of dialogue histories, but they neglect the coherence between generated responses and target utterances. |
| Approach: | They propose a Reinforcement Learning approach emphasizing Topic and Rhetorical Coherence to enhance the model's perception of coherence with the target utterance. |
| Outcome: | The proposed approach significantly outperforms the state-of-the-art baselines on two popular datasets. |
Benchmarking Vision-Language Models on Chinese Ancient Documents: From OCR to Knowledge Reasoning (2026.findings-acl)
Copied to clipboard
Haiyang Yu, Yuchuan Wu, Fan Shi, Jinghui Lu, Ke Niu, Xiaodong Ge, Minghan Zhuo, Jingqun Tang, Bin Li
| Challenge: | Existing document benchmarks focus on English printed texts or simplified Chinese . current vision-language models struggle with visual complexity and poor adaptability . |
| Approach: | They propose a benchmark to evaluate Chinese ancient documents' visual/linguistic complexity . ancient documents are valuable cultural heritage, but they face challenges in digitization and understanding . |
| Outcome: | the first benchmark for Chinese ancient documents evaluates VLMs from OCR to knowledge reasoning . ancient documents carry thousands of years of Chinese history and culture . traditional methods only scan images, while current models struggle with visual complexity . |
Mind Reader: Latent User Demand-Guided Content Optimization for Generative Search Engine (2026.acl-long)
Copied to clipboard
Tong Chen, JiaWei Guo, Yuxi Li, Baiming Chen, Houxing Ren, Zhang Zhiwei, Yunxiang Zhang, Hanyang Xia, Kun Liang, Zhaoran Fan
| Challenge: | Generative Search Engines (GSEs) have reshaped information retrieval and Generating Engine Optimization (GEO) emerges to improve the content visibility in GSEs’ responses. |
| Approach: | They propose a method to optimize content to cover latent semantic information of GSEs by decomposing query into diverse perspectives and capturing underlying semantic information. |
| Outcome: | The proposed method outperforms baselines and effectively improves content visibility (with up to 2.44x objective metrics and 1.23x subjective metrics on average). |
SEAVER: Attention Reallocation for Mitigating Distractions in Language Models for Conditional Semantic Textual Similarity Measurement (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Conditional Semantic Textual Similarity (C-STS) introduces specific limiting conditions to the traditional Semantics task. |
| Approach: | They propose a conditional semantic textual similarity (C-STS) task that introduces specific limiting conditions to the traditional Semantic Textual Similarity task. |
| Outcome: | The proposed model outperforms existing models on the C-STS-2023 test set and consistently improves on million-scale fine-tuning baseline models (up to 3 points). |
SrDetection: A Self-Referential Framework for Data Leakage Detection in Code Large Language Models (2026.findings-acl)
Copied to clipboard
Shuaimin Li, Liyang Fan, Zeyang li, Zhuoyue Wan, Yufang Lin, Shiwen Ni, Feiteng Fang, Hamid Alinejad-Rokny, Yuanfeng Song, Kun Jing, Chen Jason Zhang, Min Yang
| Challenge: | Existing methods for evaluating code large language models assume access to proprietary training corpora or use external reference sets with manually tuned, non-generalizable thresholds. |
| Approach: | They propose a framework for self-referential leakage detection for gray-box and black-box settings. |
| Outcome: | The proposed framework improves average F1 by 21.52 points in the gray-box setting and 14.46 points in black-box settings over strong baselines. |
Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (2023.emnlp-main)
Copied to clipboard
| Challenge: | Extensive experiments show that MEO significantly improves computational efficiency . compared to dense networks, sparsely activated networks only employ a few parameters for each input . |
| Approach: | They propose a method that merges multiple experts into one to reduce computation costs . they demonstrate that a sparse Mixture of Experts (MoE) can reduce the cost by activating a small subset of parameters for each input . |
| Outcome: | The proposed approach reduces the computational cost to that of a single expert by 83.3% compared to 82.6% in vanilla MoE. |
RBPtool: A Deep Language Model Framework for Multi-Resolution RBP-RNA Binding Prediction and RNA Molecule Design (2025.emnlp-main)
Copied to clipboard
Jiyue Jiang, Yitao Xu, Zikang Wang, Yihan Ye, Yanruisheng Shao, Yuheng Shan, Jiuming Wang, Xiaodan Fan, Jiao Yuan, Yu Li
| Challenge: | RNA-binding proteins play key roles in post-transcriptional gene regulation . existing methods focus on shallow sequence features or coarse structural representations . large language models allow for precise modeling and biologically informed de novo RNA design . |
| Approach: | They extend RPI15223 into a multi-resolution, structure-level RBP-RNA dataset and introduce RBPtool, a framework that fuses sequence and structural information. |
| Outcome: | The proposed framework achieves state-of-the-art performance on public benchmarks and the RPI15223 dataset while supporting fine-grained level predictions. |
On-policy Reinforcement Fine-tuning with Offline reward for Multi-step Embodied Planning (2026.acl-long)
Copied to clipboard
| Challenge: | Embodied planning requires agents to make coherent multi-step decisions based on dynamic visual observations and verbal goals. |
| Approach: | They propose an On-policy Reinforcement fine-tuning framework with offline rewards for Embodied Task Planning that preserves generalization benefits of RFT while addressing costly interaction and sparse rewards. |
| Outcome: | The proposed framework outperforms closed-source and online-RL methods on EmbodiedBench, a recent benchmark for interactive embodied tasks. |
Enhancing Event Causality Identification with LLM Knowledge and Concept-Level Event Relations (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods to identify causal relationships between events often overlook the dependencies between similar events. |
| Approach: | They propose an ECI method enhanced by LLM Knowledge and Concept-Level Event Relations (LKCER) the method constructs a conceptual-level heterogeneous event graph by leveraging local contextual information of related event mentions. |
| Outcome: | The proposed method outperforms previous state-of-the-art methods on both benchmarks, EventStoryLine and Causal-TimeBank. |
Conversational Recommender System and Large Language Model Are Made for Each Other in E-commerce Pre-sales Dialogue (2023.findings-emnlp)
Copied to clipboard
Yuanxing Liu, Weinan Zhang, Yifan Chen, Yuchi Zhang, Haopeng Bai, Fan Feng, Hengbin Cui, Yongbin Li, Wanxiang Che
| Challenge: | E-commerce pre-sales dialogues elicit user needs and preferences for items . large language models lack domain-specific knowledge for accurate recommendations . |
| Approach: | They propose two collaboration strategies to integrate CRS and large language models in pre-sales dialogues. |
| Outcome: | The proposed methods can be very effective in some cases, the authors say . |
EMCompress: Video-LLMs with Endomorphic Multimodal Compression (2026.findings-acl)
Copied to clipboard
| Challenge: | Static, sparse frame sampling either dilutes evidence across task-irrelevant segments at significant cost or misses fine-grained temporal semantics altogether. |
| Approach: | They propose a novel task that compresses multimodal input while preserving answer invariance across reasonable downstream models. |
| Outcome: | The proposed task surpasses prior methods by 0.40 F-1 with competitive query rewriting. |
Compressing then Matching: An Efficient Pre-training Paradigm for Multimodal Embedding (2026.acl-long)
Copied to clipboard
Da Li, Yuxiao Luo, Keping Bi, Jiafeng Guo, Wei Yuan, Biao Yang, Yan Wang, Fan Yang, Tingting Gao, Guorui Zhou
| Challenge: | Recent approaches demonstrate that MLLMs can be adapted into competitive embedding models via large-scale contrastive learning. |
| Approach: | They propose a compressed pre-training phase which serves as a warm-up stage for contrastive learning. |
| Outcome: | The proposed model achieves state-of-the-art among MLLMs of comparable size on the MMEB, realizing optimization in both efficiency and effectiveness. |
Leibniz: Theory-of-Mind Driven Neuro-Symbolic Logical Reasoning via Multi-Agent Collaboration (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for logical reasoning with large language models suffer from insufficient rule semantic grounding and weak rule application mechanisms. |
| Approach: | They propose a theory-of-mind driven neuro-symbolic reasoning framework that integrates natural language and symbolic representations throughout the reasoning process. |
| Outcome: | The proposed model surpasses state-of-the-art models in reasoning accuracy and flexibility. |
ReRec: Reasoning-Augmented LLM-based Recommendation Assistant via Reinforcement Fine-tuning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing reasoning-augmented systems that handle complex queries are lacking . we present a framework that enhances LLM-based recommendation assistants . |
| Approach: | They propose a reinforcement fine-tuning framework that enhances LLM-based recommendation . they use a dual-graph Enhanced Reward Shaping framework to integrate recommendation metrics . |
| Outcome: | The proposed framework outperforms state-of-the-art recommendations and preserves core abilities. |
ADDMU: Detection of Far-Boundary Adversarial Examples with Data and Model Uncertainty Estimation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods show poor performance under Far Boundary (FB) adversarial examples. |
| Approach: | They propose to use a new technique to detect adversarial examples based on data and model uncertainty to outperform existing methods. |
| Outcome: | The proposed method outperforms existing methods by 3.6 and 6.0 AUC points under each scenario. |
Unknown Intent Detection Using Gaussian Mixture Model with an Application to Zero-shot Intent Classification (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for unknown intent detection are limited by prior knowledge of class labels. |
| Approach: | They propose to use a Gaussian mixture model to model utterance embeddings with a distribution and inject dynamic class semantic information into Gausssian means. |
| Outcome: | The proposed model performs well on three real task-oriented dialogue datasets in two languages. |
MARIO: MAth Reasoning with code Interpreter Output - A Reproducible Pipeline (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models lack mathematical reasoning, a hurdle on the path to true artificial general intelligence. |
| Approach: | They propose a protocol for fine-tuning large language models with a Python code interpreter to enhance the text analysis of the LLMs. |
| Outcome: | The proposed protocol improves the performance of a 7B-parameter LLM on the GSM8K and MATH datasets while allowing for an outlier-free value model-based inference method. |
Multilingual Translation from Denoising Pre-Training (2021.findings-acl)
Copied to clipboard
Yuqing Tang, Chau Tran, Xian Li, Peng-Jen Chen, Naman Goyal, Vishrav Chaudhary, Jiatao Gu, Angela Fan
| Challenge: | Recent work shows potential of training one model for multilingual machine translation . but little has been explored on the potential to combine denoising pretraining with multilingual translation in a single model. |
| Approach: | They propose to combine denoising pretraining with multilingual machine translation in a single model. |
| Outcome: | The proposed model improves over models trained from scratch and bilingually for translation into English. |
See2Refine: Vision-Language Feedback Improves LLM-Based eHMI Action Designers (2026.acl-long)
Copied to clipboard
| Challenge: | External Human-Machine Interfaces (eHMIs) are emerging as promising solutions to address this communication gap. |
| Approach: | They propose a framework that uses vision-language models (VLMs) for perceptual evaluation as automated visual feedback to improve an LLM-based eHMI action designer. |
| Outcome: | The proposed framework outperforms prompt-only LLM designers and manually specified baselines in three eHMI modalities and multiple LLM model sizes. |
PEToolLLM: Towards Personalized Tool Learning in Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing tool learning studies focus on general-purpose tool-use capability, but ignore the importance of personalized tool-user preferences. |
| Approach: | They propose a framework to adapt Large Language Models to personalized tool learning task, which is trained through supervised fine-tuning and direct preference optimization. |
| Outcome: | Extensive experiments on PEToolBench show that the proposed framework outperforms existing LLMs in the personalized tool learning task. |
Suggest-Verify-Revise: A Three-Stage Document-Level Event Causality Identification with Narrative Consistency (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for document-level Event Causality Identification rely on local semantic similarity for independent event-pair discrimination . Existing approaches ignore the influence of the overall narrative backbone in the propagation of causal dependencies and the role differentiation of events within multi-cause/multi-effect structures. |
| Approach: | They propose a suggest-verify-revise approach for document-level Event Causality Identification with narrative consistency (SVRECI) they integrate heuristic causal suggestions generated by an LLM with structural suggestions derived from hypergraph modeling . |
| Outcome: | The proposed approach outperforms existing methods on event-storylines and Causal-TimeBank datasets. |
Translate the Beauty in Songs: Jointly Learning to Align Melody and Translate Lyrics (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Song translation requires both translation of lyrics and alignment of music notes . human translators of songs need to have a mastery of cultural traditions and the poetic usage of both source and target languages . |
| Approach: | They propose a model that can model lyric translation and lyrics-melody alignment . they use an encoder-decoder framework that can translate lyrics and determine number of aligned notes . |
| Outcome: | The proposed framework can translate lyrics and determine the number of aligned notes at each decoding step. |
Learning to Ask Denotative and Connotative Questions for Knowledge-based VQA (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models have attracted increasing attention due to their prominent performance on various tasks. |
| Approach: | They propose to let LLMs learn to ask informative questions to collect visual information . they introduce concepts of denotation and connotation to promote image and question understanding . |
| Outcome: | The proposed model can generate high-quality questions and efficiently collect required information without expensive training or annotations. |
Towards IP Intelligence: Benchmarking Large Language Models on Intellectual Property Knowledge and Practice (2026.findings-acl)
Copied to clipboard
Qiyao Wang, Guhong Chen, Hongbo Wang, Huaren Liu, Minghui Zhu, Zhifei Qin, Li Linwei, Yilin Yue, Shiqiang Wang, Jiayan Li, Wu Yihang, Ziqiang Liu, Longze Chen, Run Luo, Liyang Fan, Jiaming Li, Lei Zhang, Kan Xu, Hamid Alinejad-Rokny, Chengming Li, Shiwen Ni, Yuan Lin, Min Yang
| Challenge: | Existing datasets and benchmarks focus only on patents or cover limited aspects of the IP field, lacking alignment with real-world scenarios. |
| Approach: | They propose a bilingual IP task taxonomy and a large-scale bilingual benchmark to evaluate LLMs in real-world IP practice. |
| Outcome: | The proposed model achieves only 75.8% accuracy, indicating room for improvement . open-source IP and law-oriented models lag behind closed-source general-purpose models . |
BattleAgent: Multi-modal Dynamic Emulation on Historical Battles to Complement Historical Analysis (2024.emnlp-demo)
Copied to clipboard
Shuhang Lin, Wenyue Hua, Lingyao Li, Che-Jui Chang, Lizhou Fan, Jianchao Ji, Hang Hua, Mingyu Jin, Jiebo Luo, Yongfeng Zhang
| Challenge: | Recent advances in large language models have demonstrated impressive reasoning capabilities, indicating their potential to serve as the foundation for agents. |
| Approach: | They propose a detailed emulation system that combines large vision-language model and multi-agent system to emulate dynamic interactions between multiple agents over a period of time. |
| Outcome: | The proposed system combines large vision-language model and multi-agent system to emulate dynamic interactions between agents and their environments over a period of time. |
Contextual Rephrase Detection for Reducing Friction in Dialogue Systems (2021.emnlp-main)
Copied to clipboard
| Challenge: | Large-scale conversational AI based dialogue systems like Alexa, Siri, and Google Assistant, are getting more and more prevalent in real-world applications to help users across the globe. |
| Approach: | They propose a contextual rephrase detection model ContReph to automatically identify rephrasings from multi-turn dialogues using contextual information and user-agent interaction signals. |
| Outcome: | The proposed model outperforms the pairwise rephrase detection models by leveraging the context and user-agent interaction signals. |
NegotiationToM: A Benchmark for Stress-testing Machine Theory of Mind on Negotiation Surrounding (2024.findings-emnlp)
Copied to clipboard
Chunkit Chan, Cheng Jiayang, Yauwai Yim, Zheye Deng, Wei Fan, Haoran Li, Xin Liu, Hongming Zhang, Weiqi Wang, Yangqiu Song
| Challenge: | Theory of mind evaluations currently focus on testing models using machine-generated data or game settings prone to shortcuts and spurious correlations. |
| Approach: | They propose a benchmark to stress-test machine ToM in real-world negotiation surrounding covered multi-dimensional mental states. |
| Outcome: | The proposed benchmark builds upon the Belief-Desire-Intention theory and conducts the necessary empirical experiments to evaluate large language models. |
Enhancing Goal-oriented Proactive Dialogue Systems via Dynamic Multi-dimensional Consistency Optimization (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work on goal-oriented proactive dialogue systems failed to address the multi-dimensional consistency issue between generated responses and key contextual elements. |
| Approach: | They propose a Dynamic Multi-dimensional Consistency Reinforcement Learning framework which measures the impact of each consistency dimension on overall dialogue quality and provides feedback to improve response quality. |
| Outcome: | The proposed framework significantly improves the consistency of generated responses on two datasets. |
CMQCIC-Bench: A Chinese Benchmark for Evaluating Large Language Models in Medical Quality Control Indicator Calculation (2025.findings-acl)
Copied to clipboard
Guangya Yu, Yanhao Li, Zongying Jiang, Yuxiong Jin, Li Dai, Yupian Lin, Ruihui Hou, Weiyan Zhang, Yongqi Fan, Qi Ye, Jingping Liu, Tong Ruan
| Challenge: | Medical quality control indicators are essential to assess the qualifications of healthcare institutions for medical services. |
| Approach: | They propose a Chinese electronic medical records-based dataset for MQCIC and propose CF-IR method that disentangles clinical fact verification and inferential rule reasoning actions. |
| Outcome: | The proposed method outperforms Chain-of-Thought methods on 20 representative LLMs, covering general and medical models. |
SLAM: Towards Efficient Multilingual Reasoning via Selective Language Alignment (2025.coling-main)
Copied to clipboard
Yuchun Fan, Yongyu Mu, YiLin Wang, Lei Huang, Junhao Ruan, Bei Li, Tong Xiao, Shujian Huang, Xiaocheng Feng, Jingbo Zhu
| Challenge: | Large language models (LLMs) have demonstrated significant improvements in reasoning abilities, but these improvements are primarily focused on English, leading to inferior performance in non-English scenarios. |
| Approach: | They propose a multilingual reasoning alignment approach that fine-tunes the layers responsible for multilingual comprehension in one stage. |
| Outcome: | The proposed method fine-tunes 6 of the 9 layers responsible for multilingual comprehension, while reducing training time by 4.1-11.9 compared to the two-stage method. |
Reformatted Alignment (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Current methods to improve data quality are labor-intensive or prone to factual errors caused by LLM hallucinations. |
| Approach: | They propose a method which reformats the responses of instruction data into a format that better aligns with pre-established criteria and the collated evidence. |
| Outcome: | The proposed approach minimizes human annotation, hallucination, and the difficulty in scaling, remaining orthogonal to existing alignment techniques. |
kFolden: k-Fold Ensemble for Out-Of-Distribution Detection (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies studying OOD detection in NLP often rely on external data to diversify model predictions. |
| Approach: | They propose a framework which mimics OOD detection behavior without external data . they take text classification as an archetype and compare them to existing datasets . |
| Outcome: | The proposed framework can resolve in- and out-distribution examples in a natural way using existing datasets. |
Idea23D: Collaborative LMM Agents Enable 3D Model Generation from Interleaved Multimodal Inputs (2025.coling-main)
Copied to clipboard
| Challenge: | Existing 3D AIGC methods don’t fully unleash human creativity. |
| Approach: | They propose a framework that generates 3D content from multimodal inputs . they propose 198 multimodal text inputs for 3D generation tasks . |
| Outcome: | The proposed framework generates 3D content from multimodal inputs without human intervention. |
CAMIEval: Enhancing NLG Evaluation through Multidimensional Comparative Instruction-Following Analysis (2025.naacl-long)
Copied to clipboard
| Challenge: | Evaluating the quality of texts generated by language models has always been a challenging task in natural language processing (NLP). |
| Approach: | They propose a multidimensional comparative evaluation method based on instruction-following that combines relevance, factuality, and adherence with a concrete Chain-of-Thoughts process to enhance the accuracy of evaluations. |
| Outcome: | The proposed method outperforms existing methods in correlation with human evaluations on two NLG evaluation benchmarks. |
Pruning via Merging: Compressing LLMs via Manifold Alignment Based Layer Merging (2024.emnlp-main)
Copied to clipboard
Deyuan Liu, Zhanyue Qin, Hairu Wang, Zhao Yang, Zecheng Wang, Fangying Rong, Qingbin Liu, Yanchao Hao, Bo Li, Xi Chen, Cunhang Fan, Zhao Lv, Dianhui Chu, Zhiying Tu, Dianbo Sui
| Challenge: | Existing methods for parameter pruning fail to utilize the knowledge from pruned parameters. |
| Approach: | They propose a method that uses manifold learning and the Information Bottleneck measure to merge similar layers to preserve model performance. |
| Outcome: | The proposed method outperforms pruning methods on multiple datasets and LLMs with quantization and achieves substantial compression ratios. |
NeuSym-RAG: Hybrid Neural Symbolic Retrieval with Multiview Structuring for PDF Question Answering (2025.acl-long)
Copied to clipboard
Ruisheng Cao, Hanchong Zhang, Tiancheng Huang, Zhangyi Kang, Yuxin Zhang, Liangtai Sun, Hanqi Li, Yuxun Miao, Shuai Fan, Lu Chen, Kai Yu
| Challenge: | Existing approaches to retrieval augmented generation neglect PDF structure and layout . individual PDFs often exceed prompt limits and user queries may span multiple documents. |
| Approach: | They propose a hybrid neural symbolic retrieval framework which combines both paradigms in an interactive process. |
| Outcome: | The proposed framework organizes semi-structured PDF content into relational database and vectorstore . it defeats both RAG and structured baselines on three PDF-based QA datasets . |
Think Faster Than Words: Efficient LLM Chain-of-Thought Reasoning via Dynamic Shortcut Decoding (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods that prune or employ early stopping to reduce latency often compromise reasoning reliability. |
| Approach: | They propose a shortcut decoding framework that integrates probes over internal hidden states with step-level entropy to detect convergence of reasoning during generation and adaptively selects between a fast-exit path and a stability-verified path to remove redundant steps while preserving answer correctness. |
| Outcome: | The proposed framework reduces token usage by approximately 35% and maintains accuracy comparable to full CoT decoding. |
Datamart-Agent: LLM-Driven Game-Theoretic Agent for Data Marketplace Modeling (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on data marketplaces model static equilibria and complete information, which limits their realism. |
| Approach: | They propose an LLM-driven game-theoretic agent that makes equilibrium-consistent decisions in analytically tractable data marketplaces with evolving and incomplete-information. |
| Outcome: | The proposed framework matches equilibrium-consistent decision execution in a static data marketplace with a dynamic game tree memory and mechanism-guided reflection without updating parameters. |
Does Chain-of-Thought Reasoning Really Reduce Harmfulness from Jailbreaking? (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing jailbreak attacks fail against reasoning models enhanced by Chain-of-Thought (CoT) reasoning. |
| Approach: | They propose a jailbreak method that uses Chain-of-Thought reasoning to reduce harmfulness from jailbreaking. |
| Outcome: | The proposed jailbreak method performs well against open AI models and deepseek-R1 reasoning models. |
To What Extent Do Natural Language Understanding Datasets Correlate to Logical Reasoning? A Method for Diagnosing Logical Reasoning. (2022.coling-1)
Copied to clipboard
| Challenge: | Reasoning and knowledge-related skills are considered as fundamental skills for natural language understanding (NLU) tasks. |
| Approach: | They propose a method to diagnose correlations between an NLU dataset and a specific skill. |
| Outcome: | The proposed method is able to diagnose correlations between dataset and logical reasoning skill on 8 MRC and 3 NLI datasets. |
GigaSpeech 2: An Evolving, Large-Scale and Multi-domain ASR Corpus for Low-Resource Languages with Automated Crawling, Transcription and Refinement (2025.acl-long)
Copied to clipboard
Yifan Yang, Zheshu Song, Jianheng Zhuo, Mingyu Cui, Jinpeng Li, Bo Yang, Yexing Du, Ziyang Ma, Xunying Liu, Ziyuan Wang, Ke Li, Shuai Fan, Kai Yu, Wei-Qiang Zhang, Guoguo Chen, Xie Chen
| Challenge: | GigaSpeech 2 is a large-scale, multi-domain, multilingual speech recognition corpus for low-resource languages. |
| Approach: | They propose a large-scale, multi-domain, multilingual speech recognition corpus for low-resource languages and an automated pipeline for data crawling, transcription, and label refinement. |
| Outcome: | The proposed corpus reduces the word error rate for Thai, Indonesian, and Vietnamese on a realistic YouTube test set by 25% to 40% compared to Whisper large-v3. |
InferenceDynamics: Adaptive LLM Routing through Structured Capability and Knowledge Profiling (2026.acl-long)
Copied to clipboard
Haochen Shi, Tianshi Zheng, Weiqi Wang, Baixuan Xu, Chunyang Li, Chunkit Chan, Tao Fan, Yangqiu Song
| Challenge: | Large Language Model (LLM) routing is a pivotal technique for navigating a diverse landscape of LLMs. |
| Approach: | They propose a flexible and scalable multi-dimensional routing framework that models the capability and knowledge of models. |
| Outcome: | The proposed framework can be used to generalize and identify top-performing models for group-level routing using modern benchmarks including MMLU-Pro, GPQA, BigGenBench, and LiveBench. |
ClueAnchor: Clue-Anchored Knowledge Reasoning Exploration and Optimization for Retrieval-Augmented Generation (2025.findings-emnlp)
Copied to clipboard
Hao Chen, Yukun Yan, Sen Mei, Wanxiang Che, Zhenghao Liu, Qi Shi, Xinze Li, Yuchun Fan, Pengcheng Huang, Qiushi Xiong, Zhiyuan Liu, Maosong Sun
| Challenge: | Existing RAG systems often underutilize the retrieved documents, authors say . they fail to extract and integrate key clues needed to support faithful and interpretable reasoning . |
| Approach: | a new framework extracts key clues from retrieved content and generates multiple reasoning paths . the framework optimizes the model by selecting the most appropriate reasoning path . |
| Outcome: | Experiments show that ClueAnchor outperforms baseline RAG frameworks in completeness and robustness. |
Chain-of-Thought Tuning: Masked Language Models can also Think Step By Step in Natural Language Understanding (2023.emnlp-main)
Copied to clipboard
| Challenge: | Chain-of-Thought (CoT) is a technique that guides large language models to decompose complex tasks into multi-step reasoning processes. |
| Approach: | They propose a two-step reasoning framework based on prompt tuning to implement step-by-step thinking for MLMs on NLU tasks. |
| Outcome: | The proposed framework outperforms baselines and achieves state-of-the-art performance on two NLU tasks. |
Simulating Dual-Process Thinking in Dialogue Topic Shift Detection (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for topic shift detection focus on shallow local reasoning, overlooking the importance of considering the global historical structure and local details to elucidate the underlying causes of topic shift. |
| Approach: | They propose a dual-process theory for dialogue topic shift detection that employs Large Language Models to extract and store the global topic structure of historical dialogue, while a reasoning module introduces a LLM to generate reasoning samples between the response and the most recent topic of historical dialog. |
| Outcome: | The proposed framework outperforms the state-of-the-art on three public datasets and is based on a dual-process theory. |
Interview Evaluation: A Novel Approach for Automatic Evaluation of Conversational Question Answering Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing evaluation methods for CQA use pre-collected human-human conversations . previous methods use model-predicted dialogue history instead of ground truth . |
| Approach: | They propose an automatic evaluation approach that uses the model's dialogue history to evaluate models. |
| Outcome: | The proposed method improves on existing models and their evaluations on QuAC and CoQA. |
Uni-Retrieval: A Multi-Style Retrieval Framework for STEM’s Education (2025.acl-long)
Copied to clipboard
| Challenge: | Current retrieval models focus on natural text-image retrieval, which is insufficient for STEM education contexts due to ambiguities in the retrieval process. |
| Approach: | They propose a diverse expression retrieval task tailored to educational scenarios . they extract query style features as prototypes and build a continuously updated Prompt Bank . |
| Outcome: | The proposed model outperforms existing retrieval models in most retrieval tasks. |
DeepPlanner: Scaling Planning Capability for Deep Research Agents via Advantage Shaping (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to planning involve implicit planning or introduce explicit planners without systematically optimizing the planning stage. |
| Approach: | They propose an end-to-end RL framework that enhances the planning capabilities of deep research agents. |
| Outcome: | Experiments show that DeepPlanner improves planning quality and achieves state-of-the-art results under a lower training budget. |
FairSteer: Inference Time Debiasing for LLMs with Dynamic Activation Steering (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing prompt-based debiasing methods exhibit instability due to sensitivity to prompt changes . fine-tuning-based techniques incur substantial computational overhead and catastrophic forgetting . |
| Approach: | They propose a debiasing framework that encodes fairness-related features into separable directions in the hidden activation space. |
| Outcome: | The proposed framework performs inference-time debiasing without requiring retraining or prompt design . it detects bias signatures in activations and then computes debiased steering vectors . the proposed framework is available to download in the u.s. |
Overcoming Catastrophic Forgetting During Domain Adaptation of Seq2seq Language Generation (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing work on lifelong learning requires incremental memory space to learn a model . existing work on experience replay or elastic weighted consolidation requires incremental space . |
| Approach: | They propose a framework that leverages a recall optimization mechanism to memorize parameters of previous tasks via regularization and a domain drift estimation algorithm to compensate the drift between different domains in the embedding space. |
| Outcome: | The proposed framework outperforms SOTA models on paraphrase and dialog response generation tasks. |
Logic-guided Semantic Representation Learning for Zero-Shot Relation Classification (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods to zero-shot relation classification can only identify seen relations . existing methods rely on descriptive information to improve understandability of relation types . |
| Approach: | They propose a logic-guided semantic representation learning model for zero-shot relation classification that builds connections between seen and unseen relations via implicit and explicit semantic representations with knowledge graph embeddings and logic rules. |
| Outcome: | The proposed model can generalize to unseen relation types and achieve promising improvements. |
Structural Supervision for Word Alignment and Machine Translation (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing knowledge on syntactic structure neglects the rich structural information from target tokens and the structural similarity between the source and target sentences. |
| Approach: | They propose to incorporate syntactic structure of both source and target tokens into the encoder-decoder framework, tightly correlating the internal logic of word alignment and machine translation for multi-task learning. |
| Outcome: | The proposed method outperforms baselines on four publicly available language pairs and consistently outperformed baselines in alignment accuracy and translation quality. |
AgentGL: Towards Agentic Graph Learning with LLMs via Reinforcement Learning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing agentic frameworks treat external information as unstructured text and fail to leverage topological dependencies inherent in real-world data. |
| Approach: | They propose to reframe graph learning as an interleaved process of topology-aware navigation and LLM-based inference. |
| Outcome: | The proposed framework outperforms strong GraphLLMs and GraphRAG benchmarks in multiple LLM backbones. |
An LLM-based Framework for Biomedical Terminology Normalization in Social Media via Multi-Agent Collaboration (2025.coling-main)
Copied to clipboard
| Challenge: | Experimental results indicate that our approach exhibits competitive performance. |
| Approach: | They propose a tuning-free approach to normalize non-standard terms using large language models . they use a search engine and a domain knowledge base to expand the short texts into accurate descriptions . |
| Outcome: | The proposed approach is based on the "Recall and Re-rank" framework . it can be used to identify the standard term in a specified termbase for non-standardized mentions . |
AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corpora (2026.acl-long)
Copied to clipboard
Jiaxin Bai, Wei Fan, Qi Hu, Qing Zong, Chunyang Li, Hong Ting Tsang, Hongyu Luo, Yauwai Yim, Haoyu Huang, Xiao Zhou, Feng Qin, Tianshi Zheng, Xi Peng, Xin Yao, Huiwen Yang, Leijie Wu, JI Yi, Gong Zhang, Renhai Chen, Yangqiu Song
| Challenge: | Existing knowledge graph construction frameworks require predefined schemas, limiting their scalability and domain coverage. |
| Approach: | They propose a framework for fully autonomous knowledge graph construction that eliminates the need for predefined schemas. |
| Outcome: | The proposed framework outperforms state-of-the-art models on multi-hop QA tasks and enhances LLM factuality. |
SummaCoz: A Dataset for Improving the Interpretability of Factual Consistency Detection for Summarization (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Summarization is an important application of Large Language Models. |
| Approach: | They integrate human-annotated and model-generated natural language explanations to elucidate how a summary deviates and becomes inconsistent with its source article. |
| Outcome: | The proposed model provides rationales for its judgments and improves its accuracy significantly. |
Learning to Adapt to Low-Resource Paraphrase Generation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Conventional approaches to paraphrase generation often rely on a large number of parallel paraphrases, which require a lot of domain knowledge. |
| Approach: | They propose an adapter for paraphrase generation models optimized by meta-learning to overcome domain shifting problem when training on scarce labeled data. |
| Outcome: | The proposed model achieves state-of-the-art on three benchmark datasets. |
Advancing the Robustness of Large Language Models through Self-Denoised Smoothing (2024.naacl-short)
Copied to clipboard
Jiabao Ji, Bairu Hou, Zhen Zhang, Guanhua Zhang, Wenqi Fan, Qing Li, Yang Zhang, Gaowen Liu, Sijia Liu, Shiyu Chang
| Challenge: | Existing adversarial attacks can cause LLMs to make wrong predictions on downstream tasks or generate harmful content misaligned with human values. |
| Approach: | They propose to use randomized smoothing to add noise to the input and then make predictions based on these denoised versions. |
| Outcome: | The proposed method surpasses existing methods in both empirical and certified robustness in defending against adversarial perturbations for both downstream tasks and human alignments (i.e., jailbreak attacks). |
Scaling Laws for Code: A More Data-Hungry Regime (2026.acl-long)
Copied to clipboard
Xianzhen Luo, Wenzhen Zheng, Qingfu Zhu, Rongyi Zhang, Houyi Li, Siming Huang, YuanTao Fan, Wanxiang Che
| Challenge: | Code Large Language Models (LLMs) are revolutionizing software engineering, but scaling laws are primarily analyzed on Natural Language (NL). |
| Approach: | They fit Chinchilla law and Farsser law to test scaling laws for code . they find code is more data-hungry and requires higher data-to-parameter ratio . |
| Outcome: | The proposed scaling laws show that the more expressive Farsser law offers greater accuracy and scales with model size. |
Leveraging AMR Graph Structure for Better Sequence-to-Sequence AMR Parsing (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent studies on AMR parsing often regard this task as a seq2seq translation problem. |
| Approach: | They propose to translate AMR graphs into AMR token sequences in pre-processing and recover AMR from sequences after decoding. |
| Outcome: | The proposed approach outperforms baseline and achieves 85.5 0.1 and 84.2 0.2 Smatch scores on AMR 2.0 and AMR 3.0. |
Multi-Scale Spectral Selection and Entropy-Guided Uncertainty Fusion for Multimodal Rumor Detection (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for multimodal content detection fail to capture cross-modal semantic inconsistencies and ignore inherent noise in multimodal features. |
| Approach: | They propose a multimodal rumor detection method based on a frequency domain spectral selection method and entropy-guided uncertainty fusion method to capture cross-modal semantic inconsistencies. |
| Outcome: | The proposed method outperforms state-of-the-art methods in multimodal rumor detection . it shows stronger detection capability and robustness on multiple datasets . |
Knowledge as A Bridge: Improving Cross-domain Answer Selection with External Knowledge (C18-1)
Copied to clipboard
| Challenge: | Existing approaches to answer selection are limited in domains with limited labeled data. |
| Approach: | They propose a Knowledge-aware Attentive Network framework for cross-domain answer selection that uses the knowledge base as a bridge to enable knowledge transfer from the source domain to the target domain. |
| Outcome: | The proposed model outperforms strong competitors by a noticeable margin in cross-domain answer selection. |
Language-Specific Layer Matters: Efficient Multilingual Enhancement for Large Vision-Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large vision-language models exhibit an imbalance in multilingual capabilities . |
| Approach: | They propose a training recipe that achieves efficient multilingual enhancement for LVLMs by Precise Language Specific layers fine-tuning. |
| Outcome: | The proposed training recipe achieves efficient multilingual enhancement for LVLMs by fine-tuning language specific layers. |
Improving Factual Consistency of News Summarization by Contrastive Preference Optimization (2024.findings-emnlp)
Copied to clipboard
Huawen Feng, Yan Fan, Xiong Liu, Ting-En Lin, Zekun Yao, Yuchuan Wu, Fei Huang, Yongbin Li, Qianli Ma
| Challenge: | Recent advances in news summarization have created problems with “hallucinations” that are factually inconsistent with the source text. |
| Approach: | They propose to disentangle LLMs’ propensities to generate faithful and fake content by adopting a probing-based specific training method to improve their capacity of distinguishing two types of propensity. |
| Outcome: | The proposed method disentangles LLMs’ propensities to generate faithful and fake content and improves their ability to distinguish between two types of propensity. |
FiNE: Filtering and Improving Noisy Data Elaborately with Large Language Models (2025.naacl-long)
Copied to clipboard
| Challenge: | Currently, there are two mainstream methods for improving data integrity: data filtering and data augmentation. |
| Approach: | They propose a method to improve data integrity by combining data filtering and data augmentation with LLMs. |
| Outcome: | The proposed method surpasses the open-source chat version on HalluQA by 8.45 on the open source version. |
On the Step Length Confounding in LLM Reasoning Data Selection (2026.findings-acl)
Copied to clipboard
Bing Wang, Rui Miao, Chen Shen, Shaotian Yan, Kaiyuan Liu, Ximing Li, Xiaosong Yuan, Sinan Fan, Jun Zhang, Jieping Ye
| Challenge: | Existing pipelines generate long reasoning data from more capable Large Language Models (LLMs) and apply manually heuristic or naturalness-based selection methods to filter high-quality samples. |
| Approach: | They propose to use supervised fine-tuning to generate long reasoning data from more capable Large Language Models and apply manually heuristic or naturalness-based selection methods to filter high-quality samples. |
| Outcome: | Experiments on four LLMs and five evaluation benchmarks show that the proposed approach is effective in mitigating step length confounding problem. |
Saber: Efficient Sampling with Adaptive Acceleration and Backtracking Enhanced Remasking for Diffusion Language Model in Code Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Diffusion language models (DLMs) offer advantages in parallel generation and bidirectional context modeling, but they face a critical trade-off between inference speed and output quality for tasks with strict structural constraints such as code generation. |
| Approach: | They propose an efficient sampling algorithm that reduces the number of tokens unmasked per step based on the model’s evolving confidence. |
| Outcome: | The proposed method improves Pass@1 accuracy by 1.9% while achieving 251.4% inference speedup. |
How do Language Models Reshape Entity Alignment? A Survey of LM-Driven EA Methods: Advances, Benchmarks, and Future (2025.emnlp-main)
Copied to clipboard
| Challenge: | Entity alignment (EA) is critical for knowledge graph (KG) integration. |
| Approach: | They propose a taxonomy that categorizes methods in three stages: data preparation, feature embedding, and alignment. |
| Outcome: | The proposed taxonomy categorizes methods in three key stages: data preparation, feature embedding, and alignment. |
TranSHER: Translating Knowledge Graph Embedding with Hyper-Ellipsoidal Restriction (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing knowledge graph embedding methods restrict entities on hyper-ellipsoid surfaces, resulting in suboptimal knowledge graph completion. |
| Approach: | They propose a score function that leverages relation-specific translations between head and tail entities to relax constraints on hyper-ellipsoid surfaces. |
| Outcome: | The proposed method achieves state-of-the-art performance on link prediction and generalizes well to datasets in different domains and scales. |
LoPT: Lossless Parallel Tokenization Acceleration for Long Context Inference of Large Language Model (2026.acl-long)
Copied to clipboard
| Challenge: | Existing parallel tokenization methods suffer from inconsistent results due to boundary artifacts that occur after merging. |
| Approach: | They propose a Lossless Parallel Tokenization framework that ensures output identical to standard sequential tokenization. |
| Outcome: | The proposed method achieves significant speedup while guaranteeing lossless tokenization. |
Self-Reinforcing Controllable Synthesis of Rare Relational Data via Bayesian Calibration (2026.findings-acl)
Copied to clipboard
Chongsheng Zhang, Hao Wang, Zelong Yu, Esteban Garces Arias, Julian Rodemann, Zhanshuo Zhang, Qilong Li, Gaojuan Fan, Krikamol Muandet, Christian Heumann
| Challenge: | Existing approaches to synthesis of relational/structured tabular data lack effective feedback mechanism to optimize quality of generated data. |
| Approach: | They propose a relational data generator with dynamic guidance framework that uses chain-of-thought steps to generate tabular data for enhancing downstream imbalanced classification performance. |
| Outcome: | The proposed framework outperforms existing approaches in both data fidelity and downstream imbalanced classification performance on real and synthetic datasets. |
ReAgent: Reversible Multi-Agent Reasoning for Knowledge-Enhanced Multi-Hop QA (2025.emnlp-main)
Copied to clipboard
Zhao Xinjie, Fan Gao, Xingyu Song, Yingjian Chen, Rui Yang, Yanran Fu, Yuyang Wang, Yusuke Iwasawa, Yutaka Matsuo, Irene Li
| Challenge: | Multi-hop question answering (QA) is a central challenge in natural language processing . early mistakes can cause errors and undermine the final result, authors say . |
| Approach: | They propose a reversible multi-agent reasoning framework that backtracks to earlier valid states when conflicts arise. |
| Outcome: | Empirical evaluation shows that the framework improves on forward-only benchmarks by 6% . the approach enables agents to backtrack to valid states when conflicts arise . |
Tackling Long Code Search with Splitting, Encoding, and Aggregating (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing pretraining models take the first 256 tokens of code snippets by default, limiting the input length to 512. |
| Approach: | They propose a baseline SEA model which splits long code into code blocks and aggregates them to obtain a comprehensive long code representation. |
| Outcome: | The proposed model can model long code without changing their internal structure and re-pretraining. |
One Agent to Serve All: a Lite-Adaptive Stylized AI Assistant for Millions of Multi-Style Official Accounts (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for prompting in official accounts are computationally prohibitive and lack contextually grounded responses. |
| Approach: | They propose a lite-adaptive framework for stylized contextual question answering that scales to millions of official accounts. |
| Outcome: | The proposed framework can serve large volumes of official accounts with minimal overhead while maintaining stylistic diversity. |
AutoSUIT Bench - Automated Security UnIt Test Benchmark for LLM Coding (2026.findings-acl)
Copied to clipboard
Samuel Osebe, Fan Yang, Junyi Li, Yue Gu, Yongxin Wang, Satyapriya Krishna, Kai-Wei Chang, Aram Galstyan, Rahul Gupta, Weitong Ruan
| Challenge: | Large Language Models (LLMs) are evolving rapidly on code generation tasks. |
| Approach: | They propose to automate the vulnerability code benchmark creation with iterative auto validation. |
| Outcome: | The proposed benchmark covers 232 CWE categories across C/C++, Java, and Python languages. |
HAD: HAllucination Detection Language Models Based on a Comprehensive Hallucination Taxonomy (2026.acl-industry)
Copied to clipboard
| Challenge: | relying on large language models for information has raised concerns about reliability and accuracy of outputs. |
| Approach: | They propose a hallucination taxonomy with 11 categories for various NLG tasks and propose HAllucination Detection models which integrate hallucinism detection, span-level identification, and correction into a single inference process. |
| Outcome: | The proposed models outperform baselines on HaluEval, FactCHD, and FaithBench, confirming their robustness and versatility. |
From Data-Centric to Sample-Centric: Enhancing LLM Reasoning via Progressive Optimization (2026.acl-long)
Copied to clipboard
| Challenge: | Reinforcement learning with verifiable rewards (RLVR) has recently advanced the reasoning capabilities of large language models (LLMs). |
| Approach: | They propose a method that incorporates partial solution prefixes from expert demonstrations to guide the policy. |
| Outcome: | The proposed methods outperform strong baselines, yielding faster convergence and a higher performance ceiling. |
Training Verifier to Assessing Complex Real-World Tool-Use Trajectories (2026.findings-acl)
Copied to clipboard
Linzhuang Sun, Mingyang Chen, Hao Liang, Tianpeng Li, Zhou Yijie, Chenzheng Zhu, Tianyu Guo, Huanyao Zhang, Jingxuan Wei, Bihui Yu, Fan Yang, Wentao Zhang
| Challenge: | Existing methods for training effective AI agents often resort to synthetic data generation. |
| Approach: | They propose a plug-and-play framework for data quality control in tool-use scenarios . they construct a tool-verify dataset and release a benchmark to assess its performance . |
| Outcome: | The proposed framework surpasses Qwen2.5-72B-Instruct on Tool-V-Bench and the previous APIGen-MT dataset. |
GrandGuard: Taxonomy, Benchmark, and Safeguards for Elderly-Chatbot Interaction Safety (2026.findings-acl)
Copied to clipboard
Changxuan Fan, Xi Yang, Yueyuan Zheng, Bin Zhou, Yuanping Wang, Wenbin Hu, Huihao Jing, Ki Sen Hung, Dazhao Du, Haoran Li, Janet Hui-wen Hsiao, Yangqiu Song
| Challenge: | a survey of older adults shows that many LLMs mishandle elderly-specific contextual risks. |
| Approach: | They propose a framework to assess elderly-specific contextual risks in LLM interactions . they use a taxonomy to identify 50 fine-grained risk types across mental well-being, financial, medical, toxicity, and privacy domains . |
| Outcome: | a new framework assesses elderly-specific contextual risks in LLM interactions . it achieves 96.2% and 90.9% unsafe-prompt detection accuracy, respectively . |
LegalDrill: Diagnosis-Driven Synthesis for Legal Reasoning in Small Language Models (2026.acl-industry)
Copied to clipboard
Tianchun Li, Haochen Liu, Vishwa Pardeshi, Xingchen Wang, Tianci Liu, Huijun Zhao, Wei Fan, Jing Gao
| Challenge: | Small language models (SLMs) are promising for real-world deployment but struggle with high-stakes legal reasoning tasks. |
| Approach: | They propose a diagnostic-driven synthesis framework that extracts and refines reasoning trajectories from a capable teacher via fine-grained prompting and a self-reflective verification is employed to adaptively select the most effective data for the SLM student. |
| Outcome: | The proposed framework extracts and refines reasoning trajectories from a capable teacher via fine-grained prompting, then a self-reflective verification is employed to adaptively select the most effective data for the student. |
Analyzing and Internalizing Complex Policy Documents for LLM Agents (2026.acl-long)
Copied to clipboard
Jiateng Liu, Zhenhailong Wang, Xiaojiang Huang, Yingjie Li, Xiang Li, Chenlei Guo, Xing Fan, Ruhi Sarikaya, Heng Ji
| Challenge: | Large language model agents rely on in-context policy documents to act as effective user assistants. |
| Approach: | They propose an agentic benchmark generator with Controllable Complexity in agent policy across four levels to evaluate agents under increasing complexity. |
| Outcome: | The proposed method outperforms the baseline in data-sparse and high-complexity settings. |
VoxMind: An End-to-End Agentic Spoken Dialogue System (2026.acl-long)
Copied to clipboard
Tianle Liang, Yifu Chen, Shengpeng Ji, Yijun Chen, Zhiyang Jia, Jingyu Lu, Fan Zhuo, Xueyi Pu, Yangzhuo Li, Zhou Zhao
| Challenge: | Existing research on end-to-end spoken dialogue models has focused on core perception and generation, with limited exploration of tool-augmented extensions. |
| Approach: | They propose a framework to equip end-to-end spoken dialogue models with comprehensive agentic abilities by leveraging a 470-hour AgentChat dataset. |
| Outcome: | The proposed framework outperforms Gemini-2.5-Pro on spoken agent tasks while maintaining general conversational quality. |
TL-Training: A Task-Feature-Based Framework for Training Large Language Models in Tool Use (2025.findings-emnlp)
Copied to clipboard
Junjie Ye, Yilong Wu, Sixian Li, Yuming Yang, Zhiheng Xi, Tao Gui, Qi Zhang, Xuanjing Huang, Peng Wang, Zhongchao Shi, Jianping Fan, Zhengyin Du
| Challenge: | a new approach to training large language models (LLMs) overlooks task-specific characteristics in tool use, leading to performance bottlenecks. |
| Approach: | They propose a task-feature-based framework that mitigates the effects of suboptimal training data . they use a dataset to train large-scale LLMs and a reward mechanism tailored to error categories . |
| Outcome: | The proposed framework matches or surpasses open- and closed-source LLMs in tool-use performance using only 1,217 training data points. |
Cooperative Denoising for Distantly Supervised Relation Extraction (C18-1)
Copied to clipboard
| Challenge: | Existing methods for distantly supervised relation extraction suffer from noisy labeling problem, which can severely degrade its performance. |
| Approach: | They propose a framework for distantly supervised relation extraction that leverages text corpus and knowledge graph and a cooperative module involving their mutual learning. |
| Outcome: | The proposed method reduces the noisy labels and achieves substantial improvement over the state-of-the-art methods. |
Giving Control Back to Models: Enabling Offensive Language Detection Models to Autonomously Identify and Mitigate Biases (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models often rely on specific words to predict offensive content, compromising model fairness and potentially exacerbates biases against vulnerable and minority groups. |
| Approach: | They propose a bias self-awareness and data self-iteration framework to help models identify and mitigate biases by integrating multiple natural language processing techniques. |
| Outcome: | The proposed framework reduces false positive rate of models in in-distribution and out-of-difference tests, enhances model accuracy and fairness, and shows promising performance improvements on larger datasets. |
MoC: Mixtures of Text Chunking Learners for Retrieval-Augmented Generation System (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for text chunking are limited by text chunks and lack of domain-specific knowledge. |
| Approach: | They propose a dual-metric evaluation method to quantify text chunking quality . they aim to generate a structured list of chunking regular expressions . |
| Outcome: | The proposed method enables direct quantification of chunking quality . it substantiates the need to integrate LLMs into chunking process . |
MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluation (2025.emnlp-main)
Copied to clipboard
Weihao Xuan, Rui Yang, Heli Qi, Qingcheng Zeng, Yunze Xiao, Aosong Feng, Dairui Liu, Yun Xing, Junjue Wang, Fan Gao, Jinghui Lu, Yuang Jiang, Huitao Li, Xin Li, Kunyu Yu, Ruihai Dong, Shangding Gu, Yuekang Li, Xiaofei Xie, Felix Juefei-Xu, Foutse Khomh, Osamu Yoshie, Qingyu Chen, Douglas Teodoro, Nan Liu, Randy Goebel, Lei Ma, Edison Marrese-Taylor, Shijian Lu, Yusuke Iwasawa, Yutaka Matsuo, Irene Li
| Challenge: | Existing large language model evaluation benchmarks focus on English, while current multilingual tasks lack parallel questions that specifically assess cross-lingual reasoning abilities. |
| Approach: | They propose a comprehensive benchmark covering 29 languages, built on an English benchmark. |
| Outcome: | The MMLU-ProX is a comprehensive benchmark covering 29 languages, built on an English benchmark. |
MAPO: Boosting Large Language Model Performance with Model-Adaptive Prompt Optimization (2023.findings-emnlp)
Copied to clipboard
Yuyan Chen, Zhihao Wen, Ge Fan, Zhengyu Chen, Wei Wu, Dayiheng Liu, Zhixu Li, Bang Liu, Yanghua Xiao
| Challenge: | Existing research emphasizes the importance of adapting prompts to specific tasks, rather than specific LLMs. |
| Approach: | They propose a model-adaptive prompt optimizer method that optimizes original prompts for each LLM in downstream tasks. |
| Outcome: | The proposed method can optimize prompts for an LLM in downstream tasks. |
FRVA: Fact-Retrieval and Verification Augmented Entailment Tree Generation for Explainable Question Answering (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for generating a entailment tree exhibit the reasoning chains from knowledge facts to predicted answers, but they have large fact search spaces and error accumulation problems resulting in the generation of invalid steps. |
| Approach: | They propose a Fact-Retrieval and Verification Augmented bidirectional entailment tree generation method that contains two systems. |
| Outcome: | The proposed method outperforms existing models and achieves state-of-the-art performance in fact selection and structural correctness. |
DP-GTR: Differentially Private Prompt Protection via Group Text Rewriting (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for prompt privacy focus on document-level rewriting, neglecting rich, multi-granular representations of text. |
| Approach: | a framework that leverages local differential privacy and composition theorem via group text rewriting is proposed . the framework is compatible with existing rewrite techniques and is publicly available at anonymous.4open.science for reproducibility. |
| Outcome: | DP-GTR is the first framework to integrate document-level and word-level information while exploiting in-context learning to improve privacy and utility. |
Augmenting Large Language Model Translators via Translation Memories (2023.findings-acl)
Copied to clipboard
Yongyu Mu, Abudurexiti Reheman, Zhiquan Cao, Yuchun Fan, Bei Li, Yinqiao Li, Tong Xiao, Chunliang Zhang, Jingbo Zhu
| Challenge: | Using translation memories (TMs) as prompts is a promising approach to in-context learning of machine translation models. |
| Approach: | They propose to use translation memories (TMs) as prompts to prompt large language models (LLMs) they find that the ability of LLMs to "understand" prompts is helpful . |
| Outcome: | The results are comparable to state-of-the-art NMT systems with bilingual data and are tuned on downstream tasks. |
ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios (2025.coling-main)
Copied to clipboard
Junjie Ye, Guanyu Li, SongYang Gao, Caishuang Huang, Yilong Wu, Sixian Li, Xiaoran Fan, Shihan Dou, Tao Ji, Qi Zhang, Tao Gui, Xuanjing Huang
| Challenge: | Existing evaluations of tool learning focus on validation of tools for large language models with expected outcomes, but this focus ignores the complex capabilities required for LLMs to effectively use tools. |
| Approach: | They propose a fine-grained system for evaluation of large language models’ tool learning capabilities in authentic scenarios. |
| Outcome: | The proposed system examines seven real-world scenarios, analyzing five dimensions crucial to LLMs in tool learning: format alignment, intent comprehension, behavior planning, tool selection, and answer organization. |
STINMatch: Semi-Supervised Semantic-Topological Iteration Network for Financial Risk Detection via News Label Diffusion (2023.emnlp-main)
Copied to clipboard
Xurui Li, Yue Qin, Rui Zhu, Tianqianjin Lin, Yongming Fan, Yangyang Kang, Kaisong Song, Fubang Zhao, Changlong Sun, Haixu Tang, Xiaozhong Liu
| Challenge: | Commercial news provides rich semantics and timely information for automated financial risk detection. |
| Approach: | They propose a semi-supervised Semantic-Topological Iteration Network, STINMatch, along with a news-enterprise knowledge graph to endorse the risk detection enhancement. |
| Outcome: | The proposed model outperforms existing models in terms of generalization and semantics and annotation. |
Activating Distributed Visual Region within LLMs for Efficient and Effective Vision-Language Training and Inference (2025.acl-long)
Copied to clipboard
| Challenge: | Existing Large Vision-Language Models (LVLMs) learn visual capacity through visual instruction tuning. |
| Approach: | They propose a method for LVLMs to be trained by selective layers tuning . they propose removing non-critical layers outside the visual region . |
| Outcome: | The proposed approach preserves nearly 99% of visual performance and improves textual task results while reducing training time. |
KiPT: Knowledge-injected Prompt Tuning for Event Detection (2022.coling-1)
Copied to clipboard
| Challenge: | Existing prompt-based methods may suffer from low precision because they lack event-related semantic knowledge. |
| Approach: | They propose a Knowledge-injected Prompt Tuning model to improve prompt tuning . event detection aims to detect events from text by identifying and classifying event triggers . |
| Outcome: | The proposed model outperforms baseline models in few-shot scenarios. |
Few-Shot Semantic Dependency Parsing via Graph Contrastive Learning (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing graph neural networks (GNNs) have shown promising performance on semantic dependency parsing (SDP) training a high-performing model requires a large amount of labeled data and it is prone to over-fitting in the absence of sufficient labele . |
| Approach: | They propose a syntax-guided graph contrastive learning framework to train GNNs with unlabeled data and fine-tune pre-trained GNN models with few-shot labeled SDP data. |
| Outcome: | The proposed framework achieves promising results when few-shot training samples are available. |
Self-Critique Guided Iterative Reasoning for Multi-hop Question Answering (2025.findings-acl)
Copied to clipboard
Zheng Chu, Huiming Fan, Jingchang Chen, Qianyu Wang, Mingda Yang, Jiafeng Liang, Zhongjie Wang, Hao Li, Guo Tang, Ming Liu, Bing Qin
| Challenge: | Large language models (LLMs) have demonstrated remarkable reasoning capabilities, but they still face challenges in knowledge-intensive multi-hop reasoning. |
| Approach: | They propose a method that uses self-critique feedback to guide iterative reasoning by enabling iteration and self-evaluation of its intermediate reasoning steps. |
| Outcome: | The proposed method surpasses the previous SOTA by 8.6% on three multi-hop reasoning datasets. |
Paraphrase Generation as Unsupervised Machine Translation (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for paraphrase generation rely on labeled datasets or are limited in narrow domains. |
| Approach: | They propose a paradigm for paraphrase generation by treating the task as unsupervised machine translation based on pairs of unlabeled monolingual sentences. |
| Outcome: | The proposed paradigm can generate paraphrases on a large unlabeled monolingual corpus without relying on bilingual sentence pairs. |
On the Intractability to Synthesize Factual Inconsistencies in Summarization (2024.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods for detecting factual inconsistencies in abstractive summarization are lacking in factual consistency detection. |
| Approach: | They propose to use real model-generated summaries with human annotations to detect factual inconsistencies. |
| Outcome: | The proposed model outperforms the SOTA on CoGenSumm, FactCC, Frank, and SummEval datasets. |
Business as Rulesual: A Benchmark and Framework for Business Rule Flow Modeling with LLMs (2026.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks for extracting structured procedural knowledge from unstructured business documents are limited by simplistic schemas and shallow logical dependencies. |
| Approach: | They propose a framework for extracting structured procedural knowledge from unstructured business documents . they propose BREX, a carefully curated benchmark comprising 409 real-world business documents and 2,855 expert-annotated rules . |
| Outcome: | The proposed framework outperforms standard prompts in rule extraction and execution. |
Improving Dialogue Discourse Parsing via Reply-to Structures of Addressee Recognition (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to learn dialogue discourse parsing with related tasks require additional annotation, thus limiting their generality. |
| Approach: | They propose a multitasking framework that integrates dialogue discourse parsing with addressee recognition to reflect relation-based structure of dialogue. |
| Outcome: | The proposed framework outperforms baselines on the Molweni and STAC datasets. |
Mathematical Proof as a Litmus Test: Revealing Failure Modes of Advanced Large Reasoning Models (2026.acl-long)
Copied to clipboard
| Challenge: | Large reasoning models have demonstrated remarkable mathematical problem-solving abilities, but their true reasoning shortcomings are often hidden. |
| Approach: | They propose to leverage the rigor and methodological complexity of mathematical proofs as a diagnostic tool to expose hidden failures. |
| Outcome: | The proposed model evaluation exploits the rigor and complexity of proof problems to uncover 10 fine-grained errors. |
DeTriever: Decoder-representation-based Retriever for Improving NL2SQL In-Context Learning (2025.coling-main)
Copied to clipboard
Raymond Li, Yuxi Feng, Zhenan Fan, Giuseppe Carenini, Weiwei Zhang, Mohammadreza Pourreza, Yong Zhang
| Challenge: | In-context Learning (ICL) has proven to be effective in a variety of complex tasks, but the selection of the most beneficial demonstration examples remains an open research problem. |
| Approach: | They propose a demonstration retrieval framework that learns a weighted combination of LLM hidden states where rich semantic information is encoded. |
| Outcome: | Experiments on two popular NL2SQL benchmarks show that the proposed method outperforms state-of-the-art models. |
RoTBench: A Multi-Level Benchmark for Evaluating the Robustness of Large Language Models in Tool Learning (2024.emnlp-main)
Copied to clipboard
Junjie Ye, Yilong Wu, Songyang Gao, Caishuang Huang, Sixian Li, Guanyu Li, Xiaoran Fan, Qi Zhang, Tao Gui, Xuanjing Huang
| Challenge: | Current research emphasizes LLMs’ capacity to utilize tools in well-structured environments while overlooking their stability when confronted with the inevitable noise of the real world. |
| Approach: | They propose a multi-level benchmark to evaluate the robustness of large language models in tool learning by establishing five external environments with varying levels of noise. |
| Outcome: | The proposed model outperforms the GPT-4 model in tool learning in three critical phases: tool selection, parameter identification, and content filling. |
Triggerless Backdoor Attack for NLP Tasks with Clean Labels (2022.naacl-main)
Copied to clipboard
Leilei Gan, Jiwei Li, Tianwei Zhang, Xiaoya Li, Yuxian Meng, Fei Wu, Yi Yang, Shangwei Guo, Chun Fan
| Challenge: | Backdoor attacks are a new threat to neural natural language processing models due to the fragility and lack of interpretability of NLP models. |
| Approach: | They propose a method to perform backdoor attacks without an external trigger . they propose to use clean-labeled examples to generate poisoned clean-labelled examples . |
| Outcome: | The proposed strategy is effective and hard to defend due to its triggerless nature. |
RASPberry: Retrieval-Augmented Monte Carlo Tree Self-Play with Reasoning Consistency for Multi-Hop Question Answering (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for generating and analyzing multiple document knowledge are not effective for multi-hop question answering. |
| Approach: | They propose a Monte Carlo tree-based approach to inference-time scaling using RASPberry. |
| Outcome: | Experimental results show that the proposed method achieves better inference-time scaling on smaller LLMs. |
Exploring Reasoning Reward Model for Agents (2026.findings-acl)
Copied to clipboard
Kaixuan Fan, Kaituo Feng, Manyuan Zhang, Tianshuo Peng, Zhixun Li, Yilei Jiang, Shuang Chen, Xiangyu Yue
| Challenge: | Existing methods for agentic reinforcement learning rely on sparse outcome-based reward for training, leading to suboptimal results. |
| Approach: | They propose an agent-based reward model that produces structured feedback for agentic trajectories, including an explicit reasoning trace and a focused critique. |
| Outcome: | The proposed model produces structured feedback for agentic trajectories including an explicit reasoning trace, a focused critique, and an overall score that evaluates process performance. |
Benchmarking for Domain-Specific LLMs: A Case Study on Academia and Beyond (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Comp-Comp is an iterative benchmarking framework grounded in the principles of comprehensiveness and compactness. |
| Approach: | They propose a benchmark framework that incorporates the principle of comprehensiveness and compactness. |
| Outcome: | The proposed framework is domain-agnostic and adaptable to a wide range of specialized fields. |
RCTEA: Richness-guided Co-training for Temporal Entity Alignment (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing TEA models fail to capture the orthogonal yet complementary effect between structural and temporal features. |
| Approach: | They propose a framework that jointly models structural and temporal aspects of Temporal Knowledge Graphs for entity alignment. |
| Outcome: | The proposed framework achieves state-of-the-art on public TEA benchmarks. |
Multimodal Inconsistency Reasoning (MMIR): A New Benchmark for Multimodal Reasoning Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing Multimodal Large Language Models (MLLMs) are predominantly trained on consistent visual-textual inputs, leaving open the question of whether they can handle semantic mismatches in layout-rich content. |
| Approach: | They propose to use multimodal inconsistency reasoning to assess MLLMs' ability to reason about semantic mismatches in webpages, presentation slides, and posters. |
| Outcome: | The proposed model outperforms open-source models in detecting inconsistencies in webpages, presentation slides, and posters while remaining vulnerable to inconsistent errors. |
OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models (2025.acl-long)
Copied to clipboard
Siming Huang, Tianhao Cheng, Jason Klein Liu, Weidi Xu, Jiaran Hao, Liuyihan Song, Yang Xu, Jian Yang, Jiaheng Liu, Chenchen Zhang, Linzheng Chai, Ruifeng Yuan, Xianzhen Luo, Qiufeng Wang, YuanTao Fan, Qingfu Zhu, Zhaoxiang Zhang, Yang Gao, Jie Fu, Qian Liu, Houyi Li, Ge Zhang, Yuan Qi, Xu Yinghui, Wei Chu, Zili Wang
| Challenge: | Code LLMs lack reproducible data pipelines and training protocols for reproducible advancements in code intelligence. |
| Approach: | They propose a top-tier code LLM that releases model weights and inference code . reproducible data pipelines, rigorous experimental ablation results and training protocols are included . |
| Outcome: | The proposed model achieves comparable performance to leading models and serves as an "open cookbook" reproducible training data, rigorous experimental ablation results, and detailed training protocols are also included in the model. |
DELAN: Dual-Level Alignment for Vision-and-Language Navigation by Cross-Modal Contrastive Learning (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies focus on cross-modal attention at the fusion stage, but modality features generated by disparate uni-encoders reside in their own spaces, leading to a decline in the quality of cross-modulation and decision-making. |
| Approach: | They propose a framework to align navigation-related modalities before fusion by cross-modal contrastive learning. |
| Outcome: | The proposed framework integrates with the majority of existing models, resulting in improved navigation performance on various VLN benchmarks, including R2R, R4R, and CVDN. |
MTR: A Dataset Fusing Inductive, Deductive, and Defeasible Reasoning (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing datasets for logical reasoning focus on monotonic logic and a single form of reasoning. |
| Approach: | They propose to use a dataset to study the human-like reasoning in machine reading comprehension. |
| Outcome: | The proposed dataset shows that state-of-the-art neural models perform noticeably worse than expected. |
Step-level Value Preference Optimization for Mathematical Reasoning (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for generating preference-level annotations do not capture the fine-grained quality of model outputs in multi-step reasoning tasks. |
| Approach: | They propose an algorithm to automatically annotate step-level preferences for multi-step reasoning using Monte Carlo Tree Search. |
| Outcome: | The proposed algorithm achieves state-of-the-art performance on in-domain and out-of domain mathematical reasoning benchmarks. |
Understanding the Thinking Process of Reasoning Models: A Perspective from Schoenfeld’s Episode Theory (2025.emnlp-main)
Copied to clipboard
Ming Li, Nan Zhang, Chenrui Fan, Hong Jiao, Yanbin Fu, Sydney Peters, Qingshu Xu, Robert Lissitz, Tianyi Zhou
| Challenge: | Large Reasoning Models (LRMs) generate extensive chain-of-thought reasoning, but we lack a principled framework for understanding how these thoughts are structured. |
| Approach: | They propose a method to analyze the reasoning traces of Large Reasoning Models using Schoenfeld’s Episode Theory. |
| Outcome: | The proposed framework provides a theoretically grounded methodology for interpreting LRM cognition and enables future work on more controllable and transparent reasoning systems. |
MadaKV: Adaptive Modality-Perception KV Cache Eviction for Efficient Multimodal Long-Context Inference (2025.acl-long)
Copied to clipboard
Kunxi Li, Zhonghua Jiang, Zhouzhou Shen, ZhaodeWang ZhaodeWang, Chengfei Lv, Shengyu Zhang, Fan Wu, Fei Wu
| Challenge: | Existing KV cache eviction methods fail to capture modality-specific information, resulting in suboptimal performance. |
| Approach: | They propose a modality-adaptive key-value (KV) cache eviction strategy to enhance the efficiency of multimodal large language models in long-context inference. |
| Outcome: | The proposed method reduces the KV cache memory footprint and model inference latency while maintaining high accuracy across multimodal long-context tasks. |
Enhancing Multi-party Dialogue Discourse Parsing with Explanation Generation (2025.coling-main)
Copied to clipboard
| Challenge: | Multi-party dialogue discourse parsing is an important and challenging task in natural language processing. |
| Approach: | They propose a model to integrate external knowledge from Large Language Models to analyze dialogue discourse structures and semantic relations between utterances in multi-party conversations. |
| Outcome: | The proposed model outperforms the state-of-the-art (SOTA) models on two public datasets. |
FaithBench: A Diverse Hallucination Benchmark for Summarization by Modern LLMs (2025.naacl-short)
Copied to clipboard
Forrest Sheng Bao, Miaoran Li, Renyi Qu, Ge Luo, Erana Wan, Yujia Tang, Weisi Fan, Manveer Singh Tamber, Suleman Kazi, Vivek Sourabh, Mike Qi, Ruixuan Tu, Chenyu Xu, Matthew Gonzales, Ofer Mendelevitch, Amin Ahmad
| Challenge: | Existing evaluations of hallucinations in large language models suffer from a lack of diversity and recency in the LLM and LLM families considered. |
| Approach: | They propose a summarization hallucination benchmark that challenges models to disagree on hallucines . they use models to generate answers or summaries from textual input . |
| Outcome: | The proposed model combines the best of 10 modern LLMs with ground truth annotations. |
Incorporating Lexical and Syntactic Knowledge for Unsupervised Cross-Lingual Transfer (2024.lrec-main)
Copied to clipboard
| Challenge: | Unsupervised cross-lingual transfer is a process of transferring knowledge between languages without explicit supervision. |
| Approach: | They propose a framework that combines lexical and syntactic knowledge to enhance learning . they use a code-switching technique to implicitly teach lexica and a syntaktic-based graph attention network to help encode syntakic structure. |
| Outcome: | The proposed framework outperforms baselines of zero-shot cross-lingual transfer with 1.0 3.7 points on text classification, named entity recognition, and semantic parsing tasks. |
TInR: Exploring Tool-Internalized Reasoning in Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods rely on external tool documentation during reasoning, leading to tool mastery difficulty, tool size constraints, and inference inefficiency. |
| Approach: | They propose a tool-internalized reasoning framework for unified reasoning and tool usage that integrates external tools into Large Language Models (LLMs) to address these issues, they propose 'tool-internet-based' reasoning. |
| Outcome: | The proposed method achieves superior performance across in-domain and out-of-domain settings, highlighting its effectiveness and efficiency. |
TinyAlign: Boosting Lightweight Vision-Language Models by Mitigating Modal Alignment Bottlenecks (2026.findings-acl)
Copied to clipboard
Yuanze Hu, Xinyu Wang, Zhichao Yang, Gen Li, Ye Qiu, Zhaoxin Fan, Yifan Sun, Wenjun wu, Jin Dong, Xiaotie Deng
| Challenge: | Lightweight Vision-Language Models (VLMs) are indispensable for resource-constrained applications. |
| Approach: | They propose a framework that retrieves context from a memory bank to enhance alignment . they propose EMI-based approach to align vision and language models . |
| Outcome: | The proposed framework reduces training loss, accelerates convergence, and enhances task performance with negligible computational overhead. |
Uncovering the Potential of ChatGPT for Discourse Analysis in Dialogue: An Empirical Study (2024.lrec-main)
Copied to clipboard
| Challenge: | Large language models have shown remarkable capability in many downstream tasks, yet their ability to understand discourse structures of dialogues remains less explored. |
| Approach: | They aim to systematically inspect ChatGPT’s performance in two discourse analysis tasks: topic segmentation and discourse parsing. |
| Outcome: | The proposed model can give more reasonable topic structures than human annotations but only linearly parses the hierarchical rhetorical structures. |
Layer-wise Model Pruning based on Mutual Information (2021.emnlp-main)
Copied to clipboard
| Challenge: | In spite of impressive results of neural networks, the huge model size has hindered their applications in cases where computation and memory resources are limited. |
| Approach: | They propose a method for layer-wise pruning using mutual information based feature selection in SVMs and logistic regression. |
| Outcome: | The proposed pruning strategy offers greater speedup and higher performance than weight-based pruning methods. |
Unifying Cross-Lingual and Cross-Modal Modeling Towards Weakly Supervised Multilingual Vision-Language Pre-training (2023.acl-long)
Copied to clipboard
| Challenge: | Existing studies address the problem of translating English data into other languages, but they are limited in form and scale. |
| Approach: | They propose a framework to unify cross-lingual and cross-modal pre-training by using English data. |
| Outcome: | The proposed framework unifies cross-lingual and cross-modal pre-training on different data. |
OmniCompliance-100K: A Multi-Domain, Rule-Grounded, Real-World Safety Compliance Dataset (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing LLM safety datasets rely on ad-hoc taxonomies and lack rule-grounded, real-world cases. |
| Approach: | They construct a rule-grounded, real-world case dataset OmniCompliance-100K from a compliance perspective using a powerful web-searching agent. |
| Outcome: | The proposed dataset spans 74 regulations and policies across a wide range of domains including security and privacy regulations, content safety and user data privacy policies, financial security requirements, medical device risk management standards, educational integrity guidelines, and protections of fundamental human rights. |
DynGL-SDP: Dynamic Graph Learning for Semantic Dependency Parsing (2022.coling-1)
Copied to clipboard
| Challenge: | Existing parsers that learn graph representations based on static graphs are error-prone and disjointed . Graph-based parser can parse sentences efficiently but suffer from error propagation . |
| Approach: | They propose a dynamic graph learning framework to learn graph representations based on a static graph constructed by an existing parser. |
| Outcome: | The proposed parser outperforms the previous parsers on the SemEval-2015 task 18 dataset in three languages. |
Towards Noise-Tolerant Speech-Referring Video Object Segmentation: Bridging Speech and Text (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in vision-language learning have significantly advanced Human-Computer Interactions (HCI). |
| Approach: | They propose a method to align the semantic spaces between speech and text by incorporating two modules to align semantic spaces. |
| Outcome: | The proposed method outperforms state-of-the-art approaches on AVOS benchmarks. |
NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generation (2023.acl-long)
Copied to clipboard
Shengming Yin, Chenfei Wu, Huan Yang, Jianfeng Wang, Xiaodong Wang, Minheng Ni, Zhengyuan Yang, Linjie Li, Shuguang Liu, Fan Yang, Jianlong Fu, Ming Gong, Lijuan Wang, Zicheng Liu, Houqiang Li, Nan Duan
| Challenge: | Existing work generates long videos segment by segment sequentially, which is inefficient. |
| Approach: | They propose a Diffusion over Difference architecture for eXtremely Long video generation. |
| Outcome: | The proposed architecture reduces the average inference time from 7.55min to 26s (94.26%) and generates high-quality long videos with both global and local coherence. |
Privacy Checklist: Privacy Violation Detection Grounding on Contextual Integrity Theory (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing privacy studies focus on sub-fields, but they focus on a few sub-domains. |
| Approach: | They propose to use the Health Insurance Portability and Accountability Act of 1996 as an example to develop a checklist that covers social identities, private attributes, and existing privacy regulations. |
| Outcome: | The proposed checklist covers social identities, private attributes, and existing privacy regulations. |
Evaluating Large Language Models on Wikipedia-Style Survey Generation (2024.findings-acl)
Copied to clipboard
Fan Gao, Hang Jiang, Rui Yang, Qingcheng Zeng, Jinghui Lu, Moritz Blum, Tianwei She, Yuang Jiang, Irene Li
| Challenge: | Recent studies have shown that large language models can perform well in general tasks, but their effectiveness and limitations in domainspecific tasks remain unclear. |
| Approach: | They examine the proficiency of Large Language Models (LLMs) in generating succinct survey articles specific to the niche field of NLP in computer science. |
| Outcome: | The LLMs perform better in generating succinct survey articles specific to the niche field of NLP in computer science, compared to human-authored surveys, but they exhibit bias in evaluation. |
Towards Efficient and Effective Diffusion Language Model Inference via Semantic-Aware Adaptive Denoising (2026.acl-long)
Copied to clipboard
| Challenge: | Existing acceleration works cannot accurately detect semantically stabilized tokens and then skip computation, leading to sub-optimal speedup in practice. |
| Approach: | They propose a semantic-aware adaptive denoising framework that encodes scalar confidence scores into an evolution-awful feature vector and clusters vectors proactively and adaptively identify semantically converged tokens. |
| Outcome: | The proposed framework outperforms the SOTA competitor in speed and quality . it can detect semantically stabilized tokens and skip computation, resulting in sub-optimal speedup . |
MM-Verify: Enhancing Multimodal Reasoning with Chain-of-Thought Verification (2025.acl-long)
Copied to clipboard
| Challenge: | MM-Verifier and MM Reasoner are a powerful multimodal reasoning model . large language models (LLMs) have demonstrated exceptional performance across tasks spanning myriad domains. |
| Approach: | They propose a method which combines tree search and verification to generate high-quality chain-of-thought data. |
| Outcome: | The proposed method outperforms all larger models on the MathCheck, MathVista, and MathVerse benchmarks. |
Entity-Relation Extraction as Multi-Turn Question Answering (P19-1)
Copied to clipboard
| Challenge: | Identifying entities and their relations is the prerequisite of extracting structured knowledge from unstructured raw texts. |
| Approach: | They propose a new paradigm for the task of entity-relation extraction . they cast the task as a multi-turn question answering problem . |
| Outcome: | The proposed paradigm significantly outperforms previous best models on the ACE and CoNLL04 datasets. |
Multi-Granularity Fusion Text Semantic Matching Based on WoBERT (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing text-matching methods struggle with semantic nuances in short texts . a novel approach to improve text semantic matching is being developed . |
| Approach: | They propose a multi-granularity fusion model that harnesses a pre-trained language model to capture text semantic nuances. |
| Outcome: | The proposed model improves on Chinese short text matching datasets compared to traditional methods . the proposed model captures individual text semantic nuances and improves accuracy . |
Sentence Similarity Based on Contexts (2022.tacl-1)
Copied to clipboard
| Challenge: | Existing methods to measure sentence similarity face limited dataset size and training-test gap . existing methods lack large-scale labeled datasets with labeles that are labor-intensive and expensive . |
| Approach: | They propose a framework that measures sentence similarity by comparing probabilities of generating two sentences given the same context. |
| Outcome: | The proposed framework achieves significant performance boosts over baselines under supervised and unsupervised settings. |
Analyzing the Effects of Supervised Fine-Tuning on Model Knowledge from Token and Parameter Levels (2025.emnlp-main)
Copied to clipboard
Junjie Ye, Yuming Yang, Yang Nan, Shuo Li, Qi Zhang, Tao Gui, Xuanjing Huang, Peng Wang, Zhongchao Shi, Jianping Fan
| Challenge: | Large language models (LLMs) acquire substantial world knowledge during pretraining, which is further shaped by post-training techniques such as supervised fine-tuning (SFT). |
| Approach: | They evaluate closed-book question answering (CBQA) performance across five LLMs from the LLaMA-2 and LLama-3 families and examine the impact of supervised fine-tuning on model knowledge. |
| Outcome: | The proposed model performance is 14% worse than models fine-tuned on 1,920 samples and 12% worse on 240 samples. |
Synergistic Augmentation: Enhancing Cross-Domain Zero-Shot Slot Filling with Small Model-Assisted Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to slot filling are limited due to data scarcity and timeconsuming efforts. |
| Approach: | They propose a framework that harnesses the power of a small model to augment inferential capabilities of LLMs without additional training. |
| Outcome: | The proposed framework improves slot filling performance on a spoken language dataset and a NER dataset. |
Reconstructing Capsule Networks for Zero-shot Intent Classification (D19-1)
Copied to clipboard
| Challenge: | Existing methods for intent classification are limited due to fast-emerging intents . a recent study shows that existing methods are not effective in recognizing unseen intents. |
| Approach: | They propose to reconstruct capsule networks for zero-shot intent classification by using latent information from labeled utterances. |
| Outcome: | The proposed method outperforms existing methods on two task-oriented dialogue datasets in different languages. |
Building Parallel Monolingual Gan Chinese Dialects Corpus (L18-1)
Copied to clipboard
| Challenge: | In particular, we manually annotate a Gan Chinese Dialects Corpus (GCDC) including 131.5 hours and 310 documents with 6 different genres, containing news, official document, story, prose, poet, letter and speech, from 19 different Gan regions. |
| Approach: | They propose a scheme to represent Gan Chinese dialects using Chinese character, Chinese Pinyin and Chinese audio forms. |
| Outcome: | The proposed scheme is based on a Gan Chinese Dialects Corpus (GCDC) with 131.5 hours and 310 documents with 6 different genres, containing news, official document, story, prose, poet, letter and speech, from 19 different Gan regions. |
Looking Beyond the One: Operationalizing and Eliciting Visual Ambiguity in VLLMs (2026.acl-long)
Copied to clipboard
| Challenge: | Visual question answering systems typically collapse ambiguity, committing to a single interpretation during decoding and evaluation. |
| Approach: | They operationalize ambiguity as the existence of multiple answer-supporting regions in an image . they show that ambiguities are already encoded in their internal representations . |
| Outcome: | The proposed approach makes ambiguity observable without exhaustive annotations . ambiguities are already encoded in models, but not reliably expressed in outputs despite hidden states . |
OS Agents: A Survey on MLLM-based Agents for Computer, Phone and Browser Use (2025.acl-long)
Copied to clipboard
Xueyu Hu, Tao Xiong, Biao Yi, Zishu Wei, Ruixuan Xiao, Yurun Chen, Jiasheng Ye, Meiling Tao, Xiangxin Zhou, Ziyu Zhao, Yuhuai Li, Shengze Xu, Shenzhi Wang, Xinchen Xu, Shuofei Qiao, Zhaokai Wang, Kun Kuang, Tieyong Zeng, Liang Wang, Jiwei Li, Yuchen Eleanor Jiang, Wangchunshu Zhou, Guoyin Wang, Keting Yin, Zhou Zhao, Hongxia Yang, Fan Wu, Shengyu Zhang, Fei Wu
| Challenge: | a new generation of (M)LLMs is enabling the creation of superintelligent AI assistants . OS Agents can complete tasks autonomously and have the potential to significantly enhance the lives of billions of users worldwide. |
| Approach: | They propose to build OS Agents that operate within operating systems' GUIs and GUIs . they examine evaluation metrics and benchmarks to identify promising directions . |
| Outcome: | The proposed agents are based on operating systems (OS) and operating systems frameworks. |
WavAlign: Enhancing Intelligence and Expressiveness in Spoken Dialogue Models via Adaptive Hybrid Post-Training (2026.findings-acl)
Copied to clipboard
Yifu Chen, Shengpeng Ji, Qian Chen, Tianle Liang, Yangzhuo Li, Ziqing Wang, Wen Wang, Jingyu Lu, Haoxiao Wang, Xueyi Pu, Fan Zhuo, Zhou Zhao
| Challenge: | End-to-end spoken dialogue models have higher potential ceiling in expressiveness and perceptual ability than cascaded systems. |
| Approach: | They propose a modality-aware adaptive post-training recipe that constrains preference updates to the semantic channel and improves acoustic behavior via explicit anchoring. |
| Outcome: | The proposed model improves speech quality and expressiveness across spoken dialogue benchmarks and architectures. |
GoldCoin: Grounding Large Language Models in Privacy Laws via Contextual Integrity Theory (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing research studies privacy by exploring various privacy attacks, defenses, and evaluations within narrowly predefined patterns. |
| Approach: | They propose a framework that leverages the theory of contextual integrity as a bridge to help LLMs understand the complex contexts for judicial assessing privacy violations. |
| Outcome: | The proposed framework bridges the theory of contextual integrity as a bridge, creating numerous synthetic scenarios grounded in relevant privacy statutes (e.g., HIPAA). |
Scaling Behaviors of LLM Reinforcement Learning Post-Training: An Empirical Study in Mathematical Reasoning (2026.acl-long)
Copied to clipboard
Zelin Tan, Hejia Geng, Xiaohang Yu, Mulei Zhang, Guancheng Wan, Yifan Zhou, Qiang He, Xiangyuan Xue, Heng Zhou, Yutao Fan, Zhong-Zhi Li, Zaibin Zhang, Guibin Zhang, Chen Zhang, Zhenfei Yin, Philip Torr, Lei Bai
| Challenge: | elucidating scaling laws for large language models (LLMs) during pre-training remains unexplored. |
| Approach: | They characterize how model scale, data, and compute interact during pre-training . they find that large models consistently demonstrate superior compute and data efficiency . |
| Outcome: | The proposed scaling laws offer practical guidance for scaling reasoning capabilities through reinforcement learning post-training. |
TeachMaster: Generative Teaching via Code (2026.acl-industry)
Copied to clipboard
Yuheng Wang, Runde Yang, Lin Wu, Jie Zhang, Jingru Fan, Tianle Zhou, Ruoyu Fu, Huatao Li, Ruijie Shi, Siheng Chen, Weinan E, Chen Qian
| Challenge: | Existing methods for creating video content are limited by high costs and slow update cycles. |
| Approach: | They propose a paradigm shifting educators from manual creators to high-level directors who focus on pedagogical intents while agents handle execution. |
| Outcome: | The proposed framework reduces production costs to 0.3% of traditional course videos and provides a robust solution for scalable education. |
Easy and Efficient Transformer: Scalable Inference Solution For Large NLP Model (2022.naacl-industry)
Copied to clipboard
Gongzheng Li, Yadong Xi, Jingzhen Ding, Duan Wang, Ziyang Luo, Rongsheng Zhang, Bai Liu, Changjie Fan, Xiaoxi Mao, Zeng Zhao
| Challenge: | Recent studies show that transformer-based models are effective over many tasks, but they are expensive to deploy in the industrial application. |
| Approach: | They propose a transformer-based inference solution that optimizes kernels for long inputs and large hidden sizes and a flexible CUDA memory manager to reduce the memory footprint when deploying a large model. |
| Outcome: | The proposed solution achieves an average speedup of 1.40-4.20x on the transformer decoder layer with an A100 GPU. |
Multi-step Jailbreaking Privacy Attacks on ChatGPT (2023.findings-emnlp)
Copied to clipboard
| Challenge: | With the rapid evolution of large language models (LLMs), many downstream NLP tasks can be well solved given appropriate prompts. |
| Approach: | They propose to integrate ChatGPT and Bing GPT3 into their applications to create a set of LLMs that can be used to generate NLP tasks with appropriate prompts. |
| Outcome: | The proposed models can be zero-shot or few-shot learners to solve specified tasks and can even be zero or few shot learners. |
MedCoach: Enhancing Medical Reasoning in LLMs via Knowledge Graph-Augmented Chain-of-Thought Distillation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for training specialized reasoning models for the medical domain are limited due to the scarcity of high-quality, large-scale Chain-of-Thought (CoT) data. |
| Approach: | They propose a framework that introduces a dedicated coach role to guide the student model through question decomposition. |
| Outcome: | The proposed framework smooths the learning curve in medical reasoning by facilitating domain adaptation before advancing to complex long-chain reasoning. |
Mitigating Object Hallucinations in MLLMs via Multi-Frequency Perturbations (2025.findings-emnlp)
Copied to clipboard
Shuo Li, Jiajun Sun, Guodong Zheng, Xiaoran Fan, Yujiong Shen, Yi Lu, Zhiheng Xi, Yuming Yang, Wenming Tan, Tao Ji, Tao Gui, Qi Zhang, Xuanjing Huang
| Challenge: | Multimodal large language models have demonstrated remarkable performance in visual-language tasks, but their authenticity is often compromised by object hallucinations. |
| Approach: | They propose a multi-frequency perturbation method that leverages both low-frequency and high-frequency features of images to perturb visual feature representations and explicitly suppress redundant frequency-domain features during inference. |
| Outcome: | The proposed method significantly mitigates object hallucinations across various model architectures. |
Into the Gray Zone: Domain Contexts Can Blur LLM Safety Boundaries (2026.acl-long)
Copied to clipboard
Ki Sen Hung, Xi Yang, Chang Liu, Haoran Li, Kejiang Chen, Changxuan Fan, Tsun On Kwok, Weiming Zhang, Xiaomeng Li, Yangqiu Song
| Challenge: | a goal of LLM alignment is to balance usefulness with harmlessness, but this conflictes when knowledge serves both legitimate and malicious purposes. |
| Approach: | They propose a framework that combines safety-research contexts with adversarial interactions to exploit a vulnerability in Jargon queries. |
| Outcome: | a framework outperforms existing methods in analyzing Jargon queries, a study shows . it achieves 93% of attacks across seven models, while remaining useful, the authors say . |
GLProtein: Global-and-Local Structure Aware Protein Representation Learning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Despite advances in protein sequence analysis, there remains potential for further exploration in integrating protein structural information. |
| Approach: | They propose a framework that integrates global structural similarity and local amino acid details to enhance protein pre-training. |
| Outcome: | The proposed framework outperforms existing methods in several bioinformatics tasks. |
SessionIntentBench: A Multi-task Inter-session Intention-shift Modeling Benchmark for E-commerce Customer Behavior Understanding (2026.findings-acl)
Copied to clipboard
Yuqi Yang, Weiqi Wang, Baixuan Xu, Wei Fan, Qing Zong, Chunkit Chan, Zheye Deng, Xin Liu, Yifan Gao, Changlong Yu, Chen Luo, Yang Li, Zheng Li, Qingyu Yin, Bing Yin, Yangqiu Song
| Challenge: | Existing models fail to capture and model customer intention effectively because of insufficient information exploitation and only apparent information like descriptions and titles are used. |
| Approach: | They propose to exploit existing session data to capture and model intention in E-commerce product purchase sessions using a multimodal benchmark. |
| Outcome: | The proposed framework can bridge the gap between intention understanding in simplified research cases like co-buy intention and more complex yet practical scenarios like session history. |
PrivLM-Bench: A Multi-level Privacy Evaluation Benchmark for Language Models (2024.acl-long)
Copied to clipboard
Haoran Li, Dadi Guo, Donghao Li, Wei Fan, Qi Hu, Xin Liu, Chunkit Chan, Duanyi Yao, Yuan Yao, Yangqiu Song
| Challenge: | generative large language models (LLMs) exhibit surprising capability and integrate previous tasks into a unified text generation formulation. |
| Approach: | They propose a privacy evaluation benchmark to quantify the privacy leakage of language models. |
| Outcome: | The proposed benchmark compares PPLMs with different privacy implementations to find out how privacy leakage is handled. |
Two-stage Incomplete Utterance Rewriting on Editing Operation (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods to generate rewritten utterances based on dialogue context ignore coreference and ellipsis in dialogues. |
| Approach: | They propose a framework where the first stage generates editing operations and the second stage rewrites incomplete utterances utilizing the generated editing operations. |
| Outcome: | The proposed framework outperforms the existing models on three IUR datasets. |
Aspect-Based Sentiment Analysis with Syntax-Opinion-Sentiment Reasoning Chain (2025.coling-main)
Copied to clipboard
| Challenge: | Syntactic structures are crucial for capturing aspect-opinion relationships . syntactically based models struggle with linguistic complexities . |
| Approach: | They propose a syntactic-opinion-sentiment reasoning framework that leverages syntaktic information to improve ABSA performance. |
| Outcome: | The proposed framework improves ABSA performance, though smaller LLMs exhibit weaker performance. |
Discovering Representation Sprachbund For Multilingual Pre-Training (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models perform poorly on many languages and cross-lingual tasks due to typological differences and contradictions between some languages. |
| Approach: | They propose to pre-train multilingual pre-trained models to handle cross-lingual tasks in one model. |
| Outcome: | The proposed model improves performance on cross-lingual tasks compared to baselines on multiple languages . |
Answering Complex Geographic Questions by Adaptive Reasoning with Visual Context and External Commonsense Knowledge (2025.acl-long)
Copied to clipboard
| Challenge: | a new task of answering geographic reasoning questions based on the given image is proposed . the task requires identifying the objects in the image and understanding the background context . |
| Approach: | They propose a task of answering geographic reasoning questions based on the given image . they analyze the image and describe its fine-grained content by text and keywords . |
| Outcome: | The proposed method can be used to answer geographic reasoning questions based on an image . it can be applied to a large-scale dataset with 41,329 samples . |
VenusFactory: An Integrated System for Protein Engineering with Data Retrieval and Language Model Fine-Tuning (2025.acl-demo)
Copied to clipboard
Yang Tan, Chen Liu, Jingyuan Gao, Wu Banghao, Mingchen Li, Ruilin Wang, Lingrong Zhang, Huiqun Yu, Guisheng Fan, Liang Hong, Bingxin Zhou
| Challenge: | Pre-trained protein language models have been used in protein engineering, but their adoption is limited due to data collection, task benchmarking, and application challenges. |
| Approach: | They propose a versatile engine that integrates biological data retrieval, standardized task benchmarking, and modular fine-tuning of PLMs. |
| Outcome: | The proposed engine integrates biological data retrieval, task benchmarking, and modular fine-tuning of PLMs. |
Not Just Classification: Recognizing Implicit Discourse Relation on Joint Modeling of Classification and Generation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods of implicit discourse relation recognition (IDRR) focus on three aspects: enhancing discourse units representation, enhancing semantic interaction, and joint learning with other tasks. |
| Approach: | They propose a joint model to recognize the relation label and generate the target sentence containing the meaning of relations simultaneously. |
| Outcome: | The proposed model achieves the best performance against several state-of-the-art systems on Chinese and English datasets. |
Summarize, Outline, and Elaborate: Long-Text Generation via Hierarchical Supervision from Extractive Summaries (2022.coling-1)
Copied to clipboard
| Challenge: | Existing models focus on local word prediction, and cannot make high level plans on what to generate. |
| Approach: | They propose a pipelined system that summarises, outlines and elaborates on each bullet point to generate the corresponding segment. |
| Outcome: | The proposed system produces long texts with significantly better quality and faster convergence speed. |
SafeRAG: Benchmarking Security in Retrieval-Augmented Generation of Large Language Model (2025.acl-long)
Copied to clipboard
Xun Liang, Simin Niu, Zhiyu Li, Sensen Zhang, Hanyu Wang, Feiyu Xiong, Zhaoxin Fan, Bo Tang, Jihao Zhao, Jiawei Yang, Shichao Song, Mengwei Wang
| Challenge: | Existing approaches to integrating external knowledge into large language models (LLMs) however, the incorporation of external knowledge increases the vulnerability of LLMs . |
| Approach: | They propose a benchmark to evaluate the RAG security using a dataset . they classify attack tasks into silver noise, inter-context conflict, soft ad, and white Denial-of-Service . |
| Outcome: | The proposed benchmark evaluates the security of RAG against 14 representative RAG components. |
Multi-grained Named Entity Recognition (P19-1)
Copied to clipboard
| Challenge: | Existing approaches treat Named Entity Recognition (NER) as a sequence labeling task. |
| Approach: | They propose a framework for Multi-Grained Named Entity Recognition where multiple entities or entity mentions in a sentence could be non-overlapping or totally nested. |
| Outcome: | The proposed framework outperforms current state-of-the-art frameworks by 4.4% in terms of the F1 score among nested/non-overlapping NER tasks. |
STRIDE-ED: A Strategy-Grounded Stepwise Reasoning Framework for Empathetic Dialogue Systems (2026.acl-long)
Copied to clipboard
| Challenge: | Empathetic dialogue requires not only recognizing a user’s emotional state but also making strategy-aware, context-sensitive decisions throughout response generation. |
| Approach: | They propose a STRategy-grounded, interpretable, and DEep reasoning framework that models Empathetic Dialogue through structured, strategy-conditioned reasoning. |
| Outcome: | The proposed framework outperforms existing methods on automatic metrics and human evaluations. |
Hyperlink-induced Pre-training for Passage Retrieval in Open-domain Question Answering (2022.acl-long)
Copied to clipboard
Jiawei Zhou, Xiaoguang Li, Lifeng Shang, Lan Luo, Ke Zhan, Enrui Hu, Xinyu Zhang, Hao Jiang, Zhao Cao, Fan Yu, Xin Jiang, Qun Liu, Lei Chen
| Challenge: | Existing methods to train dense passage retrieval have a large data gap between upstream and downstream relevance. |
| Approach: | They propose a method to pre-train the dense retriever with the text relevance induced by hyperlinks within Web documents. |
| Outcome: | The proposed method outperforms existing methods under different scenarios and in the open-domain question answering domain. |
Untangle the KNOT: Interweaving Conflicting Knowledge and Reasoning Skills in Large Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies have explained to what extent LLMs extract conflicting knowledge from the provided text, but they neglect the necessity to reason with conflicting information. |
| Approach: | They construct a dataset for knowledge conflict resolution examination in the form of question answering that divides reasoning with conflicting knowledge into three levels. |
| Outcome: | The proposed dataset enables analysis of reasoning with conflicting knowledge in the form of question answering. |
Joint Slot Filling and Intent Detection via Capsule Neural Networks (P19-1)
Copied to clipboard
| Challenge: | Existing models that label slots and detect intent do not preserve hierarchical relationship between words, slots, and intents. |
| Approach: | They propose a capsule-based neural network model which performs slot filling and intent detection via a dynamic routing-by-agreement schema. |
| Outcome: | The proposed model performs better than existing models and existing models on real-world datasets. |
KuiLeiXi: a Chinese Open-Ended Text Adventure Game (2021.acl-demo)
Copied to clipboard
Yadong Xi, Xiaoxi Mao, Le Li, Lei Lin, Yanjiang Chen, Shuhan Yang, Xuhan Chen, Kailun Tao, Zhi Li, Gongzheng Li, Lin Jiang, Siyan Liu, Zeng Zhao, Minlie Huang, Changjie Fan, Zhipeng Hu
| Challenge: | Recent advances in pre-trained language models have made it possible to generate human-like text. |
| Approach: | They propose to integrate an open-ended text adventure game in Chinese, named KuiLeiXi, where players interact with the AI until the plot goals are reached. |
| Outcome: | The proposed game lacks incentives and relies on players to explore on their own. |
EdgeInfinite: A Memory-Efficient Infinite-Context Transformer for Edge Devices (2025.acl-industry)
Copied to clipboard
| Challenge: | Existing KV cache optimizations struggle with irreversible token eviction in long-output tasks . alternative sequence modeling architectures prove costly to adopt within established Transformer infrastructures. |
| Approach: | They propose a memory-efficient solution for infinite contexts that integrates compressed memory into Transformer-based LLMs through a trainable memory-gating module. |
| Outcome: | The proposed solution achieves comparable performance to baseline Transformer-based LLMs while optimizing memory consumption and time to first token. |
Non-Emotion-Centric Empathetic Dialogue Generation (2025.coling-main)
Copied to clipboard
| Challenge: | Empathy is a social psychology theory that enables individuals to comprehend each other's experiences and emotions, thereby fostering more intimate interpersonal relationships. |
| Approach: | They propose a framework for empathetic dialogue generation based on contrastive learning and context-sensitive entity and social commonsense that punishes responses with incorrect emotions and improves the quality of emotions. |
| Outcome: | The proposed framework improves the quality of empathetic generation and generates more diverse responses in comparison with the state-of-the-art baselines. |
LANG: Reinforcement Learning for Multilingual Reasoning with Language-Adaptive Hint Guidance (2026.acl-long)
Copied to clipboard
Yuchun Fan, Bei Li, Peiguang Li, Yilin Wang, Yongyu Mu, Jian Yang, Xin Chen, Rongxiang Weng, Jingang Wang, Xunliang Cai, JingBo Zhu, Tong Xiao
| Challenge: | Existing methods for enhancing multi-step reasoning have not fully translated to multilingual contexts. |
| Approach: | They propose a framework that leverages language-conditioned hints to guide exploration in non-English reasoning tasks. |
| Outcome: | Empirical results show that the proposed framework improves reasoning performance without compromising language consistency. |