Papers by Yu Zhang
Executing Instructions in Situated Collaborative Interactions (D19-1)
Copied to clipboard
Alane Suhr, Claudia Yan, Jack Schluger, Stanley Yu, Hadi Khader, Marwa Mouallem, Iris Zhang, Yoav Artzi
| Challenge: | a collaborative game with natural language instruction allows users to adapt to the system abilities by changing their language or deciding to accomplish tasks themselves. |
| Approach: | They propose a collaborative game where a user instructs a system to complete tasks, but acts alongside it. |
| Outcome: | The proposed game allows users to adapt to the system abilities by changing their language or deciding to accomplish tasks themselves. |
Product Question Answering in E-Commerce: A Survey (2023.acl-long)
Copied to clipboard
| Challenge: | Product question answering (PQA) aims to automatically provide instant responses to customer’s questions in E-commerce platforms. |
| Approach: | They categorize PQA studies into four problem settings in terms of the form of provided answers. |
| Outcome: | The proposed methods capture the unique challenges of product question answering (PQA) . |
Social Influence Dialogue Systems: A Survey of Datasets and Models For Social Influence Tasks (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing research focuses on task-oriented or open-domain dialogue systems with influence skills. |
| Approach: | They propose to define and introduce a category of social influence dialogue systems that influence users’ cognitive and emotional responses. |
| Outcome: | The proposed system is task-oriented or goal-oriented, but it is not open-domain. |
UniCodec: Unified Audio Codec with Single Domain-Adaptive Codebook (2025.acl-long)
Copied to clipboard
Yidi Jiang, Qian Chen, Shengpeng Ji, Yu Xi, Wen Wang, Chong Zhang, Xianghu Yue, ShiLiang Zhang, Haizhou Li
| Challenge: | Existing neural audio codecs are not capable of handling multi-domain audio data . et al., 2023) integrate speech modality with text-based large language models . |
| Approach: | They propose a unified audio codec with a single codebook to support multi-domain audio data . they propose combining a mix-of-experts strategy and a partitioned domain-adaptive codebook method . |
| Outcome: | The proposed codec outperforms existing codecs on acoustic and semantic representation capabilities. |
Transition-based Neural RST Parsing with Implicit Syntax Features (C18-1)
Copied to clipboard
| Challenge: | Syntax has been a useful source of information for statistical RST discourse parsing. |
| Approach: | They propose an implicit syntax feature extraction approach using hidden-layer vectors extracted from a neural syntax parser. |
| Outcome: | The proposed model with dynamic oracle is competitive with existing models. |
Multimodal Fusion and Coherence Modeling for Video Topic Segmentation (2025.findings-acl)
Copied to clipboard
| Challenge: | Traditional video topic segmentation methods struggle to discern topical transitions . supervised approaches have improved performance on video action or scene segmentation . |
| Approach: | They propose a new task for video topic segmentation that enhances multimodality alignment and fusion by exploring different architectures using Cross-Attention and Mixture of Experts. |
| Outcome: | The proposed model improves on educational videos, in the form of lectures . it combines cross-attention and mixture of experts to strengthen multimodality alignment and fusion . |
Improving Knowledge Graph Completion with Generative Hard Negative Mining (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for knowledge graph completion (KGC) use generative methods with a self-information-enhanced training strategy to generate high-quality negatives. |
| Approach: | They propose to leverage a sequence-to-sequence architecture to generate high-quality hard negatives from the same decoding distributions as the anchor. |
| Outcome: | The proposed method produces high-quality negatives with good hardness and diversity on three KGC benchmarks. |
MTSA: Multi-turn Safety Alignment for LLMs through Multi-round Red-teaming (2025.acl-long)
Copied to clipboard
| Challenge: | Existing jailbreak techniques rely on single-round interactions, pro-Corresponding author. |
| Approach: | They propose a multi-turn safety alignment framework to address the challenge of securing large language models in multi-round interactions. |
| Outcome: | The proposed framework exhibits state-of-the-art attack capabilities while improving safety performance on safety benchmarks. |
When to Trust Tools? Adaptive Tool Trust Calibration For Tool-Integrated Math Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Large reasoning models have performance enhancements but still suffer from shortcomings due to limitations of the underlying language models. |
| Approach: | They propose a framework that allows the model to choose when to trust or ignore the tool results based on the confidence score of generated code blocks. |
| Outcome: | The proposed framework reduces the "Tool Ignored" issue by 4.1% to 7.5%. |
HSDreport: Heart Sound Diagnosis with Echocardiography Reports (2024.findings-emnlp)
Copied to clipboard
Zihan Zhao, Pingjie Wang, Liudan Zhao, Yuchen Yang, Ya Zhang, Kun Sun, Xin Sun, Xin Zhou, Yu Wang, Yanfeng Wang
| Challenge: | Existing methods for heart sound diagnosis are limited to a few fixed categories and do not utilize echocardiography reports, the gold standard in the diagnosis of related diseases. |
| Approach: | They propose a benchmark that mandates the direct utilization of heart sounds obtained from auscultation to predict echocardiography reports. |
| Outcome: | The proposed method outperforms existing methods and existing multimodal LLMs in detecting key abnormalities in heart sounds. |
Interventional Training for Out-Of-Distribution Natural Language Understanding (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for NLU training use only known and single confounders, but in many NLU tasks the confounder can be unknown and multifactorial. |
| Approach: | They propose a method that performs multi-granular intervention with identified multifactorial confounders by using a bottom-up automatic intervention method. |
| Outcome: | The proposed method performs multi-granular intervention with identified multifactorial confounders on three NLU tasks, namely, natural language inference, fact verification and paraphrase identification. |
NL-Debugging: Exploiting Natural Language as an Intermediate Representation for Code Debugging (2025.emnlp-main)
Copied to clipboard
Weiming Zhang, Qingyao Li, Xinyi Dai, Jizheng Chen, Kounianhua Du, Weiwen Liu, Yasheng Wang, Ruiming Tang, Yong Yu, Weinan Zhang
| Challenge: | Early debugging efforts focused on code-level analysis, which often fails when addressing complex programming errors. |
| Approach: | They propose a framework that employs natural language as an intermediate representation to improve code debugging by debuggating at a natural language level. |
| Outcome: | The proposed framework outperforms traditional debugging methods and enables a broader modification space through direct refinement guided by execution feedback. |
ParaSuite: Boosting LLM Reasoning via Paradox Resolution (2026.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks for paradox research focus on checking basic logical consistency and not reflective reasoning. |
| Approach: | They propose a pipeline dedicated to paradox research that automates data synthesis, evaluation, and training. |
| Outcome: | The proposed pipeline improves paradoxical and general STEM reasoning. |
Dual Prompt Tuning based Contrastive Learning for Hierarchical Text Classification (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods focus on hierarchy-aware text feature by exploiting explicit parent-child relationships, resulting in label confusion within each layer. |
| Approach: | They propose a dual-prompt tuning method which emphasizes discrimination among peer labels by performing contrastive learning on each hierarchical layer. |
| Outcome: | The proposed method outperforms existing methods on benchmark datasets and is available on github. |
AIDA-SEAT: Towards Reliable AI Doctor Assistant via State-Evaluation-Action Tree Enhanced LLMs in Online Hospital (2026.acl-industry)
Copied to clipboard
Lianxin Sun, Xiaoying Ying, Guangya Yu, Weiyan Zhang, Chenhao Guan, Hao He, Mingxi Shang, Jianhua Li, ChunMing Wang, Tong Ruan
| Challenge: | Existing systems rely on large language models or retrieval-augmented generation (RAG) but these methods lack the explicit logical pathways essential for multi-step reasoning. |
| Approach: | They propose an AIDA-SEAT framework to provide reliable clinical decision-making support by transforming and modifying medical documents and doctors' state-evaluation-action trees. |
| Outcome: | The proposed framework achieves 1.01% higher than current state-of-the-art (SOTA) baselines across five departments, including common RAG-based methods. |
From Selection to Refinement: Iterative Optimization for Instruction Data (2026.acl-long)
Copied to clipboard
Hang Hu, Ziyan Liu, Rujie Wen, Ruihui Hou, Xueyan Wu, Mu Zhang, Jianxing Yu, Tong Ruan, Jingping Liu
| Challenge: | Existing methods to optimize instruction tuning datasets face two main challenges: unreasonable pruning of potentially valuable low-quality data and the persistence of noise or semantic drift during revision. |
| Approach: | They propose an automated iterative framework for instruction data optimization that prunes low-quality data and refines low quality data using feedback-driven iteration. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on seven public benchmark datasets with high data efficiency. |
SelfORE: Self-supervised Relational Feature Learning for Open Relation Extraction (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for relation extraction use heuristics or distant-supervised annotations, but distant supervised methods make strong assumptions on entity cooccurrence without sufficient contexts. |
| Approach: | They propose a framework that exploits weak, self-supervised signals by leveraging large pretrained language models for adaptive clustering on contextualized relational features. |
| Outcome: | The proposed framework exploits weak, self-supervised signals on open-domain Relation Extraction . it bootstraps the self-supervised signals by improving contextualized features in relation classification . |
SumSurvey: An Abstractive Dataset of Scientific Survey Papers for Long Document Summarization (2024.findings-acl)
Copied to clipboard
| Challenge: | a growing need for long document summarization datasets with 16k input is causing problems. |
| Approach: | They propose to use a dataset to analyze salient information in long document summarizations. |
| Outcome: | The proposed dataset outperforms existing models and LLMs in the distribution form of salient information and the distribution of salinal information is an indicator of quality. |
Improving Long Document Topic Segmentation Models With Enhanced Coherence Modeling (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent supervised neural models have greatly promoted the development of topic segmentation, but the deeper relationship between coherence and topic segmenting is underexplored. |
| Approach: | They propose to use topic-aware Sentence Structure Prediction and Contrastive Semantic Similarity Learning to capture coherence from logical structure and semantic similarity perspectives to further improve topic segmentation performance. |
| Outcome: | The proposed approach outperforms state-of-the-art methods on WIKI-727K and achieves an average relative reduction of 4.3% on Pk on WikiSection. |
Multiscale Collaborative Deep Models for Neural Machine Translation (2020.acl-main)
Copied to clipboard
| Challenge: | Neural machine translation models with deeper neural networks are difficult to train. |
| Approach: | They propose a MultiScale Collaborative framework to boost gradient back-propagation . they let each encoder block learn a fine-grained representation and enhance it . |
| Outcome: | The proposed framework outperforms baseline models on translation tasks with three translation directions and achieves a BLEU score of 30.56 on the English-to-German task. |
Dolphin: Moving Towards Closed-loop Auto-research through Thinking, Practice, and Feedback (2025.acl-long)
Copied to clipboard
Jiakang Yuan, Xiangchao Yan, Bo Zhang, Tao Chen, Botian Shi, Wanli Ouyang, Yu Qiao, Lei Bai, Bowen Zhou
| Challenge: | Recent studies show that AI-assisted research methods can improve research efficiency . a closed-loop framework is used to enhance the automation level of scientific research . |
| Approach: | They propose a closed-loop LLM-driven framework to enhance the automation level of scientific research. |
| Outcome: | The proposed framework improves the efficiency of scientific research by improving data analysis, accelerating computation, and fostering novel idea generation. |
CORD: Bridging the Audio–Text Reasoning Gap via Weighted On-policy Cross-modal Distillation (2026.findings-acl)
Copied to clipboard
Hu Jing, Danxiang Zhu, Xianlong Luo, Dan Zhang, Shuwei He, Yishu Lei, Shikun Feng, Hai-Tao Zheng, Jingzhou HE, Yu Sun, Hua Wu, Haifeng Wang
| Challenge: | Large Audio Language Models (LALMs) exhibit a degradation in knowledge and reasoning capabilities . empirical results show that CORD significantly bridges the audio–text performance gap . |
| Approach: | They propose a framework that performs online cross-modal self-distillation to bridge the acoustic-semantic gap between LALMs and text-based models. |
| Outcome: | The proposed framework bridges the acoustic-semantic gap between LALMs and text-based models . it employs on-policy reverse KL divergence with importance-aware weighting . |
Friend-training: Learning from Models of Different but Related Tasks (2023.eacl-main)
Copied to clipboard
| Challenge: | Current self-training methods focus on improving model performance on a single task. |
| Approach: | They propose a cross-task self-training framework where models trained to do different tasks are used in iterative training, pseudo-labeling, and retraining processes to help each other for better selection of pseudo-labeled labels. |
| Outcome: | The proposed framework achieves the best performance compared to baselines on two dialogue understanding tasks. |
TestNUC: Enhancing Test-Time Computing Approaches and Scaling through Neighboring Unlabeled Data Consistency (2025.acl-long)
Copied to clipboard
Henry Peng Zou, Zhengyao Gu, Yue Zhou, Yankai Chen, Weizhi Zhang, Liancheng Fang, Yibo Wang, Yangning Li, Kay Liu, Philip S. Yu
| Challenge: | Test-time computing approaches that leverage additional computational resources during inference have been proven effective in enhancing large language model performance. |
| Approach: | They propose a linearly scaling approach that leverages local consistency of neighboring unlabeled data to improve test-time predictions. |
| Outcome: | The proposed approach outperforms baseline methods such as prompting and self-consistency across eight datasets and performs robustly across embedding models. |
Retrieval Augmentation for Commonsense Reasoning: A Unified Approach (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for retrieving encyclopedic knowledge lack a large corpus and effective commonsense retriever. |
| Approach: | They propose a framework for retrieval-augmented commonsense reasoning with a large commonsensense corpus and a commonseense retriever. |
| Outcome: | The proposed framework outperforms existing methods on commonsense reasoning tasks. |
ESGenius: Benchmarking LLMs on Environmental, Social, and Governance (ESG) and Sustainability Knowledge (2025.emnlp-main)
Copied to clipboard
Chaoyue He, Xin Zhou, Yi Wu, Xinjia Yu, Yan Zhang, Lei Zhang, Di Wang, Shengfei Lyu, Hong Xu, Wang Xiaoqiao, Wei Liu, Chunyan Miao
| Challenge: | ESGenius is a comprehensive benchmark for evaluating Large Language Models on ESG and sustainability knowledge. |
| Approach: | They introduce ESGenius, a benchmark for evaluating and enhancing ESG proficiency . they use a rigorous two-stage evaluation protocol and a repository of foundational frameworks . |
| Outcome: | ESGenius is a benchmark for evaluating and enhancing the proficiency of Large Language Models (LLMs) in ESG and sustainability-focused question answering. |
RSMeM: Knowledge-Enhanced Memory Evolution for Remote Sensing Agents with Systematic Evaluation (2026.acl-long)
Copied to clipboard
Bingxian Wu, Yu Zhang, Zonghao Guo, Tang Liu, Chen Qian, Yuxiang Lu, Xingbo Du, Yanghao Li, Yidan Zhang, Chi Chen, Ling Yao, Chenghu Zhou, Maosong Sun
| Challenge: | Existing RS agents built on general-purpose LLMs are domain-agnostic, resulting in brittle and error-prone workflows. |
| Approach: | They propose a knowledge-enhanced memory evolution mechanism that bootstraps RS agents with pre-distilled domain knowledge and iteratively integrates online experience for robust multi-step tool execution. |
| Outcome: | Experiments show that the new model improves tool-use performance and accuracy . iteratively, iteration of the model integrates online experience for robust multi-step tool execution . |
Patton: Language Model Pretraining on Text-Rich Networks (2023.acl-long)
Copied to clipboard
| Challenge: | Existing models for text-rich networks do not take inter-document structure into account. |
| Approach: | They propose a pretraining framework for a text-rich network using a masked language model and a masking node prediction framework. |
| Outcome: | The proposed model outperforms baselines on four tasks in academic and e-commerce domains. |
MusicAgent: An AI Agent for Music Understanding and Generation with Large Language Models (2023.emnlp-demo)
Copied to clipboard
| Challenge: | MusicAgent integrates numerous music-related tools and an autonomous workflow to address user requirements. |
| Approach: | a new system is built to integrate music-related tools and an autonomous workflow . the system is based on large language models (LLMs) that can be used to organize and decompose requests . |
| Outcome: | the proposed system integrates numerous music-related tools and an autonomous workflow to address user requirements. |
SecFormer: Fast and Accurate Privacy-Preserving Inference for Transformer Models via SMPC (2024.findings-acl)
Copied to clipboard
| Challenge: | a growing number of cloud-based inference services are relying on SMPC to protect data privacy. |
| Approach: | They propose a framework for Privacy-Preserving Inference for Transformer models that eliminates exponential and maximum operations in PPI without sacrificing model performance. |
| Outcome: | The proposed framework outperforms MPCFormer in terms of performance and efficiency . it is 3.57 and 3.58 times faster than PUMA for BERTBASE and BERTLARGE . |
Exploring Diverse Expressions for Paraphrase Generation (D19-1)
Copied to clipboard
| Challenge: | Existing neural paraphrase generation methods focus on single paraphrases while ignoring the fact that diversity is essential for enhancing generalization capability and robustness of downstream applications. |
| Approach: | They propose a novel approach with two discriminators and multiple generators to generate a variety of different paraphrases. |
| Outcome: | The proposed model gains significant diversity and improves quality over state-of-the-art datasets. |
LLMs Assist NLP Researchers: Critique Paper (Meta-)Reviewing (2024.emnlp-main)
Copied to clipboard
Jiangshu Du, Yibo Wang, Wenting Zhao, Zhongfen Deng, Shuaiqi Liu, Renze Lou, Henry Zou, Pranav Narayanan Venkit, Nan Zhang, Mukund Srinath, Haoran Zhang, Vipul Gupta, Yinghui Li, Tao Li, Fei Wang, Qin Liu, Tianlin Liu, Pengzhi Gao, Congying Xia, Chen Xing, Cheng Jiayang, Zhaowei Wang, Ying Su, Raj Shah, Ruohao Guo, Jing Gu, Haoran Li, Kangda Wei, Zihao Wang, Lu Cheng, Surangika Ranathunga, Meng Fang, Jie Fu, Fei Liu, Ruihong Huang, Eduardo Blanco, Yixin Cao, Rui Zhang, Philip Yu, Wenpeng Yin
| Challenge: | a comparative analysis of paper (meta-)reviews by large language models (LLMs) aims to identify and distinguish LLMs from human activities . |
| Approach: | They present a comparative analysis to identify and distinguish LLM activities from human activities. |
| Outcome: | The proposed analysis aims to improve recognition of instances when someone implicitly uses LLMs for reviewing activities. |
Automatic Label Sequence Generation for Prompting Sequence-to-sequence Models (2022.coling-1)
Copied to clipboard
| Challenge: | Prompting has shown to be sample efficient compared to fine-tuning with pre-trained models. |
| Approach: | They propose a fully automatic prompting method that uses natural language prompts on sequence-to-sequence models and a beam search method to generate a large amount of label sequence candidates. |
| Outcome: | The proposed method significantly outperforms other no-manual-design methods on single label words and generates large amount of label sequence candidates. |
Leveraging Unit Language Guidance to Advance Speech Modeling in Textless Speech-to-Speech Translation (2025.findings-acl)
Copied to clipboard
Yuhao Zhang, Xiangnan Ma, Kaiqi Kou, Peizhuo Liu, Weiqiao Shan, Benyou Wang, Tong Xiao, Yuxin Huang, Zhengtao Yu, JingBo Zhu
| Challenge: | Existing textless speech-to-speech translation models have two main challenges: 1) learning cross-modal features and 2) learning alignment of difference languages in long sequences. |
| Approach: | They propose a unit language to overcome two main modeling challenges . they propose task prompt modeling to utilize the unit language in guiding the modeling process. |
| Outcome: | The proposed language improves over a strong baseline and achieves comparable performance to models trained with text. |
Hierarchical Memory Organization for Wikipedia Generation (2025.acl-long)
Copied to clipboard
Eugene J. Yu, Dawei Zhu, Yifan Song, Xiangyu Wong, Jiebin Zhang, Wenxuan Shi, Xiaoguang Li, Qun Liu, Sujian Li
| Challenge: | Existing methods for generating Wikipedia articles do not utilize memory directly for outline generation. |
| Approach: | They propose a method to generate Wikipedia articles autonomously by leveraging a hierarchical memory architecture. |
| Outcome: | The proposed framework outperforms baseline methods in producing informative and reliable articles. |
From Alignment to Entailment: A Unified Textual Entailment Framework for Entity Alignment (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods encode the triples of entities as embeddings and learn to align the embeddables, which prevents the direct interaction between the original information of the cross-KG entities. |
| Approach: | They propose to transform the triples into unified textual sequences and model the EA task as a bi-directional textual entailment task between the sequences of cross-KG entities. |
| Outcome: | The proposed approach outperforms the state-of-the-art methods on five cross-lingual datasets and allows the mutual enhancement of the heterogeneous information. |
Pre-training Multi-task Contrastive Learning Models for Scientific Literature Understanding (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Pre-trained language models (LMs) have shown effectiveness in literature understanding tasks, especially when tuned via contrastive learning. |
| Approach: | They propose a multi-task contrastive learning framework that enables common knowledge sharing across different scientific literature understanding tasks while preventing task-specific skills from interfering with each other. |
| Outcome: | The proposed framework outperforms state-of-the-art pre-trained language models on a comprehensive dataset. |
What Makes AI Research Replicable? Executable Knowledge Graphs as Scientific Knowledge Representations (2026.acl-short)
Copied to clipboard
Yujie Luo, Zhuoyun Yu, Xuehai Wang, Yuqi Zhu, Ningyu Zhang, Lanning Wei, Lun Du, Da Zheng, Huajun Chen
| Challenge: | Existing approaches to replicate AI research are limited by insufficient background knowledge and the limitations of retrieval-augmented generation methods. |
| Approach: | They propose a pluggable, paper-centric knowledge base that integrates code snippets and technical insights extracted from scientific literature into a verifiable, executable representation. |
| Outcome: | The proposed knowledge base shows significant performance gains on paperBench when integrated into three agent frameworks with two different LLMs. |
Recall with Reasoning: Chain-of-Thought Distillation for Mamba’s Long-Context Memory and Extrapolation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing long-context memory methods such as Mamba struggle with long-constituency when the length of the processed text exceeds the model's training length. |
| Approach: | They propose a method that uses chain-of-thought summarization to teach Mamba to actively recall and reason over long contexts. |
| Outcome: | Experiments on LONGMEMEVAL and HELMET show that RwR outperforms existing long-term memory methods while preserving short-context capabilities. |
Norm-based Noisy Corpora Filtering and Refurbishing in Neural Machine Translation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing noisy corpora filtering methods are insufficient to solve this problem, requiring multiple scorers trained on clean bitexts. |
| Approach: | They propose to use the information ratio from the source to the target side to distinguish unparallel sentence pairs by using norms of context vectors. |
| Outcome: | The proposed method performs comparably with state-of-the-art noisy corpora filtering techniques but is more efficient and easier to operate. |
How Alignment and Jailbreak Work: Explain LLM Safety through Intermediate Hidden States (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) rely on safety alignment to avoid malicious user inputs. |
| Approach: | They employ weak classifiers to explain LLM safety through the intermediate hidden states. |
| Outcome: | The proposed model can identify malicious and normal inputs and detect malicious ones without jailbreak. |
DocAssistant: Integrating Key-region Reading and Step-wise Reasoning for Robust Document Visual Question Answering (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing document understanding models focus on key information and generate answers straightforwardly . existing models ignore evidence from source documents and lack interpretability . |
| Approach: | They propose a visual encoder that fuses text into visual encoded visual encodes . they use multimodal large language models as data generators and checkers to generate step-wise question-and-answer pairs for document images. |
| Outcome: | The proposed model can answer step-wise questions without compromising the performance of the original model. |
Hierarchical Acoustic-Semantic Modeling: Modality Separation and Semantic Coherence for Full-Duplex SLMs (2026.acl-long)
Copied to clipboard
Zhenyu Liu, Xuanyu Zhang, Yunxin li, Qixun Teng, Shenyuan Jiang, Haolan Chen, Mingjun Zhao, Fanbo Meng, Yu Xu, Yancheng He, Baotian Hu, Haizhou Li, Min Zhang
| Challenge: | despite significant progress, full-duplex SLMs are constrained by severe modality interference, authors say . modality interferes with acoustic and semantic modeling, making them unintelligent and unnatural . authors propose a hierarchical parameter separation strategy that decouples conflicting modalities in deep layers . |
| Approach: | They propose a hierarchical parameter separation strategy that decouples conflicting modalities in deep layers while preserving cross-modality coherence via a dedicated semantic alignment channel. |
| Outcome: | The proposed method significantly advances the state of the art on full-duplex benchmarks . it decouples conflicting modalities in deep layers while preserving cross-modality coherence . |
Domain Generalization via Switch Knowledge Distillation for Robust Review Representation (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing models for review representations of unseen or anonymous users are limited by their in-domain nature. |
| Approach: | They propose to use in-domain user and product information to generalize reviews . they use switch knowledge distillation to learn review representations for unseen users . |
| Outcome: | The proposed model performs well for existing or anonymous unseen users. |
Exophoric Pronoun Resolution in Dialogues with Topic Regularization (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on pronoun coreference resolution focus on anaphora and cataphores . exophoric pronounos are common in daily communications, but can be disambiguated by general topics of the dialogue. |
| Approach: | They propose to leverage local context and global topics of dialogues to solve out-of-text PCR problem by adding topic regularization. |
| Outcome: | Extensive experiments show that topic regularization can be used to solve the out-of-text PCR problem. |
FOLIO: Natural Language Reasoning with First-Order Logic (2024.emnlp-main)
Copied to clipboard
Simeng Han, Hailey Schoelkopf, Yilun Zhao, Zhenting Qi, Martin Riddell, Wenfei Zhou, James Coady, David Peng, Yujie Qiao, Luke Benson, Lucy Sun, Alexander Wardle-Solano, Hannah Szabó, Ekaterina Zubova, Matthew Burtell, Jonathan Fan, Yixin Liu, Brian Wong, Malcolm Sailor, Ansong Ni, Linyong Nan, Jungo Kasai, Tao Yu, Rui Zhang, Alexander Fabbri, Wojciech Kryscinski, Semih Yavuz, Ye Liu, Xi Lin, Shafiq Joty, Yingbo Zhou, Caiming Xiong, Rex Ying, Arman Cohan, Dragomir Radev
| Challenge: | Existing benchmarks for logical reasoning in large language models lack language naturalness or limited complexity. |
| Approach: | They propose to use first-order logic annotations to evaluate logical reasoning capabilities of large language models. |
| Outcome: | The proposed dataset evaluates the FOL reasoning ability of supervised fine-tuning on medium-sized language models. |
MedQA-CS: Objective Structured Clinical Examination (OSCE)-Style Benchmark for Evaluating LLM Clinical Skills (2026.eacl-long)
Copied to clipboard
Zonghai Yao, Zihao Zhang, Chaolong Tang, Xingyu Bian, Youxia Zhao, Zhichao Yang, Junda Wang, Huixue Zhou, Won Seok Jang, Feiyun Ouyang, Hong Yu
| Challenge: | Current clinical LLM benchmarks fail to evaluate advanced clinical skills in AI and large language models (LLMs). |
| Approach: | They propose a framework to evaluate large language models (LLMs) using two instruction-following tasks designed to reflect real clinical scenarios. |
| Outcome: | The proposed framework evaluates LLMs through two instruction-following tasks designed to reflect real clinical scenarios. |
MenatQA: A New Dataset for Testing the Temporal Comprehension and Reasoning Abilities of Large Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) have shown nearly saturated performance on many NLP tasks. |
| Approach: | They construct multiple sensitive factors time QA which encompasses three temporal factors . they test current mainstream LLMs with different parameter sizes . |
| Outcome: | The proposed model incorporates three temporal factors with 2,853 samples . the results show that LLMs fall behind smaller models on these factors . |
Pre-training Language Models for Comparative Reasoning (2023.emnlp-main)
Copied to clipboard
| Challenge: | Comparative reasoning is a process of comparing objects, concepts, or entities to draw conclusions. |
| Approach: | They propose a framework to pre-train language models for enhancing comparative reasoning abilities . they collect scalable data for text-based entity comparison . |
| Outcome: | The proposed framework significantly improves comparative reasoning abilities under low-resource conditions on downstream tasks. |
FLAIR: Steering LLM Mathematical Problem Solving based on A Fuzzy-Logic-AssIsted Reasoner (2026.acl-long)
Copied to clipboard
Hao Wu, Hongru Sun, Wanqing Li, Xinguo Yu, Hao Ming, Xiao Luo, Wenbin Zhang, Jiahong Zhao, Yi Guo, Jie Yang
| Challenge: | Existing approaches to mathematical reasoning rely on static heuristics or pre-determined reasoning strategies. |
| Approach: | They propose an adaptive framework that integrates fuzzy theory into LLM-based mathematical reasoning. |
| Outcome: | The proposed framework outperforms state-of-the-art models while offering effective and interpretable diagnostics of intermediate problem-solving states. |
Native Hybrid Attention for Efficient Sequence Modeling (2026.acl-long)
Copied to clipboard
| Challenge: | Experimental results show that NHA surpasses Transformers on recall-intensive tasks. |
| Approach: | They propose a hybrid architecture of linear and full attention that integrates both into a unified layer design. |
| Outcome: | The proposed architecture surpasses Transformers and other hybrid baselines on recall-intensive and commonsense reasoning tasks. |
Resource-Limited Joint Multimodal Sentiment Reasoning and Classification via Chain-of-Thought Enhancement and Distillation (2026.findings-acl)
Copied to clipboard
| Challenge: | Current approaches for Multimodal Sentiment Analysis (MSA) rely on parameter-heavy LLMs for classification, overlooking multimodal sentiment reasoning generation in resource-limited environments. |
| Approach: | They propose a multimodal sentiment reasoning distillation model that employs a teacher-assistant-student paradigm to address deployment constraints in resource-limited environments. |
| Outcome: | The proposed model performs well on a resource-limited JMSRC task with only 3B parameters and shows generalization and interpretability. |
Memory Consolidation for Contextual Spoken Language Understanding with Dialogue Logistic Inference (P19-1)
Copied to clipboard
| Challenge: | Existing models for SLU use explicit memory representations, but the context memory is under-exploited. |
| Approach: | They propose a dialogue logistic inference task to consolidate the context memory with SLU in a multi-task framework. |
| Outcome: | The proposed model improves slot filling and domain classification performance in a multi-task framework. |
CoE-SQL: In-Context Learning for Multi-Turn Text-to-SQL with Chain-of-Editions (2024.naacl-long)
Copied to clipboard
| Challenge: | Recent studies have demonstrated that Large Language Models (LLMs) have impressive capabilities in a variety of domains and tasks. |
| Approach: | They propose a method which prompts LLMs to generate SQL queries based on the previously generated SQL query with an edition chain. |
| Outcome: | The proposed method outperforms different in-context learning baselines and achieves state-of-the-art performance on two benchmarks SParC and CoSQL using LLMs. |
STARS: A Unified Framework for Singing Transcription, Alignment, and Refined Style Annotation (2025.findings-acl)
Copied to clipboard
Wenxiang Guo, Yu Zhang, Changhao Pan, Zhiyuan Zhu, Ruiqi Li, ZheTao Chen, Wenhao Xu, Fei Wu, Zhou Zhao
| Challenge: | Existing automated singing annotation (ASA) methods tackle isolated aspects of the annotation pipeline. |
| Approach: | They propose a framework that addresses transcription, alignment, and refined style annotations. |
| Outcome: | The proposed framework delivers comprehensive multi-level annotations encompassing: (1) precise phoneme-audio alignment, (2) robust note transcription and temporal localization, (3) expressive vocal technique identification, and (4) global stylistic characterization including emotion and pace. |
The Impact of Reasoning Step Length on Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Long reasoning steps in LLMs improve reasoning abilities, but the correlation between their effectiveness and the length of reasoning steps remains largely unknown. |
| Approach: | They conducted experiments that expand and compress the rationale reasoning steps within CoT demonstrations while keeping all other factors constant. |
| Outcome: | The results show that lengthening the reasoning steps in prompts significantly enhances LLMs’ reasoning abilities across multiple datasets. |
RAGEval: Scenario Specific RAG Evaluation Dataset Generation Framework (2025.acl-long)
Copied to clipboard
Kunlun Zhu, Yifan Luo, Dingling Xu, Yukun Yan, Zhenghao Liu, Shi Yu, Ruobing Wang, Shuo Wang, Yishan Li, Nan Zhang, Xu Han, Zhiyuan Liu, Maosong Sun
| Challenge: | Existing evaluation metrics for RAG systems are lacking due to high costs of data construction and lack of factual accuracy. |
| Approach: | They propose a framework to evaluate RAG systems in specialized scenarios . they propose three new metrics to evaluate LLM-generated responses . |
| Outcome: | The proposed framework outperforms zero-shot and one-shot methods in terms of clarity, safety, conformity, and richness of generated samples. |
CodeFlowBench: A Multi-turn, Iterative Benchmark for Complex Code Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Modern software development demands code that is maintainable, testable, and scalable by organizing the implementation into modular components with iterative reuse of existing codes. |
| Approach: | They propose a benchmark to evaluate LLMs' ability to perform codeflow by reusing existing functions over multiple turns. |
| Outcome: | The proposed benchmarks show that LLMs perform significantly worse in multi-turn codeflow scenarios and that their performance inversely correlates with dependency complexity. |
BANER: Boundary-Aware LLMs for Few-Shot Named Entity Recognition (2025.coling-main)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) is a fundamental task in Natural Language Processing (NLP) that aims to detect the entity spans of text and classify them into pre-defined set of entity types. |
| Approach: | They propose a boundary-aware contrastive learning strategy to enhance the LLM’s ability to perceive entity boundaries for generalized entity spans. |
| Outcome: | The proposed framework outperforms prior methods and validates its effectiveness across a range of LLM architectures. |
PaddleSpeech: An Easy-to-Use All-in-One Speech Toolkit (2022.naacl-demo)
Copied to clipboard
Hui Zhang, Tian Yuan, Junkun Chen, Xintong Li, Renjie Zheng, Yuxin Huang, Xiaojie Chen, Enlei Gong, Zeyu Chen, Xiaoguang Hu, Dianhai Yu, Yanjun Ma, Liang Huang
| Challenge: | PaddleSpeech is an open-source speech toolkit that supports speech-to-text and text-to speech tasks. |
| Approach: | They describe the design philosophy and core architecture of PaddleSpeech to support several essential speech-to-text and text-to speech tasks. |
| Outcome: | The proposed framework achieves competitive or state-of-the-art performance on various speech datasets and implements the most popular methods. |
ProvBench: A Benchmark of Legal Provision Recommendation for Contract Auto-Reviewing (2025.acl-long)
Copied to clipboard
Xiuxuan Shen, Zhongyuan Jiang, Junsan Zhang, Junxiao Han, Yao Wan, Chengjie Guo, Bingcheng Liu, Jie Wu, Renxiang Li, Philip S. Yu
| Challenge: | Contract review is labor-intensive, time-consuming, and costly . a benchmark is proposed to detect potential legal conflicts . |
| Approach: | They propose a benchmark for legal provision recommendation and conflict detection for contract auto-reviewing which aims to recommend the legal provisions related to contract clauses and detect possible legal conflicts. |
| Outcome: | The proposed task recommends legal provisions related to contract clauses and detects legal conflicts. |
Legal Mathematical Reasoning with LLMs: Procedural Alignment through Two-Stage Reinforcement Learning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing legal mathematical reasoning models lack structured numerical reasoning . existing models perform poorly on LexNum, while LexPam improves both mathematical accuracy and legal coherence. |
| Approach: | They propose a legal mathematical reasoning benchmark LexNum and LexPam to address this problem . LexPam is a two-stage reinforcement learning framework for efficient legal reasoning training. |
| Outcome: | The proposed framework improves mathematical accuracy and legal coherence . it also improves legal cohesion and generalizes effectively across tasks and domains. |
Doc-React: Multi-page Heterogeneous Document Question-answering (2025.acl-short)
Copied to clipboard
Junda Wu, Yu Xia, Tong Yu, Xiang Chen, Sai Sree Harsha, Akash V Maharaj, Ruiyi Zhang, Victor Bursztyn, Sungchul Kim, Ryan A. Rossi, Julian McAuley, Yunyao Li, Ritwik Sinha
| Challenge: | Existing methods for integrating information across multiple modalities are suboptimal for multi-page, multimodal documents. |
| Approach: | They propose an adaptive iterative framework that balances information gain and uncertainty reduction at each step. |
| Outcome: | The proposed framework captures relevant multimodal content and achieves strong performance on complex QA tasks. |
Subgraph Retrieval Enhanced Model for Multi-hop Knowledge Base Question Answering (2022.acl-long)
Copied to clipboard
| Challenge: | Existing retrieval methods for knowledge base question answering are either heuristic or interwoven with the reasoning, causing reasoning on the partial subgraphs. |
| Approach: | They propose a subgraph retrieval framework that decouples the retrieval from the subsequent reasoning process and trains subgraphs for easier reasoning. |
| Outcome: | The proposed framework improves retrieval and QA performance over existing methods. |
CachePrune: Teaching LLMs What Not to Follow via KV-Cache Editing (2026.acl-long)
Copied to clipboard
Rui Wang, Junda Wu, Yu Xia, Tong Yu, Ruiyi Zhang, Ryan A. Rossi, Subrata Mitra, Lina Yao, Julian McAuley
| Challenge: | Existing Large Language Models exhibit critical vulnerability to indirect prompt injection attacks, where instructions injected within in the prompt context can override the user's intent. |
| Approach: | They propose a neural pruning algorithm that prunes neurons associated with instruction-following during KV cache encoding of the prompt context. |
| Outcome: | The proposed approach significantly reduces the attack success rate while preserving the model's ability to follow user instructions. |
IOPO: Empowering LLMs with Complex Instruction Following via Input-Output Preference Optimization (2025.acl-long)
Copied to clipboard
| Challenge: | Existing algorithms to improve the ability of LLMs to follow complex instructions are lacking. |
| Approach: | They propose a benchmark to improve the ability to follow complex instructions by using a IOPO alignment method to take input and output preference into consideration. |
| Outcome: | The proposed algorithm shows 8.15%, 2.18% improvements on in-domain data and 5.91%, 2.83% on out-of-domain datasets compared to SFT and DPO respectively. |
Uncertainty-Aware Routing for Principled Alignment with MoE Dynamics (2026.acl-long)
Copied to clipboard
Yilong Chen, Junyuan Shang, Yuchen Feng, Zhenyu Zhang, Naibin Gu, Ziqi Wang, Tingwen Liu, Shuohuan Wang, Yu Sun, Hua Wu, Haifeng Wang
| Challenge: | Mixture-of-Experts (MoE) is a cornerstone for scaling LLMs, yet its training dynamics remain poorly understood, often leading to sub-optimal specialization. |
| Approach: | They propose to use Helmholtz Free Energy and Router Entropy to study the MoE lifecycle and identify a universal Three-Stage Phase Transition . |
| Outcome: | The proposed model reduces perplexity and improves expert distinctiveness, offering a principled path toward thermodynamically aligned computation. |
Text Fluoroscopy: Detecting LLM-Generated Text through Intrinsic Features (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have revolutionized the field of natural language processing because of their excellent performance on various tasks. |
| Approach: | They propose a black-box method with better generalizability for detecting LLM-generated text by mining the intrinsic features of the text to be detected. |
| Outcome: | The proposed method achieves 7.36% and 2.84% improvement in detection performance compared to baselines in detecting texts from different domains generated by GPT-4 and Claude3 respectively. |
MultiCMET: A Novel Chinese Benchmark for Understanding Multimodal Metaphor (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing research on multimodal metaphors does not address categorizing the source and target domains in metaphors beyond the English language. |
| Approach: | They propose a Cascading Domain Knowledge Integration benchmark to detect metaphors by introducing domain-specific lexical features. |
| Outcome: | The proposed dataset includes 13,820 text-image pairs of advertisements with manual annotations of the occurrence of metaphors, domain categories, and sentiments metaphors convey. |
ScalingFilter: Assessing Data Quality through Inverse Utilization of Scaling Laws (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing quality filtering methods rely on a high-quality dataset as reference . Existing methods introduce potential biases and compromise diversity . |
| Approach: | They propose a method that evaluates text quality based on the perplexity difference between two language models trained on the same data. |
| Outcome: | The proposed approach improves performance of pre-trained models without increasing training costs. |
Event Semantic Classification in Context (2024.findings-eacl)
Copied to clipboard
| Challenge: | In this work, we focus on the semantic classification of events in context to help machines gain a deeper understanding of events. |
| Approach: | They propose to integrate event semantics into downstream tasks to help machines understand events better. |
| Outcome: | The proposed model improves the understanding of events in context. |
Rethinking Cooperative Rationalization: Introspective Extraction and Complement Control (D19-1)
Copied to clipboard
| Challenge: | Selective rationalization is a common mechanism to ensure that predictive models reveal how they use any available features. |
| Approach: | They propose a co-operative method which uses introspection to explicitly predict and incorporate the outcome into the selection process. |
| Outcome: | The proposed model maintains high predictive accuracy and leads to comprehensive rationales. |
CLOMO: Counterfactual Logical Modification with Large Language Models (2024.acl-long)
Copied to clipboard
Yinya Huang, Ruixin Hong, Hongming Zhang, Wei Shao, Zhicheng Yang, Dong Yu, Changshui Zhang, Xiaodan Liang, Linqi Song
| Challenge: | Existing studies on evaluating model reasoning are limited in both form and content. |
| Approach: | They propose a task to cultivate counterfactual thought processes within large language models and an evaluation metric to evaluate their natural language output instead of modeling the task as a multiple-choice problem. |
| Outcome: | The proposed evaluation metric aligns well with human preference. |
OpenHuEval: Evaluating Large Language Model on Hungarian Specifics (2025.findings-acl)
Copied to clipboard
Haote Yang, Xingjian Wei, Jiang Wu, Noémi Ligeti-Nagy, Jiaxing Sun, Yinfan Wang, Győző Zijian Yang, Junyuan Gao, Jingchao Wang, Bowen Jiang, Shasha Wang, Nanjun Yu, Zihao Zhang, Shixin Hong, Hongwei Liu, Wei Li, Songyang Zhang, Dahua Lin, Lijun Wu, Gábor Prószéky, Conghui He
| Challenge: | Recent advances in Large Language Models (LLMs) represent significant strides toward artificial general intelligence (AGI). |
| Approach: | They introduce OpenHuEval, the first benchmark for LLMs focusing on the Hungarian language and specifics. |
| Outcome: | The framework reveals intrinsic patterns and mechanisms of LLMs in non-English languages, with Hungarian serving as an example. |
Topology-of-Question-Decomposition: Enhancing Large Language Models with Information Retrieval for Knowledge-Intensive Tasks (2025.coling-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) are constrained to chaining immediate reasoning steps and relying solely on parametric knowledge. |
| Approach: | They propose a framework that activates retrieval only when necessary to improve answer accuracy. |
| Outcome: | Experiments show that the proposed framework improves performance in knowledge-intensive tasks. |
Leveraging Dependency Forest for Neural Medical Relation Extraction (D19-1)
Copied to clipboard
| Challenge: | Existing methods for medical relation extraction use dependency syntax as a source of features. |
| Approach: | They propose a method to extract relational information from medical literature by using dependency forests. |
| Outcome: | The proposed method outperforms the standard tree-based methods in the medical domain. |
Self-Debiasing Large Language Models: Zero-Shot Recognition and Reduction of Stereotypes (2025.naacl-short)
Copied to clipboard
Isabel O. Gallegos, Ryan Aponte, Ryan A. Rossi, Joe Barrow, Mehrab Tanjim, Tong Yu, Hanieh Deilamsalehy, Ruiyi Zhang, Sungchul Kim, Franck Dernoncourt, Nedim Lipka, Deonna Owens, Jiuxiang Gu
| Challenge: | Large language models exhibit harmful social biases, but they are often difficult to train and modify. |
| Approach: | They leverage the zero-shot capabilities of large language models to reduce stereotyping . they introduce a technique called zero- shot self-debiasing to reduce bias . |
| Outcome: | The proposed technique reduces stereotyping across nine different social groups while relying on the LLM itself and a simple prompt. |
Task-Oriented Dialogue as Dataflow Synthesis (2020.tacl-1)
Copied to clipboard
Jacob Andreas, John Bufe, David Burkett, Charles Chen, Josh Clausman, Jean Crawford, Kate Crim, Jordan DeLoach, Leah Dorner, Jason Eisner, Hao Fang, Alan Guo, David Hall, Kristin Hayes, Kellie Hill, Diana Ho, Wendy Iwaszuk, Smriti Jha, Dan Klein, Jayant Krishnamurthy, Theo Lanman, Percy Liang, Christopher H. Lin, Ilya Lintsbakh, Andy McGovern, Aleksandr Nisnevich, Adam Pauls, Dmitrij Petters, Brent Read, Dan Roth, Subhro Roy, Jesse Rusak, Beth Short, Div Slomin, Ben Snyder, Stephon Striplin, Yu Su, Zachary Tellman, Sam Thomson, Andrei Vorobev, Izabela Witoszko, Jason Wolfe, Abby Wray, Yuchen Zhang, Alexander Zotov
| Challenge: | Existing approaches to task-oriented dialogue represent dialogue state as a dataflow graph . microsoft's SMCalFlow dataset features complex dialogues about events, weather, places, and people . |
| Approach: | They propose a dataflow graph-based dialogue agent that maps each user utterance to a program that extends this graph. |
| Outcome: | The proposed framework improves representability and predictability in natural dialogues . it uses dataflow graphs and metacomputation to map user intents to a program . |
CoCo: Coherence-Enhanced Machine-Generated Text Detection Under Low Resource With Contrastive Learning (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent proposed methods fail to consider the linguistic structure of texts and lack the ability to handle the low-resource problem. |
| Approach: | They propose a coherence-based contrastive learning model named CoCo to detect MGTs under low-resource scenario. |
| Outcome: | The proposed model outperforms state-of-the-art methods on two datasets and two self-constructed datasets. |
Fact-and-Reflection (FaR) Improves Confidence Calibration of Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on the confidence calibration of LLMs have not explored the effects of different prompting strategies on LLM performance. |
| Approach: | They propose Fact-and-Reflection prompting which improves LLM confidence calibration . they propose to use human cognition to elicit known "facts" and ask model to "reflect" over them . |
| Outcome: | The proposed method lowers the expected calibration error by 23.5% on multi-purpose QA tasks. |
ShifCon: Enhancing Non-Dominant Language Capabilities with a Shift-based Multilingual Contrastive Framework (2025.acl-long)
Copied to clipboard
Hengyuan Zhang, Chenming Shang, Sizhe Wang, Dongdong Zhang, Yiyao Yu, Feng Yao, Renliang Sun, Yujiu Yang, Furu Wei
| Challenge: | Experiments show that ShifCon significantly enhances the performance of non-dominant languages due to the imbalance in training data across languages. |
| Approach: | They propose a Shift-based multilingual Contrastive framework that aligns the internal forward process of other languages toward that of the dominant one. |
| Outcome: | The proposed framework significantly improves performance of non-dominant languages, particularly for low-resource ones. |
ChartVerse: Scaling Chart Reasoning via Reliable Programmatic Synthesis from Scratch (2026.acl-long)
Copied to clipboard
Zheng Liu, Honglin Lin, Xiaoyang Wang, Xin Gao, Yu Li, Mengzhang Cai, Yun Zhu, Zhanping Zhong, Qizhi Pei, Zhuoshi Pan, Xiaoran Shang, Conghui He, Bin Cui, Wentao Zhang, Lijun Wu
| Challenge: | Existing open-source vision language models lack high-quality training data for chart reasoning . current models are simplistic and repetitive, while associated QA pairs are prone to hallucinations . |
| Approach: | They propose a framework to synthesize complex charts and reliable reasoning data from scratch. |
| Outcome: | Experimental results show that ChartVerse-8B surpasses existing models in QA and difficulty . lack of high-quality training data hampers development of open-source models . |
Detecting Emotional Incongruity of Sarcasm by Commonsense Reasoning (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for sarcasm detection lack commonsense inferential ability when faced with complex situations. |
| Approach: | They propose a commonsense reasoning framework for sarcasm detection based on commonsensense augmentation to supplement commonsence knowledge and infer the incongruity. |
| Outcome: | The proposed framework is able to detect sarcasm in five datasets and is robust to complex scenarios. |
Privacy in Action: Towards Realistic Privacy Mitigation and Evaluation for LLM-Powered Agents (2025.findings-emnlp)
Copied to clipboard
Shouju Wang, Fenglin Yu, Xirui Liu, Xiaoting Qin, Jue Zhang, Qingwei Lin, Dongmei Zhang, Saravan Rajmohan
| Challenge: | Existing benchmarks for privacy performance of LLM agents are limited to static, simplified scenarios. |
| Approach: | They propose a model-agnostic, contextual integrity based mitigation approach that effectively reduces privacy leakage from 36.08% to 7.30% on DeepSeek-R1 and from 33.06% to 8.32% on GPT-4o. |
| Outcome: | The proposed approach reduces privacy leakage from 36.08% to 7.30% on DeepSeek-R1 and from 33.06% to 8.32% on GPT-4o while preserving task helpfulness. |
Self-Powered LLM Modality Expansion for Large Speech-Text Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models exhibit remarkable performance across diverse tasks . however, these methods require significant resource demands and tend to overfit specific tasks. |
| Approach: | They propose a self-powered LSM that leverages augmented automatic speech recognition data generated by the model itself for more effective instruction tuning. |
| Outcome: | The proposed model mitigates speech anchor bias and improves the fusion of speech and text modalities in large language models. |
One Cognitive Loop Is Enough: SODA unlocks Pure-Text Spatial Reasoning in Large Language Models (2026.acl-long)
Copied to clipboard
Shunwen Bai, Jiahuan Zhang, Haoran Huang, Yurun Wang, Jiale Liu, Yanxi Wu, Ningzhe Yu, Yudong Gao, Mingjun Cheng
| Challenge: | Existing large language models (LLMs) lack visual input, leading to errors in basic numerical comparisons. |
| Approach: | They propose a spatial OODA framework that integrates the OODAC cognitive loop into multiple control tasks and integrates it into LLMs. |
| Outcome: | The proposed model significantly improves the spatial reasoning capabilities of large language models across multiple scenarios including SPOD-Bench, SPACE and applications. |
ROSE: A Reward-Oriented Data Selection Framework for LLM Task-Specific Instruction Tuning (2025.findings-emnlp)
Copied to clipboard
Yang Wu, Huayi Zhang, Yizheng Jiao, Lin Ma, Xiaozhong Liu, Jinhong Yu, Dongyu Zhang, Dezhi Yu, Wei Xu
| Challenge: | Prevailing methods for task-specific instruction tuning use similarity metrics to select training data . but instruction tuning loss often fails to exhibit a monotonic relationship with actual task performance . |
| Approach: | They propose a task-specific instruction tuning method that leverages pairwise preference loss as a reward signal. |
| Outcome: | The proposed method surpasses state-of-the-art methods for task-specific instruction tuning. |
Revisiting Data Reconstruction Attacks on Real-world Dataset for Federated Natural Language Understanding (2024.lrec-main)
Copied to clipboard
Zhuo Zhang, Jintao Huang, Xiangjing Hu, Jingyuan Zhang, Yating Zhang, Hui Wang, Yue Yu, Qifan Wang, Lizhen Qu, Zenglin Xu
| Challenge: | Existing DRA methods fail to accurately recover the original text of real-world privacy data. |
| Approach: | They propose to use a real-world privacy dataset to examine the performance of federated learning (FL) methods. |
| Outcome: | The proposed method improves on a real-world privacy dataset and shows that the tokens within a recovery sentence are disordered and intertwined with tokens from other sentences in the same training batch. |
Enhancing Auto-regressive Chain-of-Thought through Loop-Aligned Reasoning (2026.eacl-long)
Copied to clipboard
| Challenge: | Chain-of-Thought prompting is a powerful technique for enhancing language model’s reasoning capabilities, but generating long and correct CoT trajectories is challenging. |
| Approach: | They propose to align the steps of Chain-of-Thought reasoning with loop iterations and apply intermediate supervision during the training of Looped Transformers. |
| Outcome: | The proposed method generates accurate reasoning chains for complex problems exceeding training length, and improves performance of the auto-regressive model. |
Seed-Guided Topic Discovery with Out-of-Vocabulary Seeds (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing topic models adopt a fully unsupervised setting and their discovered topics may not reflect user preferences well due to their unsupervised nature. |
| Approach: | They propose a framework that allows out-of-vocabulary seeds to be used to find latent topics from text corpora. |
| Outcome: | The proposed framework can find topics that are never seen in the corpus and can benefit from the general knowledge of pre-trained language models. |
Enhanced Data Synthesis for LLM through Reasoning Structures Generated by Hierarchical GFlowNet (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to optimize instruction-response pairs lack a systematic design for the underlying reasoning structure. |
| Approach: | They propose a Reasoning Structure driven data Synthesis method that leverages a coarse-to-fine directed acyclic graph to construct reasoning structures efficiently. |
| Outcome: | The proposed method outperforms existing methods in 48.50%, 84.00%, 79.90% of the synthetic datasets trained on the proposed model. |
DeFine: Decision-Making with Analogical Reasoning over Factor Profiles (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models are ideal for decision-making, but they can be difficult to process when they are verbose and include repetition, hedging, and vagueness. |
| Approach: | They propose a framework that constructs probabilistic factor profiles from complex scenarios and integrates them with analogical reasoning to guide LLMs in making decisions in new situations. |
| Outcome: | The proposed framework separates the tasks of quantifying uncertainty and incorporating it into LLM decision-making. |
DebateCoder: Towards Collective Intelligence of LLMs via Test Case Driven LLM Debate for Code Generation (2025.acl-long)
Copied to clipboard
Jizheng Chen, Kounianhua Du, Xinyi Dai, Weiming Zhang, Xihuai Wang, Yasheng Wang, Ruiming Tang, Weinan Zhang, Yong Yu
| Challenge: | Existing debate-based approaches to code generation are limited due to several reasons: 1) Reliance on different instances of the same LLM for debate, 2) under-utilization of test cases, and 3) reliance on third-party moderators for result consolidation and decision-making. |
| Approach: | They propose to use test cases to analyze code and identify bugs while opposing models generate test cases for each other to challenge each other's code during the debate process. |
| Outcome: | The proposed model collects intelligence of LLMs via test case-driven debate for code generation. |
Understanding Demonstration-based Learning from a Causal Perspective (2023.acl-short)
Copied to clipboard
| Challenge: | Demonstration-based learning has shown impressive performance in exploiting pretrained language models under few-shot learning settings. |
| Approach: | They propose to construct a Structural Causal Model to understand demonstration-based learning from causal perspectives and interpret random demonstrations as interventions on the demonstration variable within the causal model. |
| Outcome: | The proposed model outperforms hand-crafted demonstrations on public sequence labeling benchmarks. |
TexSmart: A System for Enhanced Natural Language Understanding (2021.acl-demo)
Copied to clipboard
Lemao Liu, Haisong Zhang, Haiyun Jiang, Yangming Li, Enbo Zhao, Kun Xu, Linfeng Song, Suncong Zheng, Botong Zhou, Dick Zhu, Xiao Feng, Tao Chen, Tao Yang, Dong Yu, Feng Zhang, ZhanHui Kang, Shuming Shi
| Challenge: | TexSmart supports fine-grained named entity recognition (NER) Large-scale fine-granular entity types are expected to provide richer semantic information for downstream NLP applications. |
| Approach: | They introduce TexSmart, a text understanding system that supports fine-grained named entity recognition (NER) and enhanced semantic analysis functionalities. |
| Outcome: | The proposed system supports fine-grained named entity recognition (NER) and enhanced semantic analysis functions. |
Skeleton-Guided-Translation: A Benchmarking Framework for Code Repository Translation with Fine-Grained Quality Evaluation (2025.findings-emnlp)
Copied to clipboard
Xing Zhang, Jiaheng Wen, Fangkai Yang, Yu Kang, Pu Zhao, Junhao Wang, Maoquan Wang, Yufan Huang, Shengyu Fu, Elsie Nallipogu, Qingwei Lin, Yingnong Dang, Saravan Rajmohan, Dongmei Zhang
| Challenge: | Existing code translation benchmarks focus on individual functions, overlooking repository-level challenges like intermodule coherence and dependency management. |
| Approach: | They propose a framework for benchmarking Java-to-C# translation at the repository level . it uses a translation framework guided by skeletons and fine-grained quality evaluation . |
| Outcome: | The proposed framework improves Java-to-C# translation quality at the repository level. |
Context-aware Information-theoretic Causal De-biasing for Interactive Sequence Labeling (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing deep learning models for sequence labeling are expensive and time-consuming. |
| Approach: | They propose an interactive sequence labeling that allows training directly with the user feedback . they identify context and feedback biases by formulating interactive sequence labels via a Structural Causal Model. |
| Outcome: | The proposed approach can effectively alleviate the biases and can be learnt with the user feedback. |
A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discovery (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing surveys on scientific LLMs focus on one or two fields or a single modality. |
| Approach: | They survey 260 scientific LLMs and examine their architectures and pre-training techniques . they also discuss commonalities and differences between LLM architectures . |
| Outcome: | The proposed model architectures and evaluation techniques are used to improve scientific discovery. |
TRAMS: Training-free Memory Selection for Long-range Language Modeling (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods like Transformer-XL are plagued by ineffective memory selections due to the high number of tokens involved in attention calculation. |
| Approach: | They propose a plug-and-play strategy that selects tokens participating in attention calculation based on one simple metric and ignores the other ones. |
| Outcome: | The proposed strategy keeps tokens with high attention scores and ignores the other ones on word-level and character-level benchmarks without additional training or adding additional parameters. |
FAST: Fast Annotation tool for SmarT devices (2021.emnlp-demo)
Copied to clipboard
| Challenge: | In real-world applications, annotators with the same attributes are required to annotate whether the outputs of natural language generation systems are fluent or not. |
| Approach: | They propose an annotation tool for application tasks that focuses on the user experience of mobile devices and can be customized to fit various tasks. |
| Outcome: | The proposed tool can annotate faster than existing methods while maintaining the quality of annotation. |
Inconsistent dialogue responses and how to recover from them (2024.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods to assess and bolster utterance consistency of chat systems have been shown difficult to detect. |
| Approach: | They propose to use annotators to write dialogue responses and recovery utterances to assess and bolster utteration consistency of chat systems. |
| Outcome: | The proposed dataset significantly improves the detection and resolution of inconsistencies in chat conversations. |
DANLI: Deliberative Agent for Following Natural Language Instructions (2022.emnlp-main)
Copied to clipboard
Yichi Zhang, Jianing Yang, Jiayi Pan, Shane Storks, Nikhil Devraj, Ziqiao Ma, Keunwoo Yu, Yuwei Bao, Joyce Chai
| Challenge: | Recent work on embodied AI agents that can perform tasks by following human language instructions is limited by reactive methods, which are insufficient for long-horizon complex tasks. |
| Approach: | They propose a neuro-symbolic deliberative agent that, while following language instructions, proactively applies reasoning and planning based on its neural and symbolic representations acquired from past experience. |
| Outcome: | The proposed agent achieves greater than 70% improvement over reactive baselines on the challenging TEACh benchmark. |
Exploring Schema Generalizability of Text-to-SQL (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing text-to-SQL models are limited in their generalizability, despite their performance being over-estimated. |
| Approach: | They propose a framework to generate novel text-to-SQL data via automatic and synchronous (DS, SQL) pair altering. |
| Outcome: | The proposed framework generates text-to-SQL data via automatic and synchronous (DS, SQL) pair altering. |
TABGEN-ICL: Residual-Aware In-Context Example Selection for Tabular Data Generation (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to tabular data generation require fine-tuning, which is computationally expensive. |
| Approach: | They propose a new in-context learning framework to prompt a fixed LLM with in-constitut examples to enhance the in-text learning ability of LLMs for tabular data generation. |
| Outcome: | The proposed framework outperforms random selection strategies on five real-world tabular datasets and reduces error rate by 42.2% on fidelity metric. |
Make-A-Voice: Revisiting Voice Large Language Models as Scalable Multilingual and Multitask Learners (2024.acl-long)
Copied to clipboard
Rongjie Huang, Chunlei Zhang, Yongqi Wang, Dongchao Yang, Jinchuan Tian, Zhenhui Ye, Luping Liu, Zehan Wang, Ziyue Jiang, Xuankai Chang, Jiatong Shi, Chao Weng, Zhou Zhao, Dong Yu
| Challenge: | Large language models (LLMs) have been used for general-purpose interfaces across multiple tasks and languages. |
| Approach: | They propose to use large language models as a general-purpose interface across multiple tasks and languages. |
| Outcome: | The proposed model performs better on 200K hours of 6-language data for voice generation applications. |
ExplainCPE: A Free-text Explanation Benchmark of Chinese Pharmacist Examination (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing explanation datasets for large language models are limited to the English language and general domain, leading to a scarcity of linguistic diversity and a lack of resources in specialized domains, such as medical. |
| Approach: | They propose to use a medical dataset to assess the interpretability of Large Language Models (LLMs) . they propose to analyze medical text and generate rationales for their decisions . |
| Outcome: | The proposed model passes the pharmacist examination with a 75.7% accuracy, while other models like ChatGPT fail. |
It is AI’s Turn to Ask Humans a Question: Question-Answer Pair Generation for Children’s Story Books (2022.acl-long)
Copied to clipboard
| Challenge: | Existing question answering (QA) techniques are created mainly to answer questions asked by humans, but in educational applications, teachers often need to decide what questions to ask . |
| Approach: | They propose to use a fairytale-themed storybook as input to generate QA pairs that can test a student's comprehension skills. |
| Outcome: | The proposed system outperforms state-of-the-art QAG baseline systems and builds an interactive story-telling application for the future real-world deployment. |
PAEG: Phrase-level Adversarial Example Generation for Neural Machine Translation (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for adversarial example generation are word-level or character-level, which ignore the ubiquitous phrase structure. |
| Approach: | They propose a phrase-level adversarial example generation framework to enhance the robustness of the translation model by adopting a sentence-level substitution strategy. |
| Outcome: | The proposed method improves translation performance and robustness to noise on three benchmarks. |
CSS: A Large-scale Cross-schema Chinese Text-to-SQL Medical Dataset (2023.findings-acl)
Copied to clipboard
| Challenge: | a cross-domain text-to-SQL task aims to parse user questions into SQL on complete unseen databases . a single-domain task evaluates the performance on identical databases based on the same domain . |
| Approach: | They propose a cross-domain text-to-SQL task that parses user questions into SQL on unseen databases. |
| Outcome: | The proposed system can parse user questions into SQL on complete unseen databases. |
Align2LLaVA: Cascaded Human and Large Language Model Preference Alignment for Multi-modal Instruction Curation (2025.findings-acl)
Copied to clipboard
Hongzhe Huang, Jiang Liu, Zhewen Yu, Li Cai, Dian Jiao, Wenqiao Zhang, Siliang Tang, Juncheng Li, Hao Jiang, Haoyuan Li, Yueting Zhuang
| Challenge: | Recent advances in Multi-modal Large Language Models (MLLMs) introduce significant variability in data quality. |
| Approach: | They propose to use human and LLM preference alignment to compress large corpus of machine-generated multimodal instructions into a compact and high-quality form. |
| Outcome: | The proposed algorithm outperforms LLaVA-series models in MLLM benchmarks by 90% . it uses human and LLM preference alignment to compress a large dataset . |
Rethinking Text-to-SQL: Dynamic Multi-turn SQL Interaction for Real-world Database Exploration (2026.findings-acl)
Copied to clipboard
Linzhuang Sun, Tianyu Guo, Hao Liang, Ruitong Liu, Yuying Li, Qifeng Cai, Jingxuan Wei, Yuchen Wu, Bihui Yu, Xiangxiang Zhang, Wentao Zhang, Bin Cui
| Challenge: | Structured Query Language (SQL) is the cornerstone for data-driven decision-making. |
| Approach: | They propose a benchmark to rigorously evaluate Large Language Models within a dynamic interaction framework. |
| Outcome: | The proposed benchmark aims to rigorously evaluate LLMs within a dynamic interaction framework. |
A Survey on LLM-based Conversational User Simulation (2026.eacl-long)
Copied to clipboard
Bo Ni, Yu Wang, Leyao Wang, Branislav Kveton, Franck Dernoncourt, Yu Xia, Hongjie Chen, Reuben Luera, Samyadeep Basu, Subhojyoti Mukherjee, Puneet Mathur, Nesreen K. Ahmed, Junda Wu, Li Li, Huixin Zhang, Ruiyi Zhang, Tong Yu, Sungchul Kim, Jiuxiang Gu, Zhengzhong Tu, Alexa Siu, Zichao Wang, Seunghyun Yoon, Nedim Lipka, Namyong Park, Zihao Lin, Trung Bui, Yue Zhao, Tyler Derr, Ryan A. Rossi
| Challenge: | Recent advances in large language models (LLMs) have enabled high-fidelity generation of synthetic user conversation. |
| Approach: | They propose a taxonomy covering user granularity and simulation objectives . they analyze core techniques and evaluation methodologies to help them understand the latest developments . |
| Outcome: | The proposed model enables high-fidelity generation of synthetic user conversation. |
Dynamic Sampling that Adapts: Self-Aware Iterative Data Persistent Optimization for Mathematical Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Current data selection paradigms rely on static, externally defined metrics, which fail to adapt to the evolving capabilities of models during training. |
| Approach: | They propose a dynamic sampling framework that aligns training data with the model's intrinsic competence by iterating on real-time feedback. |
| Outcome: | Extensive experiments on eight benchmarks show that SAI-DPO outperforms static baselines at most nearly 6 points, achieving state-of-the-art efficiency with significantly less data. |
SafeSteer: A Decoding-level Defense Mechanism for Multimodal Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing defense methods rely on fine-tuning or inefficient post-hoc interventions, limiting their ability to address novel attacks. |
| Approach: | They propose a decoding-level defense mechanism that employs a lightweight discriminator to iteratively steer the decoding process toward safety. |
| Outcome: | The proposed method improves safety performance by up to 33.40% without fine-tuning on multiple MLLMs. |
How do Words Contribute to Sentence Semantics? Revisiting Sentence Embeddings with a Perturbation Method (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing studies on sentence representation learning focus on human annotation, but they neglect the critical property that essential contents should contribute to sentence semantics more than non-essential contents when encoding a sentence. |
| Approach: | They propose a perturbation method for unsupervised semantic analysis that uses a sentence compression metric to adapt sentence compression datasets for automatic evaluation. |
| Outcome: | The proposed method can capture the main semantics of sentences better than several SOTA unsupervised sentence embedding models. |
HiURE: Hierarchical Exemplar Contrastive Learning for Unsupervised Relation Extraction (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing methods to extract relational feature signals from natural language sentences use self-supervised clustering and classification that cause gradual drift problems. |
| Approach: | They propose a framework that derives hierarchical signals from relational feature space using cross hierarchy attention and effectively optimizes relation representation of sentences under exemplar-wise contrastive learning. |
| Outcome: | The proposed framework can extract the relationship between entities from natural language sentences without prior knowledge on relation scope or distribution. |
UFO: A UI-Focused Agent for Windows OS Interaction (2025.naacl-long)
Copied to clipboard
Chaoyun Zhang, Liqun Li, Shilin He, Xu Zhang, Bo Qiao, Si Qin, Minghua Ma, Yu Kang, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang, Qi Zhang
| Challenge: | UFO is a UI-Fcused agent designed to fulfill user requests tailored to Windows OS applications . it decomposes user requests using divide-and-conquer approach, enabling seamless navigation and addressing sub-tasks across multiple applications. |
| Approach: | They propose a UI-Fcused Windows OS agent that decomposes user requests using a divide-and-conquer approach and incorporates a control interaction module tailored for Windows OS. |
| Outcome: | The proposed agent decomposes user requests using divide-and-conquer approach, enabling seamless navigation and addressing sub-tasks across multiple applications. |
BMRetriever: Tuning Large Language Models as Better Biomedical Text Retrievers (2024.emnlp-main)
Copied to clipboard
Ran Xu, Wenqi Shi, Yue Yu, Yuchen Zhuang, Yanqiao Zhu, May Dongmei Wang, Joyce Ho, Chao Zhang, Carl Yang
| Challenge: | Developing effective biomedical retrieval models is important for excelling at knowledge-intensive biomedically tasks but still challenging due to the lack of sufficient publicly annotated biomedic data and computational resources. |
| Approach: | They propose a series of dense retrievers for enhancing biomedical retrieval via unsupervised pre-training on large biomedically corpora, followed by instruction fine-tuning on a combination of labeled datasets and synthetic pairs. |
| Outcome: | Experiments on 5 biomedical tasks across 11 datasets confirm the performance of the retrieval model on various biomedically demanding tasks. |
Chain of Ideas: Revolutionizing Research Via Novel Idea Development with LLM Agents (2025.findings-emnlp)
Copied to clipboard
Long Li, Weiwen Xu, Jiayan Guo, Ruochen Zhao, Xingxuan Li, Yuqian Yuan, Boqiang Zhang, Yuming Jiang, Yifei Xin, Ronghao Dang, Yu Rong, Deli Zhao, Tian Feng, Lidong Bing
| Challenge: | Existing methods for idea generation either trivially prompt LLMs or expose LLM to extensive literature without indicating useful information. |
| Approach: | They propose a chain-of-ideas agent that organizes literature in a chains structure . they propose evaluating idea-generation methods from different perspectives . |
| Outcome: | The proposed agent outperforms existing methods and matches human quality in idea generation. |
NUT-RC: Noisy User-generated Text-oriented Reading Comprehension (2020.coling-main)
Copied to clipboard
| Challenge: | Existing RC models focus on extractive or generative, but ignore integration of them. |
| Approach: | They propose a noisy user-generated text-oriented RC model that integrates extractive and generative RC models by a multi-task learning mechanism and an answer selection module. |
| Outcome: | The proposed model outperforms state-of-the-art models on Twitter. |
WIKIGENBENCH:Exploring Full-length Wikipedia Generation under Real-World Scenario (2025.coling-main)
Copied to clipboard
Jiebin Zhang, Eugene J. Yu, Qinyu Chen, Chenhao Xiong, Dawei Zhu, Han Qian, Mingbo Song, Weimin Xiong, Xiaoguang Li, Qun Liu, Sujian Li
| Challenge: | Existing efforts to generate Wikipedia articles for new events fall short of real-world application. |
| Approach: | They propose a benchmark to generate Wikipedia articles for new events under real-world scenarios . they use systematic metrics and LLM-based metrics to assess verifiability, organization, and other aspects aligned with real-life scenarios. |
| Outcome: | The proposed benchmarks show that hierarchical-based methods generate more comprehensive content while fine-tuned methods achieve better verifiability. |
Locate, Steer, and Improve: A Practical Survey of Actionable Mechanistic Interpretability in Large Language Models (2026.findings-acl)
Copied to clipboard
Hengyuan Zhang, Zhihao Zhang, Ercong Nie, Mingyang Wang, Zunhai Su, Yiwei Wang, Qianli Wang, Shuzhou Yuan, Xufeng Duan, Qibo Xue, Zeping Yu, Chenming Shang, Xiao Liang, Jing Xiong, Hui Shen, Chaofan Tao, Zhengwu Liu, Senjie Jin, Zhiheng Xi, Dongdong Zhang, Sophia Ananiadou, Tao Gui, Ruobing Xie, Hayden Kwok-Hay So, Hinrich Schuetze, Xuanjing Huang, Qi Zhang, Ngai Wong
| Challenge: | Existing literature on mechanistic interpretation (MI) treats it as an observational science, leaving practical applications underexplored. |
| Approach: | They propose a survey structured around the pipeline to identify and improve MI models. |
| Outcome: | The proposed framework enables tangible improvements in Alignment, Capability, and Efficiency. |
DI-BENCH: Benchmarking Large Language Models on Dependency Inference with Testable Repositories at Scale (2025.findings-acl)
Copied to clipboard
Linghao Zhang, Junhao Wang, Shilin He, Chaoyun Zhang, Yu Kang, Bowen Li, Jiaheng Wen, Chengxing Xie, Maoquan Wang, Yufan Huang, Elsie Nallipogu, Qingwei Lin, Yingnong Dang, Saravan Rajmohan, Dongmei Zhang, Qi Zhang
| Challenge: | Existing studies highlight that dependency-related issues cause over 40% of observed runtime errors on the generated repository. |
| Approach: | They propose a large-scale benchmark and evaluation framework specifically designed to assess LLMs’ capability on dependency inference. |
| Outcome: | The proposed model achieves only a 48% execution pass rate on Python, indicating room for improvement. |
Multiplex Word Embeddings for Selectional Preference Acquisition (D19-1)
Copied to clipboard
| Challenge: | Existing word embeddings are limited in their ability to represent fixed vectors . instead, they incorporate relational dependencies of different words into their embeddables - a limitation that is addressed by a multiplex model . |
| Approach: | They propose a word embedding model which incorporates relational dependencies of different words into their embeddables. |
| Outcome: | The proposed model can be easily extended according to various relations among words. |
Enriching Non-Autoregressive Transformer with Syntactic and Semantic Structures for Neural Machine Translation (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing non-autoregressive models have boosted the efficiency of neural machine translation, but their performance is significantly worse than that of autoregressive counterparts. |
| Approach: | They propose to incorporate syntactic and semantic structures among natural languages into a non-autoregressive Transformer for the task of neural machine translation. |
| Outcome: | The proposed model achieves faster speed and keeps translation quality compared with other models. |
Simple Recurrent Units for Highly Parallelizable Recurrence (D18-1)
Copied to clipboard
| Challenge: | recurrent neural networks scale poorly due to the intrinsic difficulty in parallelizing their state computations. |
| Approach: | They propose a simple recurrent unit that provides expressive recurrence and allows highly parallel implementation. |
| Outcome: | The proposed model achieves 5—9x speed-up over cuDNN-optimized LSTM on classification and question answering datasets and delivers stronger results than LS and convolutional models. |
TeamLoRA: Boosting Low-Rank Adaptation with Expert Collaboration and Competition (2025.acl-long)
Copied to clipboard
Tianwei Lin, Jiang Liu, Wenqiao Zhang, Yang Dai, Haoyuan Li, Zhelun Yu, Wanggui He, Juncheng Li, Jiannan Guo, Hao Jiang, Siliang Tang, Yueting Zhuang
| Challenge: | Existing methods for fine-tuning are resource-efficient, but performance often falls short . a new approach, TeamLoRA, integrates collaborative and competitive modules to improve performance. |
| Approach: | They propose to introduce task-specific LoRA as domain experts to improve learning efficiency . teamLoRA integrates collaborative and competition modules to improve model learning . |
| Outcome: | Experiments show that TeamLoRA improves performance in multi-task learning . teamLorea integrates collaborative and competitive modules to improve performance . |
SOTOPIA-π: Interactive Learning of Socially Intelligent Language Agents (2024.acl-long)
Copied to clipboard
Ruiyi Wang, Haofei Yu, Wenxin Zhang, Zhengyang Qi, Maarten Sap, Yonatan Bisk, Graham Neubig, Hao Zhu
| Challenge: | Existing studies on building language agents have not addressed this social learning gap. |
| Approach: | They propose an interactive learning method that improves the social intelligence of language agents by using behavior cloning and self-reinforcement based training on filtered social interaction data. |
| Outcome: | The proposed method allows a 7B LLM to reach the social goal completion ability of an expert model (GPT-4-based agent) without the loss of more generic abilities, such as the ability to answer knowledge-based questions. |
AcTune: Uncertainty-Based Active Self-Training for Active Fine-Tuning of Pretrained Language Models (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing methods for fine-tuning pre-trained language models ignore the potential of unlabeled data. |
| Approach: | They propose a framework that allows users to unleash the power of unlabeled data via self-training. |
| Outcome: | The proposed framework outperforms active learning and self-training baselines and improves the label efficiency of PLM fine-tuning by 56.2% on average. |
Beyond Noise: Characterizing Creative Potential in Unverifiable LLM Hallucinations (2026.acl-long)
Copied to clipboard
Yu Yan, Chunhong Zhang, Haiyu Zhao, Ziyang Zeng, Zihao Liu, Yongkang Wu, Jianzhou Diao, YiJie Chen, Shujie Wang, Zheng Hu
| Challenge: | Large Language Models generate outputs that extend beyond established knowledge . prior work does not characterize the unverifiable space as a whole . |
| Approach: | They propose a novelty-verifiability characterization that distinguishes Creative Synthesis from Groundless Fabrication by a conceptual creation task. |
| Outcome: | The proposed model distinguishes Creative Synthesis (Region A) from Groundless Fabrication (Regium B) it shows that Region A is non-negligible and robust, persisting across generation strategies, models, domains, and embedding choices. |
COCO-DR: Combating Distribution Shift in Zero-Shot Dense Retrieval with Contrastive and Distributionally Robust Learning (2022.emnlp-main)
Copied to clipboard
| Challenge: | Using COCO-DR, we combat distribution shifts between source training tasks and target scenarios. |
| Approach: | They propose a method to combat distribution shifts between source training tasks and target scenarios by COtinuous COtrastive learning. |
| Outcome: | The proposed method outperforms existing models on BEIR and the giant GPT-3 embedding model with 500x more parameters. |
Sub-Sentence Encoder: Contrastive Learning of Propositional Semantic Representations (2024.naacl-long)
Copied to clipboard
Sihao Chen, Hongming Zhang, Tong Chen, Ben Zhou, Wenhao Yu, Dian Yu, Baolin Peng, Hongwei Wang, Dan Roth, Dong Yu
| Challenge: | Sentence embeddings are typically learned to recognize the semantic relation between two text inputs. |
| Approach: | They introduce a contrastively-learned contextual embedding model for fine-grained semantic representation of text. |
| Outcome: | The proposed model is able to produce contextual embeddings corresponding to different atomic propositions, i.e. semantic equivalence between propositions across different text sequences. |
RoseRAG: Robust Retrieval-augmented Generation with Small-scale LLMs via Margin-aware Preference Optimization (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have impressive performance but face high computational costs and latency, limiting their deployment in resource-constrained settings. |
| Approach: | They propose a robust RAG framework for large language models via Margin-aware Preference Optimization to enhance the accuracy and reliability of SLMs. |
| Outcome: | The proposed framework surpasses state-of-the-art benchmarks on three open-domain question answering tasks. |
Title2Event: Benchmarking Open Event Extraction with a Large-scale Chinese Title Dataset (2022.emnlp-main)
Copied to clipboard
Haolin Deng, Yanan Zhang, Yangfan Zhang, Wangyang Ying, Changlong Yu, Jun Gao, Wei Wang, Xiaoling Bai, Nan Yang, Jin Ma, Xiang Chen, Tianhua Zhou
| Challenge: | Existing EE datasets define fixed event types and design specific schemas for each of them, failing to cover diverse events emerging from the online text. |
| Approach: | They propose to use a sentence-level dataset to benchmark Open Event Extraction without restricting event types. |
| Outcome: | The proposed dataset contains more than 42,000 news titles in 34 topics collected from Chinese web pages. |
MCIL: Multimodal Counterfactual Instance Learning for Low-resource Entity-based Multimodal Information Extraction (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to perform multimodal information extraction only investigated entity-based tasks under supervised learning with adequate labeled data. |
| Approach: | They propose to investigate the entity-based MIE tasks under the low-resource settings by decomposing the features into image, entity, and context factors. |
| Outcome: | The proposed method is able to perform on two public MIE benchmark datasets and the experimental results confirm it. |
Stronger, Lighter, Better: Towards Life-Long Attribute Value Extraction for E-Commerce Products (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing models for attribute value extraction struggle for parameter efficiency and reliability due to data contamination and catastrophic forgetting. |
| Approach: | They propose to decouple product type and attribute to promote de-contamination and parameter efficiency while scaling up. |
| Outcome: | The proposed model achieves state-of-the-art performance with affordable parameter size, least historical knowledge forgetting, and greatest robustness against noises. |
NOVA-63: Native Omni-lingual Versatile Assessments of 63 Disciplines (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing multilingual benchmarks show severe drawbacks, such as overly translated content, the absence of difficulty control, and disciplinary imbalance, making the benchmarking process unreliable and showing low convincingness. |
| Approach: | They propose a multilingual benchmark that integrates LLM-assisted formatting, expert quality verification, and multi-level difficulty screening to provide a comprehensive, difficult multilingual assessment. |
| Outcome: | The proposed benchmark features 93,536 questions sourced from native speakers across 14 languages and 63 academic disciplines. |
Can Large Language Models Understand Context? (2024.findings-eacl)
Copied to clipboard
Yilun Zhu, Joel Moniz, Shruti Bhargava, Jiarui Lu, Dhivya Piraviperumal, Site Li, Yuan Zhang, Hong Yu, Bo-Hsiang Tseng
| Challenge: | Existing evaluation methodologies for Large Language Models (LLMs) have been inadequate to evaluate their ability to understand contextual features. |
| Approach: | They propose a benchmark to assess large language models' ability to understand context by adapting existing datasets to suit their evaluation. |
| Outcome: | The proposed model performs better under the in-context learning pretraining scenario than state-of-the-art models. |
Benchmarking and Improving Large Vision-Language Models for Fundamental Visual Graph Understanding and Reasoning (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for enhancing understanding and reasoning abilities in graphbased tasks focus on specific graph types or tasks, posing challenges in designing versatile systems suitable for various tasks and graphs across diverse domains. |
| Approach: | They propose a structure-aware fine-tuning framework to enhance LVLMs with structure learning abilities through three self-supervised learning tasks. |
| Outcome: | Extensive evaluations on 14 LVLMs reveal that LVLs are weak in basic graph understanding and reasoning tasks, particularly those concerning relational or structurally complex information. |
MAPS: Motivation-Aware Personalized Search via LLM-Driven Consultation Alignment (2025.acl-long)
Copied to clipboard
| Challenge: | Existing personalized product search methods assume that users’ query fully captures their real motivation, but in practice, user's queries do not always articulate the requirements. |
| Approach: | They propose a Motivation-Aware Personalized Search method that embeds queries and consultations into a unified semantic space via LLMs and utilizes a Mixture of Attention Experts (MoAE) to prioritize critical semantics. |
| Outcome: | Extensive experiments on real and synthetic data show that the proposed method outperforms existing methods in retrieval and ranking tasks. |
Preserving Knowledge Invariance: Rethinking Robustness Evaluation of Open Information Extraction (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing evaluation benchmarks focus on pairwise matching, ignoring robustness . current models exhibit frustrating degradation, with a maximum drop of 23.43 F1 score . |
| Approach: | They propose a benchmark that simulates the evaluation of open information extraction models in the real world . they perform experiments on typical models published in the last decade and a representative large language model . |
| Outcome: | The proposed model is rated robust on a knowledge-invariant clique with different syntactic and expressive forms. |
VCB Bench: An Evaluation Benchmark for Audio-Grounded Large Language Model Conversational Agents (2026.findings-acl)
Copied to clipboard
Jiliang Hu, Wenfu Wang, Zuchao Li, Chenxing Li, Yiyang Zhao, Hanzhao Li, Liqiang Zhang, Meng Yu, Dong Yu
| Challenge: | despite advances in multimodal conversational systems, current benchmarks lack comprehensive evaluation across key dimensions. |
| Approach: | They propose a Chinese benchmark built exclusively on real human speech to fill this gap . they assess LALMs across three complementary axes: instruction following, knowledge understanding, robustness . |
| Outcome: | VCB Bench assesses LALMs across three complementary axes: instruction following, knowledge understanding, and robustness . VCBM Bench provides reproducible and fine-grained framework for Chinese voice chat bots . results show significant performance disparities and offer tangible insights for future improvements . |
Is EEG-to-Text Feasible in Real-World Scenarios? An In-Depth Analysis Using a Neuropsychology-Inspired Benchmark (2026.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks for EEG2Text have neglected EEG instability, a problem that has confounded inference and sparked debate. |
| Approach: | They propose to use a 128-channel high-density EEG cap to evaluate EEG2Text models . they find existing benchmarks have neglected EEG instability, a flaw that has confounded inferences and sparked debate . |
| Outcome: | The proposed benchmarks provide key evidence for teacher-forcing-free decoding of EEG2Text models. |
EHRAgent: Code Empowers Large Language Models for Few-shot Complex Tabular Reasoning on Electronic Health Records (2024.emnlp-main)
Copied to clipboard
Wenqi Shi, Ran Xu, Yuchen Zhuang, Yue Yu, Jieyu Zhang, Hang Wu, Yuanda Zhu, Joyce Ho, Carl Yang, May Dongmei Wang
| Challenge: | EHRAgent enables clinicians to interact with EHRs using natural language . reliance on rule-based conversion systems often necessitates additional training or effort from data engineers. |
| Approach: | They propose a large language model agent that generates and executes code in natural language to facilitate clinicians in directly interacting with EHRs. |
| Outcome: | The proposed agent outperforms the strongest baseline by up to 29.6% in success rate on three real-world EHR datasets. |
Semantic Role Labeling Guided Multi-turn Dialogue ReWriter (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing attentive models attend to all words without prior focus, which results in inaccurate concentration on some dispensable words. |
| Approach: | They propose to use semantic role labeling to provide additional guidance for multi-turn dialogue rewriting models. |
| Outcome: | The proposed model outperforms existing models on multi-turn dialogue rewriting tasks. |
CB-Whisper: Contextual Biasing Whisper Using Open-Vocabulary Keyword-Spotting (2024.lrec-main)
Copied to clipboard
Yuang Li, Yinglu Li, Min Zhang, Chang Su, Jiawei Yu, Mengyao Piao, Xiaosong Qiao, Miaomiao Ma, Yanqing Zhao, Hao Yang
| Challenge: | End-to-end automatic speech recognition systems struggle to recognize rare name entities such as personal names, organizations and terminologies that are not frequently encountered in the training data. |
| Approach: | They propose a convolutional neural network-based ASR system that performs open-vocabulary keyword-spotting before the decoder to match the features between the entities and the utterances. |
| Outcome: | The proposed system significantly improves mixed-error-rate (MER) and entity recall compared to the original Whisper model on three internal datasets and two publicly available datasets. |
Generating then Refining for Reliable Knowledge Base Question Answering (2026.acl-long)
Copied to clipboard
| Challenge: | Existing knowledge base question answering methods generate LFs that are non-executable due to semantic hallucination issue of large language models. |
| Approach: | They propose a "generate-verify-refine" framework for reliable LF generation . they propose ARI-KBQA to generate query paths based on hop-by-hop reasoning . |
| Outcome: | The proposed framework significantly improves model performance with a reduced search space . ARI-KBQA can generate LFs that are non-executable due to semantic hallucination issue . |
Miner: Mining Intrinsic Mastery for Data-Efficient RL in Large Reasoning Models (2026.acl-long)
Copied to clipboard
| Challenge: | Current critic-free RL methods for large reasoning models suffer from severe inefficiency when training on positive homogeneous prompts. |
| Approach: | They propose a method that repurposes the policy’s intrinsic uncertainty as a self-supervised reward signal, with no external supervision, auxiliary models, or additional inference cost. |
| Outcome: | Evaluated across six reasoning benchmarks on Qwen3-4B and Qwend3-8B base models, the proposed method achieves state-of-the-art performance among the other four methods. |
Visual Spatial Description: Controlled Spatial-Oriented Image-to-Text Generation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Image-to-text tasks such as captioning and controllable image descriptions have received extensive attention for decades. |
| Approach: | They propose a new perspective for image-to-text to generate spatial descriptions by combining two objects in an image. |
| Outcome: | The proposed model is awe-inspiring and human-like, and the proposed end-to-end architecture is the better choice for their integration. |
LLM×MapReduce-V3: Enabling Interactive In-Depth Survey Generation through a MCP-Driven Hierarchically Modular Agent System (2025.emnlp-demos)
Copied to clipboard
Yu Chao, Siyu Lin, Xiaorong Wang, Zhu Zhang, Zihan Zhou, Haoyu Wang, Shuo Wang, Jie Zhou, Zhiyuan Liu, Maosong Sun
| Challenge: | Generating high-quality long-form survey articles poses significant challenges to AI Agent systems. |
| Approach: | They propose a hierarchically modular agent system for long-form survey generation . they use atomic models to implement skeleton initialization, digest construction, and skelet refinement . human evaluations demonstrate system surpasses representative baselines . |
| Outcome: | The proposed system surpasses representative baselines in both content depth and length, highlighting the strength of MCP-based modular planning. |
Lightweight Spatial Modeling for Combinatorial Information Extraction From Documents (2023.findings-eacl)
Copied to clipboard
Yanfei Dong, Lambert Deng, Jiazheng Zhang, Xiaodong Yu, Ting Lin, Francesco Gelli, Soujanya Poria, Wee Sun Lee
| Challenge: | Existing datasets do not cover documents with complex spatial structures and a lack of spatial information for document entity classification. |
| Approach: | They propose a new spatial bias in attention calculation based on the K-nearest-neighbor graph of document entities that limits entities’ attention to their local radius. |
| Outcome: | The proposed model outperforms baselines in most entity types and is highly parameter-efficient compared to existing methods. |
A Mixed-Language Multi-Document News Summarization Dataset and a Graphs-Based Extract-Generate Model (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing research on news summarization focuses on single-language single-document (SLSD), single-linguistic multi-document or cross-language multi-doc (CLSD) however, in real-world scenarios, news articles often involve multiple documents in different languages, i.e., mixed-language MLMD. |
| Approach: | They propose a mixed-language multi-document news summarization dataset with four different languages and 10,992 source document cluster and target summary pairs. |
| Outcome: | The proposed dataset contains four different languages and 10,992 source document cluster and target summary pairs. |
MMRC: A Large-Scale Benchmark for Understanding Multimodal Large Language Model in Real-World Conversation (2025.acl-long)
Copied to clipboard
Haochen Xue, Feilong Tang, Ming Hu, Yexin Liu, Qidong Huang, Yulong Li, Chengzhi Liu, Zhongxing Xu, Chong Zhang, Chun-Mei Feng, Yutong Xie, Imran Razzak, Zongyuan Ge, Jionglong Su, Junjun He, Yu Qiao
| Challenge: | Existing multimodal large language models lack the ability to memorize, recall, and reason in sustained interactions. |
| Approach: | They propose a multimodal real-world conversation benchmark for evaluating open-ended abilities of multimodal large language models. |
| Outcome: | The proposed benchmarks show that the models perform better in open-ended conversations. |
Joint Intent Detection and Entity Linking on Spatial Domain Queries (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Spatial domain queries have unique properties making them more challenging for language understanding than common conversational queries. |
| Approach: | They propose a language understanding framework for spatial domain queries that jointly learns the intent detection and entity linking tasks on a voice assistant service. |
| Outcome: | The proposed framework outperforms baseline methods with a significant margin. |
Zero Pronoun Resolution with Attention-based Neural Network (C18-1)
Copied to clipboard
| Challenge: | Recent neural network methods for zero pronoun resolution use contextual information to encode the zero pronomins since they contain no actual content. |
| Approach: | They propose a self-attention mechanism for encoding zero pronouns that focus on some informative parts of the associated texts and produce an efficient way of encode them. |
| Outcome: | The proposed model significantly surpasses existing Chinese zero pronoun resolution baseline systems. |
SoftMCL: Soft Momentum Contrastive Learning for Fine-grained Sentiment-aware Pre-training (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for pre-training language models capture general language understanding but fail to distinguish affective impact of a particular context to a specific word. |
| Approach: | They propose a soft momentum contrastive learning method for fine-grained sentiment-aware pre-training that uses valence ratings as soft-label supervision instead of hard labels. |
| Outcome: | The proposed method improves on four sentiment-related tasks and the results are published online. |
Locomo-Plus: Beyond-Factual Cognitive Memory Evaluation Framework for LLM Agents (2026.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks and evaluation protocols focus on surface-level factual recall. |
| Approach: | They propose a benchmark for assessing cognitive memory under cue–trigger semantic disconnect. |
| Outcome: | The proposed framework reveals failures not captured by existing benchmarks. |
Augment before You Try: Knowledge-Enhanced Table Question Answering via Table Expansion (2025.findings-emnlp)
Copied to clipboard
Yujian Liu, Jiabao Ji, Tong Yu, Ryan A. Rossi, Sungchul Kim, Handong Zhao, Ritwik Sinha, Yang Zhang, Shiyu Chang
| Challenge: | Existing methods to integrate external information into a given table neglect the structured nature of the table. |
| Approach: | They propose a simple yet effective method to integrate external information into a given table by first building an augmenting table and then generating a SQL query over the two tables to answer the question. |
| Outcome: | The proposed method outperforms strong baselines on three table QA benchmarks. |
Balancing Knowledge Breadth and Task Depth for Effective Domain Adaptation Fine-Tuning (2026.findings-acl)
Copied to clipboard
| Challenge: | a lack of knowledge breadth and task depth can hinder curriculum learning in domains such as medicine and finance. |
| Approach: | They propose a two-dimensional curriculum learning framework that coordinates model training along two orthogonal axes: the knowledge dimension and the task dimension. |
| Outcome: | The proposed framework improves accuracy on medical evaluations by 2.49% and on financial evaluations 1.2% compared with the second-best method. |
Diversifying Content Generation for Commonsense Reasoning with Mixture of Knowledge Graph Experts (2022.findings-acl)
Copied to clipboard
| Challenge: | Recent years have seen a surge of interest in improving the generation quality of commonsense reasoning tasks. |
| Approach: | They propose a method that diversifies the generative reasoning by a mixture of expert strategy on commonsense knowledge graphs to encourage various generation outputs. |
| Outcome: | The proposed method improves diversity while achieving on par performance on two GCR benchmarks, based on both automatic and human evaluations. |
Coarse-to-Fine Contrastive Learning in Image-Text-Graph Space for Improved Vision-Language Compositionality (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have highlighted severe limitations of contrastive learning models in their ability to perform compositional reasoning over objects, attributes, and relations. |
| Approach: | They propose a graph decomposition framework and negative mining techniques to improve attribute binding and relation understanding of scene graphs. |
| Outcome: | The proposed approach improves attribute binding, relation understanding, generalization, and productivity on multiple benchmarks. |
Attention Mechanism with Energy-Friendly Operations (2022.findings-acl)
Copied to clipboard
| Challenge: | Empirical results show that attention mechanism can be improved from the energy consumption aspects. |
| Approach: | They propose to replace multiplications with either selective operations or additions to reduce energy consumption. |
| Outcome: | The proposed model achieves competitable accuracy while saving 99% and 66% energy during alignment calculation and the whole attention procedure. |
Using active learning to expand training data for implicit discourse relation recognition (D18-1)
Copied to clipboard
| Challenge: | Existing methods to determine semantic relations between text spans are limited in the field of discourse-level relation recognition. |
| Approach: | They propose to expand the training data set using the corpus of explicitly-related arguments by arbitrarily dropping the overtly presented discourse connectives. |
| Outcome: | The proposed model expands the training data set using the corpus of explicitly-related arguments, by arbitrarily dropping the overtly presented discourse connectives. |
Exploring the Cognitive Knowledge Structure of Large Language Models: An Educational Diagnostic Assessment Approach (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies on LLMs evaluation with exams are lacking in cognitive research on their overall knowledge structure. |
| Approach: | They conduct an evaluation using a human test dataset based on Bloom Taxonomy to reveal the knowledge structures of Large Language Models and gain insights of their cognitive capabilities. |
| Outcome: | The proposed model can pass AP, SAT, and Leetcode exams, but lacks the cognitive power to perform on human exams. |
ChemReason-Bench: Benchmarking Large Language Models for Procedural Reasoning in Experimental Chemistry (2026.acl-long)
Copied to clipboard
| Challenge: | Experimental protocols in organic synthesis specify not only the intended transformation, but also an executable sequence of operations and conditions. |
| Approach: | They propose a human-validated benchmark for verifiable experimental procedure reasoning . they instantiate 7306 benchmark tasks across six complementary formats . |
| Outcome: | The proposed benchmarks show that the evaluations are less diagnostic of procedure-level decision making. |
Teaching Vision-Language Models to Ask: Resolving Ambiguity in Visual Questions (2025.acl-long)
Copied to clipboard
| Challenge: | Existing research addresses ambiguous visual questions by rephrasing questions, but it fails to address the inherently interactive nature of user interactions with visual language models (VLMs). Existing studies focus on re-phrase questions, and lack of a benchmark to assess VLMs’ capacity for resolving ambiguities through interaction. |
| Approach: | They propose a visual question answering task that provides a natural language answer to a question based on a given image and an automated pipeline to generate ambiguity-clarification question pairs. |
| Outcome: | The proposed benchmark targets three common categories of ambiguity in visual question answering (VQA) context and encompasses various VQA scenarios. |
A Unified Framework for Modeling Heterogeneous Financial Data via Dual-Granularity Prompting (2026.acl-industry)
Copied to clipboard
| Challenge: | Recent industrial credit scoring models rely heavily on manually tuned statistical learning methods due to the complexity of heterogeneous financial data and the challenge of modeling evolving creditworthiness. |
| Approach: | They propose a framework that reformulates credit scoring as a multi-scale sequential learning problem. |
| Outcome: | FinLangNet improves KS and bad debt rate by 6.3 pp in real world deployments. |
PQR: Improving Dense Retrieval via Potential Query Modeling (2025.acl-long)
Copied to clipboard
| Challenge: | Existing training data is sparse, with each document associated with one or a few labeled queries. |
| Approach: | They propose a training-free potential query retrieval framework to address this problem . they use a Gaussian mixture distribution to model all potential queries for a document . |
| Outcome: | The proposed method is able to capture comprehensive semantic information from a document with multiple queries. |
Domain Adaptation for Subjective Induction Questions Answering on Products by Adversarial Disentangled Learning (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods to answer subjective questions about products are often imbalanced across product domains. |
| Approach: | They propose a domain-adaptive model that integrates multiple viewpoints into a good answer by integrating these heterogeneous and inconsistent viewpoints. |
| Outcome: | The proposed model integrates multiple viewpoints into a single answer span and is able to integrate them into the answer. |
PsyChain: A Collaborative Chain-of-Agents Framework for Generating Personalized and Professional Counseling Dialogues (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing psychological counseling datasets suffer from monolithic client personas, insufficient therapeutic depth, and a lack of process controllability. |
| Approach: | They propose a framework that evolves static counseling corpora into high-fidelity dialogues . they use a Client Profiler that pairs life scenarios with psychological personality archetypes based on client personality and stage progression . |
| Outcome: | The proposed framework achieves 61-91% win rates against domain-specific baselines in pairwise evaluation and the highest average score in human evaluation, indicating potential for real-world counseling. |
GDA: Generative Data Augmentation Techniques for Relation Extraction Tasks (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing work adopts data augmentation techniques to generate pseudo-annotated sentences . existing methods neither preserve semantic consistency of original sentences nor preserve syntax structure of sentences when expressing relations using seq2seq models, resulting in less diverse augmentations. |
| Approach: | They propose a dedicated augmentation technique for relational texts, named GDA, which uses two complementary modules to preserve both semantic consistency and syntax structures. |
| Outcome: | The proposed technique can bring 2.0% F1 improvements in three datasets under low-resource setting. |
Z-LaVI: Zero-Shot Language Solver Fueled by Visual Imagination (2022.emnlp-main)
Copied to clipboard
| Challenge: | Large-scale pretrained language models suffer from reporting bias, describing the lack of explicit commonsense knowledge in written text. |
| Approach: | They propose to endow language models with visual imagination capabilities by recalling existing images and synthesizing nonexistent images via text-to-image generation. |
| Outcome: | The proposed model improves the performance of existing language models across a diverse set of language tasks. |
Exploring Mathematical Extrapolation of Large Language Models with Synthetic Data (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have shown excellent capabilities in language understanding, text generation and many other tasks, but struggle in complex multi-step reasoning problems such as mathematical reasoning. |
| Approach: | They propose to fine tune an open-llama-3B model to perform well on multi-step reasoning tasks via synthetic data. |
| Outcome: | The proposed model can reach a zero-shot pass@1 at 0.44 on the in-domain dataset and demonstrates certain generalization capabilities on the out-of-domain data. |
RAG+: Enhancing Retrieval-Augmented Generation with Application-Aware Reasoning (2025.emnlp-main)
Copied to clipboard
Yu Wang, Shiwan Zhao, Zhihu Wang, Ming Fan, Xicheng Zhang, Yubo Zhang, Zhengfan Wang, Heyuan Huang, Ting Liu
| Challenge: | Existing RAG paradigms often overlook the cognitive step of applying knowledge, leaving a gap between retrieved facts and task-specific reasoning. |
| Approach: | They introduce a module extension that integrates application-aware reasoning into the RAG pipeline. |
| Outcome: | Experiments show that RAG+ outperforms standard RAG variants and achieves gains of 3–5% in complex scenarios. |
Knowledge-aware Attention Network for Medication Effectiveness Prediction (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing effectiveness prediction methods focus on one specific medicine, one specific disease, or one specific lab test, making it hard to extend to general medicines and diseases in hospital/ICU scenarios. |
| Approach: | They propose to use knowledge enhanced module to incorporate external knowledge about medications and a medical feature learning module to determine the interaction between diagnosis and medications. |
| Outcome: | The proposed model outperforms state-of-the-art methods on a public dataset showing that it significantly outperformed existing models. |
ProgGen: Generating Named Entity Recognition Datasets Step-by-step with Self-Reflexive Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) exhibit remarkable adaptability across domains, but they are often not suitable for structured knowledge extraction tasks such as named entity recognition (NER). |
| Approach: | They propose a method that instructs LLMs to self-reflect on the specific domain and generates domain-relevant attributes for creating attribute-rich training data. |
| Outcome: | The proposed method produces NER datasets in domains with domain-relevant attributes and generates entity terms and NER context data around these entities. |
DictLLM: Harnessing Key-Value Data Structures with Large Language Models for Enhanced Medical Diagnostics (2024.findings-acl)
Copied to clipboard
| Challenge: | Structured data processing is a complex and complex process. |
| Approach: | They propose a framework that captures heterogeneity of structured data using large language models . they propose group positional encoding, hierarchical attention bias and optimal transport alignment layer . |
| Outcome: | The proposed framework outperforms baseline methods and few-shot GPT-4 on a medical lab report dataset. |
WebRollback: Enhancing Web Agents with Explicit Rollback Mechanisms (2026.eacl-short)
Copied to clipboard
| Challenge: | Recent studies have adopted a greedy one-way search strategy to deal with dynamic web environments. |
| Approach: | They propose to integrate a rollback mechanism into web agents to allow them to revert back to a previous state in navigation trajectory. |
| Outcome: | The proposed method is able to revert back to a previous state in its navigation trajectory, allowing the models to directly control the search process. |
INSET: Sentence Infilling with INter-SEntential Transformer (2020.acl-main)
Copied to clipboard
| Challenge: | Missing sentence generation fosters a wide range of applications in natural language generation . Developing models for sentence infilling can potentially facilitate many text generation applications . |
| Approach: | They propose a framework to decouple the problem from natural language processing . they propose generating missing sentences that can syntactically and semantically bridge context . |
| Outcome: | The proposed model learns a sentence representation and generates 'missing sentences' the proposed model can be used for document auto-completion and meeting note expansion . |
Fast and Accurate End-to-End Span-based Semantic Role Labeling as Word-based Graph Parsing (2022.coling-1)
Copied to clipboard
| Challenge: | Using end-to-end span-based SRL, we propose a word-based graph parsing task for word-level representation of spans . compared with word-driven SRL, span-Based SRL is more complex due to difficulties in determining argument boundaries. |
| Approach: | They propose to cast end-to-end span-based SRL as a word-based graph parsing task . they propose a constrained Viterbi procedure to ensure the legality of the output graph . |
| Outcome: | The proposed model can parse 669/252 sentences per second without and with pre-trained models. |
OpenEval: Benchmarking Chinese LLMs across Capability, Alignment and Safety (2024.acl-demos)
Copied to clipboard
Chuang Liu, Linhao Yu, Jiaxuan Li, Renren Jin, Yufei Huang, Ling Shi, Junhui Zhang, Xinmeng Ji, Tingting Cui, Liutao Liutao, Jinwang Song, Hongying Zan, Sun Li, Deyi Xiong
| Challenge: | a rapid development of Chinese large language models poses big challenges for efficient LLM evaluation. |
| Approach: | They propose an evaluation testbed that benchmarks Chinese LLMs across capability, alignment and safety. |
| Outcome: | The evaluation platform OpenEval benchmarks Chinese LLMs across capability, alignment and safety. |
ReasonMed: A 370K Multi-Agent Generated Dataset for Advancing Medical Reasoning (2025.emnlp-main)
Copied to clipboard
Yu Sun, Xingyu Qian, Weiwen Xu, Hao Zhang, Chenghao Xiao, Long Li, Deli Zhao, Wenbing Huang, Tingyang Xu, Qifeng Bai, Yu Rong
| Challenge: | Existing medical reasoning datasets are limited in scale and typically rely on incomplete data. |
| Approach: | They propose to use ReasonMed to train medical reasoning models using a multi-agent generation, verification, and refinement pipeline. |
| Outcome: | The largest medical reasoning dataset to date surpasses the prior best sub-10B models by 4.17% and even exceeds LLaMA3.1-70B on PubMedQA by 4.60%. |
SEP-MLDC: A Simple and Effective Paradigm for Multi-Label Document Classification (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods focus on optimizing document features, overlooking the potential of high-quality label features to enhance classification performance. |
| Approach: | They propose a multi-label document classification paradigm that utilizes large language models to expand the label content and generate pseudo-samples for the tail categories. |
| Outcome: | The proposed method significantly outperforms state-of-the-art models. |
Joint Goal Segmentation and Goal Success Prediction on Multi-Domain Conversations (2022.coling-1)
Copied to clipboard
| Challenge: | Existing metrics to measure the performance of conversational AI assistants are difficult to establish due to their slow nature. |
| Approach: | They propose an automatic dialogue evaluation framework that performs goal segmentation and success prediction by adding multi-task learning heads. |
| Outcome: | The proposed model achieves on-par with human annotation compared to a gold annotation benchmark. |
Doc2Bot: Accessing Heterogeneous Documents via Conversational Bots (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Documents contain various structures that hinder the ability of machines to comprehend . user information needs are often underspecified, and the nature of heterogeneous documents poses challenges. |
| Approach: | They propose a dataset for building machines that help users seek information via conversations . their dataset contains over 100,000 turns based on Chinese documents from five domains . |
| Outcome: | The proposed tasks are challenging and worthy of further research. |
Evaluating Multimodal Large Language Models on Video Captioning via Monte Carlo Tree Search (2025.acl-long)
Copied to clipboard
Linhao Yu, Xingguang Ji, Yahui Liu, Fanheng Kong, Chenxi Sun, Jingyuan Zhang, Hongzhi Zhang, V. W., Fuzheng Zhang, Deyi Xiong
| Challenge: | Existing benchmarks and evaluation protocols suffer from inadequate or homogeneous creation of key points, exorbitant cost of data creation, and limited evaluation scopes. |
| Approach: | They propose an automatic framework which leverages Monte Carlo Tree Search to construct numerous and diverse descriptive sentences that thoroughly represent video content in an iterative way. |
| Outcome: | The proposed framework improves MCTS-VCB and DREAM-1K on video captioning tasks by 25.0% and 16.3% respectively. |
Don’t Stop Early: Scalable Enterprise Deep Research with Controlled Information Flow and Evidence-Aware Termination (2026.acl-industry)
Copied to clipboard
Prafulla Kumar Choubey, Kung-Hsiang Huang, Pranav Narayanan Venkit, Jiaxin Zhang, Vaibhav Vats, Yu Li, Xiangyu Peng, Chien-Sheng Wu
| Challenge: | Enterprise deep research systems fail to produce decision-ready reports due to uneven information coverage, context explosion, and premature stopping. |
| Approach: | They propose a scalable Enterprise Deep Research (EDR) architecture that decomposes requests into coverage-driven objectives via outline generation with reflection and localizes context with dependency-guided execution and explicit information sharing. |
| Outcome: | The proposed system achieves the strongest overall performance compared with competitive deep-research baselines on internal sales enablement tasks and the public DeepResearch Bench benchmark. |
An Efficient Framework for Whole-Page Reranking via Single-Modal Supervision (2026.acl-industry)
Copied to clipboard
Zishuai Zhang, Sihao Yu, null Xiewenyi, Ying Nie, Junfeng Wang, Zhiming Zheng, Dawei Yin, Hainan Zhang
| Challenge: | Existing whole-page reranking methods require large-scale expert annotations to achieve high-quality results. |
| Approach: | They propose a whole-page reranking framework that converts single-modal rankers into page-level guidance by constructing budget-aware candidates for cross-modal annotations and distilling intra-modality preferences to align relevance scales across modalities. |
| Outcome: | The proposed framework reduces annotation costs by 70-90% while outperforming fully-annotated reranking baselines. |
FLiText: A Faster and Lighter Semi-Supervised Text Classification with Convolution Networks (2021.emnlp-main)
Copied to clipboard
| Challenge: | obtaining large amounts of labeled data is expensive. |
| Approach: | They develop a semi-supervised learning framework called FLiText which improves text classification accuracy. |
| Outcome: | The proposed framework improves accuracy of lightweight models on IMDb, Yelp-5, and Yahoo! Answer . the framework improve accuracy by 6.59%, 3.94%, and 3.22% on the datasets of IMDa, Yep-5 and Yahoo. Answer compared with the fully supervised method on the full dataset . |
TACLR: A Scalable and Efficient Retrieval-based Method for Industrial Product Attribute Value Identification (2025.acl-long)
Copied to clipboard
Yindu Su, Huike Zou, Lin Sun, Ting Zhang, Haiyang Yang, Chen Li Yu, David Lo, Qingheng Zhang, Shuguang Han, Jufeng Chen
| Challenge: | Existing methods for product attribute value identification face critical challenges . seller-provided attribute values are often incomplete or inaccurate . |
| Approach: | They propose a retrieval-based method that uses taxonomy-aware contrastive learning . they use product profiles and candidate values to encode and retrieve attributes based on similarity . |
| Outcome: | The proposed method is based on a taxonomy-aware, hard negative sampling and adaptive inference with dynamic thresholds. |
Interpretable and Low-Resource Entity Matching via Decoupling Feature Learning from Decision Making (2021.acl-long)
Copied to clipboard
| Challenge: | Entity Matching (EM) aims at recognizing entity records that denote the same real-world object. |
| Approach: | They propose a novel EM framework that consists of Heterogeneous Information Fusion and Key Attribute Tree Induction to decouple feature representation from matching decision. |
| Outcome: | The proposed framework outperforms SOTA EM models on 6 public datasets and 3 industrial datasets. |
FAITH: Factuality Alignment through Integrating Trustworthiness and Honestness (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to correct factually inaccurate outputs are lacking the semantic richness needed to properly understand its internal states of trustworthiness and honesty. |
| Approach: | They propose a framework for factuality alignment that integrates natural-language uncertainty signals with external knowledge and computes confidence scores and semantic entropy from LLM outputs. |
| Outcome: | Extensive experiments on four knowledge-intensive benchmarks show that FAITH improves the factual accuracy and truthfulness of Large Language Models (LLMs). |
Self-Supervised Prompt Optimization (2025.findings-emnlp)
Copied to clipboard
Jinyu Xiang, Jiayi Zhang, Zhaoyang Yu, Xinbing Liang, Fengwei Teng, Jinhao Tu, Fashen Ren, Xiangru Tang, Sirui Hong, Chenglin Wu, Yuyu Luo
| Challenge: | Existing prompt optimization methods rely heavily on external references such as ground truth or by humans, limiting their applicability in real-world scenarios where such data is unavailable or costly to obtain. |
| Approach: | They propose a cost-efficient framework that discovers effective prompts for both closed and open-ended tasks without external reference. |
| Outcome: | The proposed framework outperforms state-of-the-art prompt optimization methods with significantly lower costs and fewer samples. |
Improving Relation Extraction with Relational Paraphrase Sentences (2020.coling-main)
Copied to clipboard
| Challenge: | Existing annotated data is expensive and non-scalable, limiting performance of relation extraction models. |
| Approach: | They propose to enrich relation expressions by relational paraphrase sentences by annotating human-annotated data. |
| Outcome: | The proposed model improves performance even on a strong baseline. |
MES-RAG: Bringing Multi-modal, Entity-Storage, and Secure Enhancements to RAG (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing approaches to retrieve entity information are limited by document level retrieval and intermingled storage of information from different entities. |
| Approach: | They propose a framework that enhances entity-specific query handling . MES-RAG introduces proactive security measures that ensure system integrity . |
| Outcome: | Experimental results show that MES-RAG improves accuracy and recall . the framework can be integrated into existing RAG architectures . |
LiGen: Active Lipid Generation via a Molecular Language Model (2026.acl-long)
Copied to clipboard
| Challenge: | Lipid nanoparticles (LNPs) can deliver cargos to tumor and immune cells . traditional approaches rely on experimental screening and expert judgment . |
| Approach: | They propose a method to generate lipid molecules efficiently and actively using deep learning. |
| Outcome: | The proposed method outperforms baseline methods on multiple cell lines and achieves a 30% improvement over the current methods. |
Why Does New Knowledge Create Messy Ripple Effects in LLMs? (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing research has focused on post-training knowledge editing (KE) for language models to ensure that knowledge remains accurate and up-to-date. |
| Approach: | They propose to use a GradSim indicator to detect when and why updated knowledge ripples in language models. |
| Outcome: | The proposed indicator GradSim shows that LMs that fail to handle ripple effects have low GradSIM. |
LLM-Based Human-Agent Collaboration and Interaction Systems: A Survey (2026.findings-acl)
Copied to clipboard
Henry Peng Zou, Wei-Chieh Huang, Yaozu Wu, Jizhou Guo, Yankai Chen, Chunyu Miao, Hoang H Nguyen, Yue Zhou, Weizhi Zhang, Liancheng Fang, Hanrong Zhang, Fangxin Wang, Pengfei Zhang, Langzhou He, Yangning Li, Dongyuan Li, Renhe Jiang, Philip S. Yu
| Challenge: | Recent advances in large language models (LLMs) have sparked growing interest in building fully autonomous agents. |
| Approach: | They propose to integrate human-provided information, feedback, or control into the agent system to enhance system performance, reliability, and safety. |
| Outcome: | The proposed systems improve system performance, reliability, and safety by integrating human-provided information, feedback, or control into the agent system. |
An Exploratory Study on Long Dialogue Summarization: What Works and What’s Next (2021.findings-emnlp)
Copied to clipboard
Yusen Zhang, Ansong Ni, Tao Yu, Rui Zhang, Chenguang Zhu, Budhaditya Deb, Asli Celikyilmaz, Ahmed Hassan Awadallah, Dragomir Radev
| Challenge: | Existing models for dialogue summarization focus on extracting the main events of short conversations, but real-world dialogues are difficult to train. |
| Approach: | They propose three strategies to deal with the lengthy input problem and locate relevant information using long dialogue datasets. |
| Outcome: | The retrieve-then-summarize pipeline models yield the best performance on three long dialogue datasets. |
Text Classification Using Label Names Only: A Language Model Self-Training Approach (2020.emnlp-main)
Copied to clipboard
| Challenge: | Current text classification methods require a large number of labeled documents as training data. |
| Approach: | They propose a model that uses only the label name of each class to train classification models on unlabeled data without using any labeled examples. |
| Outcome: | The proposed model achieves 90% accuracy on four benchmark datasets using label names as the only supervision . |
Fantastic Questions and Where to Find Them: FairytaleQA – An Authentic Dataset for Narrative Comprehension (2022.acl-long)
Copied to clipboard
Ying Xu, Dakuo Wang, Mo Yu, Daniel Ritchie, Bingsheng Yao, Tongshuang Wu, Zheng Zhang, Toby Li, Nora Bradford, Branda Sun, Tran Hoang, Yisi Sang, Yufang Hou, Xiaojuan Ma, Diyi Yang, Nanyun Peng, Zhou Yu, Mark Warschauer
| Challenge: | Existing QA datasets rarely distinguish fine-grained reading skills, such as the understanding of varying narrative elements. |
| Approach: | They propose to use FairytaleQA to generate 10,580 questions based on 278 children-friendly stories to assess model's fine-grained learning skills. |
| Outcome: | The proposed dataset consists of 10,580 questions derived from 278 children-friendly stories, covering seven types of narrative elements or relations. |
Multistage Fusion with Forget Gate for Multimodal Summarization in Open-Domain Videos (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for multimodal summarization for open-domain videos lack fine-grained interactions between multisource inputs. |
| Approach: | They propose a multistage fusion network with a forget gate module to integrate multimodal information into a fluent textual summary. |
| Outcome: | The proposed model achieves state-of-the-art on multiple encoder-decoder architectures and low noise transcripts. |
TinyScientist: An Interactive, Extensible, and Controllable Framework for Building Research Agents (2025.emnlp-demos)
Copied to clipboard
Haofei Yu, Keyang Xuan, Fenghai Li, Kunlun Zhu, Zijie Lei, Jiaxun Zhang, Ziheng Qi, Kyle Richardson, Jiaxuan You
| Challenge: | Existing research systems often design and use agentic workflows to perform research tasks such as ideation, scientific coding, review writing, and tree-based search. |
| Approach: | They propose an open-source codebase, an interactive web demonstration, and a PyPI Python package to make state-of-the-art auto-research pipelines broadly accessible to every researcher and developer. |
| Outcome: | The proposed framework adapts easily to new tools and supports iterative growth. |
Distilling Large Embeddings via Hyperspherical Householder Quantization (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for quantizing large embeddings rely on Euclidean quantization, which is poorly aligned with the angular geometry induced by contrastive embeddment training. |
| Approach: | They propose a geometry-aware distillation method that compresses large embeddings into short discrete representations via iterative Householder transformations on the unit hypersphere. |
| Outcome: | The proposed method reduces decoding cost and maintains strong semantic retrieval accuracy. |
Paraphrase Augmented Task-Oriented Dialog Generation (2020.acl-main)
Copied to clipboard
| Challenge: | Neural generative models can perform dialog generation tasks with a large data set, but lack of high-quality data and expensive data annotation process limit their application in real world settings. |
| Approach: | They propose to combine paraphrase and response generation models to improve dialog generation performance by annotating dialog states and dialog act labels. |
| Outcome: | The proposed framework outperforms existing methods significantly in dialog generation tasks, especially under low resource settings. |
Learning Language-guided Adaptive Hyper-modality Representation for Multimodal Sentiment Analysis (2023.emnlp-main)
Copied to clipboard
| Challenge: | Multimodal Sentiment Analysis (MSA) is effective when using rich information from multiple sources, but the potential sentiment-irrelevant information across modalities may hinder the performance from being further improved. |
| Approach: | They propose an Adaptive Language-guided Multimodal Transformer (ALMT) that learns an irrelevance/conflict-suppressing representation from visual and audio features under guidance of language features at different scales. |
| Outcome: | The proposed model achieves state-of-the-art on several popular datasets and an abundance of ablation shows the effectiveness of the proposed model. |
Gradient-guided Attention Map Editing: Towards Efficient Contextual Hallucination Mitigation (2025.findings-naacl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) often experience “contextual hallucination” where they prioritize self-generated content over input context, leading to a disregard for pertinent details. |
| Approach: | They propose a method that dynamically adjusts attention maps to enhance contextual relevance by using a trained classifier to identify attention maps likely to induce hallucinations. |
| Outcome: | The proposed approach reduces hallucinations across open-source models on summarization and open-book QA tasks. |
DYLE: Dynamic Latent Extraction for Abstractive Long-Input Summarization (2022.acl-long)
Copied to clipboard
Ziming Mao, Chen Henry Wu, Ansong Ni, Yusen Zhang, Rui Zhang, Tao Yu, Budhaditya Deb, Chenguang Zhu, Ahmed Awadallah, Dragomir Radev
| Challenge: | Existing models struggle with summarizing long text due to high memory complexity of the full self-attention. |
| Approach: | They propose a dynamic latent extraction approach for abstractive long-input summarization that treats extracted text snippets as latent variables and allows dynamic attention weights during decoding. |
| Outcome: | The proposed method outperforms existing methods on GovReport, QMSum, and arXiv while yielding strong results on arX. |
CrossQG: Improving Difficulty-Controllable Question Generation through Consistency Enhancement (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models can generate questions with controlled difficulty, but they often fail to align with the given target difficulty. |
| Approach: | They propose a question generation method that requires no tuning of generator parameters yet significantly improves difficulty consistency. |
| Outcome: | The proposed method outperforms several mainstream methods on high-quality question answering datasets and achieves superior consistency with target difficulty. |
Enhancing Cross-lingual Transfer via Phonemic Transcription Integration (2023.findings-acl)
Copied to clipboard
| Challenge: | Previous cross-lingual transfer methods are limited to orthographic representation learning via textual scripts. |
| Approach: | They propose a phonemic transcription framework that incorporates phonemic translations as an additional linguistic modality beyond the orthographic transcriptions for cross-lingual transfer. |
| Outcome: | The proposed framework captures local one-to-one alignment between two different modalities and integrates bilingual dictionaries into multilingual contexts. |
Active Sentence Learning by Adversarial Uncertainty Sampling in Discrete Space (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing uncertainty sampling methods are time-consuming and can't be executed frequently. |
| Approach: | They propose adversarial uncertainty sampling in discrete space to find informative unlabeled text samples for annotation using adversarials. |
| Outcome: | The proposed approach outperforms baselines on effectiveness on five datasets. |
Reframe Your Life Story: Interactive Narrative Therapist and Innovative Moment Assessment with Large Language Models (2025.emnlp-main)
Copied to clipboard
Yi Feng, Jiaqi Wang, Wenxuan Zhang, Zhuang Chen, Shen Yutong, Xiyao Xiao, Minlie Huang, Liping Jing, Jian Yu
| Challenge: | Existing approaches to mental health support lack realism and capture therapeutic progression over time. |
| Approach: | They propose a framework that simulates expert narrative therapists by planning therapeutic stages, guiding reflection levels, and generating contextually appropriate responses through retrieval-augmentation. |
| Outcome: | The proposed framework outperforms standard methods in quality and depth on 260 simulated clients and 230 human participants. |
Two Streams, One Sarcasm: Orthogonal Expert Tuning for Holistic Multimodal Sarcasm Understanding (2026.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks for multimodal satirical cognition hinder evaluation of multimodal Sarcasm Understanding . lack of a unified benchmark for holistic satire cognition hampers evaluation of MSU . |
| Approach: | They propose a framework to decouple experts into orthogonal shared perception and private execution streams to physically block gradient interference between tasks. |
| Outcome: | The proposed framework achieves superior performance on DocMSU-PLUS. |
SParC: Cross-Domain Semantic Parsing in Context (P19-1)
Copied to clipboard
Tao Yu, Rui Zhang, Michihiro Yasunaga, Yi Chern Tan, Xi Victoria Lin, Suyi Li, Heyang Er, Irene Li, Bo Pang, Tao Chen, Emily Ji, Shreya Dixit, David Proctor, Sungrok Shim, Jonathan Kraft, Vincent Zhang, Caiming Xiong, Richard Socher, Dragomir Radev
| Challenge: | Xu et al., 2017): a dataset for cross-domain semantic parsing in context with 4,298 question sequences. |
| Approach: | They present a dataset for cross-domainSemanticParsing inContext that consists of 4,298 coherent question sequences. |
| Outcome: | The proposed dataset demonstrates that it has greater semantic diversity and can be generalized to unseen domains due to its cross-domain nature and the unseened databases at test time. |
VocabTailor: Dynamic Vocabulary Selection for Downstream Tasks in Small Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing static vocabulary pruning designs that reduce memory usage suffer from rigid, one-size-fits-all designs that cause information loss during the prefill stage and lack flexibility. |
| Approach: | They propose a decoupled dynamic vocabulary selection framework that addresses memory constraints through offloading embedding and implements a hybrid static-dynamic vocabulary selection strategy for LM Head. |
| Outcome: | The proposed framework reduces memory usage by 99% with minimal or no degradation in performance. |
Beyond Sequences: Two-dimensional Representation and Dependency Encoding for Code Generation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing code generation approaches represent code as a linear sequence of tokens, but positional encodings compromise generalization . explicit positional encoders sacrifice permutation invariance, imposes a strict order on the input sequence . |
| Approach: | They propose to represent code snippets as two-dimensional entities with explicit encodings . they propose to use dictionary learning to perform semantic matching between code lines . |
| Outcome: | The proposed model captures the hierarchical and spatial structure of code, especially the dependencies between code lines. |
Knowledge Enhanced Fine-Tuning for Better Handling Unseen Entities in Dialogue Generation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for dialogue generation use an external knowledge base to generate appropriate responses. |
| Approach: | They propose to use an external knowledge base to generate appropriate responses for unseen entities. |
| Outcome: | Experiments on two dialogue corpus show that pre-trained models perform poorly with unseen entities. |
SRF: Enhancing Document-Level Relation Extraction with a Novel Secondary Reasoning Framework (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for document-level relation extraction ignore bidirectional mention interaction when generating relational features for entity pairs. |
| Approach: | They propose a document-level relation extraction model that incorporates bidirectional mention fusion and a simple yet effective evidence extraction module for relation prediction. |
| Outcome: | The proposed model achieves SOTA performance and the proposed method is effective and general when integrated into existing models. |
LLMInit: A Free Lunch from Large Language Models for Selective Initialization of Recommendation (2025.emnlp-industry)
Copied to clipboard
Weizhi Zhang, Liangwei Yang, Wooseong Yang, Henry Peng Zou, Yuqing Liu, Ke Xu, Sourav Medya, Philip S. Yu
| Challenge: | Existing algorithms for collaborative filtering are limited by their computational demands and latency. |
| Approach: | They propose a framework to integrate pre-trained LLM embeddings into CF models through selective initialization strategies. |
| Outcome: | The proposed framework improves recommendation performance while maintaining low computational costs. |
DART: Open-Domain Structured Data Record to Text Generation (2021.naacl-main)
Copied to clipboard
Linyong Nan, Dragomir Radev, Rui Zhang, Amrit Rau, Abhinand Sivaprasad, Chiachun Hsieh, Xiangru Tang, Aadit Vyas, Neha Verma, Pranav Krishna, Yangxiaokang Liu, Nadia Irwanto, Jessica Pan, Faiaz Rahman, Ahmad Zaidi, Mutethia Mutuma, Yasin Tarabar, Ankit Gupta, Tao Yu, Yi Chern Tan, Xi Victoria Lin, Caiming Xiong, Richard Socher, Nazneen Fatema Rajani
| Challenge: | Data-to-text annotations can be costly when dealing with tables with nontrivial structures. |
| Approach: | They propose a procedure for extracting semantic triples from tables that encodes their structures by exploiting table headers and table title. |
| Outcome: | The proposed method exploits the semantic dependencies between table headers and title to extract semantic triples from tables. |
LayoutDIT: Layout-Aware End-to-End Document Image Translation with Multi-Step Conductive Decoder (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods struggle to capture the visual layout in complex document images. |
| Approach: | They propose to integrate layout knowledge into document image translation by using a layout-aware encoder and a multi-step conductive decoder to achieve the translation step by step. |
| Outcome: | The proposed model outperforms state-of-the-art methods with better parameter efficiency. |
Accelerating Inference for Pretrained Language Models by Unified Multi-Perspective Early Exiting (2022.coling-1)
Copied to clipboard
| Challenge: | Existing competitive methods to accelerate inference of pretrained language models are limited by their complexity and computational consumption. |
| Approach: | They propose a unified horizontal and vertical multi-perspective early exiting framework to accelerate inference of transformer-based models. |
| Outcome: | Experiments show that MPEE can achieve higher acceleration inference with competent performance than existing competitive methods. |
ErrorRadar: Benchmarking Complex Mathematical Reasoning of Multimodal Large Language Models Via Error Detection (2026.findings-acl)
Copied to clipboard
Yibo Yan, Shen Wang, Jiahao Huo, Hang Li, Boyan Li, Jiamin Su, Xiong Gao, YiFan Zhang, Tianlong Xu, Zhendong Chu, Aoxiao Zhong, Kun Wang, Hui Xiong, Philip S. Yu, Xuming Hu, Qingsong Wen
| Challenge: | Current mathematical benchmarks focus on evaluating MLLMs’ problem-solving ability, yet there is a crucial gap in addressing more complex scenarios such as error detection. |
| Approach: | They propose to evaluate multimodal error detection by evaluating two sub-tasks error step identification and error categorization. |
| Outcome: | The proposed task evaluates MLLMs' ability to handle multimodal questions compared to text-only models. |
GSID: Generative Semantic Indexing for E-Commerce Product Understanding (2025.emnlp-industry)
Copied to clipboard
Haiyang Yang, Qinye Xie, Qingheng Zhang, Chen Li Yu, Huike Zou, Chengbao Lian, Shuguang Han, Fei Huang, Jufeng Chen, Bo Zheng
| Challenge: | Structured product information is a major bottleneck for the efficiency of e-commerce platforms. |
| Approach: | They propose a data-driven approach to generate product structured representations using product metadata. |
| Outcome: | Extensive experiments show that GSID can generate better product representations on real-world e-commerce platforms. |
Curriculum Consistency Learning for Conditional Sentence Generation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Consistency learning (CL) has proven to be a valuable technique for improving the robustness of conditional sentence generation models. |
| Approach: | They propose a strategy that guides models to learn consistency in alignment with their current capacity to differentiate between features. |
| Outcome: | The proposed strategy delivers +2.0 accuracy point improvement compared with vanilla IT and +0.7 COMET scores over traditional CL methods in MT tasks. |
LaTeX2Solver: a Hierarchical Semantic Parsing of LaTeX Document into Code for an Assistive Optimization Modeling Application (2023.acl-demo)
Copied to clipboard
Rindra Ramamonjison, Timothy Yu, Linzi Xing, Mahdi Mostajabdaveh, Xiaorui Li, Xiaojin Fu, Xiongwei Han, Yuanzhe Chen, Ren Li, Kun Mao, Yong Zhang
| Challenge: | Existing systems that translate optimization formulas manually are cumbersome and time-consuming. |
| Approach: | They propose a system that converts optimization formulas from TeX document to solver language. |
| Outcome: | The proposed system helps operations research practitioners convert optimization formulations into solver modeling languages. |
NOAHQA: Numerical Reasoning with Interpretable Graph Question Answering Dataset (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing question answering datasets lack numerical reasoning and reasoning processes . current research on numerical reasoning focuses on simple calculations . |
| Approach: | They propose a conversational and bilingual question answering dataset with numerical reasoning with compound mathematical expressions. |
| Outcome: | The proposed model achieves 55.5 exact match scores while human performance is 89.7. |
Enhancing Character-Level Understanding in LLMs through Token Internal Structure Learning (2025.acl-long)
Copied to clipboard
Zhu Xu, Zhiqiang Zhao, Zihan Zhang, Yuchi Liu, Quanwei Shen, Fei Liu, Yu Kuang, Jian He, Conglin Liu
| Challenge: | Large language models (LLMs) use tokenization methods but often obscure internal character structures within tokens. |
| Approach: | They propose a method that improves models’ ability to capture character positions within tokens by training them on reverse character prediction tasks using the tokenizer’s vocabulary. |
| Outcome: | Experiments show that the proposed method improves position prediction accuracy in large language models, enabling more precise identification of target characters in original text. |
HiGen: Hierarchy-Aware Sequence Generation for Hierarchical Text Classification (2024.eacl-long)
Copied to clipboard
| Challenge: | Hierarchical text classification is a complex subtask under multi-label text classification . the relevance of document sections can vary based on the hierarchy level, necessitating a dynamic document representation. |
| Approach: | They propose a text-generation-based framework that uses language models to encode dynamic text representations. |
| Outcome: | The proposed framework surpasses existing methods while handling data and mitigating class imbalance. |
From Selection to Generation: A Survey of LLM-based Active Learning (2025.acl-long)
Copied to clipboard
Yu Xia, Subhojyoti Mukherjee, Zhouhang Xie, Junda Wu, Xintong Li, Ryan Aponte, Hanjia Lyu, Joe Barrow, Hongjie Chen, Franck Dernoncourt, Branislav Kveton, Tong Yu, Ruiyi Zhang, Jiuxiang Gu, Nesreen K. Ahmed, Yu Wang, Xiang Chen, Hanieh Deilamsalehy, Sungchul Kim, Zhengmian Hu, Yue Zhao, Nedim Lipka, Seunghyun Yoon, Ting-Hao Kenneth Huang, Zichao Wang, Puneet Mathur, Soumyabrata Pal, Koyel Mukherjee, Zhehao Zhang, Namyong Park, Thien Huu Nguyen, Jiebo Luo, Ryan A. Rossi, Julian McAuley
| Challenge: | Large Language Models (LLMs) have been used for selection and training of data for active learning. |
| Approach: | They propose an intuitive taxonomy that categorizes LLM-based active learning techniques and discuss the transformative roles they can play in the active learning loop. |
| Outcome: | The proposed model can generate entirely new data instances and provide more cost-effective annotations with fewer labeled data instances. |
A Survey of RAG-Reasoning Systems in Large Language Models (2025.findings-emnlp)
Copied to clipboard
Yangning Li, Weizhi Zhang, Yuyao Yang, Wei-Chieh Huang, Yaozu Wu, Junyu Luo, Yuanchen Bei, Henry Peng Zou, Xiao Luo, Yusheng Zhao, Chunkit Chan, Yankai Chen, Zhongfen Deng, Yinghui Li, Hai-Tao Zheng, Dongyuan Li, Renhe Jiang, Ming Zhang, Yangqiu Song, Philip S. Yu
| Challenge: | a survey of RAG-based reasoning-based approaches shows that it is not effective for multi-step inferences. |
| Approach: | They map how advanced reasoning optimizes each stage of RAG . they show how retrieved knowledge supply missing premises and expand context for complex inference . |
| Outcome: | The proposed frameworks achieve state-of-the-art across knowledge-intensive benchmarks. |
OpenWebVoyager: Building Multimodal Web Agents via Iterative Real-World Exploration, Feedback and Optimization (2025.acl-long)
Copied to clipboard
Hongliang He, Wenlin Yao, Kaixin Ma, Wenhao Yu, Hongming Zhang, Tianqing Fang, Zhenzhong Lan, Dong Yu
| Challenge: | Existing studies focus on building text-only agents in synthetic environments where the reward signals are clearly defined. |
| Approach: | They propose a multimodal web agent that can autonomously conduct real-world exploration and improve itself after each iteration. |
| Outcome: | The proposed agent improves itself after each iteration, demonstrating strong performance across multiple test sets. |
From What to Why: Improving Relation Extraction with Rationale Graph (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing neural relation extraction models are limited by entity type and textual context. |
| Approach: | They propose a novel RAtionale Graph to organize co-occurrence constraints among entity types, triggers and relations in a holistic graph view. |
| Outcome: | The proposed method outperforms baselines significantly and achieves state-of-the-art performance on document-level and sentence-level RE benchmarks. |
Fake Alignment: Are LLMs Really Aligned Well? (2024.naacl-long)
Copied to clipboard
Yixu Wang, Yan Teng, Kexin Huang, Chengqi Lyu, Songyang Zhang, Wenwei Zhang, Xingjun Ma, Yu-Gang Jiang, Yu Qiao, Yingchun Wang
| Challenge: | Existing studies on large language models have shown that they are poorly aligned in practice. |
| Approach: | They propose a framework to evaluate safety in large language models . they propose two new metrics to quantify fake alignment and obtain corrected performance estimation. |
| Outcome: | The proposed framework and two metrics show that some models with purported safety are poorly aligned in practice. |
Rethinking Jailbreak Detection of Large Vision Language Models with Representational Contrastive Scoring (2026.acl-long)
Copied to clipboard
| Challenge: | Large Vision-Language Models (LVLMs) are vulnerable to a growing array of multimodal jailbreak attacks, necessitating a generalizable defense that is efficient for practical deployment. |
| Approach: | They propose a framework that uses a lightweight projection to separate benign and malicious inputs in safety-critical layers. |
| Outcome: | The proposed framework enables a simple yet powerful contrastive score that differentiates true malicious intent from mere distribution shift. |
SEAD: A Surrogate-free Label-only Membership Inference Attack against Pre-trained LLMs with Semantic-Aware Density (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing membership inference attacks require access to complete logits, but such access is often unavailable in real-world deployments where only the generated text is exposed. |
| Approach: | They propose a surrogate-free label-only MIA approach that directly estimates token probabilities through Monte Carlo sampling of the target model. |
| Outcome: | The proposed approach outperforms existing label-only attacks and serves as a foundational density estimator in the label-exclusive setting. |
AOT*: Efficient Synthesis Planning via LLM-Empowered AND-OR Tree Search (2026.findings-acl)
Copied to clipboard
| Challenge: | Experimental evaluation shows that AOT* achieves competitive solve rates using 3-5 fewer iterations than existing LLM-based approaches. |
| Approach: | They propose a framework that integrates LLM-generated chemical synthesis pathways with systematic AND-OR tree search. |
| Outcome: | Experimental results show that AOT* improves search efficiency and solves faster than existing approaches. |
Retrieval-augmented GUI Agents with Generative Guidelines (2025.emnlp-main)
Copied to clipboard
| Challenge: | GUI agents powered by vision-language models struggle with real-world tasks due to their complex nature and limited training data. |
| Approach: | They propose a lightweight vision-language model that leverages web tutorials at inferencetime to synthesize GUI agents. |
| Outcome: | The proposed agent outperforms baseline GUI agents and surpasses other inference baselines by 2.6% to 13.3% across two model sizes. |
Joint Semantic and Strategy Matching for Persuasive Dialogue (2023.findings-emnlp)
Copied to clipboard
Chuhao Jin, Yutao Zhu, Lingzhen Kong, Shijie Li, Xiao Zhang, Ruihua Song, Xu Chen, Huan Chen, Yuchong Sun, Yu Chen, Jun Xu
| Challenge: | Persuasive dialogue models rely on utterance semantic matching and a key aspect has been ignored . compared with utterrance semantics, conversation strategies are high-level concepts, which can be informative and provide complementary information to achieve effective persuation. |
| Approach: | They propose to model conversation semantics and strategies to match them using a BERT-like module and an auto-regressive predictor. |
| Outcome: | The proposed model improves state-of-the-art by 5% on a small and 37% on 'large' datasets. |
SERE: Structural Example Retrieval for Enhancing LLMs in Event Causality Identification (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated strong performance across various NLP tasks, but their effectiveness in ECI remains limited due to biases in causal reasoning. |
| Approach: | They propose a structural example retrieval framework that leverages LLMs’ few-shot learning capabilities to help LLM models in ECI. |
| Outcome: | The proposed framework leverages LLMs’ few-shot learning capabilities to guide LLM models in causal reasoning, mitigating bias and improving accuracy. |
DuReadervis: A Chinese Dataset for Open-domain Document Visual Question Answering (2022.findings-acl)
Copied to clipboard
| Challenge: | Open-domain question answering is a task that requires answering questions based on a collection of document images. |
| Approach: | They propose to use document images to answer questions using layouts and visual features instead of text. |
| Outcome: | The proposed approach reduces human cost and improves scalability of QA systems by incorporating layouts and visual features. |
ToolCPT: Improving Tool Utilization in LLM Agents via Continuous Pre-training (2026.findings-acl)
Copied to clipboard
| Challenge: | Current approaches to enhancing tool use for LLM-based agents focus on post-training fine-tuning or test-time context extension. |
| Approach: | They propose to enhance tool knowledge for LLM-based agents during continuous pre-training . they curate 5.1 million code artifacts from large-scale, high-quality code repositories . |
| Outcome: | The proposed model outperforms existing methods on out-of-distribution tools on multiple benchmarks. |
ProphetNet: Predicting Future N-gram for Sequence-to-SequencePre-training (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing sequence-to-sequence models are optimized for future n-gram prediction and n stream self-attention mechanism. |
| Approach: | They propose a self-supervised objective called future n-gram prediction and the proposed n stream self-attention mechanism to optimize the model for sequence-to-sequence learning. |
| Outcome: | The proposed model achieves state-of-the-art on CNN/DailyMail, Gigaword, and SQuAD 1.1 benchmarks compared to the models using the same scale pre-training corpus. |
ProcessBench: Identifying Process Errors in Mathematical Reasoning (2025.acl-long)
Copied to clipboard
Chujie Zheng, Zhenru Zhang, Beichen Zhang, Runji Lin, Keming Lu, Bowen Yu, Dayiheng Liu, Jingren Zhou, Junyang Lin
| Challenge: | Existing models fail to generalize to more challenging math problems, authors say . existing benchmarks related to assessing language models' reasoning process are limited . |
| Approach: | They propose a tool to measure language models' ability to identify erroneous steps in reasoning . they use two types of models: process reward models and critic models . |
| Outcome: | The proposed model outperforms existing models in evaluating language models' reasoning process . the best open-source model has demonstrated the critique capability competitive with the proprietary model . |
Multimodal Clickbait Detection by De-confounding Biases Using Causal Representation Inference (2024.emnlp-main)
Copied to clipboard
| Challenge: | a new method to detect clickbait posts on the Web is needed to detect such posts. |
| Approach: | They propose a method to detect clickbait posts on the Web using latent factors . they use features in multiple modalities to characterize the posts and causal inference to eliminate noise . |
| Outcome: | The proposed method can detect clickbait posts on popular social media platforms with good generalization ability. |
Beyond Guilt: Legal Judgment Prediction with Trichotomous Reasoning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Current legal large language models lack trichotomous reasoning capabilities due to the absence of an appropriate benchmark dataset. |
| Approach: | They propose a benchmark dataset for Legal Judgment Prediction with Innocent Verdicts that incorporates trichotomous dogmatics into zero-shot prompting and fine-tuning. |
| Outcome: | The proposed dataset extends three widely-used legal datasets through LLM-based augmentation and manual verification. |
Crossing the Reward Bridge: Expanding Reinforcement Learning with Verifiable Rewards Across Diverse Domains (2026.acl-long)
Copied to clipboard
| Challenge: | Reinforcement learning with verifiable rewards (RLVR) has been effective on structured tasks, but its reliance on simple, rule-based verifiers creates a bottleneck. |
| Approach: | They propose a framework that uses a generative verifier to provide soft, probabilistic rewards. |
| Outcome: | The proposed framework outperforms existing models up to 10x their size and can be scalable and effective. |
RMTBench: Benchmarking LLMs Through Multi-Turn User-Centric Role-Playing (2025.findings-emnlp)
Copied to clipboard
Hao Xiang, Tianyi Tang, Yang Su, Bowen Yu, An Yang, Fei Huang, Yichang Zhang, Yaojie Lu, Hongyu Lin, Xianpei Han, Jingren Zhou, Junyang Lin, Le Sun
| Challenge: | Existing benchmarks focus on character-centric approach and fail to reflect real-world applications. |
| Approach: | RMTBench is a user-centric bilingual role-playing benchmark featuring 80 diverse characters and over 8,000 dialogue rounds. |
| Outcome: | RMTBench features 80 diverse characters and over 8,000 dialogue rounds. |
From Scores to Steps: Diagnosing and Improving LLM Performance in Evidence-Based Medical Calculations (2025.emnlp-main)
Copied to clipboard
Benlu Wang, Iris Xia, Yifan Zhang, Junda Wang, null Feiyun Ouyang, Shuo Han, Arman Cohan, Hong Yu, Zonghai Yao
| Challenge: | Existing benchmarks assess only the final answer with a wide numerical tolerance, overlooking systematic reasoning failures and potentially causing serious clinical misjudgments. |
| Approach: | They propose a new step-by-step evaluation pipeline that assesses formula selection, entity extraction, and arithmetic computation. |
| Outcome: | The proposed method improves the accuracy of large language models on medical benchmarks from 16.35% to 53.19%. |
A Large Scale Speech Sentiment Corpus (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing corpus for sentiment analysis uses text inputs, but voice inputs are becoming more important as smart assistants and mobile voice control become more prevalent. |
| Approach: | They propose to extend the Switchboard-1 Telephone Speech Corpus by adding sentiment labels from 3 different human annotators for every transcript segment. |
| Outcome: | The proposed corpus contains 49500 labeled speech segments covering 140 hours of audio. |
AgentAsk: Multi-Agent Systems Need to Ask (2026.acl-long)
Copied to clipboard
Bohan Lin, Kuo Yang, Zelin Tan, Yingchuan Lai, Chen Zhang, Guibin Zhang, Xinlei Yu, Miao Yu, Xu Wang, Yudong Zhang, Yang Wang
| Challenge: | Multi-agent systems fail to consistently outperform strong single-a agent baselines due to error propagation at inter-aggent message handoffs. |
| Approach: | They propose an edge-level error taxonomy that identifies four main errors in multi-agent interactions as data gaps, signal corruption, referential drift and capacity gaps as primary sources of failure. |
| Outcome: | The proposed module outperforms existing systems on five benchmarks and is architecture-agnostic. |
Cold-Start Data Selection for Better Few-shot Language Model Fine-tuning: A Prompt-based Uncertainty Propagation Approach (2023.acl-long)
Copied to clipboard
| Challenge: | Pre-trained language models (PLMs) have achieved competitive performance with limited labeled data for many NLP tasks. |
| Approach: | They propose a prompt-based data selection method for pre-trained language models fine-tuning under cold-start scenarios. |
| Outcome: | The proposed method outperforms the strongest cold-start data selection baselines on six text classification datasets with 128 labels. |
Label-Aware Double Transfer Learning for Cross-Specialty Medical Named Entity Recognition (N18-1)
Copied to clipboard
Zhenghui Wang, Yanru Qu, Liheng Chen, Jian Shen, Weinan Zhang, Shaodian Zhang, Yimei Gao, Gen Gu, Ken Chen, Yong Yu
| Challenge: | NER is a fundamental problem for medical text mining because of the difference of specialties and cost of human annotation. |
| Approach: | They propose a label-aware double transfer learning framework for medical NER from electronic medical records. |
| Outcome: | The proposed framework improves accuracy over strong baselines on 12 cross-specialty NER tasks. |
S2O: Early Stopping for Sparse Attention via Online Permutation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing block-granularity sparsification can reduce latency, but coarse blocks impose an intrinsic sparsity ceiling. |
| Approach: | They propose a method that performs early stopping for sparse attention via online permutation. |
| Outcome: | The proposed approach reduces the complexity of the model and its performance. |
Semi-Supervised Lifelong Language Learning (2022.findings-emnlp)
Copied to clipboard
Yingxiu Zhao, Yinhe Zheng, Bowen Yu, Zhiliang Tian, Dongkyu Lee, Jian Sun, Yongbin Li, Nevin L. Zhang
| Challenge: | Existing methods to learn languages only focus on supervised learning, and unlabeled data is underexplored. |
| Approach: | They propose a semi-supervised lifelong language learning setting where a model learns sequentially arriving language tasks with both labeled and unlabeled data. |
| Outcome: | The proposed model outperforms baseline models on various language tasks and is effective and superior to existing models. |
AdaDHP: Fine-Grained Fine-Tuning via Dual Hadamard Product and Adaptive Parameter Selection (2025.acl-long)
Copied to clipboard
| Challenge: | Increasing number of parameters can be challenging under resource-constrained environments. |
| Approach: | They propose a parameter-efficient fine-tuning method with fewer parameters and finer granularity that can adaptively select important parameters for each task. |
| Outcome: | The proposed method can fine-tune important parameters for each task, while maintaining the same weights. |
Generative Music Models’ Alignment with Professional and Amateur Users’ Expectations (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent years have witnessed rapid advances in text-to-music generation using large language models. |
| Approach: | They propose a task to align AI-generated music with human expressions . they use a dataset of over 1.5 million songs to analyze their content . |
| Outcome: | The proposed framework outperforms baseline models and facilitates end-to-end generation of songs audio. |
An Operation Network for Abstractive Sentence Compression (C18-1)
Copied to clipboard
| Challenge: | Sentence compression is a natural language generation task that condenses a sentence . Delete-based models remove unimportant words from the source sentence and generate a shorter sentence if the source is not a word deletion problem. |
| Approach: | They propose a neural network approach for abstractive sentence compression . they model the sentence compression process as an editing procedure . |
| Outcome: | The proposed approach outperforms state-of-the-art models in the abstractive sentence compression field. |
Hetero-Designer: Automated Design of Multi-Agent Systems with Heterogeneous LLMs (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to design LLM-based Multi-agent systems are constrained by homogeneous LLMs. |
| Approach: | They propose an automated design of heterogeneous-LLMs-based MAS with a binary-star transformer and an autoregressive graph generation pipeline. |
| Outcome: | The proposed pipeline is high-performing on various benchmarks and extensible to unseen LLMs and roles. |
Bridging Text and Knowledge with Multi-Prototype Embedding for Few-Shot Relational Triple Extraction (2020.coling-main)
Copied to clipboard
| Challenge: | Existing approaches to supervised relational triple extraction require huge amounts of labeled data. |
| Approach: | They propose a multi-prototype embedding network model to extract the composition of relational triples from unstructured text. |
| Outcome: | The proposed method improves the performance of the few-shot relational triple extraction problem. |
Experience is the Teacher: Reusing Atomic Thoughts from LLMs to Improve Medical Dialogue (2026.findings-acl)
Copied to clipboard
Guangya Yu, Hui Luo, Qi Ye, Ruihui Hou, Weiyan Zhang, Mingxi Shang, Xuanwu Li, ChunMing Wang, Tong Ruan
| Challenge: | Recent large reasoning models (LLMs) lack dynamic and diverse thinking capabilities . reusing atomic thoughts provides a practical pathway toward dynamic reasoning . |
| Approach: | They propose a framework that extracts atomic thoughts from teacher models and reuses them to guide reasoning and generate responses. |
| Outcome: | The proposed framework extracts atomic thoughts from teacher models and reuses them to guide reasoning and generate responses. |
EVEDIT: Event-based Knowledge Editing for Deterministic Knowledge Propagation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing knowledge editing approaches only operate on (subject, relation, object) triple . current methods are limited to (substance, relation) triple, causing low confidence in their answers. |
| Approach: | They propose a task of event-based knowledge editing that pairs facts with event descriptions to improve model confidence. |
| Outcome: | The proposed method improves model confidence by 55.6% while maintaining the naturalness of generation. |
Licon: A Diverse, Controllable and Challenging Linguistic Concept Learning Benchmark (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for Concept Learning focus on visual information, but visual information cannot present abstract concepts exactly, which struggles the introduction of novel concepts related to known concepts. |
| Approach: | They propose a benchmark where concepts in diverse forms are defined by linguistic descriptions and an entailment-based concept learning method to model the relationship among concepts. |
| Outcome: | The proposed benchmark is based on the existing visual concepts learning benchmarks and will be released to the public soon. |
TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Control (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing models fail to generate singing voices rich in stylistic nuances for unseen singers due to multifaceted nature of singing styles. |
| Approach: | They propose a zero-shot SVS model for style transfer across cross-lingual speech and singing styles and multi-level style control. |
| Outcome: | Experimental results show that TCSinger outperforms baseline models in synthesis quality, singer similarity, and style controllability. |
Layer-aware Dual-directional Modulation for Low-resource Machine Translation (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated excellent performance in Machine Translation (MT) however, a performance gap persists between high-resource and low-resourced languages due to imbalanced pre-training data. |
| Approach: | They propose a layer-wise metric to quantify the activation divergence between high- and low-resource languages. |
| Outcome: | The proposed model outperforms standard LoRA fine-tuning on Chinese-to-seven low-resource language translations. |
Agent-in-the-Loop: A Data Flywheel for Continuous Improvement in LLM-based Customer Support (2025.emnlp-industry)
Copied to clipboard
Cen Zhao, Tiantian Zhang, Hanchen Su, Yufeng Zhang, Shaowei Su, Mingzhi Xu, Yu Liu, Wei Han, Jeremy Werner, Claire Na Cheng, Yashar Mehdad
| Challenge: | Existing offline approaches to improve an LLM-based customer support system rely on batch annotations. |
| Approach: | They propose an agent-in-the-loop framework that integrates four key types of annotations directly into live customer operations: (1) pairwise response preferences, (2) agent adoption and rationales, (3) knowledge relevance checks, and (4) identification of missing knowledge. |
| Outcome: | The proposed framework reduces retraining cycles from months to weeks by integrating four key types of annotations directly into live customer operations. |
FactVerse: A Benchmark for Factual Consistency in Interleaved Image–Text Generation (2026.acl-long)
Copied to clipboard
Yubo Shan, Kun Zhang, Qiming Xu, Liping Cao, Yingying Cao, Jian Zhang, Yu Wang, Jingyuan Li, Yuanzhuo Wang
| Challenge: | Existing benchmarks lack effective mechanisms to evaluate factual consistency in interleaved image-text generation. |
| Approach: | They propose a benchmark dedicated to evaluating factual consistency in interleaved image-text generation. |
| Outcome: | The proposed framework outperforms existing evaluation methods in evaluating factual consistency in interleaved image-text generation. |
Prompt-Guided Internal States for Hallucination Detection of Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) generate incorrect or logically incorrect responses, which is known as LLM hallucinations. |
| Approach: | They propose a framework for supervised hallucination detection using in-domain data by prompting changes to the structure related to text truthfulness in LLMs’ internal states. |
| Outcome: | The proposed framework enhances the cross-domain generalization of existing hallucination detection methods. |
Logical Phase Transitions: Understanding Collapse in LLM Logical Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Symbolic logical reasoning is a critical yet underexplored capability of large language models (LLMs). |
| Approach: | They propose a framework that aligns natural language with logical symbols to establish a shared representation and reshapes training dynamics around phase-transition boundaries to progressively strengthen reasoning at increasing logical depths. |
| Outcome: | The proposed framework mitigates logical reasoning collapse at high complexity while improving generalization to unseen logical compositions. |
Corrupted but Not Broken: Understanding and Mitigating the Negative Impacts of Corrupted Data in Visual Instruction Tuning (2025.emnlp-main)
Copied to clipboard
Yunhao Gou, Hansi Yang, Zhili Liu, Kai Chen, Yihan Zeng, Lanqing Hong, Zhenguo Li, Qun Liu, Bo Han, James Kwok, Yu Zhang
| Challenge: | Visual Instruction Tuning (VIT) aims to enhance Multimodal Large Language Models (MLLMs), but its effectiveness is often compromised by corrupted datasets with issues such as hallucinated content and poor OCR quality. |
| Approach: | They propose a corruption-robust training paradigm that surpasses existing strategies for mitigating the effects of corrupted data. |
| Outcome: | The proposed training paradigm surpasses existing strategies for mitigating the effects of corrupted data. |
JointLK: Joint Reasoning with Language Models and Knowledge Graphs for Commonsense Question Answering (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing KG-augmented models for commonsense question answering ignore the effectively fusing and reasoning over question context representations and the KG representations. |
| Approach: | They propose a novel model which combines a logical reasoning and a dynamic pruning mechanism to solve these limitations. |
| Outcome: | The proposed model improves existing models and performs interpretable reasoning on the CommonsenseQA and OpenBookQA datasets. |
MuTual: A Dataset for Multi-Turn Dialogue Reasoning (2020.acl-main)
Copied to clipboard
| Challenge: | Existing non-task oriented dialogue systems can yield a relevant and fluent response, but sometimes make logical mistakes because of weak reasoning capabilities. |
| Approach: | They propose a dataset for multi-turn dialogue reasoning that uses annotated dialogues to train a machine to handle various reasoning problems. |
| Outcome: | Empirical results show that state-of-the-art methods only reach 71%, far behind human performance of 94%. |
Editing the Moving World: Model Editing for Video LLMs (2026.acl-long)
Copied to clipboard
Qian Zhang, Xinye Li, Xiaokai Wu, Junhao Xu, Zhanyue Qin, Qingbin Liu, Junxian Cai, Xi Chen, Bolin Zhang, Zhiying Tu, Dianhui Chu, Xiaoyan Yu, Dianbo Sui
| Challenge: | Existing models for knowledge editing focus on knowledge-level or static visual domains, overlooking dynamic semantics. |
| Approach: | They propose a benchmark for modeling large language models using six representative models . they analyze the strengths and limitations of existing models and identify new directions . |
| Outcome: | The proposed benchmark extends existing models from static modalities to dynamic video scenarios. |
LEMON: Reviving Stronger and Smaller LMs from Larger LMs with Linear Parameter Fusion (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods to train a stronger and smaller model with the help of large models are limited by the model size and performance. |
| Approach: | They propose to learn competent initial points for smaller models by fusing parameters from larger models and introduce controllable receptive fields to model prior parameter characteristics. |
| Outcome: | The proposed method outperforms baselines in terms of effectiveness and efficiency. |
HuatuoGPT, Towards Taming Language Model to Be a Doctor (2023.findings-emnlp)
Copied to clipboard
Hongbo Zhang, Junying Chen, Feng Jiang, Fei Yu, Zhihong Chen, Guiming Chen, Jianquan Li, Xiangbo Wu, Zhang Zhiyi, Qingying Xiao, Xiang Wan, Benyou Wang, Haizhou Li
| Challenge: | Experimental results show that the distilled language model outperforms its teacher model (ChatGPT) in most cases. |
| Approach: | They propose a Large Language Model (LLM) that leverages both distilled data from **ChatGPT** and real-world data from**doctors** in the supervised fine-tuning stage. |
| Outcome: | The proposed model outperforms the teacher model in most cases by using additional real-world data and RLMF to align the language model with the merits of both sources. |
Affect inTweets: A Transfer Learning Approach (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing machine learning models require considerable effort to design task specific features to understand affectual states of people. |
| Approach: | They propose a transfer-learning based approach to infer the affectual state of a person from tweets. |
| Outcome: | The proposed model ranks 2nd, 4th and 6th in four of the four subtasks on SemEval-2018 task 1: Affect in Tweets. |
Knowledge Graph Enhanced Neural Machine Translation via Multi-task Learning on Sub-entity Granularity (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods to integrate knowledge graph (KG) with neural machine translation (NMT) have two problems: knowledge under-utilization and granularity mismatch. |
| Approach: | They propose a multi-task learning method on sub-entity granularity to combine machine translation and knowledge reasoning tasks. |
| Outcome: | The proposed method significantly outperforms baseline models on translation tasks and handling the entities. |
AIPO: Adaptive Information Guided Token-Level Reinforcement Learning for Large Language Model Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing RLVR methods focus on all generated tokens rather than on which tokens contribute to reasoning. |
| Approach: | They propose to use a Random–Fourier approximation of the Hilbert–Schmidt Independence Criterion to focus updates on decisive tokens discovered on the fly to improve the efficiency of mutual-information estimation. |
| Outcome: | The proposed approach yields +20% accuracy over strong RLVR baselines while updating merely 10% of tokens, demonstrating superior efficiency and effectiveness. |
Few-Shot Dialogue Summarization via Skeleton-Assisted Prompt Transfer in Prompt Tuning (2024.eacl-long)
Copied to clipboard
Kaige Xie, Tong Yu, Haoliang Wang, Junda Wu, Handong Zhao, Ruiyi Zhang, Kanak Mahadik, Ani Nenkova, Mark Riedl
| Challenge: | Existing prompt transfer techniques lack consideration for dialogue-specific information. |
| Approach: | They propose a method which leverages skeleton generation as extra supervision that functions as a medium connecting the distinct source and target task. |
| Outcome: | The proposed method significantly outperforms baselines on two dialogue summarization benchmarks. |
SyntaxSQLNet: Syntax Tree Networks for Complex and Cross-Domain Text-to-SQL Task (D18-1)
Copied to clipboard
| Challenge: | Existing studies in text-to-SQL do not require generating complex SQL queries with multiple clauses or sub-queries. |
| Approach: | They propose a syntax tree network to address the complex text-to-SQL generation task. |
| Outcome: | The proposed model outperforms the current state-of-the-art model by 9.5% on a large text-to-SQL corpus. |
LEMON: Language-Based Environment Manipulation via Execution-Guided Pre-training (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to language-based environment manipulation are difficult to generalize across environments. |
| Approach: | They propose a general framework for language-based environment manipulation tasks that can deal with various environments using the same generative language model. |
| Outcome: | The proposed framework achieves new state-of-the-art results on four of the tasks and the execution-guided pre-training strategy brings remarkable improvements on all experimental tasks. |
Reverse Modeling in Large Language Models (2025.naacl-short)
Copied to clipboard
| Challenge: | Using pre-trained LLMs with reversed text inputs can improve their performance across multiple languages. |
| Approach: | They propose a way to determine whether LLMs can understand reversed text inputs by reversing entire paragraphs or documents at the token level. |
| Outcome: | The proposed model can be used to improve understanding across multiple languages. |
On Commonsense Cues in BERT for Solving Commonsense Tasks (2021.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained language models can capture syntactic features, semantic information and factual knowledge, but structured commonsense knowledge is not captured well. |
| Approach: | They quantitatively investigate the presence of structural commonsense cues in BERT when solving commonsensense tasks and the importance of such cue for the model prediction. |
| Outcome: | The presence of commonsense knowledge is positively correlated to the model accuracy. |
Gradient Imitation Reinforcement Learning for Low Resource Relation Extraction (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to extract relation facts from limited labeled corpora are laborintensive to obtain . Existing approaches use self-training to generate pseudo labels that will cause gradual drift problem or leverage meta-learning scheme which does not solicit feedback explicitly. |
| Approach: | They propose a Gradient Imitation Reinforcement Learning method to encourage pseudo label data to imitate gradient descent direction on labeled data and bootstrap its optimization capability through trial and error. |
| Outcome: | The proposed method handles two major scenarios in low-resource relation extraction when no unlabeled data is available. |
LoRAPrune: Structured Pruning Meets Low-Rank Parameter-Efficient Fine-Tuning (2024.findings-acl)
Copied to clipboard
| Challenge: | Low-rank adaption (LoRA) is a low-level pruning method that can be expensive and slow to deploy. |
| Approach: | They propose a low-rank adaption pruning framework that provides an accurate structured pruned model in a memory-efficient manner. |
| Outcome: | The proposed pruning framework reduces perplexity and memory usage by 52.6% on LLaMA and T5 models while reducing memory usage. |
Investigating Dynamic Routing in Tree-Structured LSTM for Sentiment Analysis (D19-1)
Copied to clipboard
| Challenge: | Existing deep neural network models such as LSTM and tree-LSTM have a bias problem where the words in the tail of a sentence are more heavily emphasized than those in the header. |
| Approach: | They propose a capsule tree-LSTM model that uses dynamic routing to build sentence representations by assigning different weights to nodes according to their contributions to prediction. |
| Outcome: | The proposed model improves on the Stanford Sentiment Treebank and EmoBank datasets. |
Analyzing LLMs’ Knowledge Boundary Cognition Across Languages Through the Lens of Internal Representations (2025.acl-long)
Copied to clipboard
| Challenge: | Understanding the knowledge boundaries of Large Language Models (LLMs) is crucial to prevent hallucination, but research on the knowledge boundary perceptions of LLMs has predominantly focused on English. |
| Approach: | They propose a training-free alignment method that effectively transfers knowledge boundary perception ability across languages, thereby helping reduce hallucination risk in low-resource languages. |
| Outcome: | The proposed method reduces hallucination risk in low-resource languages by fine-tuning on bilingual question pair translation. |
DSVD: Dynamic Self-Verify Decoding for Faithful Generation in Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to reliability of large language models often lack self-correction or use costly post-hoc verification. |
| Approach: | They propose a decoding framework that enhances generation reliability through real-time hallucination detection and efficient error correction. |
| Outcome: | Extensive experiments across five benchmarks show the proposed framework improves truthfulness and factual accuracy. |
Beyond Query Memorization: Large Language Model Routing with Query Decomposition and Historical Matching (2026.acl-long)
Copied to clipboard
Bo Lv, Jingbo Sun, Jianwei Lv, Chen Tang, Shaojie Zhang, Nayu Liu, Guoxin Yu, Zihao Li, Qichao Zhang, Dongbin Zhao, Ping Luo, Yue Yu
| Challenge: | Existing routing methods rely on direct mapping from queries to models based on surface-level features, leading to poor generalizability on out-of-distribution data. |
| Approach: | They propose a new routing framework that recasts the routing task as a matching process of sifting similar queries from historical logs. |
| Outcome: | The proposed framework improves matching accuracy while lowering inference costs . it decouples linguistic surface forms from task-intrinsic requirements . |
Outcome Accuracy is Not Enough: Aligning the Reasoning Process of Reward Models (2026.acl-long)
Copied to clipboard
Binghai Wang, Yantao Liu, Yuxuan Liu, Tianyi Tang, Shenzhi Wang, Chang Gao, Chujie Zheng, Yichang Zhang, Le Yu, Shixuan Liu, Tao Gui, Qi Zhang, Xuanjing Huang, Bowen Yu, Fei Huang, Junyang Lin
| Challenge: | Recent studies observe a phenomenon where reward models achieve high accuracy on static datasets but fail to generalize effectively during RLHF. |
| Approach: | They propose a method that combines rationale consistency with outcome accuracy to improve performance on RM-Bench and JudgeBench. |
| Outcome: | The proposed method surpasses baselines on RM-Bench and JudgeBench by an average of 5% and improves creative writing tasks by 7%. |
G-Safeguard: A Topology-Guided Security Lens and Treatment on LLM-based Multi-agent Systems (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Model (LLM)-based Multi-agent Systems (MAS) have demonstrated remarkable capabilities in various complex tasks, but their vulnerability to adversarial attacks, misinformation propagation, and unintended behaviors have raised significant concerns. |
| Approach: | They propose a topology-guided security lens and treatment for robust LLM-MAS that leverages graph neural networks to detect anomalies on the multi-agent utterance graph and employ topological intervention for attack remediation. |
| Outcome: | Experiments show that the proposed security lens recovers 40% of the performance under various attack strategies and integrates with mainstream MAS with security guarantees. |
Marco-Bench-MIF: On Multilingual Instruction-Following Capability of Large Language (2025.acl-long)
Copied to clipboard
Bo Zeng, Chenyang Lyu, Sinuo Liu, Mingyan Zeng, Minghao Wu, Xuanfan Ni, Tianqi Shi, Yu Zhao, Yefeng Liu, Chenyu Zhu, Ruizhe Li, Jiahui Geng, Qing Li, Yu Tong, Longyue Wang, Weihua Luo, Kaifu Zhang
| Challenge: | Existing datasets for instruction-following are monolingual and centered on English . existing data are unable to capture linguistic and cultural subtle differences . |
| Approach: | They propose an extension of IFEval to a localized multilingual version called Marco-Bench-MIF . their benchmark addresses linguistic constraints and cultural references via translation and verification . |
| Outcome: | The proposed extension of IFEval to a localized multilingual version covers 30 languages with varying levels of localization. |
Towards Interpretable Tabular Reasoning: Enhancing LLM Reasoning on Tabular Data with Pre-Constructed Logic Graph (2026.acl-long)
Copied to clipboard
Lirong Gao, Zewei Yu, Zhongrui Yin, Qi Zhang, Yuke Zhu, Bo Zheng, Haobo Wang, Junbo Zhao, Gang Chen, Sheng Guo
| Challenge: | Tabular data is used in fields such as finance and healthcare due to its heterogeneity and complexity. |
| Approach: | They propose a Logic-Graph-Enhanced LLM Reasoning framework that integrates the strengths of tree-based models and LLMs to improve their interpretability. |
| Outcome: | The proposed framework outperforms tree-based models and state-of-the-art LLMs on tabular prediction tasks, achieving superior accuracy and interpretability. |
I²B-LPO: Latent Policy Optimization via Iterative Information Bottleneck (2026.acl-long)
Copied to clipboard
Huilin Deng, Hongchen Luo, Yue Zhu, Long Li, Zhuoyue Chen, Xinghao Zhao, Ming LI, Chuyang Zhao, Jihai Zhang, MengChang Wang, Yang Cao, Yu Kang
| Challenge: | Existing methods for large language model reasoning suffer from exploration collapse due to the semantic homogeneity of random rollouts. |
| Approach: | They propose to use latent policy optimization via iterative information bottleneck to optimize reasoning trajectories by diversifying reasoning . |
| Outcome: | Empirical results show that the proposed method achieves state-of-the-art performance with margins of up to 5.3% in accuracy and 7.4% in diversity metrics. |
Attend, Translate and Summarize: An Efficient Method for Neural Cross-Lingual Summarization (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for cross-lingual summarization are pipeline-based, but they suffer from error propagation. |
| Approach: | They propose a method that attends to some words in the source text, then translates them into the target language to get the final summary. |
| Outcome: | The proposed method outperforms baseline methods on Chinese-to-English and English-to Chinese summarization tasks. |
AttnPO: Attention-Guided Process Supervision for Efficient Reasoning (2026.acl-long)
Copied to clipboard
Shuaiyi Nie, null Dingsiyu, Wenyuan Zhang, Linhao Yu, Tianmeng Yang, Yao Chen, Weichong Yin, Yu Sun, Hua Wu, Tingwen Liu
| Challenge: | Existing trajectory-level length penalties fail to effectively shorten reasoning length and degrade accuracy, as they treat all reasoning steps uniformly and lack fine-grained signals to distinguish redundancy from necessity. |
| Approach: | They propose a low-overhead process-supervised RL framework that leverages the model’s intrinsic attention signals for step-level credit assignment. |
| Outcome: | The proposed framework reduces reasoning length while improving performance across 9 benchmarks. |
ThinkAnswer Loss: Balancing Semantic Similarity and Exact Matching for LLM Reasoning Enhancement (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for knowledge distillation use Chain-of-Thought (CoT) and answer pairs, but they lack appropriate supervision signals. |
| Approach: | They propose a framework that decouples CoT and answer supervision . the framework applies semantic similarity constraints while maintaining strict literal matching for the answer . |
| Outcome: | The proposed framework decouples CoT and answer supervision while maintaining strict literal matching for the answer. |
SudokuFill: A Multi-Agent Progressive Filling Framework for Document-Level Scientific Information Extraction (2026.findings-acl)
Copied to clipboard
Yang Li, Yajiao Wang, Yu Zhang, Yuanzhe Zhang, Maodi Hu, Mengting Zhang, Xi Sun, Hua Yue, Zhixiong Zhang
| Challenge: | Scientific information extraction (SciIE) is a key bottleneck for turning unstructured papers into computable knowledge bases. |
| Approach: | They propose a scientific information extraction framework that solves a Sudoku problem as a progressive filling problem. |
| Outcome: | The proposed framework outperforms the GPT-4o model on a document-level adjuvant dataset. |
CoTEvol: Self-Evolving Chain-of-Thoughts for Data Synthesis in Mathematical Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to improve LLMs' reasoning abilities suffer from diminishing returns or high computing overhead. |
| Approach: | They propose a genetic evolutionary framework that casts CoT generation as a population-based search over reasoning trajectories. |
| Outcome: | The proposed framework improves correct-CoT synthesis success by over 30% and enhances structural diversity with markedly improved efficiency. |
CLUE: A Chinese Language Understanding Evaluation Benchmark (2020.coling-main)
Copied to clipboard
Liang Xu, Hai Hu, Xuanwei Zhang, Lu Li, Chenjie Cao, Yudong Li, Yechen Xu, Kai Sun, Dian Yu, Cong Yu, Yin Tian, Qianqian Dong, Weitang Liu, Bo Shi, Yiming Cui, Junyi Li, Jun Zeng, Rongzhao Wang, Weijian Xie, Yanting Li, Yina Patterson, Zuoyu Tian, Yiwen Zhang, He Zhou, Shaoweihua Liu, Zhe Zhao, Qipeng Zhao, Cong Yue, Xinrui Zhang, Zhengliang Yang, Kyle Richardson, Zhenzhong Lan
| Challenge: | Existing language evaluation benchmarks for English are limited to English . lack of such benchmarks makes it difficult to replicate success in other languages . |
| Approach: | They introduce a large-scale Chinese language understanding evaluation benchmark . the benchmark uses a set of current state-of-the-art pre-trained Chinese models . |
| Outcome: | The first large-scale Chinese Language Understanding Evaluation (CLUE) benchmark is released . the benchmark evaluates models across a wide range of tasks on original Chinese text . existing language evaluation benchmarks are mostly limited to English . |
Type Enhanced BERT for Correcting NER Errors (2023.findings-acl)
Copied to clipboard
| Challenge: | Named entity recognition (NER) is the task of identifying spans that belong to particular categories, such as person, location, organization, etc. |
| Approach: | They propose a method that integrates named entity’s type information into BERT by an adapter layer and integrates it into a gazetteer. |
| Outcome: | The proposed method outperforms baselines in multiple corpus. |
Towards Tracing Trustworthiness Dynamics: Revisiting Pre-training Period of Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing studies focus on pre-trained LLMs to better understand and improve their trustworthiness. |
| Approach: | They apply linear probing to LLMs to explore five key dimensions of trustworthiness: reliability, privacy, toxicity, fairness, and robustness. |
| Outcome: | The proposed model can distinguish concepts in each trustworthiness dimension, suggesting that it can be trained in early pre-training. |
CompileAgent: Automated Real-World Repo-Level Compilation with Tool-Integrated LLM-based Agent System (2025.acl-long)
Copied to clipboard
Li Hu, Guoqiang Chen, Xiuwei Shang, Shaoyin Cheng, Benlong Wu, LiGangyang LiGangyang, Xu Zhu, Weiming Zhang, Nenghai Yu
| Challenge: | CompileAgent is the first LLM-based agent framework dedicated to repo-level compilation. |
| Approach: | They propose a LLM-based agent framework dedicated to repo-level compilation. |
| Outcome: | The proposed method significantly improves compilation success rate, ranging from 10% to 71%. |
CDT: A Comprehensive Capability Framework for Large Language Models Across Cognition, Domain, and Task (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing benchmarks focus on isolated abilities, lacking a holistic framework for assessing LLM capabilities. |
| Approach: | They propose a Cognition-Domain-Task framework which measures a model’s capabilities across three dimensions. |
| Outcome: | The proposed framework improves performance on dataset evaluation and data selection, while achieving higher scores on general and specific benchmarks. |
UniTabNet: Bridging Vision and Language Models for Enhanced Table Structure Recognition (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Table structure recognition technology is a critical tool for processing and analyzing large volumes of tabular data. |
| Approach: | They propose a framework for table structure parsing based on the image-to-text model and a vision guider to refine the model’s capability to understand textual semantics in table images. |
| Outcome: | The proposed framework improves on a dataset of PubTabNet, PubTables1M, WTW, and iFLYTAB and will be made publicly available. |
Vision-Language Models Mistake Head Orientation for Gaze Direction: Nonverbal Conversation Cues (2026.findings-acl)
Copied to clipboard
Zory Zhang, Pinyuan Feng, Bingyang Wang, Tianwei Zhao, Suyang Yu, Qingying Gao, Hokin Deng, Ziqiao Ma, Yijiang Li, Dezhi Luo
| Challenge: | Where someone looks is a nonverbal communication cue that children and adults readily use. |
| Approach: | They used 1,360 real-world photos to construct evaluation stimuli for Vision-Language Models (VLMs) they found a substantial performance gap between VLMs and humans . |
| Outcome: | The proposed model outperforms existing models in predicting gaze direction using head orientation rather than eye appearance. |
MADS: Multi-Agent Dialogue Simulation for Diverse Persuasion Data Generation (2025.emnlp-industry)
Copied to clipboard
| Challenge: | Recent studies show that LLM-based agents exhibit superior moral and emotional language performance compared to humans, raising expectations for their deployment in persuasive tasks. |
| Approach: | They propose a framework for generating persuasive multi-turn dialogues via agent self-play using user agents designed to simulate diverse persona-driven behaviors, a Dialog Agent executing task-oriented persuasion strategies and an Optimization Agent evaluating and refining dialogue outcomes. |
| Outcome: | The proposed framework significantly improved the persuasion capacity of small LLMs, increasing the organic traffic conversion rate by 22.4% (from 1.83% to 2.24%) . |
CLOWER: A Pre-trained Language Model with Contrastive Learning over Word and Character Representations (2022.coling-1)
Copied to clipboard
Borun Chen, Hongyin Tang, Jiahao Bu, Kai Zhang, Jingang Wang, Qifan Wang, Hai-Tao Zheng, Wei Wu, Liqian Yu
| Challenge: | Pre-trained language models (PLMs) have achieved remarkable performance gains across numerous downstream tasks in natural language understanding. |
| Approach: | They propose a Chinese pre-trained language model that implicitly encodes words into characters . they propose 'contrastive learning over word' and 'character' representations to improve learning . |
| Outcome: | The proposed model can encode words into fine-grained representations without modification of production pipelines. |
RESIN: A Dockerized Schema-Guided Cross-document Cross-lingual Cross-media Information Extraction and Event Tracking System (2021.naacl-demos)
Copied to clipboard
Haoyang Wen, Ying Lin, Tuan Lai, Xiaoman Pan, Sha Li, Xudong Lin, Ben Zhou, Manling Li, Haoyu Wang, Hongming Zhang, Xiaodong Yu, Alexander Dong, Zhenhailong Wang, Yi Fung, Piyush Mishra, Qing Lyu, Dídac Surís, Brian Chen, Susan Windisch Brown, Martha Palmer, Chris Callison-Burch, Carl Vondrick, Jiawei Han, Dan Roth, Shih-Fu Chang, Heng Ji
| Challenge: | We present a new information extraction system that can construct temporal event graphs from news documents. |
| Approach: | They propose a temporal event graph extraction system that can extract news documents . they extend the system from sentence-level event extraction to cross-document cross-media event extraction . |
| Outcome: | The proposed system can extract temporal event graphs from news documents in multiple languages and multiple data modalities. |
Boost, Disentangle, and Customize: A Robust System2-to-System1 Pipeline for Code Generation (2025.findings-acl)
Copied to clipboard
Kounianhua Du, Hanjing Wang, Jianxing Liu, Jizheng Chen, Xinyi Dai, Yasheng Wang, Ruiming Tang, Yong Yu, Jun Wang, Weinan Zhang
| Challenge: | Existing systems 2 methods for code generation are difficult to implement due to the complex hidden reasoning process and heterogeneous data distribution. |
| Approach: | They propose a framework that Boosts reasoning exploration via multi-agent collaboration and Disentangles heterogeneous data into specialized experts. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on APPS and CodeContest benchmarks and achieves 73.8% accuracy on hard problems. |
Word Sense Disambiguation with Knowledge-Enhanced and Local Self-Attention-based Extractive Sense Comprehension (2022.coling-1)
Copied to clipboard
| Challenge: | Word sense disambiguation (WSD) is one of the most challenging tasks in natural language processing. |
| Approach: | They propose a method to extract the right sense from a sentence context . they propose to incorporate additional examples and definitions of related senses in WordNet . |
| Outcome: | The proposed method achieves better performance than baseline models on public benchmark datasets. |
PLAWBENCH: A Rubric-Based Benchmark for Evaluating LLMs in Real-World Legal Practice (2026.acl-long)
Copied to clipboard
Yuzhen Shi, Huanghai Liu, Yiran HU, Song Gaojie, Xu Xinran, Yubo Ma, Tianyi Tang, Li Zhang, Qingjing Chen, Feng Di, Wenbo Lv, Weiheng Wu, Kexin Yang, Sen Yang, Wei Wang, Rongyao Shi, Qiu Yuanyang, Yuemeng Qi, Zhang Jingwen, Sui Xiaoyu, Yifan Chen, Zhang Yi, An Yang, Bowen Yu, Dayiheng Liu, Junyang Lin, Weixing Shen, Bing Zhao, Charles L. A. Clarke, HU Wei
| Challenge: | Existing benchmarks for large language models (LLMs) are coarse, single-dimensional metrics and do not explicitly assess fine-grained legal reasoning. |
| Approach: | They propose a Practical Law Benchmark to evaluate large language models in real-world legal practice scenarios. |
| Outcome: | The proposed model is based on 850 questions and 13 scenarios with expert-designed evaluation rubrics. |
DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection for Conversational AI (2024.findings-eacl)
Copied to clipboard
Jianguo Zhang, Kun Qian, Zhiwei Liu, Shelby Heinecke, Rui Meng, Ye Liu, Zhou Yu, Huan Wang, Silvio Savarese, Caiming Xiong
| Challenge: | DialogStudio is the largest and most diverse collection of dialogue datasets . existing datasets lack diversity and comprehensiveness, authors say . |
| Approach: | They introduce DialogStudio: the largest and most diverse collection of dialogue datasets . DialogStuio aggregates more than 80 diverse dialogue dataset . |
| Outcome: | a new dataset is created to improve the quality and diversity of dialogue datasets . DialogStudio is the largest and most diverse collection of dialogue data . |
Towards Provably Secure Generative AI: Reliable Consensus Sampling (2026.findings-acl)
Copied to clipboard
Yu Cui, Hang Fu, Sicheng Pan, Zhuoyu Sun, Yifei Liu, Yuhong Nie, Bo Ran, Baohan Huang, Xufeng Zhang, Haibin Zhang, Cong Zuo, Licheng Wang
| Challenge: | Existing research on generative AI security is driven by mutually reinforcing attack and defense methodologies grounded in empirical experience. |
| Approach: | They propose a new algorithm that uses a random sampling algorithm to control risk. |
| Outcome: | The proposed algorithm improves robustness and utility while maintaining latency comparable to existing algorithms. |
MARCH: Multi-Agent Reinforced Check for Hallucination (2026.acl-long)
Copied to clipboard
Zhuo Li, Yupeng Zhang, Pengyu Cheng, Jiajun Song, Mengyu Zhou, Hao Li, Shujie Hu, Yu Qin, null Erchao.zec, Xiaoxi Jiang, null Guanjunjiang
| Challenge: | Existing methods to detect hallucinations suffer from inherent confirmation bias, where the verifier inadvertently reproduces the errors of the original generation. |
| Approach: | They propose a framework that enforces rigorous factual alignment by leveraging deliberate *information asymmetry* by combining a pipeline of three specialized agents: a Solver, a Proposer, and a Checker. |
| Outcome: | Extensive experiments across hallucination benchmarks demonstrate that MARCH substantially reduces hallucinism rates. |
Too Correct to Learn: Reinforcement Learning on Saturated Reasoning Data (2026.acl-short)
Copied to clipboard
| Challenge: | Strong base models saturate benchmarks, resulting in weaker performance, a paradox . a new approach to Reinforcement Learning (RL) is needed to improve performance . |
| Approach: | They propose a method that uses constrained uniform top-k sampling to flatten the local optimization landscape by sampling uniformly from constrained high-confidence candidates. |
| Outcome: | Experiments show that the proposed approach prevents policy degeneration and boosts out-of-domain generalization. |
MARS-Bench: A Multi-turn Athletic Real-world Scenario Benchmark for Dialogue Evaluation (2025.findings-emnlp)
Copied to clipboard
Chenghao Yang, Yinbo Luo, Zhoufutu Wen, Qi Chu, Tao Gong, Longxiang Liu, Kaiyuan Zhang, Jianpeng Jiao, Ge Zhang, Wenhao Huang, Nenghai Yu
| Challenge: | Large Language Models (LLMs) have been widely adopted in real-world dialogue applications, but their robustness is criticized all along. |
| Approach: | They propose to use play-by-play text commentary to build a multi-turn athletic real-world scenario dialogue benchmark to evaluate three critical aspects of multi-turned conversations: ultra multi- turn, interactive multi-twist, and cross-turn tasks. |
| Outcome: | The proposed benchmarks outperform open-source LLMs on three critical aspects of multi-turn conversations: ultra multi-turned, interactive multi- turn, and cross-turn tasks. |
STEER: Semantic Turn Extension-Expansion Recognition for Voice Assistants (2023.emnlp-industry)
Copied to clipboard
Leon Zhang, Jiarui Lu, Joel Ruben Antony Moniz, Aditya Kulkarni, Dhivya Piraviperumal, Tien Dung Tran, Nick Tzou, Hong Yu
| Challenge: | Existing training datasets for steering use cases are limited due to the cold-start problem. |
| Approach: | They propose a steering detection model that predicts whether a follow-up turn is a user’s attempt to steer the previous command. |
| Outcome: | The proposed model outperforms existing models on human-graded evaluation sets and shows that it can identify steering intent with over 95% accuracy. |
CAPE: A Chinese Dataset for Appraisal-based Emotional Generation in Large Language Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing LLMs fail to capture the nuances of human emotions, making their interactions seem impersonal or inadequate. |
| Approach: | They propose a two-stage automatic data generation framework to generate a Chinese dataset called CAPE . their data is a cognitive appraisal theory-based Emotional corpus that accounts for personal and situational factors. |
| Outcome: | The proposed framework can generate human-like responses in conversation with large language models. |
EMNLP: Educator-role Moral and Normative Large Language Models Profiling (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing frameworks for evaluating the ethical and moral alignment of large language models (LLMs) in educational AI are lacking. |
| Approach: | They propose a framework for a teacher-role moral and normative LLMs profiling . they extend existing scales and construct 88 teacher-specific moral dilemmas . |
| Outcome: | The proposed framework evaluates compliance and vulnerability of teacher-role LLMs under soft prompt injection. |
Attribution-Based Analysis and Optimization of Modular Agentic Workflows (2026.findings-acl)
Copied to clipboard
Yingxuan Yang, Bo Huang, Siyuan Qi, Chao Feng, Haoyi Hu, Yuxuan Zhu, Jinbo Hu, Haoran Zhao, Ziyi He, Xiao Liu, ZongYu Wang, Muning Wen, Lin Qiu, Xuezhi Cao, Xunliang Cai, Yong Yu, Weinan Zhang
| Challenge: | Large Language Models (LLMs) have driven the rise of agentic workflows . yet, how can we attribute performance gains to individual upgrades and their interactions? |
| Approach: | They propose a game-theoretic framework that models component upgrades as players and evaluates component coalitions to compute Shapley values. |
| Outcome: | The proposed framework provides interaction-aware attribution and recommendation for model allocation under a fixed workflow structure. |
Semantic-Aware Logical Reasoning via a Semiotic Framework (2026.acl-long)
Copied to clipboard
Yunyao Zhang, Xinglang Zhang, Junxi Sheng, Wenbing Li, Junqing Yu, Yi-Ping Phoebe Chen, Wei Yang, Zikai Song
| Challenge: | Existing studies largely overlook the interplay between logical complexity and semantic complexity, limiting their robustness under abstract propositions, ambiguous contexts, and conflicting stances. |
| Approach: | They propose a semiotic-square-guided framework that integrates automated deduction with reflective verification to manage logical complexity across deeper reasoning chains. |
| Outcome: | The proposed framework achieves state-of-the-art performance on RepublicQA with 6.25% average gain, and generalizes well to four mainstream logical reasoning benchmarks with an additional 7.05% improvement. |
ACT-SQL: In-Context Learning for Text-to-SQL with Automatically-Generated Chain-of-Thought (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies have focused on the development of semantic parsers within the framework of cross-domain analysis. |
| Approach: | They propose a method to generate auto-CoT exemplars using ACT-SQL and extend it to multi-turn text-to-Sql tasks. |
| Outcome: | The proposed method achieves SOTA performance on the Spider dev set among existing in-context learning approaches. |
FedPETuning: When Federated Learning Meets the Parameter-Efficient Tuning Methods of Pre-trained Language Models (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing research on federated learning (FL) for pre-trained language models (PLMs) with increasing concerns about data privacy, enterprises or institutions are not allowed to collect data from end devices or local clients to a centralized server for fine-tuning PLMs. |
| Approach: | They investigate the parameter-efficient tuning of pre-trained language models (PLMs) and develop a federated benchmark for four representative PETuning methods . |
| Outcome: | The proposed method can defend against privacy attacks and maintain acceptable performance with reducing heavy resource consumption. |
CultureSynth: A Hierarchical Taxonomy-Guided and Retrieval-Augmented Framework for Cultural Question-Answer Synthesis (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Cultural competence is defined as the ability to understand and adapt to multicultural contexts. |
| Approach: | They propose a framework that uses a hierarchical multilingual taxonomy and a Retrieval-Augmented Generation to synthesize culturally relevant question-answer pairs. |
| Outcome: | The proposed framework contains a hierarchical multilingual taxonomy covering 12 primary and 130 secondary topics and a Retrieval-Augmented Generation (RAG)-based methodology leveraging factual knowledge to synthesize culturally relevant question-answer pairs. |
Many-Shot Scaling of In-Context Learning with Self-Generated Demonstrations (2026.findings-acl)
Copied to clipboard
| Challenge: | In-context learning methods that use self-generated annotations do not scale to many-shot scenarios. |
| Approach: | They propose a framework analogous to semi-supervised learning that uses self-generated annotations instead of ground truth labels. |
| Outcome: | The proposed framework outperforms ground truth ICL under zero-shot, few-shot and many-shot settings. |
PROBE: PROcess-Based BEnchmark for Hallucination Detection (2026.findings-acl)
Copied to clipboard
Yu Zhang, Peter Belcak, Shizhe Diao, Yonggan Fu, Shaona Ghosh, Morteza Mardani, Eileen Margaret Peters Long, Bei Yu, Pavlo Molchanov
| Challenge: | Existing agentic applications rely on LLMs to self-assess the factuality of outputs . but current LLM systems fail to detect hallucinations . |
| Approach: | They propose a benchmark that breaks down hallucination detection into four critical steps . they show that when halluciation detection is treated as a multi-step process, all models achieve considerably better performance. |
| Outcome: | The proposed benchmark breaks down hallucination detection into four critical steps . it shows that when halluciation detection is treated as a multi-step process, all models achieve considerably better performance. |
Second Language (Arabic) Acquisition of LLMs via Progressive Vocabulary Expansion (2025.acl-long)
Copied to clipboard
Jianqing Zhu, Huang Huang, Zhihang Lin, Juhao Liang, Zhengyang Tang, Khalid Almubarak, Mosen Alharthi, Bang An, Juncai He, Xiangbo Wu, Fei Yu, Junying Chen, Ma Zhuoheng, Yuhao Du, He Zhang, Saied Alshahrani, Emad A. Alghamdi, Lian Zhang, Ruoyu Sun, Haizhou Li, Benyou Wang, Jinchao Xu
| Challenge: | In the evolving landscape of large language models, the predominant focus has been on English and Chinese. |
| Approach: | They propose to utilize Arabic-specific vocabulary in the tokenizer to accelerate decoding. |
| Outcome: | The proposed model achieves decent performance comparable to the best Arabic LLMs across various Arabic benchmarks. |
Bypassing Neural Evaluations for Fast Audio Editing via Adaptive Trajectory Extrapolation (2026.findings-acl)
Copied to clipboard
Xiaoqian Liu, Zhengkun Ge, Jianjin Wang, Haoran Zhang, Yuan Ge, Kaiyan Chang, Chen Xu, Tong Xiao, Zhengtao Yu, Linfeng Zhang, JingBo Zhu
| Challenge: | Recent advances in audio diffusion models have significantly improved text-to-audio editing via inversion techniques, but these models typically rely on dense, fixed-step sampling trajectories to maintain structural integrity. |
| Approach: | They propose a model-agnostic Adaptive Trajectory Extrapolation framework that accelerates inversion-based editing process by dynamically evaluating only the most critical generative phases. |
| Outcome: | The proposed framework achieves a 3.9 speedup with negligible loss in fidelity. |
GAM: Hierarchical Graph-based Agentic Memory for LLM Agents (2026.acl-long)
Copied to clipboard
Zhaofen Wu, Hanrong Zhang, Fulin Lin, Wujiang Xu, Xinran Xu, Yankai Chen, Henry Peng Zou, Shaowen Chen, Weizhi Zhang, Xue Liu, Philip S. Yu, Hongwei Wang
| Challenge: | Current unified stream-based memory systems facilitate context updates but remain vulnerable to interference from transient noise. |
| Approach: | They propose a hierarchical Graph-based Agentic Memory framework that explicitly decouples memory encoding from consolidation to resolve conflict between rapid context perception and stable knowledge retention. |
| Outcome: | The proposed framework outperforms state-of-the-art benchmarks on LoCoMo and LongDialQA. |
RESIN-11: Schema-guided Event Prediction for 11 Newsworthy Scenarios (2022.naacl-demo)
Copied to clipboard
Xinya Du, Zixuan Zhang, Sha Li, Pengfei Yu, Hongwei Wang, Tuan Lai, Xudong Lin, Ziqi Wang, Iris Liu, Ben Zhou, Haoyang Wen, Manling Li, Darryl Hannan, Jie Lei, Hyounghun Kim, Rotem Dror, Haoyu Wang, Michael Regan, Qi Zeng, Qing Lyu, Charles Yu, Carl Edwards, Xiaomeng Jin, Yizhu Jiao, Ghazaleh Kazeminejad, Zhenhailong Wang, Chris Callison-Burch, Mohit Bansal, Carl Vondrick, Jiawei Han, Dan Roth, Shih-Fu Chang, Martha Palmer, Heng Ji
| Challenge: | Existing methods for event prediction are incomplete and noisy. |
| Approach: | They propose to use news-related event schemas to extract newsworthy events . they build a demo website and include a video demonstrating the framework . |
| Outcome: | The proposed framework can be applied to a wide variety of newsworthy scenarios. |
WebVoyager: Building an End-to-End Web Agent with Large Multimodal Models (2024.acl-long)
Copied to clipboard
| Challenge: | Existing web agents only handle one input modality and are evaluated only in simplified web simulators or static web snapshots, greatly limiting their applicability in real-world scenarios. |
| Approach: | They propose a large multimodal model-powered web agent that can complete user instructions end-to-end by interacting with real-world websites. |
| Outcome: | The proposed agent achieves 59.1% task success rate, surpassing both GPT-4 and WebVoyager setups. |
Personalized Federated Learning for Text Classification with Gradient-Free Prompt Tuning (2024.findings-naacl)
Copied to clipboard
Rui Wang, Tong Yu, Ruiyi Zhang, Sungchul Kim, Ryan Rossi, Handong Zhao, Junda Wu, Subrata Mitra, Lina Yao, Ricardo Henao
| Challenge: | Pretrained language models (PLMs) are used for personalized federated learning . communication costs are high with large PLMs, and local training is expensive . |
| Approach: | They propose a framework for federated learning with pretrained language models . they propose 'discrete local search' and compression mechanism for local training . |
| Outcome: | The proposed framework achieves superior performance compared with baselines. |
Template-Based Named Entity Recognition Using BART (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for fewshot NER do not make full use of knowledge transfer in NER model parameters. |
| Approach: | They propose a template-based method for NER that treats NER as a language model ranking problem in a sequence-to-sequence framework. |
| Outcome: | The proposed method achieves 92.55% F1 score on the CoNLL03 task and significantly better than fine-tuning BERT 10.88%, 15.34%, and 11.73% F1 scores on the MIT Movie, the ATIS, and the MATLAB task. |
Beyond Unimodal Shortcuts: MLLMs as Cross-Modal Reasoners for Grounded Named Entity Recognition (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to GMNER use MLLMs as auxiliary tools, causing cumulative error propagation and a lack of rigorous cross-modal verification. |
| Approach: | They propose a model that enforces structured cross-modal reasoning through Multi-style Reasoning Schema Injection and Constraint-guided Verifiable Optimization. |
| Outcome: | The proposed model enforces structured cross-modal reasoning through multi-style Reasoning Schema Injection and Constraint-guided Verifiable Optimization. |
Improving Neural Machine Translation by Multi-Knowledge Integration with Prompting (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods focus on how to integrate multiple types of knowledge into NMT models . |
| Approach: | They propose a framework that integrates multiple types of knowledge into NMT models . they use multiple types as prefix-prompts of input for the encoder and decoder . |
| Outcome: | The proposed framework outperforms baselines on English-Chinese and English-German translation. |
KeFVP: Knowledge-enhanced Financial Volatility Prediction (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Current studies ignore the role of financial metrics knowledge in earnings calls and little consideration is given to integrating text and price information. |
| Approach: | They propose to integrate financial metrics knowledge into text comprehension by knowledge-enhanced adaptive pre-training and effectively incorporating text and price information by introducing a conditional time series prediction module. |
| Outcome: | The proposed method outperforms state-of-the-art methods on three real-world datasets and is effective and reliable. |
Pairwise Prompt-Based Tuning with Parameter Efficient Fast Adaptation for Generalized Zero-Shot Intent Detection (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods to generalize from seen intents to unseen intents are not effective . Xian et al., 2019: a novel approach to generalized zero-shot intent detection is needed . |
| Approach: | They propose a pairwise prompt-based tuning model with parameter efficient fast adaptation . they leverage hybrid contrastive learning in discriminant space and masked language modeling . |
| Outcome: | The proposed model can generalize to unseen intents with the help of seen intents . the proposed model is based on a pairwise prompt-based tuning model with fast adaptation . |
SAD: A Large-Scale Strategic Argumentative Dialogue Dataset (2026.acl-long)
Copied to clipboard
YongKang Liu, Jiayang Yu, Mingyang Wang, Yiqun Zhang, Ercong Nie, Shi Feng, Daling Wang, Kaisong Song, Hinrich Schuetze
| Challenge: | Argumentation is a key part of human reasoning and decision-making . existing argumentative corpora focus on single-turn settings, but multi-turn dialogues are often realized as multi-turned dialogues . |
| Approach: | They present a dataset for strategic multi-turn argumentation dialogues . they annotate each utterance with five strategy types, allowing multiple strategies per utterrance . |
| Outcome: | The proposed dataset shows that explicit prompting improves fluency, stylistic coherence and persuasiveness. |
Training Language Model to Critique for Better Refinement (2025.findings-acl)
Copied to clipboard
Tianshu Yu, Chao Xiang, Mingchuan Yang, Pei Ke, Bosi Wen, Cunxiang Wang, Jiale Cheng, Li Zhang, Xinyu Mu, Chuxiong Sun, Minlie Huang
| Challenge: | Large language models (LLMs) have remarkable evaluation and critique capabilities, providing insightful feedback and identifying flaws in various tasks. |
| Approach: | They propose a framework to train critic models using refinement signals to generate feedback loops where critiques guide the model in refining its responses. |
| Outcome: | The proposed framework outperforms traditional methods and open-source models in terms of critique quality and refinement outcomes. |
Low-Bit Quantization Favors Undertrained LLMs (2025.acl-long)
Copied to clipboard
| Challenge: | Larger models or those trained on fewer tokens exhibit less quantization-induced degradation (QiD), while smaller, well-trained models face significant performance losses. |
| Approach: | They propose to use QiD to measure an LLM’s training levels and determine the number of training tokens required for fully training LLMs of various sizes. |
| Outcome: | The proposed scaling laws can predict the quantization performance of different-sized LLMs trained with tokens. |
DECOR: Improving Coherence in L2 English Writing with a Novel Benchmark for Incoherence Detection, Reasoning, and Rewriting (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing automated writing evaluation systems only detect incoherence in writing . a recent study has found that incorporating specific reasons for incohence improves the quality of rewrites . |
| Approach: | They propose a benchmark that includes expert annotations for detecting incoherence in L2 English writing, identifying the underlying reasons, and rewriting the incoerent sentences. |
| Outcome: | The proposed benchmark improves coherence in L2 English writing by fine-tuning models . the authors find that incorporating specific reasons improves quality of rewrites . |
On the Emotion Understanding of Synthesized Speech (2026.acl-long)
Copied to clipboard
Yuan Ge, Haishu Zhao, AoKai Hao, Junxiang Zhang, Bei Li, Xiaoqian Liu, Chenglong Wang, Jianjin Wang, Bingsen Zhou, Bingyu Liu, JingBo Zhu, Zhengtao Yu, Tong Xiao
| Challenge: | Existing models for emotion understanding do not capture fundamental features of synthesized speech. |
| Approach: | They evaluate emotion recognition models on synthesized speech using SER models and generative models. |
| Outcome: | The proposed model can't generalize to synthesized speech because of speech token prediction . generative models tend to infer emotion from textual semantics while ignoring paralinguistic cues. |
RePair: Automated Program Repair with Process-based Feedback (2024.findings-acl)
Copied to clipboard
| Challenge: | Commercial-scale language models (LMs) have taken APR to unprecedented levels, but they are limited by parameters and humans interact with them through explicit prompts. |
| Approach: | They propose a method that utilizes process supervision to improve program repair by allowing users to input feedback from compilers and test cases. |
| Outcome: | The proposed method outperforms large outcome-based generation methods and is inspired by strategies used in programming competitions. |
Semi-Supervised Dialogue Policy Learning via Stochastic Reward Estimation (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for dialogue policy optimization do not provide sufficient supervision signals at the end of dialogues. |
| Approach: | They propose to learn from state-action pairs of an optimal policy to provide turn-by-turn rewards. |
| Outcome: | The proposed approach outperforms competitive policy learning baselines on a benchmark multi-domain dataset. |
CLaMP 2: Multimodal Music Information Retrieval Across 101 Languages Using Large Language Models (2025.findings-naacl)
Copied to clipboard
Shangda Wu, Yashan Wang, Ruibin Yuan, Guo Zhancheng, Xu Tan, Ge Zhang, Monan Zhou, Jing Chen, Xuefeng Mu, Yuejie Gao, Yuanliang Dong, Jiafeng Liu, Xiaobing Li, Feng Yu, Maosong Sun
| Challenge: | Current music information retrieval systems struggle to meet linguistic diversity challenges . current systems struggle with text queries in non-English languages . |
| Approach: | They propose a music information retrieval system that supports both ABC notation and MIDI . CLaMP 2 includes a multilingual text encoder and a multiple-modal music encoder . |
| Outcome: | The proposed system achieves state-of-the-art results in multilingual semantic search and music classification across modalities. |
Internalizing Multi-Agent Reasoning for Accurate and Efficient LLM-based Recommendation (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are reshaping recommender systems by leveraging extensive world knowledge and semantic reasoning to interpret user intent. |
| Approach: | They propose a single-agent Trajectory-Aligned Recommender to integrate reasoning capabilities into a model by a multi-agend teacher system. |
| Outcome: | The proposed model surpasses its teacher by 8.7% to 39.5% while eliminating iterative latency. |
ObfusLM: Privacy-preserving Language Model Service against Embedding Inversion Attacks (2025.acl-long)
Copied to clipboard
Yu Lin, Ruining Yang, Yunlong Mao, Qizhi Zhang, Jue Hong, Quanwei Cai, Ye Wu, Huiqi Liu, Zhiyu Chen, Bing Duan, Sheng Zhong
| Challenge: | Recent studies show that obfuscation techniques for MLaaS are susceptible to embedding inversion attacks (EIAs). |
| Approach: | They propose a model obfuscation framework that protects client inputs from embedding inversion attacks by obliviously obbing models. |
| Outcome: | The proposed framework outperforms existing works in utility by 10% with a nearly 80% resistance rate against embedding inversion attacks. |
Structure-Aware Zero-Shot Relational Learning for Knowledge Graphs without External Knowledge (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for Zero-shot Relational Learning depend on external knowledge, resulting in increased annotation costs and limited practical applicability. |
| Approach: | They propose a structure-aware paradigm that performs ZRL without external knowledge . it leverages intrinsic structural patterns in KGs to bridge semantic correlations for new relations with existing ones. |
| Outcome: | The proposed paradigm achieves 10.66% improvement in MRR while reducing annotation costs and enhancing practical applicability on three real-world benchmarks. |
EvoBench: Towards Real-world LLM-Generated Text Detection Benchmarking for Evolving Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to detect LLM-generated texts rely on static benchmarks that neglect the evolving nature of LLMs. |
| Approach: | They propose a benchmark to evaluate the generalization of LLM-generated text detection methods. |
| Outcome: | The proposed benchmark measures generalization of 14 detection methods across LLMs. |
Augmenting Operations Research with Auto-Formulation of Optimization Models From Problem Descriptions (2022.emnlp-industry)
Copied to clipboard
Rindra Ramamonjison, Haley Li, Timothy Yu, Shiqi He, Vishnu Rengan, Amin Banitalebi-dehkordi, Zirui Zhou, Yong Zhang
| Challenge: | Existing systems for operations research use NLP to suggest formulations of optimization problems. |
| Approach: | They propose an augmented intelligence system that can be used to simplify and enhance the modeling experience for operations research. |
| Outcome: | The proposed system validates and edits the proposed formulations with a dataset of linear programming problems drawn from various application domains. |
Dissecting Failure Dynamics in Large Language Model Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models achieve strong performance through extended inference-time deliberation, yet how their reasoning failures arise remains poorly understood. |
| Approach: | They propose a framework that probes and redirects critical transitions using uncertainty signals. |
| Outcome: | Empirical evaluations show that GUARD improves reasoning performance . GUard probes critical transitions and redirects them using uncertainty signals . |
COPR: Continual Human Preference Learning via Optimal Policy Regularization (2025.findings-acl)
Copied to clipboard
Han Zhang, Lin Gui, Yu Lei, Yuanzhao Zhai, Yehong Zhang, Zhuo Zhang, Yulan He, Hui Wang, Yue Yu, Kam-Fai Wong, Bin Liang, Ruifeng Xu
| Challenge: | Reinforcement Learning from Human Feedback (RLHF) is effective for aligning Large Language Models with human preferences, but its complex process limits its ability to continually learn human feedback. |
| Approach: | They propose a non-RL offline method to convert historical optimal policies into optimization constraints when continually learning new preferences. |
| Outcome: | The proposed method outperforms strong CL baselines in terms of reward-based evaluations and human assessment. |
Trident: Self-Supervised Preference Alignment via Triplet Regularization (2026.findings-acl)
Copied to clipboard
| Challenge: | Large vision-Language Models suffer from noisy supervision and semantic ambiguity in self-supervised settings. |
| Approach: | They propose a self-supervised framework that constructs reliable preference triplets . they propose 'trident' objective that enforces semantic separation between the triplet components . |
| Outcome: | The proposed framework outperforms state-of-the-art RLHF and RLAIF benchmarks on LLaVA-1.5-7B and achieves 95.70% precision on POPE using only 4k self-generated triplets and a single epoch. |
Neural Parameter Search for Slimmer Fine-Tuned Models and Better Transfer (2025.acl-long)
Copied to clipboard
Guodong Du, Zitao Fang, Jing Li, Junlin Li, Runhua Jiang, Shuyang Yu, Yifei Guo, Yangneng Chen, Sim Kuan Goh, Ho-Kin Tang, Daojing He, Honghai Liu, Min Zhang
| Challenge: | Foundational models and their checkpoints have advanced deep learning, boosting performance across applications. |
| Approach: | They propose a method for pruning fine-tuned models by calculating differences between them and original model. |
| Outcome: | The proposed method can improve performance across vision, NLP, and multi-modal benchmarks. |
Few-Shot Intent Detection via Contrastive Pre-Training and Fine-Tuning (2021.emnlp-main)
Copied to clipboard
Jianguo Zhang, Trung Bui, Seunghyun Yoon, Xiang Chen, Zhiwei Liu, Congying Xia, Quan Hung Tran, Walter Chang, Philip Yu
| Challenge: | Existing methods address few-shot intent detection tasks from two perspectives: data augmentation and task-adaptive training with pre-trained models. |
| Approach: | They propose a few-shot intent detection schema using contrastive pre-training and fine-tuning. |
| Outcome: | The proposed method achieves state-of-the-art performance on three challenging intent detection datasets under 5-shot and 10-shot settings. |
Nested Named Entity Recognition with Span-level Graphs (2022.acl-long)
Copied to clipboard
| Challenge: | Named entity recognition is one of the major subtasks of information extraction for extracting categorized named entities from unstructured text. |
| Approach: | They propose to use retrieval-based span-level graphs to connect spans and entities in the training data based on n-gram features to integrate information of similar neighbor entities into the span representation. |
| Outcome: | The proposed method achieves general improvements on all three benchmarks and special superiority on low frequency entities. |
CMQCIC-Bench: A Chinese Benchmark for Evaluating Large Language Models in Medical Quality Control Indicator Calculation (2025.findings-acl)
Copied to clipboard
Guangya Yu, Yanhao Li, Zongying Jiang, Yuxiong Jin, Li Dai, Yupian Lin, Ruihui Hou, Weiyan Zhang, Yongqi Fan, Qi Ye, Jingping Liu, Tong Ruan
| Challenge: | Medical quality control indicators are essential to assess the qualifications of healthcare institutions for medical services. |
| Approach: | They propose a Chinese electronic medical records-based dataset for MQCIC and propose CF-IR method that disentangles clinical fact verification and inferential rule reasoning actions. |
| Outcome: | The proposed method outperforms Chain-of-Thought methods on 20 representative LLMs, covering general and medical models. |
Bring Invariant to Variant: A Contrastive Prompt-based Framework for Temporal Knowledge Graph Forecasting (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for temporal knowledge graph forecasting are insufficient structural contexts to learn effective representations. |
| Approach: | They propose a Contrastive Prompt-based framework with Entity background information for TKG forecasting that brings time-invariant entity background information to time-variant structural information. |
| Outcome: | The proposed framework is effective and stays competitive in inference with limited structural information. |
WebAggregator: Enhancing Compositional Reasoning Capabilities of Deep Research Agent Foundation Models (2026.acl-long)
Copied to clipboard
Rui Wang, Ce Zhang, Jun-Yu Ma, Jianshu Zhang, Hongru Wang, Yi Chen, Boyang Xue, Tianqing Fang, Zhisong Zhang, Hongming Zhang, Haitao Mi, Dong Yu, Kam-Fai Wong
| Challenge: | Existing agentic systems are retrieval-heavy but reasoning-light . current systems lack compositional reasoning, a key component of deep research . |
| Approach: | They propose a data synthesis pipeline WebAggregator to shift agentic paradigm . they use Proactive Explorer to collect interconnected knowledge and Compositional Logic Proposer to weave knowledge into complex questions . |
| Outcome: | The proposed pipeline surpasses GPT-4.1 and matches Claude-3.7-Sonnet on GAIA, WebWalkerQA, and XBench. |
START: Self-taught Reasoner with Tools (2025.emnlp-main)
Copied to clipboard
Chengpeng Li, Mingfeng Xue, Zhenru Zhang, Jiaxi Yang, Beichen Zhang, Bowen Yu, Binyuan Hui, Junyang Lin, Xiang Wang, Dayiheng Liu
| Challenge: | Large Reasoning Models (LRMs) have demonstrated remarkable capabilities in complex reasoning through long chain-of-thought, yet they struggle with precise computations and algorithmic operations. |
| Approach: | They propose a training-free approach that activates LRMs’ latent tool-use capabilities through artificial hints and a framework that enables models to learn effective tool utilization through diverse hint patterns and rejection-based data synthesis. |
| Outcome: | Experiments show that START significantly improves state-of-the-art LRMs across challenging benchmarks, including competition-level mathematics (AMC23: 95.0%, AIME24: 75.6%) and graduate-level science questions (GPQA: 64.6%). |
Budget-Aware Anytime Reasoning with LLM-Synthesized Preference Data (2026.findings-acl)
Copied to clipboard
Xuanming Zhang, Shwan Ashrafi, Aziza Mirsaidova, Amir H. Rezaeian, Miguel Ballesteros, Lydia Chilton, Zhou Yu, Dan Roth
| Challenge: | Recent work has explored reasoning efficiency via test-time scaling and early exit strategies. |
| Approach: | They propose an anytime reasoning framework and the Anytime Index to improve model quality . they also propose an inference-time self-improvement method to produce better intermediate solutions . |
| Outcome: | The proposed method improves on NaturalPlan, AIME, and GPQA datasets and improves reasoning quality and efficiency under budget constraints. |
Review-based Question Generation with Adaptive Instance Transfer and Augmentation (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods to generate questions for verbose reviews are inefficient for potential consumers . lack of training data hinders efficient review digestion, authors say . |
| Approach: | They propose to generate questions that can be answered by corresponding review sentences . they propose an iterative learning framework with adaptive instance transfer and augmentation . |
| Outcome: | The proposed model can generate questions that can be answered by review sentences . it is easier to find critical review parts that are important for potential consumers . |
Coarse-to-Fine Pre-training for Named Entity Recognition (2020.emnlp-main)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) is a task of discovering information entities and identifying their corresponding categories. |
| Approach: | They propose a NER-specific framework to inject coarse-to-fine named entity knowledge into pre-trained models by using a remote supervision strategy. |
| Outcome: | The proposed framework achieves significant improvements against several pre-trained base-lines, demonstrating its effectiveness in label-few and low-resource scenarios. |
Editing-Based SQL Query Generation for Cross-Domain Context-Dependent Questions (D19-1)
Copied to clipboard
Rui Zhang, Tao Yu, Heyang Er, Sungrok Shim, Eric Xue, Xi Victoria Lin, Tianze Shi, Caiming Xiong, Richard Socher, Dragomir Radev
| Challenge: | Generating SQL queries from user utterances is an important task to help end users acquire information from databases. |
| Approach: | They propose a context-dependent text-to-SQL generation task that edits previous queries . they use an utterance-table encoder and a table-aware decoder to incorporate context . |
| Outcome: | The proposed model is flexible to change individual tokens and robust to error propagation. |
Improved Pseudo Data for Machine Translation Quality Estimation with Constrained Beam Search (2023.emnlp-main)
Copied to clipboard
Xiang Geng, Yu Zhang, Zhejian Lai, Shuaijie She, Wei Zou, Shimin Tao, Hao Yang, Jiajun Chen, Shujian Huang
| Challenge: | evaluating the quality of machine translation outputs becomes increasingly essential with the rapid development of machine language (MT). |
| Approach: | They propose to generate pseudo data using the MT model with constrained beam search (CBSQE) they propose to preserve the reference parts with high MT probabilities as correct translations . |
| Outcome: | The proposed model outperforms strong baselines in both supervised and unsupervised settings. |
Teaching Small Language Models Reasoning through Counterfactual Distillation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated remarkable performance in a wide range of downstream tasks. |
| Approach: | They propose a counterfactual distillation framework that leverages LLMs to generate high-quality counterfacts and utilizes multi-view CoT to enhance the diversity of reasoning samples. |
| Outcome: | The proposed framework enhances reasoning capabilities of large language models and is more robust to OOD data. |
Enhancing Chinese Pre-trained Language Model via Heterogeneous Linguistics Graph (2022.acl-long)
Copied to clipboard
| Challenge: | Experimental results show that pre-trained Chinese language models ignore linguistics knowledge to learn representations. |
| Approach: | They propose a task-free enhancement module to integrate linguistics knowledge into Chinese pre-trained language models. |
| Outcome: | The proposed model improves Chinese pre-trained language models on 6 tasks with 10 benchmark datasets. |
Selection Bias Explorations and Debias Methods for Natural Language Sentence Matching Datasets (P19-1)
Copied to clipboard
| Challenge: | Natural Language Sentence Matching (NLSM) is a popular NLP task. |
| Approach: | They propose to use QuoraQP to train and evaluate NLSM models using a selection bias framework. |
| Outcome: | The proposed framework can improve generalization ability of trained models and give more trustworthy evaluation results for real-world adoptions. |
SpecCache: Speculative KV Cache Reuse for Efficient RAG Serving (2026.acl-long)
Copied to clipboard
Zijian Wen, Tao Zhang, Shuangwu Chen, Shenghao Ye, Yu Guo, Qirui Chen, Jingxian Shuai, Yunpeng Hou, Huasen He, null Jianyang
| Challenge: | Retrieval-Augmented Generation (RAG) improves LLMs but faces high prefill latency during long contexts. |
| Approach: | They propose a method that uses deep-layer hidden-state norms to guide token selection . they propose to use deep-layered hidden-status norms as a proxy to guide the token selection. |
| Outcome: | The proposed SpecCache outperforms state-of-the-art (SOTA) benchmarks. |
Syntax-Aware Retrieval Augmented Code Generation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Neural code generation models with token-level retrieval capabilities are often noisy and time-consuming. |
| Approach: | They propose a token-level retrieval augmented code generation method that leverages syntax constraints for the retrieval of datastores. |
| Outcome: | The proposed method reduces the impact of retrieve noise on code generation on two datasets. |
Edge-Enhanced Graph Convolution Networks for Event Detection with Syntactic Relation (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Event detection (ED) is a key subtask of information extraction. |
| Approach: | They propose an architecture that exploits syntactic structure and typed dependency label information to perform event detection. |
| Outcome: | The proposed architecture exploits syntactic structure and typed dependency label information to perform ED. |
Latent Reasoning for Low-Resource Question Generation (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to multihop question generation require extensive data collection and decomposition. |
| Approach: | They propose a generative approach that optimizes the two-phase model without question decomposition data. |
| Outcome: | The proposed approach outperforms baselines on HOTPOTQA, a benchmark multi-hop question answering dataset. |
Learning to Prune Dependency Trees with Rethinking for Neural Relation Extraction (2020.coling-main)
Copied to clipboard
| Challenge: | Existing approaches to remove noise from dependency trees are not optimal due to complexity and variability of natural language. |
| Approach: | They propose a dynamically pruned Graph Convolutional Network (DP-GCN) that prunes the dependency tree with rethinking in an end-to-end scheme. |
| Outcome: | The proposed model achieves impressive results compared to strong competitors. |
Camouflaged Chinese Spam Content Detection with Semi-supervised Generative Active Learning (2020.acl-main)
Copied to clipboard
| Challenge: | Existing active learning models for text spam detection tasks are based on pool-based active learning, but the annotating process is laborious and time consuming for humans. |
| Approach: | They propose a semi-supervised active learning model to address spam imbalances . they propose masked attention learning approach and character variation graph-enhanced augmentation procedure . |
| Outcome: | The proposed model can improve the performance of existing models for Chinese spam detection task. |
AoM: Detecting Aspect-oriented Information for Multimodal Aspect-Based Sentiment Analysis (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to extract aspects from text-image pairs and recognize their sentiments are noisy and coarsely establishing image-aspect alignment will interfere with aspect-relevant semantic and sentiment information. |
| Approach: | They propose an Aspect-oriented method to detect aspect-relevant semantic and sentiment information by selecting textual tokens and image blocks that are semantically related to the aspects. |
| Outcome: | The proposed method is superior to existing methods in the field of sentiment analysis. |
SimPBL: A Multi-Agent Framework for Project-Based Learning (2026.acl-long)
Copied to clipboard
Daniel Zhang-Li, Joy Jia Yin Lim, Binglin Liu, Shangqing Tu, Zijun Yao, Hao Peng, Jifan Yu, Haoxuan Li, Zhanxin Hao, Ye He, Zekun Li, Jiangyi Wang, Lei Hou, Bin Xu, Xin Cong, Zhiyuan Liu, Huiqin Liu, Yu Zhang, Juanzi Li
| Challenge: | Existing LLMs provide partial assistance without modeling these roles, and overly comprehensive help can reduce learner autonomy. |
| Approach: | They propose a multi-agent framework with an orchestrator agent that provides adaptive scaffolding from interaction logs and collaborator agents that support project work through boundary-aware collaboration. |
| Outcome: | The proposed framework improves learner examination scores by 14% . it is based on a multi-agent framework with an orchestrator agent . |
HOSMEL: A Hot-Swappable Modularized Entity Linking Toolkit for Chinese (2022.acl-demo)
Copied to clipboard
| Challenge: | Existing studies have explored the use of entity linking (EL) in downstream tasks. |
| Approach: | They propose a modularized entity linking toolkit for easy task adaptation. |
| Outcome: | The proposed toolkit achieves significantly better accuracy and less time and spaceconsumption than existing methods. |
OpenFact: Factuality Enhanced Open Knowledge Extraction (2023.tacl-1)
Copied to clipboard
Linfeng Song, Ante Wang, Xiaoman Pan, Hongming Zhang, Dian Yu, Lifeng Jin, Haitao Mi, Jinsong Su, Yue Zhang, Dong Yu
| Challenge: | Existing OIE systems organize knowledge into subject-relation-object (SRO) triplets, and they use templates to extract such knowledge triplet. |
| Approach: | They propose a framework to handle expressiveness and groundedness in OpenFact . they propose to use templates, extra constraints, and adopt human efforts to ensure that most triplets contain enough details. |
| Outcome: | The proposed framework improves expressiveness and groundedness of OpenFact . it is more accurate and denser than OPIEC-Linked, which is grounded to Wikidata . |
Mixture-of-LoRAs: An Efficient Multitask Tuning Method for Large Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Instruction Tuning has the potential to stimulate or enhance specific capabilities of large language models. |
| Approach: | They propose a mixture-of-LoRAs architecture which is a parameter-efficient tuning method designed for multi-task learning with LLMs. |
| Outcome: | The proposed method can be iteratively adapted to a new domain, enabling quick domain-specific adaptation. |
AnchorAttention: Difference-Aware Sparse Attention with Stripe Granularity (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for large language models with extended context lengths face significant computational challenges during the prefill phase. |
| Approach: | They propose a difference-aware, dynamic sparse attention mechanism that efficiently identifies critical attention regions at a finer stripe granularity while adapting to global contextual information. |
| Outcome: | The proposed model achieves a speedup of 1.44 while maintaining higher recall rates. |
FFAEval: Evaluating Dialogue System via Free-For-All Ranking (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing evaluation metrics for open-domain dialogue systems show poor correlation with human assessment. |
| Approach: | They propose a free-for-all human evaluation framework that shares dialogue history with annotators for multi-turn scoring. |
| Outcome: | The proposed framework achieves a strong correlation with human assessment on English and Chinese dialogue systems. |
BLADE: Benchmarking Language Model Agents for Data-Driven Science (2024.findings-emnlp)
Copied to clipboard
Ken Gu, Ruoxi Shang, Ruien Jiang, Keying Kuang, Richard-John Lin, Donghe Lyu, Yue Mao, Youran Pan, Teng Wu, Jiaqian Yu, Yikun Zhang, Tianmai Zhang, Lanyi Zhu, Mike Merrill, Jeffrey Heer, Tim Althoff
| Challenge: | Language model-based agents can be used to conduct and support data-driven science, but evaluating them on open-ended tasks is challenging due to multiple valid approaches, partially correct steps, and different ways to express the same decisions. |
| Approach: | They propose a benchmark to automatically evaluate agents’ multifaceted approaches to open-ended research questions. |
| Outcome: | BLADE evaluates agents’ multifaceted approaches to open-ended research questions using data from 12 datasets and research questions drawn from existing scientific literature. |
A Simple LLM Framework for Long-Range Video Question-Answering (2024.emnlp-main)
Copied to clipboard
| Challenge: | a recent study has shown that short video understanding is not trivial due to the need for long-range temporal reasoning capabilities. |
| Approach: | They propose a language-based short- and long-range question-answering framework LLoVi . they propose 'multi-round summarization prompt' that asks the LLM to summarize the captions . |
| Outcome: | The proposed framework outperforms the state-of-the-art on the EgoSchema dataset and to grounded VideoQA. |
Discarding the Crutches: Adaptive Parameter-Efficient Expert Meta-Learning for Continual Semantic Parsing (2025.coling-main)
Copied to clipboard
| Challenge: | Continual Semantic Parsing (CSP) enables parsers to generate SQL from natural language questions in task streams, using minimal annotated data to handle dynamically evolving databases in real-world scenarios. |
| Approach: | They propose a Adaptive PET eXpert meta-learning approach that assists experts in adaptively warming up, ensuring better model initialization. |
| Outcome: | The proposed method outperforms existing methods on two benchmarks and achieves superior performance without data replay or ideal settings. |
DeepKE: A Deep Learning Based Knowledge Extraction Toolkit for Knowledge Base Population (2022.emnlp-demos)
Copied to clipboard
Ningyu Zhang, Xin Xu, Liankuan Tao, Haiyang Yu, Hongbin Ye, Shuofei Qiao, Xin Xie, Xiang Chen, Zhoubo Li, Lei Li
| Challenge: | Existing knowledge extraction tools are not complete due to emerging entities and relations in real-world applications. |
| Approach: | They propose an open-source knowledge extraction toolkit DeepKE that supports low-resource, document-level and multimodal scenarios in the knowledge base population. |
| Outcome: | The proposed toolkit supports low-resource, document-level and multimodal scenarios in the knowledge base population. |
Adaptive Detoxification: Safeguarding General Capabilities of LLMs through Toxicity-Aware Knowledge Editing (2025.findings-acl)
Copied to clipboard
Yifan Lu, Jing Li, Yigeng Zhou, Yihui Zhang, Wenya Wang, Xiucheng Li, Meishan Zhang, Fangming Liu, Jun Yu, Min Zhang
| Challenge: | Existing knowledge editing methods for large language models (LLMs) suffer from over-editing, where detoxified models reject legitimate queries, compromising overall performance. |
| Approach: | They propose a toxicity-aware knowledge editing approach that dynamically detects toxic activation patterns during forward propagation and then routes computations through adaptive inter-layer pathways to mitigate toxicity effectively. |
| Outcome: | The proposed method outperforms existing methods on large language models and enhances the SafeEdit benchmark. |
ReSel: N-ary Relation Extraction from Scientific Text and Tables by Learning to Retrieve and Select (2022.emnlp-main)
Copied to clipboard
| Challenge: | Our proposed method extracts N-ary relation tuples from scientific articles. |
| Approach: | They propose a method that decomposes the task into two stages . they propose modal query and modal entity selection . their results show that ReSel outperforms state-of-the-art baselines significantly . |
| Outcome: | The proposed method outperforms state-of-the-art baselines on three scientific information extraction datasets. |
SafeConv: Explaining and Correcting Conversational Unsafe Behavior (2023.acl-long)
Copied to clipboard
| Challenge: | Existing datasets do not provide enough annotation to explain unsafe behavior . current chatbots generate toxic and offensive responses, which can be dangerous . |
| Approach: | They construct a dataset called SafeConv that provides comprehensive annotations for chatbots . they compare safe alternatives to rewrite unsafe responses . |
| Outcome: | The proposed model can explain unsafe behavior and detoxify chatbots, the authors show . the proposed model is able to detect unsafe utterances, extract unsafe spans, and convert unsafe responses to safe versions. |
FGraDA: A Dataset and Benchmark for Fine-Grained Domain Adaptation in Machine Translation (2022.lrec-1)
Copied to clipboard
Wenhao Zhu, Shujian Huang, Tong Pu, Pingxuan Huang, Xu Zhang, Jian Yu, Wei Chen, Yanfeng Wang, Jiajun Chen
| Challenge: | Recent research on domain adaptation neglects diversity in translation within a domain . current research on NMT models considers very broad target domains . |
| Approach: | They propose a fine-grained domain adaptation task for autonomous vehicles, AI education, real-time networks, and smart phone. |
| Outcome: | The proposed task is compared with a dataset of Chinese-English translation tasks for four sub-domains of information technology: autonomous vehicles, AI education, real-time networks, and smart phone. |
Comprehensive Benchmarking of Long-Form Speech Generation in Diverse Scenarios (2026.findings-acl)
Copied to clipboard
Changhao Pan, Rui Yang, Han Wang, Zhuan Zhou, Xuming He, Wenxiang Guo, Ziyue Jiang, Ruiqi Li, Yu Zhang, Chenyuhao Wen, Ke Lei, Xiang Yin, Jingyu Lu, Zhiyuan Zhu, Zhou Zhao
| Challenge: | Existing evaluation benchmarks for long-form speech are limited to limited domains, creating a significant gap with the diverse downstream applications. |
| Approach: | They propose a benchmark that decomposes "long-form speech quality" into specific, disentangled dimensions. |
| Outcome: | The proposed benchmark decomposes “long-form speech quality” into specific, disentangled dimensions. |
MoSE: Modality Split and Ensemble for Multimodal Knowledge Graph Completion (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to predict missing entities share relation representation across modalities, which results in mutual interference between modality. |
| Approach: | They propose a framework for multimodal knowledge graph completion that learns modality-split relation embeddings for each modality instead of a single modality shared one. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on three KG datasets. |
Inner Thinking Transformer: Leveraging Dynamic Depth Scaling to Foster Adaptive Internal Thinking (2025.acl-long)
Copied to clipboard
Yilong Chen, Junyuan Shang, Zhenyu Zhang, Yanxi Xie, Jiawei Sheng, Tingwen Liu, Shuohuan Wang, Yu Sun, Hua Wu, Haifeng Wang
| Challenge: | Large language models face inherent performance bottlenecks under parameter constraints . challenging tokens induce abrupt gradient spikes across layers, exposing stress points . |
| Approach: | They propose an inner thinking transformer that reimagines layer computations as implicit thinking steps. |
| Outcome: | Empirical results show that ITT outperforms Transformer/Loop variants in 11 benchmarks. |
Faithful Question Answering with Monte-Carlo Planning (2023.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to answer questions using large language models lack the ability to faithfully follow the intermediate reasoning steps from the known premises to the answer. |
| Approach: | They propose a faithful question-answering task that uses a Monte-Carlo planning algorithm to produce faithful reasoning steps from the known premises to the answer. |
| Outcome: | The proposed task can produce valid and faithful reasoning steps compared with large language models with a much smaller model size. |
Connecting Embeddings for Knowledge Graph Entity Typing (2020.acl-main)
Copied to clipboard
| Challenge: | Existing knowledge graphs suffer from incompleteness and miss important facts, jeopardizing their usefulness in downstream tasks such as question answering. |
| Approach: | They propose a method which is trained by utilizing local typing knowledge from existing entity type assertions and global triple knowledge in KGs. |
| Outcome: | The proposed model favors inferences that agree with both entity type instances and triple knowledge in KGs. |
ExpSeek: Self-Triggered Experience Seeking for Web Agents (2026.findings-acl)
Copied to clipboard
Wenyuan Zhang, Xinghua Zhang, Haiyang Yu, Shuaiyi Nie, Bingli Wu, Juwei Yue, Tingwen Liu, Yongbin Li
| Challenge: | Existing methods for integrating experience into web agents are struggling to adapt to dynamically changing contextual observations during agent-environment interaction. |
| Approach: | They propose a model that shifts experience toward step-level proactive seeking by estimating step- level entropy thresholds and designing step-Level tailored experience content. |
| Outcome: | The proposed model achieves 9.3% and 7.5% performance improvements on Qwen3-8B and 32B models across four challenging web agent benchmarks. |
Adaptive Structure Induction for Aspect-based Sentiment Analysis with Spectral Perspective (2023.findings-emnlp)
Copied to clipboard
| Challenge: | incorporating structure information can enhance the performance of aspect-based sentiment analysis. |
| Approach: | They propose to use pre-trained language models to induct latent structures from a spectrum perspective. |
| Outcome: | The proposed model shortens Aspects-sentiment Distance and improves structure induction ability. |
E2LLM: Encoder Elongated Large Language Models for Long-Context Understanding and Reasoning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Considerable efforts have been and are still being put into increasing the context length of Large Language Models (LLMs) |
| Approach: | They propose an approach that divides long contexts into chunks, compresses each into soft prompts using a pretrained text encoder, and aligns these representations with a decoder-only LLM via an adapter. |
| Outcome: | The proposed approach outperforms 8 state-of-the-art methods in effectiveness and efficiency for document summarization and question answering, and achieves the best performance on LongBench v2 among models of comparable size. |
A Closer Look at the Self-Verification Abilities of Large Language Models in Logical Reasoning (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing models of large language models struggle with complex logical reasoning problems. |
| Approach: | They propose to use large language models to identify their own errors to improve their models' performance. |
| Outcome: | The proposed models can identify logical fallacies accurately and improve by themselves. |
NACL: A General and Effective KV Cache Eviction Framework for LLM at Inference Time (2024.acl-long)
Copied to clipboard
Yilong Chen, Guoxia Wang, Junyuan Shang, Shiyao Cui, Zhenyu Zhang, Tingwen Liu, Shuohuan Wang, Yu Sun, Dianhai Yu, Hua Wu
| Challenge: | Large Language Models (LLMs) with extended context windows are expensive and infeasible on fixed memory hardware due to the surprisingly large memory consumption of KV Cache. |
| Approach: | They propose a general framework for long-context KV cache eviction that achieves more optimal and efficient evict in a single operation during the encoding phase. |
| Outcome: | The proposed framework improves performance on short- and long-text tasks by 80% and 76% respectively, reducing KV Cache by up to 5 with over 95% performance maintenance. |
Exploring Concept Depth: How Large Language Models Acquire Knowledge and Concept at Different Layers? (2025.coling-main)
Copied to clipboard
Mingyu Jin, Qinkai Yu, Jingyuan Huang, Qingcheng Zeng, Zhenting Wang, Wenyue Hua, Haiyan Zhao, Kai Mei, Yanda Meng, Kaize Ding, Fan Yang, Mengnan Du, Yongfeng Zhang
| Challenge: | Large language models have shown remarkable performances across a wide range of tasks, but mechanisms by which they encode tasks of varying complexity remain poorly understood. |
| Approach: | They propose to explore the possibility that LLMs process concepts in different layers . they propose to categorize concepts based on their level of abstraction . |
| Outcome: | The proposed model can process complex concepts in shallow layers, the authors show . the proposed model could be used to prob complex tasks in shallow ones . |
Disentangling Language and Culture for Evaluating Multilingual Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Extensive evaluations of large language models (LLMs) are conducted on a wide range of models, revealing a notable cultural-linguistic synergy phenomenon, where models exhibit better performance when questions are culturally aligned with the language. |
| Approach: | They propose a Dual Evaluation Framework to comprehensively assess the multilingual capabilities of large language models by decomposing evaluation along dimensions of linguistic medium and cultural context. |
| Outcome: | The proposed framework allows for a nuanced analysis of LLMs’ ability to process questions within both native and cross-cultural contexts cross-lingually. |
NeuSym-RAG: Hybrid Neural Symbolic Retrieval with Multiview Structuring for PDF Question Answering (2025.acl-long)
Copied to clipboard
Ruisheng Cao, Hanchong Zhang, Tiancheng Huang, Zhangyi Kang, Yuxin Zhang, Liangtai Sun, Hanqi Li, Yuxun Miao, Shuai Fan, Lu Chen, Kai Yu
| Challenge: | Existing approaches to retrieval augmented generation neglect PDF structure and layout . individual PDFs often exceed prompt limits and user queries may span multiple documents. |
| Approach: | They propose a hybrid neural symbolic retrieval framework which combines both paradigms in an interactive process. |
| Outcome: | The proposed framework organizes semi-structured PDF content into relational database and vectorstore . it defeats both RAG and structured baselines on three PDF-based QA datasets . |
Selective Prompting Tuning for Personalized Conversations with LLMs (2024.findings-acl)
Copied to clipboard
| Challenge: | Personalization in conversational AI requires persona profiles and contextual understanding to create meaningful conversations. |
| Approach: | They propose a method that softly prompts LLMs for personalized conversations in a selective way. |
| Outcome: | The proposed approach improves response diversity by up to 90% on the CONVAI2 dataset. |
Z1: Efficient Test-time Scaling with Code (2025.emnlp-industry)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) can achieve enhanced complex problem-solving through test-time computing scaling, but this often entails longer contexts and numerous reasoning token costs. |
| Approach: | They propose an efficient test-time scaling method that trains LLMs on code-related reasoning trajectories and a novel Shifted Thinking Window to mitigate overthinking overhead. |
| Outcome: | The proposed method reduces overthinking overhead while maintaining performance. |
Look before You Leap: Dual Logical Verification for Knowledge-based Visual Question Generation (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for visual question generation focus on leveraging the semantics of inputs to propose questions, ignoring the logical coherence between generated questions and images. |
| Approach: | They propose a logical verification method that checks logical structure between Q, images, answers and acquired outside knowledge by incorporating logical coherence between Q and Q twice in the whole procedure. |
| Outcome: | The proposed method can generate diverse and insightful knowledge-based visual questions on two common datasets. |
Refining Corpora from a Model Calibration Perspective for Chinese Spelling Correction (2024.findings-acl)
Copied to clipboard
| Challenge: | Chinese Spelling Correction (CSC) lacks large-scale high-quality corpora due to labor-intensive labeling of spelling errors in real-life writing or typing scenarios. |
| Approach: | They propose to use OCR/ASR-based generation to refine Chinese Spelling Correction models on random replacement-based corpora and filter them based on prediction confidence. |
| Outcome: | The proposed model outperforms existing models on three widely-used benchmarks while significantly alleviating over-correction. |
Cautious Next Token Prediction (2025.findings-acl)
Copied to clipboard
Yizhou Wang, Lingzhi Zhang, Yue Bai, Mang Tik Chiu, Zhengmian Hu, Mingyuan Zhang, Qihua Dong, Yu Yin, Sohrab Amirghodsi, Yun Fu
| Challenge: | Existing methods for decoding autoregressive models are temperature scaling and nucleus sampling to balance diversity and coherence. |
| Approach: | They propose a training-free decoding strategy that uses a model with a low perplexity score to select the trial with the lowest perplexities as the most probable and reliable path. |
| Outcome: | The proposed approach outperforms existing standard decoding strategies consistently by a clear margin. |
Unveiling Language-Specific Features in Large Language Models via Sparse Autoencoders (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) exhibit impressive abilities in various domains such as text generation, instruction following, and reasoning. |
| Approach: | They propose a method to decompose the activations of Large Language Models into a sparse linear combination of SAE features. |
| Outcome: | The proposed method shows that some features are strongly related to specific languages, while others are unaffected by ablating them. |
SynthFix: Adaptive Neuro-Symbolic Code Vulnerability Repair (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) struggle with complex semantic and structural correctness required for automated code repair. |
| Approach: | They propose a hybrid neural-symbolic framework that unifies code synthesis with compiler-informed symbolic feedback to improve LLM-based vulnerability repair. |
| Outcome: | The proposed framework improves code repair accuracy and efficiency over strong SFT and RFT training strategies on the FixJS and CodeFlaws benchmarks. |
MdEval: Massively Multilingual Code Debugging (2026.findings-acl)
Copied to clipboard
Shukai Liu, Linzheng Chai, Jian Yang, Jiajun Shi, He Zhu, Liran Wang, Jin Ke, Wei Zhang, Hualei Zhu, Shuyue Guo, Tao Sun, Jiaheng Liu, Yunlong Duan, Yu Hao, Liqun Yang, Guanglin Niu, Ge Zhang, Zhoujun Li
| Challenge: | Existing benchmarks primarily focus on Python and are limited in terms of language diversity. |
| Approach: | They propose a multilingual debugging benchmark that includes 3.9K test samples of 20 programming languages and introduces the debug instruction corpora MdEval-Instruct by injecting bugs into the correct multilingual queries and solutions. |
| Outcome: | The proposed benchmark includes 3.9K test samples of 20 programming languages and covers the automated program repair task, bug localization task, and bug identification task. |
Taxonomy-guided Semantic Indexing for Academic Paper Search (2024.emnlp-main)
Copied to clipboard
| Challenge: | Academic paper search often struggles to match underlying academic concepts between queries and documents. |
| Approach: | They propose a framework that extracts key concepts from papers and organizes them as a semantic index guided by an academic taxonomy. |
| Outcome: | The proposed framework can be flexibly employed to enhance existing retrieval frameworks. |
DPN-LE: Dual Personality Neuron Localization and Editing for Large Language Models (2026.findings-acl)
Copied to clipboard
Lifan Zheng, Xue Yang, Jiawei Chen, Chenyan WU, Jingyuan Zhang, Fanheng Kong, Xinyi Zeng, Xiang Chen, Yu Tian
| Challenge: | Current methods for editing personality traits in large language models can change personalities but reduce performance. |
| Approach: | They propose a novel paradigm for personality editing that locates and edits LLM neurons and enables competitive personality control at inference time. |
| Outcome: | Experiments on LLaMA-3-8B-Instruct and Qwen2.5-7B-instruct show that the proposed approach can improve performance and improve performance. |
Federated Learning for Semantic Parsing: Task Formulation, Evaluation Setup, New Algorithms (2023.acl-long)
Copied to clipboard
| Challenge: | Neural semantic parsers have achieved remarkable performance in recent years, but they are data-hungry and require annotators to have intimate knowledge of formal programs. |
| Approach: | They propose a task where multiple clients collaboratively train one global model without sharing their semantic parsing data. |
| Outcome: | The proposed model improves performance on three widely adopted FL algorithms (FedAvg, FedOPT and FedProx) and clients with smaller datasets enjoy faster performance. |
RFiD: Towards Rational Fusion-in-Decoder for Open-Domain Question Answering (2023.findings-acl)
Copied to clipboard
| Challenge: | Open-domain Question Answering (ODQA) systems rely on spurious features instead of genuine causal relationships to generate answers. |
| Approach: | They propose a model that leverages the encoders of FiD to distinguish between causal relationships and spurious features and guides the decoder to generate answers informed by this discernment. |
| Outcome: | The proposed model improves on two ODQA datasets and shows that it can identify causal relationships and identify spurious features. |
CoCoLM: Complex Commonsense Enhanced Language Model with Discourse Relations (2022.findings-acl)
Copied to clipboard
| Challenge: | Large-scale pre-trained language models have demonstrated strong knowledge representation ability, but struggle with complex commonsense knowledge that involves multiple eventualities. |
| Approach: | They propose to help pre-trained language models better incorporate complex commonsense knowledge that involves multiple eventualities. |
| Outcome: | The proposed model can learn to use the memorized knowledge for different tasks and achieve outstanding performance on many downstream natural language processing (NLP) tasks. |
FedMABench: Benchmarking Mobile GUI Agents on Decentralized Heterogeneous User Data (2025.emnlp-main)
Copied to clipboard
| Challenge: | Mobile GUI agents have attracted tremendous research participation recently. traditional approaches to mobile agent training rely on centralized data collection. |
| Approach: | They propose a benchmark for federated training and evaluation of mobile GUI agents . they find that federation algorithms consistently outperform local training . |
| Outcome: | The first benchmark for federated training and evaluation of mobile GUI agents is released . it features 6 datasets with 30+ subsets, 8 federation algorithms, 10+ base models, and over 800 apps across 5 categories . |
NetSafe: Exploring the Topological Safety of Multi-agent System (2025.findings-acl)
Copied to clipboard
Miao Yu, Shilong Wang, Guibin Zhang, Junyuan Mao, Chenlong Yin, Qijiong Liu, Kun Wang, Qingsong Wen, Yang Wang
| Challenge: | Large language models (LLMs) have fueled significant progress in intelligent Multi-agent Systems (MAS), with expanding academic and industrial applications. |
| Approach: | They propose a framework that unifies diverse MAS workflows via iterative RelCom interactions to enable generalized analysis. |
| Outcome: | The proposed framework unifies diverse MAS workflows via iterative RelCom interactions to enable generalized analysis. |
GigaSpeech 2: An Evolving, Large-Scale and Multi-domain ASR Corpus for Low-Resource Languages with Automated Crawling, Transcription and Refinement (2025.acl-long)
Copied to clipboard
Yifan Yang, Zheshu Song, Jianheng Zhuo, Mingyu Cui, Jinpeng Li, Bo Yang, Yexing Du, Ziyang Ma, Xunying Liu, Ziyuan Wang, Ke Li, Shuai Fan, Kai Yu, Wei-Qiang Zhang, Guoguo Chen, Xie Chen
| Challenge: | GigaSpeech 2 is a large-scale, multi-domain, multilingual speech recognition corpus for low-resource languages. |
| Approach: | They propose a large-scale, multi-domain, multilingual speech recognition corpus for low-resource languages and an automated pipeline for data crawling, transcription, and label refinement. |
| Outcome: | The proposed corpus reduces the word error rate for Thai, Indonesian, and Vietnamese on a realistic YouTube test set by 25% to 40% compared to Whisper large-v3. |
OmniFlatten: An End-to-end GPT Model for Seamless Voice Conversation (2025.acl-long)
Copied to clipboard
Qinglin Zhang, Luyao Cheng, Chong Deng, Qian Chen, Wen Wang, Siqi Zheng, Jiaqing Liu, Hai Yu, Chao-Hong Tan, Zhihao Du, ShiLiang Zhang
| Challenge: | Full-duplex spoken dialogue systems allow simultaneous bidirectional communication . low latency and natural interactions in full-duplice systems remains a challenge . |
| Approach: | They propose a multi-stage post-training scheme that adapts a text large language model into a speech-text dialogue LLM. |
| Outcome: | The proposed model can model human conversation behaviors with low latency and natural interactions with low delay. |
DEMO: Reframing Dialogue Interaction with Fine-grained Element Modeling (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) enabled dialogue systems are one of the central modes in human-machine interaction. |
| Approach: | They propose a benchmark task for dialogue element MOdeling and Element Awareness and a new benchmark for dialogue agent interaction that allows the agent to model dialogue elements via imitation learning. |
| Outcome: | The proposed agent performs well in both dialogue element modeling and out-of-domain tasks. |
Self-Supervised Sentence Polishing by Adding Engaging Modifiers (2023.acl-demo)
Copied to clipboard
| Challenge: | a typical way to polish sentences is to add engaging modifiers, which enhance the meaning of the sentence. |
| Approach: | They propose a task that requires polishing sentences while maintaining fluency . they remove engaging modifiers from public resources and fine-tune LongLM to reconstruct original sentences from corrupted ones. |
| Outcome: | The proposed model generates more engaging sentences with suitable modifiers than strong baselines while keeping fluency. |
MeMoTune: A Measure and Moment-Driven Fine-Tuning Framework for Quantized Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods combine quantization with parameter-efficient fine-tuning but fail to meet practical performance requirements. |
| Approach: | They propose a measure and moment approach to optimize objective function for superior fine-tuning results by scaling the update process through a gradient. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on tasks like text generation, summarization, and understanding. |
COSY: COunterfactual SYntax for Cross-Lingual Understanding (2021.acl-long)
Copied to clipboard
| Challenge: | Pre-trained multilingual language models suffer from a large performance gap between source and target languages . e.g., multilingual-BERT models are widely used in cross-lingual tasks . |
| Approach: | They propose a language-agnostic approach to integrate universal syntax into language models . they use SYntax-aware networks and a COunterfactual training method . |
| Outcome: | The proposed model achieves state-of-the-art performance on natural language inference and question answering without auxiliary training data. |
P-MMEval: A Parallel Multilingual Multitask Benchmark for Consistent Evaluation of LLMs (2025.emnlp-main)
Copied to clipboard
Yidan Zhang, Yu Wan, Boyi Deng, Baosong Yang, Hao-Ran Wei, Fei Huang, Bowen Yu, Dayiheng Liu, Junyang Lin, Fei Huang, Jingren Zhou
| Challenge: | Recent advances in large language models showcase varied multilingual capabilities across tasks . previous assessments focused on fundamental natural language processing (NLP) or isolated capability-specific tasks. |
| Approach: | They propose a multilingual multitask benchmark to assess multilingual capabilities . they use a large-scale benchmark covering fundamental and capability-specialized datasets . |
| Outcome: | The proposed benchmark compares models and tasks across languages and tasks and examines knowledge transfer from English to other languages. |
Document-Level Machine Translation with Large Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) such as ChatGPT can produce coherent, cohesive, relevant, and fluent answers for various natural language processing tasks. |
| Approach: | They examine the impact of different prompts on document-level translation quality and discourse phenomena using figures and lines, which are invisible to GPT-4. |
| Outcome: | The proposed models outperform commercial MT systems and advanced document-level MT methods on a number of benchmarks and show potential to become a new paradigm for document- level translation. |
EduBench: A Comprehensive Benchmarking Dataset for Evaluating Large Language Models in Diverse Educational Scenarios (2026.acl-long)
Copied to clipboard
Bin Xu, Yu Bai, Huashan Sun, Yiguan Lin, Siming Liu, Xinyue Liang, Yaolin Li, Zhuangzhi Dong, Jingren Zhang, Yufan Deng, Xinyu Zou, Yang Gao, Heyan Huang
| Challenge: | Existing benchmarks that focus on knowledge-intensive tasks do not reflect diverse educational scenarios. |
| Approach: | They propose a benchmark that incorporates 9 major scenarios and 4,000 educational contexts. |
| Outcome: | The proposed model performs comparable to state-of-the-art large models on the test set. |
Natural-Language Policies to Executable Decisions: An Interpretable Large Language Model Framework (2026.acl-industry)
Copied to clipboard
Ziqiang Zhang, Jing Ma, Zilong Wang, Jiayuan Chen, Yi Qiao, Yu He, Wei Zhang, Dai Cheng, Xiaoyu Shen
| Challenge: | a production-grade pricing system for tourism is challenging due to unstructured nature of travel orders and ever-evolving pricing policies. |
| Approach: | They propose a production-grade pricing system with a strict decision boundary . they propose to combine structured extraction and bounded policy/path selection with interpretable condition trees . |
| Outcome: | The proposed system processed 3,960 orders in six months and reduced the order management team from 15-20 to 3 . the system reduced the per-order handling time from 10 minutes to 2 minutes. |
Let GPT be a Math Tutor: Teaching Math Word Problem Solvers with Customized Exercise Generation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches for distilling large language models into smaller, more efficient student models are based on educational science principles such as knowledge tracing and personalized learning. |
| Approach: | They propose a method for distilling large language models into smaller, more efficient student models that are aligned with educational science principles such as knowledge tracing and personalized learning. |
| Outcome: | The proposed approach outperforms LLMs on three benchmarks while employing significantly fewer parameters. |
Structural Information Preserving for Graph-to-Text Generation (2020.acl-main)
Copied to clipboard
| Challenge: | Existing models that mess up or drop the core structural information of input graphs are lacking in graph-to-text generation. |
| Approach: | They propose to leverage richer training signals to guide a graph-to-text generation model by focusing on autoencoding losses and back-propagating the losses to better calibrate the model. |
| Outcome: | Experiments on two benchmarks show the proposed model over a state-of-the-art model . two types of autoencoding losses are used to back-propagate the model based on multitask training . |
Take a Closer Look at Multilinguality! Improve Multilingual Pre-Training Using Monolingual Corpora Only (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies have demonstrated remarkable cross-lingual capability of pre-trained language models . however, semantic alignments may be the reason behind such capability but remain under-explored. |
| Approach: | They propose token-level and semantic-level code-switched masked language modeling to improve cross-lingual interactions over mono-mPLMs without parallel sentences. |
| Outcome: | The proposed method outperforms mono-mPLMs on natural language understanding and unsupervised machine translation tasks. |
Cross-lingual Knowledge Graph Alignment via Graph Convolutional Networks (D18-1)
Copied to clipboard
| Challenge: | Existing approaches to align multilingual knowledge graphs with counterparts in different languages are not effective. |
| Approach: | They propose a novel approach for cross-lingual KG alignment via graph convolutional networks . they train GCNs to embed entities of each language into a unified vector space . |
| Outcome: | The proposed approach gets the best performance on real multilingual KGs compared with other embedding-based approaches. |
Text Detoxification: Data Efficiency, Semantic Preservation and Model Generalization (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for detoxification of text often rely on manually annotated data . xiangli: "detoxification of texts is a powerful way to remove toxic content" |
| Approach: | They propose a reinforcement learning framework that optimizes detoxification and semantic preservation without annotating large amounts of data. |
| Outcome: | The proposed method overcomes major limitations and surpasses humanannotated references across multiple benchmarks. |
PKAD: Pretrained Knowledge is All You Need to Detect and Mitigate Textual Backdoor Attacks (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Current defense methods can be classified into inference-time and training-time ones based on their execution phase. |
| Approach: | They propose a two-stage poison detection strategy using pre-trained language models to detect poisoned samples before model training. |
| Outcome: | The proposed method achieves better performance than current methods more quickly and with fewer training costs. |
URG: A Unified Ranking and Generation Method for Ensembling Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to rank and generate large language models have limited performance due to time-intensive nature of ranking process and lack of error propagation. |
| Approach: | They propose a framework that jointly ranks the outputs of Large Language Models and generates fine-grained fusion results. |
| Outcome: | The proposed framework achieves state-of-the-art (SOTA) performance on ranking and generation tasks. |
COVID-19 Claim Radar: A Structured Claim Extraction and Tracking System (2022.acl-demo)
Copied to clipboard
Manling Li, Revanth Gangi Reddy, Ziqi Wang, Yi-shyuan Chiang, Tuan Lai, Pengfei Yu, Zixuan Zhang, Heng Ji
| Challenge: | a new system extracts supporting and refuting claims from COVID-19 related news . the system is publicly available at GitHub and DockerHub, with complete documentation. |
| Approach: | They propose a COVID-19 Claim Radar system that extracts supporting and refuting claims . the system leverages Wikidata as the hub to consolidate coreferential knowledge elements . |
| Outcome: | The system extracts supporting and refuting claims from COVID-19 pandemic information . it leverages Wikidata as the hub to merge coreferential knowledge elements . |
Translate-Train Embracing Translationese Artifacts (2022.acl-short)
Copied to clipboard
| Challenge: | Existing approaches to train multilingual tasks are based on translationese and translatetrain. |
| Approach: | They propose to use translationese to mitigate the gap between the source and target languages to train the translator. |
| Outcome: | The proposed method outperforms baselines on the multilingual QA dataset TyDiQA. |
ZeroAE: Pre-trained Language Model based Autoencoder for Transductive Zero-shot Text Classification (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for text classification use only encoders or decoders that do not allow for the use of labels in unseen domains. |
| Approach: | They propose an autoencoder that encodes text into two disentangled spaces and decodes it to generate text with labels in the unseen domains. |
| Outcome: | The proposed model outperforms the existing methods in label-partially-unseen and label-fully-un-seeen scenarios and even outperfects the SOTA methods. |
The Essence of Contextual Understanding in Theory of Mind: A Study on Question Answering with Story Characters (2025.acl-long)
Copied to clipboard
Chulun Zhou, Qiujing Wang, Mo Yu, Xiaoqian Yue, Rui Lu, Jiangnan Li, Yifan Zhou, Shunchi Zhang, Jie Zhou, Wai Lam
| Challenge: | Theory-of-Mind (ToM) is a psychological capability that allows humans to understand and interpret the mental states of others. |
| Approach: | They propose a CharToM-QA benchmark to assess the importance of comprehensive contextual understanding about personal backgrounds in ToM. |
| Outcome: | The proposed model outperforms existing models on 1,035 ToM questions based on classic novels and shows that educated participants perform better when they have read the novels than non-educated participants. |
Dual-Encoder Transformers with Cross-modal Alignment for Multimodal Aspect-based Sentiment Analysis (2022.aacl-main)
Copied to clipboard
| Challenge: | Multimodal aspect-based sentiment analysis (MABSA) aims to extract aspect terms from text and image pairs, and then analyze their corresponding sentiment. |
| Approach: | They propose a dual-encoder transformer with cross-modal alignment to extract aspect terms from text and image pairs and then analyze their corresponding sentiments. |
| Outcome: | The proposed approach outperforms existing methods on two benchmarks. |
All Information is Valuable: Question Matching over Full Information Transmission Network (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods for question matching only transmit one kind of information while failing to utilize both kinds of information simultaneously. |
| Approach: | They propose a question matching network that can transmit both representation and interactive information together in a simultaneous fashion. |
| Outcome: | The proposed approach outperforms strong baseline models on two standard benchmarks. |
OASIS: Order-Augmented Strategy for Improved Code Search (2025.acl-long)
Copied to clipboard
Gao Zuchen, Zizheng Zhan, Xianming Li, Erxin Yu, Haotian Zhang, Chenbin Chenbin, Yuqun Zhang, Jing Li
| Challenge: | Code embeddings capture the semantic representations of code and are crucial for various code-related large language model (LLM) applications. |
| Approach: | They propose an order-augmented strategy for improved code search that leverages order-based similarity labels to capture subtle differences in similarity among negative pairs. |
| Outcome: | The proposed model outperforms state-of-the-art models focusing on major positive-negative differences. |
ARL2: Aligning Retrievers with Black-box Large Language Models via Self-guided Adaptive Relevance Labeling (2024.acl-long)
Copied to clipboard
| Challenge: | Existing retrievers are misaligned with large language models due to separate training processes and inherent black-box nature of LLMs. |
| Approach: | They propose a retriever learning technique that harnesses LLMs as labelers to annotate and score adaptive relevance evidence. |
| Outcome: | Extensive experiments show that ARL2 improves accuracy and reduces the cost of API calls. |
CriticLean: Critic-Guided Reinforcement Learning for Mathematical Formalization (2026.acl-long)
Copied to clipboard
Zhongyuan Peng, Yifan Yao, Kaijing Ma, Shuyue Guo, Yizhe Li, Yichi Zhang, Chenchen Zhang, Yifan Zhang, Zhouliang Yu, Luming Li, Minghao Liu, Yihang Xia, Jiawei Shen, Yuchen Wu, Yixin Cao, Zhaoxiang Zhang, Wenhao Huang, Jiaheng Liu, Ge Zhang
| Challenge: | Existing approaches to formalizing mathematical statements face limitations in accuracy, especially in the context of complex, highlevel problems that involve sophisticated mathematical reasoning. |
| Approach: | They propose a CriticLean framework that elevates the role of the critic from a passive validator to an active learning component and introduce a benchmark to measure models’ ability to distinguish semantically correct from incorrect formalizations. |
| Outcome: | The proposed framework outperforms open- and closed-source benchmarks and shows that it significantly outperformed existing models. |
A Survey of Multi-task Learning in Natural Language Processing: Regarding Task Relatedness and Training Methods (2023.eacl-main)
Copied to clipboard
| Challenge: | Multi-task learning is a popular approach in natural language processing because of its commonalities and differences. |
| Approach: | They propose to summarize recent advances in multi-task learning methods based on their task relatedness into two general multi-step training methods. |
| Outcome: | The proposed methods summarize the tasks and discuss future directions. |
Chain-of-Specificity: Enhancing Task-Specific Constraint Adherence in Large Language Models (2025.coling-main)
Copied to clipboard
| Challenge: | Existing approaches to enhancing large language models fail to emphasize specific constraints and unlock the underlying knowledge. |
| Approach: | They propose a method that emphasizes specific constraints and unlocks knowledge within LLMs by iteratively emphasising on specific constraints. |
| Outcome: | The proposed method outperforms existing methods in enhancing generated content, especially in terms of specificity. |
Detection, Diagnosis, and Explanation: A Benchmark for Chinese Medial Hallucination Evaluation (2024.lrec-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have made significant progress in recent years, but their practical use is hindered by their tendency to generate hallucinations. |
| Approach: | They propose to use ICD-10 and MeSH to evaluate LLMs' ability to detect medical hallucinations and make accurate diagnoses in noisy environments. |
| Outcome: | The proposed benchmark can be used to evaluate LLMs’ ability to detect medical hallucinations, make accurate diagnoses in noisy conditions, and provide plausible explanations. |
MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmark (2025.acl-long)
Copied to clipboard
Xiang Yue, Tianyu Zheng, Yuansheng Ni, Yubo Wang, Kai Zhang, Shengbang Tong, Yuxuan Sun, Botao Yu, Ge Zhang, Huan Sun, Yu Su, Wenhu Chen, Graham Neubig
| Challenge: | Recent advances in multimodal large language models have led to progress in tackling complex reasoning tasks that combine textual and visual information. |
| Approach: | They introduce a robust version of the Massive Multi-discipline Multimodal Understanding and Reasoning (MMMU) benchmark. |
| Outcome: | The proposed model performs lower on MMMU-Pro than on the previous benchmark, ranging from 16.8% to 26.9%. |
Efficient Zero-shot Event Extraction with Context-Definition Alignment (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Conventional supervised methods cannot generalize to event types out of the pre-defined ontology. |
| Approach: | They propose to use two separate transformer models to model the definition semantics of an event type name into the same embedding space and then minimize their embeddable distance via contrastive learning. |
| Outcome: | The proposed model outperforms all previous zero-shot EE methods with fast inference speed due to the disjoint design. |
PlanE: Meta Planning of Data, Tuning, and Inference for Extractive-based LLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for optimizing LLMs for task-specific tasks are limited due to the sheer volume of data. |
| Approach: | They propose a Planning framework for constructing Extractive-based LLMs called PlanE . they propose 'data decomposition', instruction tuning, prompt inference and a 'Data-Tuning-Inference' planner . |
| Outcome: | The proposed framework improves performance across different datasets and on different dataset. |
ProphetNet-X: Large-Scale Pre-training Models for English, Chinese, Multi-lingual, Dialog, and Code Generation (2021.acl-demo)
Copied to clipboard
Weizhen Qi, Yeyun Gong, Yu Yan, Can Xu, Bolun Yao, Bartuer Zhou, Biao Cheng, Daxin Jiang, Jiusheng Chen, Ruofei Zhang, Houqiang Li, Nan Duan
| Challenge: | Existing models for pre-training are not convenient for users to find and set them up. |
| Approach: | They propose to extend ProphetNet into other domains and languages by pre-training models . they pre-train a cross-lingual generation model ProphetNet-Multi and a Chinese generation model . |
| Outcome: | The proposed models achieve new state-of-the-art on 10 benchmarks. |
Prta: A System to Support the Analysis of Propaganda Techniques in the News (2020.acl-demos)
Copied to clipboard
Giovanni Da San Martino, Shaden Shaar, Yifan Zhang, Seunghak Yu, Alberto Barrón-Cedeño, Preslav Nakov
| Challenge: | recent events have brought the public attention to the dangers of online disinformation. |
| Approach: | a new tool helps users analyze propaganda using specific rhetorical and psychological techniques. a prta system identifies the spans in which propaganda techniques occur and compares them. |
| Outcome: | a new tool can analyze articles crawled on a regular basis and compare them on the basis of their use of propaganda techniques. |
APT: Improving Specialist LLM Performance with Weakness Case Acquisition and Iterative Preference Training (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models often require domain-specific fine-tuning to address targeted tasks, which risks degrading their general capabilities. |
| Approach: | They propose to use self-generated dis-preferred weakness data to enhance model performance with a targeted training approach that minimizes interference with existing knowledge base. |
| Outcome: | The proposed approach ensures no reduction in generic capacity and achieves superior performance on downstream tasks compared to existing methods. |
Recent Advances in Speech Language Models: A Survey (2025.acl-long)
Copied to clipboard
Wenqian Cui, Dianzhi Yu, Xiaoqi Jiao, Ziqiao Meng, Guangyan Zhang, Qichao Wang, Steven Y. Guo, Irwin King
| Challenge: | Text-based Large Language Models (LLMs) are a promising solution for end-to-end speech interaction. |
| Approach: | They propose to build a framework that allows users to input text and translate it into speech . they propose to use a text-only LLM and a "textto-speech" framework to generate a response based on this transcription . |
| Outcome: | The survey offers an overview of recent approaches to building SpeechLMs . it outlines core architectural components, training methodologies, evaluation strategies and challenges . |
Re-TASK: Revisiting LLM Tasks from Capability, Skill, and Knowledge Perspectives (2025.findings-acl)
Copied to clipboard
Zhihu Wang, Shiwan Zhao, Yu Wang, Heyuan Huang, Sitao Xie, Yubo Zhang, Jiaxin Shi, Zhixing Wang, Hongyan Li, Junchi Yan
| Challenge: | Existing approaches to solving complex tasks with large language models (LLMs) fail to decompose tasks accurately or execute subtasks effectively. |
| Approach: | They propose a Chain-of-Learning (CoL) paradigm that highlights task dependencies on specific capability items, further broken down into their constituent knowledge and skill components. |
| Outcome: | The proposed model improves Yi-1.5-9B and Llama3-Chinese-8B for legal tasks by 45.00% and 24.50% on different domains. |
TUNA: Comprehensive Fine-grained Temporal Understanding Evaluation on Dense Dynamic Videos (2025.acl-long)
Copied to clipboard
Fanheng Kong, Jingyuan Zhang, Hongzhi Zhang, Shi Feng, Daling Wang, Linhao Yu, Xingguang Ji, Yu Tian, V. W., Fuzheng Zhang
| Challenge: | Existing benchmarks for video understanding often focus on specific aspects, overlooking the holistic nature of video content. |
| Approach: | They propose a temporal-oriented benchmark for fine-grained understanding on dense dynamic videos with two complementary tasks: captioning and QA. |
| Outcome: | The proposed model performs well on diverse video scenarios and dynamic videos, with interpretable and robust evaluation criteria. |
WebAgent-R1: Training Web Agents via End-to-End Multi-Turn Reinforcement Learning (2025.emnlp-main)
Copied to clipboard
Zhepei Wei, Wenlin Yao, Yao Liu, Weizhi Zhang, Qin Lu, Liang Qiu, Changlong Yu, Puyang Xu, Chao Zhang, Bing Yin, Hyokun Yun, Lihong Li
| Challenge: | Existing work on reinforcement learning has focused on single-turn tasks such as solving math problems. |
| Approach: | They propose a framework that learns directly from online interactions by asynchronously generating diverse trajectories, guided by binary rewards depending on task success. |
| Outcome: | Experiments on the WebArena-Lite benchmark show that the framework outperforms state-of-the-art methods and strong proprietary models. |
Graph Attention Network with Memory Fusion for Aspect-level Sentiment Analysis (2020.aacl-main)
Copied to clipboard
| Challenge: | Recent studies ignored the syntactic relationship between the aspect and its corresponding context words, leading the model to focus on syntaktically unrelated words mistakenly. |
| Approach: | They propose to extend the graph convolutional network by assigning different weights to edges of connected words. |
| Outcome: | The proposed method can improve on five datasets showing that it learns and exploits multiword relations and draws different weights of words to improve performance. |
Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Task (D18-1)
Copied to clipboard
Tao Yu, Rui Zhang, Kai Yang, Michihiro Yasunaga, Dongxu Wang, Zifan Li, James Ma, Irene Li, Qingning Yao, Shanelle Roman, Zilin Zhang, Dragomir Radev
| Challenge: | Existing datasets for semantic parsing are too small in terms of number of programs for training modern data-intensive models. |
| Approach: | They propose a large-scale complex and cross-domain semantic parsing task for a database . they use a dataset with 10,181 questions and 5,693 unique complex SQL queries . |
| Outcome: | The proposed task is different from previous tasks because it uses the same database and program . the best model achieves only 9.7% exact matching accuracy on a database split setting. |
RethinkMCTS: Refining Erroneous Thoughts in Monte Carlo Tree Search for Code Generation (2025.emnlp-main)
Copied to clipboard
Qingyao Li, Wei Xia, Xinyi Dai, Kounianhua Du, Weiwen Liu, Yasheng Wang, Ruiming Tang, Yong Yu, Weinan Zhang
| Challenge: | Existing tree search methods neglect the underlying reasoning process, resulting in poor search quality. |
| Approach: | They propose a framework that systematically explores and refines the reasoning process for code generation by using a tree search engine and a reflection mechanism. |
| Outcome: | The proposed framework outperforms existing methods in the code generation domain. |
Entity Pair-guided Relation Summarization and Retrieval in LLMs for Document-level Relation Extraction (2025.findings-naacl)
Copied to clipboard
| Challenge: | Document-level relation extraction (DocRE) aims to extract relations between entities in a document. |
| Approach: | They propose an entity pair-guided relation summarization and retrieval model for DocRE . the model uses entity pairs to guide relation summaries and retrievals . |
| Outcome: | The proposed model achieves state-of-the-art (SOTA) performance on three datasets. |
CITE: Benchmarking Heterogeneous Text-Attributed Graph Models (2026.acl-long)
Copied to clipboard
| Challenge: | Recent advances in large language models and text-aware graph learning have increased interest in reasoning over text-attributed graphs. |
| Approach: | They propose a large-scale heterogeneous text-attributed graph benchmark for catalytic materials that contains over 438K nodes and 1.2M edges . they establish standardized evaluation protocols for node classification and link prediction and conduct ablation studies to assess the impact of graph heterogenity and textual attributes. |
| Outcome: | The proposed benchmarks are compared to existing methods and provide a baseline for the evaluation of four classes of learning paradigms. |
Can Foundation Models Watch, Talk and Guide You Step by Step to Make a Cake? (2023.findings-emnlp)
Copied to clipboard
Yuwei Bao, Keunwoo Yu, Yichi Zhang, Shane Storks, Itamar Bar-Yossef, Alex de la Iglesia, Megan Su, Xiao Zheng, Joyce Chai
| Challenge: | despite advances in AI, it remains a challenge to develop interactive task guidance systems that can offer situated, personalized guidance and assist humans in various tasks. |
| Approach: | They propose to use a multimodal benchmark dataset to study whether interactive task guidance systems can be quickly adapted to perceptually enabled tasks. |
| Outcome: | The proposed models demonstrate fair performances in some cases with no training . the results will provide a stepping stone for future work on situated task guidance . |
The Lessons of Developing Process Reward Models in Mathematical Reasoning (2025.findings-acl)
Copied to clipboard
Zhenru Zhang, Chujie Zheng, Yangzhen Wu, Beichen Zhang, Runji Lin, Bowen Yu, Dayiheng Liu, Jingren Zhou, Junyang Lin
| Challenge: | a recent study shows that process reward models can make mistakes, leading to wrong conclusions. |
| Approach: | They propose a consensus filtering mechanism that integrates MC estimation with LLM-as-a-judge to improve model performance and data efficiency. |
| Outcome: | The proposed model outperforms existing open-source alternatives and provides practical guidelines for future research. |
IAM: A Comprehensive and Large-Scale Dataset for Integrated Argument Mining Tasks (2022.acl-long)
Copied to clipboard
| Challenge: | Argument mining (AM) is a computational process that is used to analyze information in a debating system. |
| Approach: | They propose to use a large dataset to automate the manual process of debating . they propose to integrate claim extraction, stance classification and evidence extraction tasks . |
| Outcome: | The proposed tasks can extract claims, stances, evidence and more from a large dataset . the proposed tasks are highly efficient and can be applied to argument mining tasks . |
VortexPIA: Indirect Prompt Injection Attack against LLMs for Efficient Extraction of User Privacy (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have been widely deployed in Conversational AIs . however, the methods proposed in the study rely on a white-box setting . |
| Approach: | They propose an indirect prompt injection attack that induces privacy extraction in LLMs . they use token-efficient data containing false memories to inject LLM data . |
| Outcome: | The proposed method outperforms baselines and achieves state-of-the-art performance. |
Learning Confidence for Transformer-based Neural Machine Translation (2022.acl-long)
Copied to clipboard
| Challenge: | A well-calibrated confidence estimate is not sufficient for neural machine translation (NMT) where probabilities from softmax distribution fail to describe when the model is probably mistaken. |
| Approach: | They propose an unsupervised confidence estimate learning jointly with the training of a neural machine translation model to quantify confidence. |
| Outcome: | The proposed model outperforms standard label smoothing and can predict failures in two real-world scenarios. |
VReST: Enhancing Reasoning in Large Vision-Language Models through Tree Search and Self-Reward Mechanism (2025.acl-long)
Copied to clipboard
| Challenge: | Large Vision-Language Models (LVLMs) have shown exceptional performance in multimodal tasks, but their effectiveness in complex visual reasoning is constrained. |
| Approach: | They propose a training-free approach that enhances Reasoning in Large Vision-Language Models . they propose integrating Monte Carlo Tree Search and Self-Reward mechanisms into the reasoning tree . |
| Outcome: | The proposed approach surpasses current prompting methods and secures state-of-the-art performance across three multimodal reasoning benchmarks. |
MEXA: Towards General Multimodal Reasoning with Dynamic Multi-Expert Aggregation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | MEXA is a training-free framework that performs modality- and task-aware aggregation of multiple expert models to enable effective multimodal reasoning across diverse domains. |
| Approach: | MEXA is a training-free framework that performs modality- and task-aware aggregation of multiple expert models. |
| Outcome: | MEXA performs modality- and task-aware aggregation of multiple expert models . it generates interpretable textual reasoning outputs and reasons over them using a Large Reasoning Model (LRM) MEX A consistently delivers performance improvements over strong multimodal benchmarks . |
Controllable Contamination Detection for Reliable LLM Evaluation with Statistical Guarantees (2026.acl-long)
Copied to clipboard
Zheng Zhang, Qi Liu, Siyuan Liang, Ning Li, Zirui Hu, Weibo Gao, Rui Li, Zhenya Huang, Leszek Rutkowski, Baosheng Yu, Dacheng Tao
| Challenge: | Existing training data detectors fail to detect clean samples from contaminated test sets . existing methods fail to identify clean samples due to black-box nature of LLMs . |
| Approach: | They propose a framework that detects and filters contaminated evaluation data . they propose 'failure detection' to reduce the proportion of contaminated samples mistakenly retained . |
| Outcome: | The proposed framework reduces false discovery rate (FDR) under valid FDR control while maintaining evaluation consistency. |
Logic Rules as Explanations for Legal Case Retrieval (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent efforts to learn explainable legal case retrieval models fail to provide faithful and interpretable explanations for legal cases. |
| Approach: | They propose a framework that uses logic rules to explain legal case retrieval results . they extend benchmarks of LeCaRD and ELAM with manually annotated logic rules . |
| Outcome: | The proposed framework is able to provide faithful explanations for legal case retrieval. |
Beyond Self-Report: Bridging the Intention-Behavior Gap in Critical Thinking Assessment via Interpretable Multi-Agent System (2026.acl-long)
Copied to clipboard
Zekun Li, Jifan Yu, Haoxuan Li, Ye He, Daniel Zhang-Li, Shangqing Tu, Joy Jia Yin Lim, Yikun Jiang, Jiaxin Yuan, Yu Zhang
| Challenge: | Accurate assessment of critical thinking is limited by the Intention Behavior Gap in psychology . evaluators that measure self-reported competence are limited by multiagent architectures . |
| Approach: | They propose a framework that operationalizes cognitive assessment into an interpretable multi-agent workflow with Assessment Chain-of-Thought. |
| Outcome: | The proposed framework aligns better with human expert ratings than gold-standard inventories on large-scale simulations and human participants. |
TriPlay-RL: Tri-Role Self-Play Reinforcement Learning for LLM Safety Alignment (2026.acl-long)
Copied to clipboard
Zhewen Tan, Wenhan Yu, Jianfeng Si, Tongxin Liu, Kaiqi Guan, Huiyan Jin, Jiawen Tao, Xiaokun Yuan, Xiangzheng Zhang, Duohe Ma, Tong Yang, Lin Sun
| Challenge: | Existing approaches to safety alignment of large language models rely on costly manual annotations or human review. |
| Approach: | They propose a closed-loop reinforcement learning framework called TriPlay-RL that enables iterative collaboration among three roles with near-zero manual annotation. |
| Outcome: | The proposed framework achieves 20%–50% improvement in adversarial effectiveness while preserving high output diversity while achieving 10%–30% gains in safety performance without degrading general reasoning capability. |
Instruction Tuning with Retrieval-based Examples Ranking for Aspect-based Sentiment Analysis (2024.findings-acl)
Copied to clipboard
| Challenge: | Aspect-based sentiment analysis (ABSA) identifies sentiment information related to specific aspects . previous studies have proposed using fixed examples for instruction tuning . |
| Approach: | They propose an instruction learning method with retrieval-based example ranking for ABSA tasks. |
| Outcome: | The proposed method is superior to existing models on three ABSA subtasks. |
DSQG-Syn: Synthesizing High-quality Data for Text-to-SQL Parsing by Domain Specific Question Generation (2025.findings-naacl)
Copied to clipboard
Shaoming Duan, Youxuan Wu, Chuanyi Liu, Yuhao Zhang, Zirui Wang, Peiyi Han, Shengyuan Yu, Liang Yan, Yingwei Liang
| Challenge: | Existing methods for generating SQL queries using natural language questions produce inconsistent NLQ-SQL pairs. |
| Approach: | They propose a text-to-SQL data synthesis framework that generates domain-relevant questions . they synthesize NLQ-SqL pairs that are domain-specific and intent-consistent . |
| Outcome: | The proposed method outperforms closed-source LLMs on the Text-to-SQL task. |
Unsupervised Context Rewriting for Open Domain Conversation (D19-1)
Copied to clipboard
| Challenge: | Existing approaches to model conversation context have drawbacks, such as lack of coreferences and long dependency. |
| Approach: | They propose a context rewriting method which explicitly rewrites the last utterance by considering context history. |
| Outcome: | The proposed method outperforms baselines in terms of rewriting quality, multi-turn response generation, and end-to-end retrieval-based chatbots. |
DatawiseAgent: A Notebook-Centric LLM Agent Framework for Adaptive and Robust Data Science Automation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing large language model (LLM) agents for data science automation are limited by narrow task scopes, limited generalization across tasks and models, and over-reliance on state-of-the-art (SOTA) LLMs. |
| Approach: | They propose a notebook-centric LLM agent framework for adaptive and robust data science automation. |
| Outcome: | The proposed framework surpasses baselines such as AutoGen and TaskWeaver in performance tests across diverse data science scenarios and models. |
Safety in Large Reasoning Models: A Survey (2025.findings-emnlp)
Copied to clipboard
Cheng Wang, Yue Liu, Baolong Bi, Duzhen Zhang, Zhong-Zhi Li, Yingwei Ma, Yufei He, Shengju Yu, Xinfeng Li, Junfeng Fang, Jiaheng Zhang, Bryan Hooi
| Challenge: | Large Reasoning Models (LRMs) have a high level of advanced reasoning capabilities, but they are vulnerable and vulnerable. |
| Approach: | This paper presents the first comprehensive survey of Large Reasoning Models . it explores the new safety risks, attacks, and defense strategies specific to LRMs based on reasoning . |
| Outcome: | The proposed study examines the safety and security risks of large reasoning models. |
NL2Lean: Translating Natural Language into Lean 4 through Multi-Aspect Reinforcement Learning (2025.emnlp-main)
Copied to clipboard
Yue Fang, Shaohan Huang, Xin Yu, Haizhen Huang, Zihan Zhang, Weiwei Deng, Furu Wei, Feng Sun, Qi Zhang, Zhi Jin
| Challenge: | Existing formal proof assistants rely on instruction tuning and lack fine-grained structural and semantic alignment. |
| Approach: | They propose a reinforcement learning framework that enables LLMs to translate natural language into formal language such as Lean 4 . they use a model with basic translation ability to refine the model's reinforcement learning . |
| Outcome: | The proposed method outperforms baseline models on NL-to-Lean 4 tasks. |
Eliciting In-Context Learning in Vision-Language Models for Videos Through Curated Data Distributional Properties (2024.emnlp-main)
Copied to clipboard
| Challenge: | Emergent In-context Learning on Videos induces in-contact learning over video and text . eILeV-trained models outperform other off-the-shelf VLMs in few-shot video narration for novel, rare actions. |
| Approach: | They implement Emergent In-context Learning on Videos (EILeV) that induces in-contact learning over video and text by capturing key properties of pre-training data. |
| Outcome: | The proposed training paradigm outperforms off-the-shelf VLMs in few-shot video narration for novel, rare actions. |
KICGPT: Large Language Model with Knowledge in Context for Knowledge Graph Completion (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing knowledge graph completion methods struggle with long-tail entities due to limited structural information and imbalanced distributions of entities. |
| Approach: | They propose a framework that integrates a large language model and a triple-based KGC retriever to alleviate the long-tail problem without incurring additional training overhead. |
| Outcome: | The proposed model reduces training overhead and finetuning costs on benchmark datasets. |
Chain-of-Skills: A Configurable Model for Open-Domain Question Answering (2023.acl-long)
Copied to clipboard
| Challenge: | Using customized retrieval models, model transferability and scalability are limited. |
| Approach: | They propose a modular retrieval model where individual modules correspond to key skills that can be reused across datasets. |
| Outcome: | The proposed model outperforms self-supervised retrievers in zero-shot evaluations and achieves state-of-the-art fine-tuned retrieval performance on NQ, HotpotQA and OTT-QA. |
A Query-Response Framework for Whole-Page Complex-Layout Document Image Translation with Relevant Regional Concentration (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for document image translation rely on the vanilla encoder-decoder paradigm . a novel dynamic aggregation mechanism is designed to enhance the text semantics in query features toward translation. |
| Approach: | They propose a Query-Response DIT framework that reformulates the DIT task into a parallel response/translation process of multiple queries. |
| Outcome: | The proposed framework improves translation quality on four translation directions on three benchmarks. |
Logic-Consistency Text Generation from Semantic Parses (2021.findings-acl)
Copied to clipboard
| Challenge: | Text generation from semantic parses is challenging due to the complexity of the inner logic and the lack of automatic evaluation metrics for logic consistency. |
| Approach: | They propose a framework for logic consistent text generation from semantic parses that employs iterative training procedures and quality control. |
| Outcome: | The proposed framework enhances logic consistency and human evaluation on two benchmark datasets. |
SciCustom: A Framework for Custom Evaluation of Scientific Capabilities in Large Language Models (2026.acl-long)
Copied to clipboard
Yiyang Gu, Junwei Yang, Junyu Luo, Ye Yuan, Bin Feng, Yingce Xia, Shufang Xie, Kaili Liu, Bohan Wu, Qi Shi, Haoran Li, Beier Xiao, Zhiping Xiao, Xiao Luo, Weizhi Zhang, Philip S. Yu, Zequn Liu, Ming Zhang
| Challenge: | Existing evaluations of large language models fail to reflect fine-grained capabilities . existing benchmarks are manually curated or domain-generic, limiting scalability and alignment with real use cases. |
| Approach: | They propose a framework that allows custom construction of benchmarks from large-scale scientific data to evaluate application-specific scientific capabilities in LLMs. |
| Outcome: | The proposed framework reveals fine-grained differences in scientific capabilities that standard benchmarks overlook . it allows custom construction of benchmarks from large-scale scientific data to evaluate application-specific capabilities in LLMs. |
Generalizable and Explainable Dialogue Generation via Explicit Action Learning (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Conditioned response generation for task-oriented dialogues implicitly optimizes task completion and language quality. |
| Approach: | They propose to learn natural language actions that represent utterances as a span of words. |
| Outcome: | The proposed approach outperforms latent action baselines on a multi-domain dataset. |
Ascending the Infinite Ladder: Benchmarking Spatial Deformation Reasoning in Vision-Language Models (2026.acl-long)
Copied to clipboard
Jiahuan Zhang, Shunwen Bai, Tianheng Wang, KaiWen Guo, Zijia Song, Hanqing WU, Guozheng Rao, Kai Han, Kaicheng Yu
| Challenge: | Existing benchmarks explore aspects of threedimensional spatial reasoning and visual-language reasoning in dynamic environments, but they are unable to perform well on 3D spatial deformation reasoning. |
| Approach: | They propose to use a ladder competition format to assess the model's spatial deformation reasoning abilities to determine its performance. |
| Outcome: | The proposed framework assesses the performance of Vision-Language Models in spatial deformation reasoning tasks. |
Jailbreak Large Vision-Language Models Through Multi-Modal Linkage (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods to jailbreak large vision-language models fail against cutting-edge models such as GPT-4o, despite having undergone safety alignment training. |
| Approach: | They propose a new framework for jailbreaking large vision-language models that uses an encryption-decryption process to mitigate the over-exposure of harmful information. |
| Outcome: | The proposed framework jailbreaks GPT-4o with 99.40% success rates on SafeBench, 98.81% on MM-SafeBench and 99.07% on HADES-Dataset. |
PDALN: Progressive Domain Adaptation over a Pre-trained Model for Low-Resource Cross-Domain Named Entity Recognition (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to Named Entity Recognition (NER) are limited in labeled resources and domain shift. |
| Approach: | They propose a progressive domain adaptation knowledge distillation approach to adapt high-resource domains to low-resourced target domains by employing three components to achieve superior domain adaptability. |
| Outcome: | The proposed approach can adapt high-resource domains to low-resourced target domains even if they are diverse in terms and writing styles. |
On the Dimensionality of Sentence Embeddings (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work focuses on improving the quality of sentence embeddings, but the exploration of sentence dimension is limited. |
| Approach: | They propose a two-step training method where the encoder and pooler are optimized separately to mitigate the overall performance loss in low-dimension scenarios. |
| Outcome: | The proposed method significantly improves the performance of low-dimensional sentence embeddings on seven STS tasks and seven sentence classification tasks. |
AgentRM: Enhancing Agent Generalization with Reward Modeling (2025.acl-long)
Copied to clipboard
Yu Xia, Jingru Fan, Weize Chen, Siyu Yan, Xin Cong, Zhong Zhang, Yaxi Lu, Yankai Lin, Zhiyuan Liu, Maosong Sun
| Challenge: | Existing LLM-based agents have strong performance on held-in tasks, but their generalizability to unseen tasks remains poor. |
| Approach: | They propose a reward-based generalizable reward model to guide the policy model for effective test-time search. |
| Outcome: | The proposed agentRM outperforms existing agents on held-in tasks by 8.8 points on average. |
KERS: A Knowledge-Enhanced Framework for Recommendation Dialog Systems with Multiple Subgoals (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing frameworks for multi-subgoal dialogs require a system to build a social bond with users to gain trust and develop affinity. |
| Approach: | They propose a framework for common knowledge-based multi-subgoal dialogs that divides up conversations with multiple subgoals and propose mechanisms to filter noisy knowledge and to include cleaned knowledge in the dialog response generation process. |
| Outcome: | The proposed framework obtains state-of-the-art results on a DuRecDial dataset in both automatic and human evaluation. |
M3AV: A Multimodal, Multigenre, and Multipurpose Audio-Visual Academic Lecture Dataset (2024.acl-long)
Copied to clipboard
Zhe Chen, Heyang Liu, Wenyi Yu, Guangzhi Sun, Hongcheng Liu, Ji Wu, Chao Zhang, Yu Wang, Yanfeng Wang
| Challenge: | Publishing open-source academic video recordings is an emerging approach to sharing knowledge online. |
| Approach: | They propose a multimodal, multigenre, and multipurpose audio-visual academic lecture dataset with human annotations for multimodal content recognition and understanding tasks. |
| Outcome: | The proposed dataset can be used for multiple audio-visual recognition and understanding tasks. |
UNCLE: Benchmarking Uncertainty Expressions in Long-Form Generation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing work lacks direct and fair evaluation of Large Language Models’ ability to express uncertainty effectively in long-form generation. |
| Approach: | They propose a benchmark to evaluate uncertainty expression in both long- and short-form question answering (QA) they propose prompt-based and training-based methods to improve models’ performance. |
| Outcome: | The proposed method mitigates this issue but a misalignment persists in uncertainty expression between long- and short-form generation. |
Answering Product-related Questions with Heterogeneous Information (2020.aacl-main)
Copied to clipboard
| Challenge: | Existing product question answering methods only consider a single information source such as user reviews and/or require large amounts of labeled data. |
| Approach: | They propose a framework to exploit heterogeneous information including natural language text and attribute-value pairs from two information sources of the concerned product, namely product details and user reviews. |
| Outcome: | The proposed framework achieves superior performance over state-of-the-art models on a real-world dataset. |
ForestCast: Open-Ended Event Forecasting with Semantic News Forest (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches and datasets overlook the complex relationships among events . current research lacks comprehensive evaluation methods to evaluate OEEF . |
| Approach: | They propose a prediction pipeline that extracts forecast-relevant events from news data . forestcast organizes news events into a story tree and predicts subsequent events along each path . |
| Outcome: | The proposed pipeline extracts forecast-relevant events from news data and predicts subsequent events along each path. |
Progressive LoRA for Multimodal Continual Instruction Tuning (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to MCIT address Catastrophic Forgetting and Knowledge Transfer (KT) but using a fixed number of shared LoRA blocks across tasks can lead to knowledge interference. |
| Approach: | They propose a framework that uses a fixed number of shared LoRA blocks to reduce knowledge interference. |
| Outcome: | The proposed framework outperforms existing approaches on the latest MCIT benchmark. |
Mnemis: Dual-Route Retrieval on Hierarchical Graphs for Long-Term LLM Memory (2026.acl-long)
Copied to clipboard
Zihao Tang, Xin Yu, Ziyu Xiao, Zengxuan Wen, Zelin Li, Jiaxi Zhou, Hualei Wang, Haohua Wang, Haizhen Huang, Weiwei Deng, Feng Sun, Qi Zhang
| Challenge: | Existing methods for retrieving historical messages are based on similarity-based mechanisms. |
| Approach: | They propose a system that integrates System-1 similarity search with a complementary System-2 mechanism, termed Global Selection. |
| Outcome: | The proposed framework achieves state-of-the-art on long-term memory benchmarks and 93.9 on LoCoMo and 91.6 on LongMemEval-S. |
Self-Paced Learning for Neural Machine Translation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies have shown that the training of neural machine translation (NMT) rely on the quality of artificial schedule drawn up with the handcrafted features, e.g. sentence length or word rarity. |
| Approach: | They propose to train NMT model using a self-paced learning approach that allows it to quantify the learning confidence over training examples and flexibly govern its learning via regulating the loss in each iteration step. |
| Outcome: | The proposed model outperforms baseline models and those trained with human-designed curricula on translation quality and convergence speed. |
Revisiting Commonsense Reasoning in Machine Translation: Training, Evaluation and Challenge (2023.acl-long)
Copied to clipboard
| Challenge: | CR is the ability to understand and navigate the world using basic knowledge and understanding shared by most people. |
| Approach: | They propose to incorporate pretrained knowledge into NMT models and use them as robust testbeds for investigating CR in NMT. |
| Outcome: | The proposed method improves the training of NMT models with high CR abilities and provides accurate evaluation metrics. |
Complementary Evidence Identification in Open-Domain Question Answering (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing approaches to QA that only measure the relevance between the question and each paragraph are not effective. |
| Approach: | They propose a method that learns vector representations of passages and models the sufficiency and diversity within the selected set, in addition to the relevance between the question and passages. |
| Outcome: | The proposed method significantly improves the accuracy of complementary evidence selection in open-domain question answering domain. |
MoE Adapter for Large Audio Language Models: Sparsity, Disentanglement, and Gradient-Conflict-Free (2026.findings-acl)
Copied to clipboard
Yishu Lei, Shuwei He, Hu Jing, Dan Zhang, Xianlong Luo, Danxiang Zhu, Shikun Feng, Rui Liu, Jingzhou HE, Yu Sun, Hua Wu, Haifeng Wang
| Challenge: | Existing research on Large Language Models (LLMs) limited to textual input modality . acoustic information is intrinsically heterogeneous, entangling attributes such as speech, music, and environmental context. |
| Approach: | They propose a sparse Mixture-of-Experts architecture to decouple acoustic information by routing audio tokens to specialized experts. |
| Outcome: | The proposed architecture outperforms existing models on audio semantic and paralinguistic tasks while retaining shared experts for global context. |
Self-Cleaning: Improving a Named Entity Recognizer Trained on Noisy Data with a Few Clean Instances (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods to train named entity recognition models on noisy data are expensive and time-intensive to accumulate. |
| Approach: | They propose to denoise noisy NER data with guidance from a small set of clean instances. |
| Outcome: | The proposed method can improve on large-scale datasets with a small guidance set. |
CodePRM: Execution Feedback-enhanced Process Reward Model for Code Generation (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in code generation focus on optimizing the thought process, but lack effective process supervision, making it difficult to optimize the thoughts. |
| Approach: | They propose a method that leverages the code execution feedback to build a code PRM by collecting a large dataset of thought traces and then training it to take both the reasoning process and code execution as input. |
| Outcome: | The proposed approach outperforms baselines and strong LLMs in the inference stage. |
Learning Logic Rules for Document-Level Relation Extraction (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for document-level relation extraction relied on implicitly powerful representations, which makes the model less transparent. |
| Approach: | They propose a probabilistic model for document-level relation extraction by learning logic rules. |
| Outcome: | The proposed model outperforms baseline models in relation performance and logical consistency. |
Prompt-Based Meta-Learning For Few-shot Text Classification (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to learn text labels require large amounts of data to build many few-shot tasks. |
| Approach: | They propose a Prompt-Based Meta-Learning model that adds the prompting mechanism to the meta-learning method. |
| Outcome: | The proposed method improves on four text classification datasets with high accuracy and robustness. |
UniMoE-Audio: Unified Speech and Music Generation with Dynamic-Capacity Mixture-of-Experts (2026.acl-long)
Copied to clipboard
Zhenyu Liu, Yunxin li, Xuanyu Zhang, Qixun Teng, Shenyuan Jiang, Xinyu Chen, Haoyuan Shi, Haolan Chen, Fanbo Meng, Mingjun Zhao, Yu Xu, Yancheng He, Baotian Hu, Haizhou Li, Min Zhang
| Challenge: | Recent advances in unified multimodal models indicate a clear trend towards comprehensive content generation. |
| Approach: | They propose a unified speech and music generation model built upon a novel framework . they propose specialized MoE architectures and curated training strategies to tackle data imbalances . |
| Outcome: | The proposed model achieves state-of-the-art performance on major speech and music generation benchmarks. |
AndroidLab: Training and Systematic Benchmarking of Android Autonomous Agents (2025.acl-long)
Copied to clipboard
Yifan Xu, Xiao Liu, Xueqiao Sun, Siyi Cheng, Hao Yu, Hanyu Lai, Shudan Zhang, Dan Zhang, Jie Tang, Yuxiao Dong
| Challenge: | Existing studies on Android agents lack systematic research on open-source and closed-source models. |
| Approach: | They propose a framework for Android agents that includes an operation environment and a reproducible benchmark. |
| Outcome: | The proposed framework lifts the success rate of open-source LLMs and LMMs from 4.59% to 21.50% for LLM and 1.93% to 13.28% for LMM. |
DivScene: Towards Open-Vocabulary Object Navigation with Large Vision Language Models in Diverse Scenes (2025.findings-emnlp)
Copied to clipboard
Zhaowei Wang, Hongming Zhang, Tianqing Fang, Ye Tian, Yue Yang, Kaixin Ma, Xiaoman Pan, Yangqiu Song, Dong Yu
| Challenge: | Large Vision-Language Models (LVLMs) have achieved significant progress in tasks like visual question answering and document understanding. |
| Approach: | They introduce DivScene, a large-scale dataset with 4,614 houses across 81 scene types and 5,707 kinds of target objects. |
| Outcome: | The proposed dataset provides a much greater diversity of target objects and scene types than existing datasets, enabling a comprehensive task evaluation. |
Improving Multilingual Sign Language Translation with Automatically Clustered Language Family Information (2025.coling-main)
Copied to clipboard
| Challenge: | Recent research has focused on bilingual translation models, but multilingual sign language translation presents unique challenges due to the diversity of sign languages across nations. |
| Approach: | They propose a method that leverages sign language families to improve MSLT performance. |
| Outcome: | The proposed approach can achieve balance between translation accuracy and computational cost by regulating the number of language families. |
TruthX: Alleviating Hallucinations by Editing Large Language Models in Truthful Space (2024.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) sometimes produce untruthful responses despite knowing the correct knowledge. |
| Approach: | They propose an inference-time intervention method to activate the truthfulness of Large Language Models (LLMs) by editing the features within LLM’s internal representations that govern the truthful. |
| Outcome: | The proposed method improves the truthfulness of 13 advanced LLMs by an average of 20% on TruthfulQA benchmark. |
The Stochastic Parrot on LLM’s Shoulder: A Summative Assessment of Physical Concept Understanding (2025.naacl-long)
Copied to clipboard
| Challenge: | Recent years have witnessed remarkable advancements in large language models (LLMs) many researchers argue that LLMs may not * Equal contribution. |
| Approach: | They propose a task that summarises the memorization issue by using grid inputs that abstractly describe physical phenomena. |
| Outcome: | The proposed task alleviates the memorization issue by using grid-format inputs that abstractly describe physical phenomena. |
Dynamic Scaling of Unit Tests for Code Reward Modeling (2025.acl-long)
Copied to clipboard
| Challenge: | Existing large language models struggle to produce accurate responses on the first attempt for complex reasoning tasks like code generation. |
| Approach: | They propose a lightweight yet effective unit test generator that scales unit tests based on problem difficulty. |
| Outcome: | The proposed approach significantly improves performance on three benchmarks. |
PRA-RAG: Provably Robust Aggregation in Retrieval-Augmented Generation against Retrieval Corruption (2026.findings-acl)
Copied to clipboard
Xue Tan, Yi Zheng, Chang Huo, Yunruo Zhang, Yu Liu, Hao Luan, Zhuyang Yu, Jun Dai, Xiaoyan Sun, Ping Chen
| Challenge: | Existing defense mechanisms lack theoretical robustness guarantees and perform unreliably when the LLM has limited knowledge of the retrieved content. |
| Approach: | They propose a provably robust retrieval aggregation algorithm designed to defend against poisoning attacks on retrieved texts. |
| Outcome: | Experiments show that PRA-RAG reduces the attack success rate to as low as 1% while maintaining an accuracy of 71%, significantly outperforming representative state-of-the-art (SOTA) methods. |
Learning Inter-Entity-Interaction for Few-Shot Knowledge Graph Completion (2022.emnlp-main)
Copied to clipboard
| Challenge: | Recent FKGC studies focus on learning semantic representations of entity pairs by separately encoding the neighborhoods of head and tail entities. |
| Approach: | They propose a model to learn semantic representations of entity pairs by separately encoding the neighborhoods of head and tail entities. |
| Outcome: | The proposed model outperforms state-of-the-art methods on two public datasets. |
Utility-Oriented Visual Evidence Selection for Multimodal Retrieval-Augmented Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for multimodal retrieval-augmented generation rely on semantic relevance or surface-level similarity, which are often misaligned with the actual utility of visual evidence for downstream reasoning. |
| Approach: | They propose a latent notion of evidence usefulness and propose 'surrogate-accelerated' framework that efficiently estimates evidence utility using lightweight multimodal models. |
| Outcome: | The proposed framework outperforms state-of-the-art models while achieving substantial reductions in computational cost. |
TSGP: Two-Stage Generative Prompting for Unsupervised Commonsense Question Answering (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies focus on acquiring relevant knowledge by retrieving external knowledge bases and fine-tuning pre-trained models. |
| Approach: | They propose a two-stage prompt-based unsupervised commonsense question answering framework that leverages implicit knowledge stored in PrLMs to generate knowledge for questions with unlimited types and possible candidate answers independent of specified choices. |
| Outcome: | The proposed framework significantly improves the reasoning ability of language models in unsupervised settings. |
UNIKIE-BENCH: Benchmarking Large Multimodal Models for Key Information Extraction in Visual Documents (2026.acl-long)
Copied to clipboard
Yifan Ji, Zhipeng Xu, Zhenghao Liu, Zulong Chen, Qian Zhang, Zhibo Yang, Junyang Lin, Yu Gu, Ge Yu, Maosong Sun
| Challenge: | Recent Large Multimodal Models (LMMs) have shown promising potential for performing end-to-end KIE directly from document images. |
| Approach: | They propose a benchmark to evaluate the performance of Large Multimodal Models (LMMs) using a constrained-category KIE track and an open-categorical KIE Track. |
| Outcome: | Experiments on 15 state-of-the-art LMMs show performance degradation under diverse schema definitions, long-tail key fields, and complex layouts, along with pronounced performance disparities across different document types and scenarios. |
PURE: Aligning LLM via Pluggable Query Reformulation for Enhanced Helpfulness (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) depend on vast amounts of text data sourced from the Internet for their training. |
| Approach: | They propose a new alignment paradigm that reformulates risky queries into highly relevant yet harmless ones before feeding them into LLMs. |
| Outcome: | The proposed approach eliminates the high costs of training base LLMs and achieves a promising balance of harmlessness and helpfulness. |
Living in the Moment: Can Large Language Models Grasp Co-Temporal Reasoning? (2024.acl-long)
Copied to clipboard
| Challenge: | Current temporal reasoning datasets are limited to questions about single or isolated events, falling short in mirroring the realistic temporal characteristics involving concurrent nature and intricate temporal interconnections. |
| Approach: | They propose a co-temporal Question Answering benchmark that contains four co-time scenarios with 4,748 samples for evaluating the co-timing abilities of large language models. |
| Outcome: | The proposed benchmarks show that current LLMs struggle on CoTempQA tasks even when enhanced with Chain of Thought methodologies. |
Crowdsource, Crawl, or Generate? Creating SEA-VL, a Multicultural Vision-Language Dataset for Southeast Asia (2025.acl-long)
Copied to clipboard
Samuel Cahyawijaya, Holy Lovenia, Joel Ruben Antony Moniz, Tack Hwa Wong, Mohammad Rifqi Farhansyah, Thant Thiri Maung, Frederikus Hudi, David Anugraha, Muhammad Ravi Shulthan Habibi, Muhammad Reza Qorib, Amit Agarwal, Joseph Marvin Imperial, Hitesh Laxmichand Patel, Vicky Feliren, Bahrul Ilmi Nasution, Manuel Antonio Rufino, Genta Indra Winata, Rian Adam Rajagede, Carlos Rafael Catalan, Mohamed Fazli Mohamed Imam, Priyaranjan Pattnayak, Salsabila Zahirah Pranida, Kevin Pratama, Yeshil Bangera, Adisai Na-Thalang, Patricia Nicole Monderin, Yueqi Song, Christian Simon, Lynnette Hui Xian Ng, Richardy Lobo Sapan, Taki Hasan Rafi, Bin Wang, null Supryadi, Kanyakorn Veerakanjana, Piyalitt Ittichaiwong, Matthew Theodore Roque, Karissa Vincentio, Takdanai Kreangphet, Phakphum Artkaew, Kadek Hendrawan Palgunadi, Yanzhi Yu, Rochana Prih Hastuti, William Nixon, Mithil Bangera, Adrian Xuan Wei Lim, Aye Hninn Khine, Hanif Muhammad Zhafran, Teddy Ferdinan, Audra Aurora Izzani, Ayushman Singh, Evan Evan, Jauza Akbar Krito, Michael Anugraha, Fenal Ashokbhai Ilasariya, Haochen Li, John Amadeo Daniswara, Filbert Aurelian Tjiaranata, Eryawan Presma Yulianrifat, Can Udomcharoenchaikit, Fadil Risdian Ansori, Mahardika Krisna Ihsani, Giang Nguyen, Anab Maulana Barik, Dan John Velasco, Rifo Ahmad Genadi, Saptarshi Saha, Chengwei Wei, Isaiah Edri W. Flores, Kenneth Chen Ko Han, Anjela Gail D. Santos, Wan Shen Lim, Kaung Si Phyo, Tim Santos, Meisyarah Dwiastuti, Jiayun Luo, Jan Christian Blaise Cruz, Ming Shan Hee, Ikhlasul Akmal Hanif, M.Alif Al Hakim, Muhammad Rizky Sya’ban, Kun Kerdthaisong, Lester James Validad Miranda, Fajri Koto, Tirana Noor Fatyanosa, Alham Fikri Aji, Jostin Jerico Rosal, Jun Kevin, Robert Wijaya, Onno P. Kampman, Ruochen Zhang, Börje F. Karlsson, Peerat Limkonchotiwat
| Challenge: | Southeast Asia is underrepresented in vision-language research . SEA-VL is an open-source initiative dedicated to developing culturally relevant datasets for SEA languages. |
| Approach: | They propose to use crowdsourced, automated image crawling and synthetic image generation to develop culturally relevant datasets for SEA languages. |
| Outcome: | The proposed datasets capture SEA cultural nuances and contexts better than existing datasets. |
TimeR4 : Time-aware Retrieval-Augmented Large Language Models for Temporal Knowledge Graph Question Answering (2024.emnlp-main)
Copied to clipboard
| Challenge: | Temporal Knowledge Graph Question Answering (TKGQA) aims to answer temporal questions using knowledge in Temporal knowledge graphs (TKTs). |
| Approach: | They propose a Time-aware retrieve-rewrite-retrieve-rerank framework to integrate temporal knowledge from TKGs into Large Language Models (LLMs) to reduce temporal hallucination, they propose rewrite module to rew questions using background knowledge stored in TKG's, then implement a retrieve-rank module to retrieve semantically and temporally relevant facts from Tkgs and rerank them according to temporal constraints. |
| Outcome: | The proposed approach achieves relative gains of 47.8% and 22.5% on two datasets, underscoring its effectiveness in boosting the temporal reasoning abilities of LLMs. |
FastSeq: Make Sequence Generation Faster (2021.acl-demo)
Copied to clipboard
Yu Yan, Fei Hu, Jiusheng Chen, Nikhil Bhendawade, Ting Ye, Yeyun Gong, Nan Duan, Desheng Cui, Bingyu Chi, Ruofei Zhang
| Challenge: | Transformer-based models have made tremendous impact in natural language generation, but inference speed is still a bottleneck due to large model size and intensive computing involved in auto-regressive decoding process. |
| Approach: | They propose an attention cache optimization, an efficient algorithm for detecting repeated n-grams, and an asynchronous generation pipeline with parallel I/O to accelerate sequence generation without loss of accuracy. |
| Outcome: | The proposed framework can accelerate the sequence generation by 4x to 9x with a simple one-line code change for a set of widely used and diverse models. |
Self-Generated Critiques Boost Reward Modeling for Language Models (2025.naacl-long)
Copied to clipboard
Yue Yu, Zhengxing Chen, Aston Zhang, Liang Tan, Chenguang Zhu, Richard Yuanzhe Pang, Yundi Qian, Xuewei Wang, Suchin Gururangan, Chao Zhang, Melanie Kambadur, Dhruv Mahajan, Rui Hou
| Challenge: | Existing reward models produce scalar scores and struggle to incorporate critiques in a natural language format. |
| Approach: | They propose a framework that predicts critiques and rewards using self-generated critiques without extra supervision. |
| Outcome: | The proposed framework improves reward modeling accuracy by 3.7%-7.3% compared to standard reward models and LLM judges. |
MultiFinBen: Benchmarking Large Language Models for Multilingual and Multimodal Financial Application (2026.acl-long)
Copied to clipboard
Xueqing Peng, Lingfei Qian, Yan Wang, Ruoyu Xiang, Yueru He, Yang Ren, Mingyang Jiang, Vincent Jim Zhang, Yuqing Guo, Jeff Zhao, Huan He, Yi Han, Yun Feng, Yuechen Jiang, Yupeng Cao, Haohang Li, Yangyang Yu, Xiaoyu Wang, Penglei Gao, Shengyuan Lin, Keyi Wang, Shanshan Yang, Yilun Zhao, Zhiwei Liu, Peng Lu, Jerry Huang, Suyuchen Wang, Triantafillos Papadopoulos, Polydoros Giannouris, Efstathia Soufleri, Nuo Chen, Zhiyang Deng, Heming Fu, Yijia Zhao, Mingquan Lin, Meikang Qiu, Kaleb E Smith, Arman Cohan, Xiao-Yang Liu, Jimin Huang, Guojun Xiong, Alejandro Lopez-Lira, Xi Chen, Junichi Tsujii, Jian-Yun Nie, Sophia Ananiadou, Qianqian Xie
| Challenge: | Existing evaluations of LLMs in finance are text-only, monolingual, and largely saturated by current models. |
| Approach: | They propose a multilingual and multimodal benchmark for evaluating LLMs in real financial contexts. |
| Outcome: | The first expert-annotated multilingual and multimodal benchmark is released . it evaluates 21 leading LLMs and shows they perform better in multilingual settings . |
Mirror: A Universal Framework for Various Information Extraction Tasks (2023.emnlp-main)
Copied to clipboard
Tong Zhu, Junfei Ren, Zijian Yu, Mengsong Wu, Guoliang Zhang, Xiaoye Qu, Wenliang Chen, Zhefeng Wang, Baoxing Huai, Min Zhang
| Challenge: | Recent studies often formulate IE tasks as a triplet extraction problem, but this paradigm does not support multi-span and n-ary extraction, leading to weak versatility. |
| Approach: | They propose a multi-span cyclic graph extraction problem and a non-autoregressive graph decoding algorithm to extract all spans in a single step. |
| Outcome: | The proposed model outperforms or reaches competitive performance with SOTA systems under few-shot and zero-shot settings and it is compatible with 57 datasets. |
Truth-Aware Context Selection: Mitigating Hallucinations of Large Language Models Being Misled by Untruthful Contexts (2024.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are easily misled by untruthful contexts provided by users or knowledge augmentation tools, leading to hallucinations. |
| Approach: | They propose a lightweight method to adaptively recognize and mask untruthful context from the inputs and a new evaluation metric to further study the LLMs’ ability to accept truthful information and resist untrusted information. |
| Outcome: | The proposed method can detect and mask untruthful context from the inputs and significantly improve the quality of LLMs’ responses when presented with misleading information. |
End-to-end Task-oriented Dialogue: A Survey of Tasks, Methods, and Future Directions (2023.emnlp-main)
Copied to clipboard
| Challenge: | End-to-end task-oriented dialogue (EToD) can generate responses in an end-to end fashion without modular training, which attracts escalating popularity. |
| Approach: | They present a systematic review of EToD and propose a unified perspective to summarize existing approaches and recent trends. |
| Outcome: | The proposed approaches can generate responses in an end-to-end fashion without modular training, which attracts escalating popularity. |
Dr.ECI: Infusing Large Language Models with Causal Knowledge for Decomposed Reasoning in Event Causality Identification (2025.coling-main)
Copied to clipboard
| Challenge: | Existing solutions lack generalizability to unseen domains, underscoring the urgent need for generalization capabilities in the field of ECI. |
| Approach: | They propose a multi-agent Decomposed reasoning framework for Event Causality Identification that incorporates specialized agents such as Causal Explorer and Mediator Detector. |
| Outcome: | The proposed framework improves the state-of-the-art performance of LLMs for event causality identification (ECI) tasks compared with baselines based on LLM and supervised training. |
LoGU: Long-form Generation with Uncertainty Expressions (2025.acl-long)
Copied to clipboard
Ruihan Yang, Caiqi Zhang, Zhisong Zhang, Xinting Huang, Sen Yang, Nigel Collier, Dong Yu, Deqing Yang
| Challenge: | Large Language Models (LLMs) generate factually incorrect content, i.e., hallucinations, despite impressive performance. |
| Approach: | They propose a framework to enable models to express uncertainty when unsure . they propose atomic claims to refine uncertainty and refine it using supervised fine-tuning and direct preference optimization to enhance uncertainty expression. |
| Outcome: | The proposed framework significantly improves accuracy, reduces hallucinations, and maintains comprehensiveness of responses. |
Find or Classify? Dual Strategy for Slot-Value Predictions on Multi-Domain Dialog State Tracking (2020.starsem-1)
Copied to clipboard
| Challenge: | Existing methods for dialog state tracking are ontology-based and ontologie-free . however, it is not clear enough which slots are better handled by either of the two methods . |
| Approach: | They propose a dual-strategy model that integrates both ontology-based and ontological-free methods. |
| Outcome: | The proposed model outperforms the existing model on noisy and cleaner datasets. |
Single-to-mix Modality Alignment with Multimodal Large Language Model for Document Image Machine Translation (2025.acl-long)
Copied to clipboard
| Challenge: | Document Image Machine Translation (DIMT) faces generalization challenges due to limited training data and the complex interplay between visual and textual information. |
| Approach: | They propose a single-to-mix Modality alignment framework leveraging Multimodal Large Language Models (MLLMs) this framework aligns an imageonly encoder with multimodal representations of an MLLM pre-trained on large-scale document image datasets. |
| Outcome: | The proposed framework improves translation quality in cross-domain generalization and challenging document image scenarios. |
Non-autoregressive Text Editing with Copy-aware Latent Alignments (2023.emnlp-main)
Copied to clipboard
| Challenge: | Seq2Edit approaches still face several challenges such as inflexibility in generation and difficulty in generalizing to other languages. |
| Approach: | They propose a non-autoregressive text editing method that models the edit process with latent CTC alignments and introduces the copy operation into the edit space. |
| Outcome: | The proposed method outperforms existing Seq2Edit models and achieves similar or even better results than Seq1Edit with over 4 speedup. |
GLGE: A New General Language Generation Evaluation Benchmark (2021.findings-acl)
Copied to clipboard
Dayiheng Liu, Yu Yan, Yeyun Gong, Weizhen Qi, Hang Zhang, Jian Jiao, Weizhu Chen, Jie Fu, Linjun Shou, Ming Gong, Pengcheng Wang, Jiusheng Chen, Daxin Jiang, Jiancheng Lv, Ruofei Zhang, Winnie Wu, Ming Zhou, Nan Duan
| Challenge: | Multi-task benchmarks focus on a range of Natural Language Understanding (NLU) tasks without considering the Natural Language Generation (NLG) models. |
| Approach: | They propose a multi-task benchmark for evaluating the generalization capabilities of NLG models across eight language generation tasks. |
| Outcome: | The proposed benchmarks are based on GLUE and Su-perGLUE for English and several other languages. |
SPE Attention: Making Attention Equivariant to Semantic-Preserving Permutation for Code Processing (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to train code processing models to capture symmetry of code . semantic-preserving permutations are not found in natural languages . |
| Approach: | They propose a mechanism that captures a unique symmetry of code, called the SPE attention . they propose symmetry graphs that are then combined to create a symmetry mask . |
| Outcome: | The proposed model can be used to analyze code summarization and error detection tasks. |
Evaluating Evaluation Metrics – The Mirage of Hallucination Detection (2025.findings-emnlp)
Copied to clipboard
Atharva Kulkarni, Yuan Zhang, Joel Ruben Antony Moniz, Xiou Ge, Bo-Hsiang Tseng, Dhivya Piraviperumal, Swabha Swayamdipta, Hong Yu
| Challenge: | a large-scale empirical evaluation of hallucination detection metrics is conducted . hallucinosity is a significant obstacle to the reliability and widespread adoption of language models . |
| Approach: | They conduct large-scale empirical evaluation of hallucination detection metrics . they compare hallucinian language models, language models and decoding methods . |
| Outcome: | The results show that the evaluations of hallucination detection metrics fail to align with human judgments, they say . they also show that evaluations with LLM-based evaluation yield the best overall results . |
TingIS: Real-time Risk Event Discovery from Noisy Customer Incidents at Enterprise Scale (2026.acl-industry)
Copied to clipboard
| Challenge: | a 5minute downtime for an incident could result in a loss of 40 million dollars and erosion of user trust. |
| Approach: | They propose a multi-stage event unification engine that synergizes efficient indexing techniques with Large Language Models (LLMs) to make informed decisions on event merging. |
| Outcome: | The proposed system outperforms baseline methods in routing accuracy, clustering quality, and Signal-to-Noise Ratio. |
ReCode: Reinforcing Code Generation with Reasoning-Process Rewards (2026.acl-long)
Copied to clipboard
| Challenge: | Bringing process-level supervision into RL often neglects optimizing reasoning quality. |
| Approach: | They propose a framework for RL that integrates reasoning-process rewards with strict execution outcomes and a benchmark comprising preference pairs of superior and inferior reasoning processes. |
| Outcome: | The proposed framework outperforms the base version of ReCode by 16.1% and reaches performance comparable to GPT-4-Turbo. |
Attacking Vision-Language Computer Agents via Pop-ups (2025.acl-long)
Copied to clipboard
| Challenge: | Existing tools for analyzing and testing VLMs are lacking in understanding what types of attacks are possible and what types are effective. |
| Approach: | They propose to integrate pop-ups into existing agent testing environments to attack VLM agents by ignoring them. |
| Outcome: | The proposed attack success rate is 86% and decreases by 47% when integrating pop-ups into existing agent testing environments. |
Synchronous Double-channel Recurrent Network for Aspect-Opinion Pair Extraction (2020.acl-main)
Copied to clipboard
| Challenge: | Existing studies focus on aspect-opinion relation detection, but neglect to recognize the relations between aspects and opinion expressions. |
| Approach: | They propose a Synchronous Double-channel Recurrent Network to deal with AOPE task . they propose an opinion entity extraction unit, a relation detection unit, and a synchronization unit . |
| Outcome: | The proposed system achieves state-of-the-art in opinion entity extraction . it is based on three datasets based upon SemEval 2014 and 2015 benchmarks . |
MCMH: Learning Multi-Chain Multi-Hop Rules for Knowledge Graph Reasoning (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work on knowledge graphs infers a missing relationship between entities with a multi-hop rule . Empirical results show that our multi-chain multi-homing (MCMH) rules yield superior results compared to the standard single-chain approaches. |
| Approach: | They propose to use a generalized form of multi-hop rules to learn generalized rules efficiently . they propose to select a small set of relation chains as a rule and evaluate confidence . |
| Outcome: | The proposed method outperforms the existing methods and the existing frameworks. |
Transforming Visual Scene Graphs to Image Captions (2023.acl-long)
Copied to clipboard
Xu Yang, Jiawei Peng, Zihua Wang, Haiyang Xu, Qinghao Ye, Chenliang Li, Songfang Huang, Fei Huang, Zhangzikang Li, Yu Zhang
| Challenge: | Existing approaches to generate captions using image captioning are based on multi-head attention (MHA) |
| Approach: | They propose to transform scene graphs into more descriptive captions by using multi-head attention to build a Graph Neural Network (GNN) . they construct a Mixture-of-Expert (MOE)-based decoder where each expert is built on MHA for discriminating the graph embeddings to generate different kinds of words. |
| Outcome: | The proposed framework can generate captions from multiple visual features and objects . it is based on a mixture-of-expert (MOE)-based decoder based upon MHA . |
RolePlot: A Systematic Framework for Evaluating and Enhancing the Plot-Progression Capabilities of Role-Playing Agents (2025.acl-long)
Copied to clipboard
| Challenge: | Existing research has focused on role-playing agents’ ability to portray specified characters, but their ability to advance the plot requires substantial improvements to deliver more engaging interaction. |
| Approach: | They propose a role-playing framework to evaluate and enhance the plot-progression capabilities of role-players. |
| Outcome: | The proposed framework improves RPAs’ ability to time plot developments and yields a significant increase in conversation turns and sustained higher arousal levels. |
Efficient Second-Order TreeCRF for Neural Dependency Parsing (2020.acl-main)
Copied to clipboard
| Challenge: | In the deep learning (DL) era, dependency parsing models are extremely simplified with little hurt on performance thanks to the remarkable capability of multi-layer BiLSTMs in context representation. |
| Approach: | They propose to extend the biaffine parser to a second-order TreeCRF extension to reduce the complexity of the inside-outside algorithm. |
| Outcome: | The proposed extension can be used to batchify the inside and Viterbi algorithms and avoid the complex outside algorithm via efficient back-propagation. |
RepoShapley: Shapley-Enhanced Context Filtering for Repository-Level Code Completion (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models have strong reasoning, coding, and generation capabilities, but retrieval-augmented generation remains difficult under fixed context budgets. |
| Approach: | They propose a coalition-aware context filtering framework supervised by Shapley-style marginal contributions that captures sign effects via teacher-forced probing and computes exact Shaply values for small retrieval sets. |
| Outcome: | Experiments show that RepoShapley improves completion quality while reducing harmful context and unnecessary retrieval. |
ReKG-MCTS: Reinforcing LLM Reasoning on Knowledge Graphs via Training-Free Monte Carlo Tree Search (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to combining knowledge graphs with large language models face limitations in path exploration strategies or excessive computational overhead. |
| Approach: | They propose a training-free framework that synergizes Monte Carlo Tree Search with LLM capabilities to enable dynamic reasoning over KGs. |
| Outcome: | The proposed framework outperforms existing training-free methods and achieves competitive performance compared to fine-tuned baselines. |
Document Image Machine Translation with Dynamic Multi-pre-trained Models Assembling (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing TIMT tasks focus on text-line-level images. |
| Approach: | They propose to extend the existing TIMT task and introduce a new framework to translate a source document image to markdown-formatted target translation. |
| Outcome: | The proposed task aims to translate a source document image with long context and complex layout structure to markdown-formatted target translation. |
Self-Reinforcing Controllable Synthesis of Rare Relational Data via Bayesian Calibration (2026.findings-acl)
Copied to clipboard
Chongsheng Zhang, Hao Wang, Zelong Yu, Esteban Garces Arias, Julian Rodemann, Zhanshuo Zhang, Qilong Li, Gaojuan Fan, Krikamol Muandet, Christian Heumann
| Challenge: | Existing approaches to synthesis of relational/structured tabular data lack effective feedback mechanism to optimize quality of generated data. |
| Approach: | They propose a relational data generator with dynamic guidance framework that uses chain-of-thought steps to generate tabular data for enhancing downstream imbalanced classification performance. |
| Outcome: | The proposed framework outperforms existing approaches in both data fidelity and downstream imbalanced classification performance on real and synthetic datasets. |
Beyond Timestamps: Bridging Forward and Backward Reasoning in Temporal Numerical and Relational Understanding (2026.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks for Temporal Numerical and Relational reasoning rely on single-task evaluation paradigms. |
| Approach: | They propose a benchmark to evaluate Temporal Numerical and Relational reasoning . they propose QA and verification, and a Consistency Rate to quantify robustness . |
| Outcome: | The proposed framework evaluates both Temporal Numerical and Relational reasoning . it measures the alignment between QA and FV and the Consistency Rate measures robustness across these directions. |
Causal Document-Grounded Dialogue Pre-training (2023.emnlp-main)
Copied to clipboard
Yingxiu Zhao, Bowen Yu, Bowen Li, Haiyang Yu, Jinyang Li, Chao Wang, Fei Huang, Yongbin Li, Nevin Zhang
| Challenge: | Existing methods for document-grounded dialogue (DocGD) rely on general pre-trained language models without a tailored pre-training approach that explicitly captures causal relationships. |
| Approach: | They propose a causally-complete dataset construction strategy for developing million-scale DocGD pre-training corpora and a perturbation-based strategy to capture causality. |
| Outcome: | The proposed strategy yields significant and consistent improvements in fully-supervised, low-resource, few-shot, and zero-shot settings. |
Syllable-level lyrics generation from melody exploiting character-level language model (2024.findings-eacl)
Copied to clipboard
| Challenge: | Pre-trained language models specifically designed at the syllable level are not available. |
| Approach: | They propose to exploit character-level language models for syllable-level lyrics generation from symbolic melody. |
| Outcome: | The proposed system improves coherence and correctness of generated lyrics without training expensive language models. |
Coarse-to-Fine: Hierarchical Multi-task Learning for Natural Language Understanding (2022.coling-1)
Copied to clipboard
Zhaoye Fei, Yu Tian, Yongkang Wu, Xinyu Zhang, Yutao Zhu, Zheng Liu, Jiawen Wu, Dejiang Kong, Ruofei Lai, Zhao Cao, Zhicheng Dou, Xipeng Qiu
| Challenge: | Existing methods to learn downstream tasks by stitches skill block lack rationality and interpretation. |
| Approach: | They propose a hierarchical framework with a coarse-to-fine paradigm for generalized text representations from the large-scale corpus. |
| Outcome: | The proposed model learns basic language properties from all tasks and boosts performance on relevant tasks. |
Optimizing Instruction Synthesis: Effective Exploration of Evolutionary Space with Tree Search (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Extensive research has highlighted the quality of instruction data is essential for the success of this alignment. |
| Approach: | They propose a framework for iteratively improving existing instruction data by using Monte Carlo tree search to find suitable prompts that align the language model to effectively learn multiple skills. |
| Outcome: | The proposed framework improves the evaluation scores of seed instruction data, raising the average evaluation scores from 2.19 to 3.81. |
ReflectRM: Boosting Generative Reward Models via Self-Reflection within a Unified Judgment Framework (2026.acl-long)
Copied to clipboard
Kai Qin, Liangxin Liu, Yu Liang, Longzheng Wang, null Wangyan, Zhang Yueyang, Long Xia, Zhiyuan Sun, Houde Liu, Daiting Shi
| Challenge: | Existing methods for generating reward models focus on outcome-level supervision, neglecting analytical process quality, which constrains their potential. |
| Approach: | They propose a novel reward model that leverages self-reflection to assess analytical quality and enhance preference modeling. |
| Outcome: | The proposed model improves performance on four benchmarks and significantly mitigates positional bias. |
GUI-Bee: Align GUI Action Grounding to Novel Environments via Autonomous Exploration (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent work of GUI action grounding fine-tunes data from pre-trained MLLMs, but data is limited to specific GUI environments. |
| Approach: | They propose to use a GUI-based agent to collect environment-specific data and fine-tune GUI grounding models with the collected data. |
| Outcome: | The proposed model can be extended to other GUI environments to improve performance. |
Training Long-Context LLMs Efficiently via Chunk-wise Optimization (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in long-context large language models have demonstrated superior retrieval quality compared to retrievalaugmented generation (RAG) approaches. |
| Approach: | They propose a memory-efficient training paradigm that partitions lengthy inputs into manageable chunks. |
| Outcome: | The proposed model expands maximum sequence length from 1K to 16K tokens on a single RTX 3090 GPU, while SpaCO achieves accelerated training speed. |
Multi-Value-Product Retrieval-Augmented Generation for Industrial Product Attribute Value Identification (2025.emnlp-industry)
Copied to clipboard
Huike Zou, Haiyang Yang, Yindu Su, Chen Li Yu, Qinye Xie, Chengbao Lian, Qingheng Zhang, Shuguang Han, Fei Huang, Jufeng Chen
| Challenge: | Existing methods for product attribute value identification suffer from cascading errors and lack of generalization capability. |
| Approach: | They propose a multi-level retrieval scheme that uses products and attribute values as distinct hierarchical levels in PAVI domain. |
| Outcome: | The proposed method performs better than the state-of-the-art methods on a real-world industrial dataset. |
Seamlessly Integrating Factual Information and Social Content with Persuasive Dialogue (2022.aacl-main)
Copied to clipboard
| Challenge: | Persuasive dialogue systems are designed for chatbots to communicate with and influence users with specific goals. |
| Approach: | They propose a modular dialogue system framework that integrates factual information and social content into persuasive dialogues. |
| Outcome: | The proposed framework is generalizable to any dialogue tasks that have mixed social and task contents. |
Dynamically Fused Graph Network for Multi-hop Reasoning (P19-1)
Copied to clipboard
| Challenge: | Text-based question answering (TBQA) has been studied extensively in recent years. |
| Approach: | They propose a Dynamically Fused Graph Network to answer questions requiring multiple scattered evidence and reasoning over them. |
| Outcome: | The proposed method achieves competitive results on a public TBQA dataset and produces interpretable reasoning chains. |
Question-guided Knowledge Graph Re-scoring and Injection for Knowledge Graph Question Answering (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Knowledge graph question answering (KGQA) aims to provide factual answers to natural language questions by leveraging structured information stored in a knowledge graph. |
| Approach: | They propose a Question-guided Knowledge Graph Re-scoring method to eliminate noisy pathways for the input question, thereby focusing specifically on pertinent factual knowledge. |
| Outcome: | The proposed method eliminates noisy pathways for the input question, thereby focusing specifically on pertinent factual knowledge. |
CitaLaw: Enhancing LLM with Citations in Legal Domain (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks have focused on enabling large language models (LLMs) to generate citationsupported outputs. |
| Approach: | They propose to use a citation-based framework to evaluate LLMs' ability to produce legally sound responses with appropriate citations. |
| Outcome: | The proposed framework enables LLMs to retrieve supporting citations from the reference corpus and align these citation with the corresponding sentences in their responses. |
Document Classification for COVID-19 Literature (2020.findings-emnlp)
Copied to clipboard
| Challenge: | a global pandemic has made it more important than ever to quickly and accurately retrieve relevant scientific literature for effective consumption by researchers in a wide variety of fields. |
| Approach: | They analyze a LitCovid dataset to find out how classification models can help organize COVID-19 research papers. |
| Outcome: | The proposed model outperforms all baseline models on the LitCovid dataset . it also outperformed BioBERT and other models with micro-F1 and accuracy scores of 86% and 75% . |
Transferable and Efficient Non-Factual Content Detection via Probe Training with Offline Consistency Checking (2024.acl-long)
Copied to clipboard
| Challenge: | Existing factuality detection methods are not effective for large language models (LLMs). |
| Approach: | They propose a probing model that trains on offline consistency checking results. |
| Outcome: | The proposed model reduces the computational burden of generating multiple responses by online consistency verification and improves on factuality detection and question answering benchmarks. |
WebCoT: Enhancing Web Agent Reasoning by Reconstructing Chain-of-Thought in Reflection, Branching, and Rollback (2025.findings-emnlp)
Copied to clipboard
Minda Hu, Tianqing Fang, Jianshu Zhang, Jun-Yu Ma, Zhisong Zhang, Jingyan Zhou, Hongming Zhang, Haitao Mi, Dong Yu, Irwin King
| Challenge: | Web agents powered by Large Language Models lack the ability to perform in uncertain web environments. |
| Approach: | They propose to reconstruct web agents' reasoning skills into chain-of-thought rationales by fine-tuning their LLM backbone into a web-based model. |
| Outcome: | The proposed approach significantly improves the agent self-improving benchmark OpenWebVoyager, demonstrating that it can be used to improve the agent's reasoning skills. |
Improving Distantly-Supervised Named Entity Recognition with Self-Collaborative Denoising Learning (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Named entity recognition (NER) is a method of detecting entity spans and classifying them into predefined categories. |
| Approach: | They propose a method to iteratively perform noisy label refinery by using self-collaborative denoising learning. |
| Outcome: | The proposed learning paradigm exploits reliable labels and communicates with unreliable annotations by collaborative denoising. |
Fine-Tuning Pre-trained Language Model with Weak Supervision: A Contrastive-Regularized Self-Training Approach (2021.naacl-main)
Copied to clipboard
| Challenge: | Fine-tuned pre-trained language models (LMs) have enormous success in many natural language processing tasks, but they still require excessive labeled data in the fine-tuning stage. |
| Approach: | They propose a framework to enable fine-tuning pre-trained language models with weak supervision without any labeled data. |
| Outcome: | The proposed framework outperforms the strongest baseline and achieves competitive performance with fully-supervised fine-tuning methods. |
Integrating Representation Subspace Mapping with Unimodal Auxiliary Loss for Attention-based Multimodal Emotion Recognition (2024.lrec-main)
Copied to clipboard
Xulong Du, Xingnan Zhang, Dandan Wang, Yingying Xu, Zhiyuan Wu, Shiqing Zhang, Xiaoming Zhao, Jun Yu, Liangliang Lou
| Challenge: | Existing methods to identify emotions rely on a large modality gap in their representations . |
| Approach: | They propose a representation subspace mapping module that maps each modality into two distinct subspaces and a cross-modality attention module that leverages auxiliary loss to remove the noise unrelated to emotion classification. |
| Outcome: | The proposed approach achieves superior performance to state-of-the-art MER methods on the IEMOCAP and MSP-Improv datasets. |
Sequential-NIAH: A Needle-In-A-Haystack Benchmark for Extracting Sequential Needles from Long Contexts (2025.emnlp-main)
Copied to clipboard
Yifei Yu, Qian-Wen Zhang, Lingfeng Qiao, Di Yin, Fang Li, Jie Wang, Chen Zeng Xi, Suncong Zheng, Xiaolong Liang, Xing Sun
| Challenge: | Recent models have extended Corresponding Author. context lengths to millions of tokens while maintaining reasoning and comprehension capabilities. |
| Approach: | They propose a benchmark to evaluate the ability of large language models to extract sequential information items from long contexts. |
| Outcome: | The proposed model achieves maximum accuracy of 63.50% on six well-known LLMs. |
Benchmarking Post-Training Quantization of Large Language Models under Microscaling Floating Point Formats (2026.acl-long)
Copied to clipboard
| Challenge: | Microscaling Floating-Point (MXFP) is a low-precision format for large language models (LLMs). |
| Approach: | They conduct systematic evaluations of PTQ under Microscaling Floating-Point (MXFP) . they find that MXFP8 consistently achieves near-lossless performance . |
| Outcome: | The proposed method achieves near-lossless performance while MXFP4 introduces substantial accuracy degradation and remains challenging. |
Self-regulation: Employing a Generative Adversarial Network to Improve Event Detection (P18-1)
Copied to clipboard
| Challenge: | Recent studies show that neural networks can be used for event detection but can be contaminated by spurious features. |
| Approach: | They propose a self-regulated learning approach by utilizing a generative adversarial network to generate spurious features. |
| Outcome: | The proposed method is highly effective and adaptable on the ACE 2005 and TAC-KBP 2015 corpora. |
Learning Retrieval Augmentation for Personalized Dialogue Generation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Personalized dialogue generation is a popular approach for conversational AI applications . however, persona profiles may not provide comprehensive descriptions of the persona . |
| Approach: | They propose a method that leverages persona profiles and dialogue context to generate personalized dialogues by leveraging personas and persona profile. |
| Outcome: | The proposed method outperforms baselines on the CONVAI2 dataset . it is expected to generate personalized dialogues based on persona profiles and dialogue context . |
UniTE: Unified Translation Evaluation (2022.acl-long)
Copied to clipboard
| Challenge: | Recent methods for evaluation of translation quality are focused on one task, ignoring commonalities . |
| Approach: | They propose a unified framework engaged with abilities to handle all three evaluation tasks. |
| Outcome: | The proposed framework can universally surpass state-of-the-art or winner methods across tasks. |
ExeCoder: Empowering Large Language Models with Executability Representation for Code Translation (2025.emnlp-main)
Copied to clipboard
Minghua He, Yue Chen, Fangkai Yang, Pu Zhao, Wenjie Yin, Yu Kang, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang
| Challenge: | Existing code translation models only learn the contextual semantics of code during pre-training, neglecting executability information closely related to the execution state of the code. |
| Approach: | They propose an LLM specifically designed for code translation called ExeCoder . it uses executability representations such as functional semantics and syntax structures to enhance LLMs' capabilities. |
| Outcome: | The proposed model outperforms existing open-source code translation models on two metrics. |
Towards Generalized Open Information Extraction (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Open Information Extraction (OpenIE) models are evaluated on in-domain test sets aside from the training corpus, which violates the initial task principle of domain-independence. |
| Approach: | They propose to generalize OpenIE over unseen target domains with different data distributions from source training domains. |
| Outcome: | The proposed method beats the previous methods in both in- and out-of-domain settings by 6.0% in F1 score absolutely. |
EgoMemory: Memory-Augmented Personalized Retrieval for Long-Context Egocentric Video (2026.findings-acl)
Copied to clipboard
Yuanmin Tang, Jue Zhang, Xiaoting Qin, Jing Yu, Meikang Qiu, Gaopeng Gou, Gang Xiong, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang, Qi Wu
| Challenge: | Existing egocentric video datasets do not support the personalization and long-context reasoning required for episodic memory retrieval. |
| Approach: | They propose a benchmark framework that uses MLLMs and reflective Chain-of-Thought to ground user queries in personal memory explicitly. |
| Outcome: | The proposed framework outperforms state-of-the-art benchmarks on three benchmarks . it can be used to generate detailed target video descriptions in long-context contexts based on user-specific object annotations enriched with user-specified object annotation data . |
Gardener: An Agentic AI System for Single-Cell RNA Sequence Analysis (2026.acl-demo)
Copied to clipboard
| Challenge: | Existing large language models encode workflow progress as conversational state and rely on cloud-centric execution, which hinders traceability and auditability. |
| Approach: | Gardener is an open-source desktop application for macOS and windows under the Apache License 2.0. |
| Outcome: | Gardener is released as an open-source desktop application for macOS and Windows under the Apache License 2.0. |
FaD-VLP: Fashion Vision-and-Language Pre-training towards Unified Retrieval and Captioning (2022.emnlp-main)
Copied to clipboard
| Challenge: | Prior work on multimodal fashion tasks has been limited by the data in individual benchmarks or has leveraged generic vision-and-language pre-training but have not taken advantage of the characteristics of fashion data. |
| Approach: | They propose a fashion-specific pre-training framework based on weakly-supervised triplets constructed from fashion image-text pairs. |
| Outcome: | The proposed framework is based on weakly-supervised triplets constructed from fashion image-text pairs and is competitive on a diverse set of fashion tasks. |
WebEvolver: Enhancing Web Agent Self-Improvement with Co-evolving World Model (2025.emnlp-main)
Copied to clipboard
| Challenge: | Agent self-improvement, where agents train their underlying Large Language Model (LLM) on self-sampled trajectories, shows promising results but often stagnates in web environments due to limited exploration and under-utilization of pretrained web knowledge. |
| Approach: | They propose a co-evolving Large Language Model (LLM) that predicts the next observation based on current observation and action within the web environment. |
| Outcome: | The proposed framework shows that agents can perform better in real-world web environments without using any distillation from more powerful close-sourced models. |
UCFE: A User-Centric Financial Expertise Benchmark for Large Language Models (2025.findings-naacl)
Copied to clipboard
Yuzhe Yang, Yifei Zhang, Yan Hu, Yilin Guo, Ruoli Gan, Yueru He, Mingcong Lei, Xiao Zhang, Haining Wang, Qianqian Xie, Jimin Huang, Honghai Yu, Benyou Wang
| Challenge: | Recent advances in large language models (LLMs) have expanded their potential applications in finance. |
| Approach: | They propose a framework to evaluate the ability of large language models to handle financial tasks using human expert evaluations and task-specific interactions. |
| Outcome: | The proposed framework evaluates the ability of large language models to handle complex financial tasks and combines human expert evaluations with dynamic, task-specific interactions to simulate the complexities of evolving financial scenarios. |
Hypernymy Detection for Low-Resource Languages via Meta Learning (2020.acl-main)
Copied to clipboard
| Challenge: | Existing studies focus on monolingual hypernymy detection on high-resource languages, but few investigate low-resourced scenarios. |
| Approach: | They propose to combine high-resource languages to solve low-resourced hypernymy detection problem . they extensively compare three joint training paradigms and propose meta learning . |
| Outcome: | The proposed method significantly improves performance of extremely low-resource languages by preventing over-fitting on small datasets. |
Keyphrase Generation with Correlation Constraints (D18-1)
Copied to clipboard
| Challenge: | Existing methods for keyphrase generation ignore correlation among keyphrases, resulting in duplication and coverage issues. |
| Approach: | They propose a new sequence-to-sequence architecture for keyphrase generation that captures correlation among keyphrases by preceding phrases to eliminate duplicate phrases and improve result coherence. |
| Outcome: | The proposed model outperforms the state-of-the-art method on benchmark datasets in terms of accuracy and diversity. |
PromptST: Abstract Prompt Learning for End-to-End Speech Translation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Experimental results show that PromptST can improve speech-to-text translation by capturing richer linguistic knowledge. |
| Approach: | They propose a plug-in prompt-enhanced S2T model that captures richer linguistic knowledge . they use a 10GB linguistic probing benchmark to investigate the fusion of speech and text features . |
| Outcome: | The proposed model can improve on a strong baseline by capturing richer linguistic knowledge. |
HAD: HAllucination Detection Language Models Based on a Comprehensive Hallucination Taxonomy (2026.acl-industry)
Copied to clipboard
| Challenge: | relying on large language models for information has raised concerns about reliability and accuracy of outputs. |
| Approach: | They propose a hallucination taxonomy with 11 categories for various NLG tasks and propose HAllucination Detection models which integrate hallucinism detection, span-level identification, and correction into a single inference process. |
| Outcome: | The proposed models outperform baselines on HaluEval, FactCHD, and FaithBench, confirming their robustness and versatility. |
Auto-Instruct: Automatic Instruction Generation and Ranking for Black-Box Language Models (2023.findings-emnlp)
Copied to clipboard
Zhihan Zhang, Shuohang Wang, Wenhao Yu, Yichong Xu, Dan Iter, Qingkai Zeng, Yang Liu, Chenguang Zhu, Meng Jiang
| Challenge: | Large language models can perform a wide range of tasks by following natural language instructions without task-specific fine-tuning. |
| Approach: | They propose a method to automatically improve the quality of LLM instructions . they leverage the generative ability of LMS to generate diverse candidate instructions based on a scoring model trained on 575 existing NLP tasks. |
| Outcome: | The proposed method surpasses human-written and LLM-generated instructions on 118 out-of-domain tasks. |
FRAME: Feedback-Refined Agent Methodology for Enhancing Medical Research Insights (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to automate scientific research are limited by human cognitive constraints and timeintensive workflows. |
| Approach: | They propose a framework that enhances medical paper generation through iterative refinement and structured feedback. |
| Outcome: | The proposed framework achieves significant improvements over conventional methods across multiple models and evaluation dimensions. |
CSDS: A Fine-Grained Chinese Dataset for Customer Service Dialogue Summarization (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing summarization methods are prone to generate redundant and incoherent summaries, causing the performance to be worse. |
| Approach: | They propose a Chinese dataset for Customer Service Dialogue Summarization (CSDS) that provides role-oriented summaries to acquire different speakers' viewpoints. |
| Outcome: | The proposed dataset improves the abstractive summaries in two aspects . it also provides role-oriented summary to acquire different speakers’ viewpoints . |
MELOV: Multimodal Entity Linking with Optimized Visual Features in Latent Space (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to multimodal entity linking focus on textual contexts but lack in social media vision modality. |
| Approach: | They propose a latent space vision feature optimization framework MELOV to address these challenges . they exploit variational autoencoder to mine shared information and generate text-based visual features . |
| Outcome: | The proposed framework is superior to existing methods on three benchmark datasets. |
Large Language Models are Built-in Autoregressive Search Engines (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing dual-encoder dense retrievers obtain representations for questions and documents independently, allowing only shallow interactions between them. |
| Approach: | They propose to use large language models to generate URLs for document retrieval by following human instructions. |
| Outcome: | The proposed method achieves better retrieval performance than existing retrieval approaches on open-domain question answering benchmarks. |
HumanEval Pro and MBPP Pro: Evaluating Large Language Models on Self-invoking Code Generation Task (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks for code generation tasks are inadequate, but performance declines on self-invoking tasks. |
| Approach: | They propose a general recipe for generating more challenging versions of existing benchmarks . they propose to use instruction-tuned models to evaluate LLMs on self-invoking code generation tasks . |
| Outcome: | The proposed model improves on humanEval and MBPP but on self-invoking code generation tasks. |
Do LLMs Overcome Shortcut Learning? An Evaluation of Shortcut Challenges in Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown remarkable capabilities in various tasks, but may rely on dataset biases as shortcuts for prediction. |
| Approach: | They propose to use a test suite to evaluate the impact of shortcuts on LLMs' performance. |
| Outcome: | The proposed test suite incorporates six shortcut types, five evaluation metrics, and four prompting strategies. |
Prompting Large Language Models to Tackle the Full Software Development Lifecycle: A Case Study (2025.coling-main)
Copied to clipboard
Bowen Li, Wenhan Wu, Ziwei Tang, Lin Shi, John Yang, Jinyang Li, Shunyu Yao, Chen Qian, Binyuan Hui, Qicheng Zhang, Zhiyin Yu, He Du, Ping Yang, Dahua Lin, Chao Peng, Kai Chen
| Challenge: | Existing benchmarks focused on simplified or isolated aspects of coding, ignoring the full spectrum of programming challenges. |
| Approach: | They propose a case study that examines the performance of large language models across the entire software development lifecycle with four programming languages, multiple domains, and carefully designed and verified metrics for each task. |
| Outcome: | The proposed model performs across the entire software development lifecycle, including design, environment setup, implementation, acceptance testing, and unit testing. |
CycleOIE: A Low-Resource Training Framework For Open Information Extraction (2025.coling-main)
Copied to clipboard
Zhihong Jin, Chunhong Zhang, Zheng Hu, Jibin Yu, Ruiqi Ma, Qingyun Chen, Xiaohao Liao, Yanxing Zhang
| Challenge: | Open Information Extraction (OpenIE) models rely heavily on large amounts of annotated data. |
| Approach: | They propose a training framework that maximizes data efficiency through a cycle-consistency mechanism. |
| Outcome: | The proposed approach improves the quality of training data by curating low-quality datasets annotated by a large language model. |
SummerTime: Text Summarization Toolkit for Non-experts (2021.emnlp-demo)
Copied to clipboard
Ansong Ni, Zhangir Azerbayev, Mutethia Mutuma, Troy Feng, Yusen Zhang, Tao Yu, Ahmed Hassan Awadallah, Dragomir Radev
| Challenge: | Recent advances in summarization provide models that can generate high quality summaries . a new toolkit for summarizing text is being developed to make it easier for non-experts to keep track of them. |
| Approach: | They develop a toolkit for text summarization that integrates with libraries designed for NLP researchers. |
| Outcome: | SummerTime is a toolkit for text summarization, including models, datasets, and evaluation metrics. |
Confidence is not Timeless: Modeling Temporal Validity for Rule-based Temporal Knowledge Graph Forecasting (2024.acl-long)
Copied to clipboard
| Challenge: | Existing literature on temporal knowledge Graph Forecasting lacks in-depth investigation into how confidence evolves with time. |
| Approach: | They propose a framework to model the temporal validity of rules for Temporal Knowledge Graph Forecasting (TKGF) they propose rule-adversarial negative sampling and time-aware negative sampling strategies to facilitate TempValid learning. |
| Outcome: | The proposed framework outperforms state-of-the-art (SOTA) rule-based methods on six TKGF datasets. |
SeaPO: Strategic Error Amplification for Robust Preference Optimization of Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for preference optimization of large language models use pairs of positive and negative samples, but the quality of positive samples may become similar during training, complicating preference learning. |
| Approach: | SeaPO introduces error types commonly occurring in large language models to improve preference learning. |
| Outcome: | SeaPO introduces error types into model Preference Optimization to improve model performance . negative samples are more erroneous than positive samples, and preference-based training mitigates errors . |
Ditto: A Simple and Efficient Approach to Improve Sentence Embeddings (2023.emnlp-main)
Copied to clipboard
Qian Chen, Wen Wang, Qinglin Zhang, Siqi Zheng, Chong Deng, Hai Yu, Jiaqing Liu, Yukun Ma, Chong Zhang
| Challenge: | Prior studies diagnose the anisotropy problem in sentence embeddings from pre-trained language models without fine-tuning. |
| Approach: | They propose an unsupervised method that weights words with model-based importance estimations and computes the weighted average of word representations from pre-trained models as sentence embeddings. |
| Outcome: | Empirical evaluations show that the proposed method can alleviate the anisotropy problem and improve various pre-trained models on the STS benchmarks. |
STAF: Pushing the Boundaries of Test-Time Adaptation towards Practical Noise Scenarios (2024.lrec-main)
Copied to clipboard
| Challenge: | Pre-trained language models have demonstrated superior performance on NLP tasks . however, when the training domain and testing domain are taken from different distributions, the deployed model often violates this assumption. |
| Approach: | They propose a Stable Test-time Adaptation Framework to stabilize the adaptation process. |
| Outcome: | The proposed framework boosts model robustness to noise distribution shifts while minimizing error accumulation and catastrophic forgetting. |
Training Verifier to Assessing Complex Real-World Tool-Use Trajectories (2026.findings-acl)
Copied to clipboard
Linzhuang Sun, Mingyang Chen, Hao Liang, Tianpeng Li, Zhou Yijie, Chenzheng Zhu, Tianyu Guo, Huanyao Zhang, Jingxuan Wei, Bihui Yu, Fan Yang, Wentao Zhang
| Challenge: | Existing methods for training effective AI agents often resort to synthetic data generation. |
| Approach: | They propose a plug-and-play framework for data quality control in tool-use scenarios . they construct a tool-verify dataset and release a benchmark to assess its performance . |
| Outcome: | The proposed framework surpasses Qwen2.5-72B-Instruct on Tool-V-Bench and the previous APIGen-MT dataset. |
EIFBENCH: Extremely Complex Instruction Following Benchmark for Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing benchmarks focusing on single-task environments with limited constraints lack the complexity required to fully reflect the evolution of large language models (LLMs). |
| Approach: | They propose to use a Segment Policy Optimization algorithm to enhance the LLM's ability to accurately fulfill multi-task workflows. |
| Outcome: | The proposed benchmarks show that existing benchmarks lack the complexity required to fully reflect the evolution of large language models. |
LLM-Based Explicit Models of Opponents for Multi-Agent Games (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing approaches to model adversarial and cooperative interactions often focus on treating other agents as separate entities with their own intentions and strategies. |
| Approach: | They propose a model of opponents based on Large Language Models (LLMs) that constructs an individual model for each opponent and aligns these models working in synergy through a bi-level feedback-refinement framework. |
| Outcome: | The proposed model outperforms single-model approaches in multi-player deduction games, showing that it significantly enhances agents’ decision-making. |
HFT: Half Fine-Tuning for Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) with one or more fine-tuning phases can unlock various capabilities, but can be catastrophic forgetting during sequential training. |
| Approach: | They propose a method to regularly reset partial parameters to mitigate forgetting issues by using half fine-tuning instead of full fine-uning. |
| Outcome: | The proposed approach reduces the risk of catastrophic forgetting during training and the parametric knowledge lost during training may be overwhelmed by incoming training data. |
Porous Lattice Transformer Encoder for Chinese NER (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods to integrate word boundary information into character-level Chinese NER are inefficient and lack semantic interaction. |
| Approach: | They propose an extension of transformer encoder that is tailored for ChineseNER to incorporate lexicons into character-level Chinese NER by lattices. |
| Outcome: | The proposed extension performs 11.4 times faster than state-of-the-art methods while retaining the rich long-term dependencies. |
Evaluation Agent: Efficient and Promptable Evaluation Framework for Visual Generative Models (2025.acl-long)
Copied to clipboard
| Challenge: | Existing evaluation methods rely on rigid pipelines that overlook user needs and provide numerical results without clear explanations. |
| Approach: | They propose an evaluation framework that employs human-like strategies for efficient, dynamic, multi-round evaluations using only a few samples per round. |
| Outcome: | The evaluation agent framework reduces evaluation time to 10% of traditional methods while delivering comparable results. |
On the Vulnerability of Text Sanitization (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing reconstruction attacks on text sanitization are not able to accurately assess their effectiveness. |
| Approach: | They propose to use ASR to measure the effectiveness of reconstruction attacks to evaluate sanitization performance. |
| Outcome: | The proposed reconstruction attacks achieve a 46.4% improvement in ASR over the state-of-the-art baseline with a privacy budget of =4.0 on the SST-2 dataset. |
Beyond Modality Collapse: Taming Guided Modality Entropy for Omni-modal Emotion Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | EmoOmni is a data paradigm for omni-modal large language models that can be used for emotion reasoning. |
| Approach: | They propose a data paradigm that interleaves guided tokens into reasoning traces to enforce structured evidence extraction. |
| Outcome: | The proposed paradigm over-relys on a dominant modality while neglecting complementary cues. |
Versatile Framework for Song Generation with Prompt-based Control (2025.findings-emnlp)
Copied to clipboard
Yu Zhang, Wenxiang Guo, Changhao Pan, Zhiyuan Zhu, Ruiqi Li, Jingyu Lu, Rongjie Huang, Ruiyuan Zhang, Zhiqing Hong, Ziyue Jiang, Zhou Zhao
| Challenge: | Existing methods for song generation fail to generate vocals with prompt-based control and proper alignment. |
| Approach: | VersBand is a multi-task song generation framework for synthesizing high-quality songs with prompt-based control. |
| Outcome: | Experimental results show that VersBand performs better than baseline models across multiple song generation tasks. |
FineReason: Evaluating and Improving LLMs’ Deliberate Reasoning through Reflective Puzzle Solving (2025.acl-long)
Copied to clipboard
Guizhen Chen, Weiwen Xu, Hao Zhang, Hou Pong Chan, Chaoqun Liu, Lidong Bing, Deli Zhao, Anh Tuan Luu, Yu Rong
| Challenge: | Recent advances in large language models (LLMs) highlight an important shift from the “System 1” way of quick reactions to the “system 2” style of reflection-and-correction problem solving. |
| Approach: | They propose a logic-puzzle benchmark for systematic evaluation of large language models' reasoning capabilities that decomposes each puzzle into atomic steps. |
| Outcome: | The proposed model improves on state checking and state transition tasks and demonstrates gains in reasoning by up to 5.1%. |
CORI: CJKV Benchmark with Romanization Integration - a Step towards Cross-lingual Transfer beyond Textual Scripts (2024.lrec-main)
Copied to clipboard
| Challenge: | Naively assuming English as a source language may hinder cross-lingual transfer . despite recent advances in cross-linguistic research, most studies have restricted themselves to two major assumptions . |
| Approach: | They propose to integrate Romanized transcription beyond textual scripts to capture contact between these languages . they propose to use a benchmark dataset to further encourage in-depth studies of language contact . |
| Outcome: | The proposed method allows for enhanced cross-lingual representations and effective zero-shot cross-linguistic transfer. |
EyeMulator: Improving Code Language Models by Mimicking Human Visual Attention (2026.acl-long)
Copied to clipboard
Yifan Zhang, Chen Huang, Yueke Zhang, Jiahao Zhang, Toby Jia-Jun Li, Collin McMillan, Kevin Leach, Yu Huang
| Challenge: | Code Language Models learn attention based on statistical input-output token correlations. |
| Approach: | They propose a model-agnostic technique to align CodeLLM attention with human visual attention without architectural changes. |
| Outcome: | The proposed model outperforms baselines in three languages, with gains of over 30 CodeBLEU points in translation and up to 22 BERTScore points in summarization. |
Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QA (2024.emnlp-main)
Copied to clipboard
Minzheng Wang, Longze Chen, Fu Cheng, Shengyi Liao, Xinghua Zhang, Bingli Wu, Haiyang Yu, Nan Xu, Lei Zhang, Run Luo, Yunshui Li, Min Yang, Fei Huang, Yongbin Li
| Challenge: | Existing benchmarks for evaluating long-context language models employ irrelevant noise texts to artificially extend the length of test cases, diverging from the real-world scenarios of long-constituency applications. |
| Approach: | They propose a long-context benchmark, Loong, aligning with realistic scenarios through extended multi-document question answering (QA) . |
| Outcome: | The proposed model can scale up the context window of large language models to perform in-depth analysis of multiple long documents. |
Learning a Grammar Inducer from Massive Uncurated Instructional Videos (2022.emnlp-main)
Copied to clipboard
| Challenge: | aims to find more accurate syntactic grammars for accompanying text using video data. |
| Approach: | They build a video-aided grammar induction model that can learn video-span correlation without manual features. |
| Outcome: | The proposed model can learn video-span correlation without manual features adopted by previous systems. |
Attention Entropy is a Key Factor: An Analysis of Parallel Context Encoding with Full-attention-based Pre-trained Language Models (2025.acl-long)
Copied to clipboard
Zhisong Zhang, Yan Wang, Xinting Huang, Tianqing Fang, Hongming Zhang, Chenlong Deng, Shuaiyi Li, Dong Yu
| Challenge: | Large language models have demonstrated remarkable performance across a wide range of language tasks due to their remarkable ability in context modeling. |
| Approach: | They propose to use parallel context encoding to reduce attention entropy by incorporating attention sinks and selective mechanisms to reduce irregular attention . they also propose to incorporate attention sink mechanisms into the parallel encoded context to reduce the irregular attention. |
| Outcome: | The proposed methods lower irregular attention entropy and narrow performance gaps. |
The Security Threat of Compressed Projectors in Large Vision-Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Mainstream VLPs have significant security implications, but their security implications have not been thoroughly examined. |
| Approach: | a study evaluates the security of visual language projectors by comparing them to uncompressed projector. |
| Outcome: | The evaluation reveals significant differences in security profiles between compressed and uncompressed projectors. |
AwarenessBench: Assessing Cognitive Capabilities of Language Models (2026.acl-long)
Copied to clipboard
Xiaojian Li, Rongwu Xu, Tianyun Zhang, Yue Wang, Shuo Chen, Qiner Lyu, Briana Zhang, Peiran Yang, Kyle Xue Chen, Haoyuan Shi, Yu Wang, Wei Xu
| Challenge: | Language models exhibit increasingly consciousness-like behaviors, requiring a baseline to evaluate their cognitive abilities. |
| Approach: | They propose a benchmark to assess the cognitive abilities of language models (LMs) they compare 18 state-of-the-art LMs to human models in metacognition, self-awareness, social awareness and situational awareness . |
| Outcome: | Evaluating 18 state-of-the-art LMs, they find they consistently surpass baselines . but most models fall short in metacognition and self-awareness, the study finds . |
ConsistRM: Improving Generative Reward Models via Consistency-Aware Self-Training (2026.acl-long)
Copied to clipboard
Yu Liang, Liangxin Liu, Longzheng Wang, null Wangyan, Zhang Yueyang, Long Xia, Zhiyuan Sun, Daiting Shi
| Challenge: | ConsistRM is a self-training framework that enables effective and stable GRM training without human annotations. |
| Approach: | They propose a self-training framework that enables effective and stable GRM training without human annotations. |
| Outcome: | The proposed framework outperforms vanilla Reinforcement Fine-Tuning (RFT) by 1.5% on five benchmark datasets. |
Overcoming Language Priors in Visual Question Answering via Distinguishing Superficially Similar Instances (2022.coling-1)
Copied to clipboard
| Challenge: | Existing VQA models rely on the superficial correlation between question type and frequent answers to make predictions, without really understanding the input. |
| Approach: | They propose a training framework that explicitly encourages the VQA model to distinguish between superficially similar instances. |
| Outcome: | The proposed framework achieves state-of-the-art performance on VQA-CP v2 . it explicitly encourages the model to distinguish between the superficially similar instances . |
Multifaceted Evaluation of Audio-Visual Capability for MLLMs: Effectiveness, Efficiency, Generalizability and Robustness (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Multi-modal large language models have been used for processing and understanding information from diverse modalities. |
| Approach: | They propose to evaluate the audio-visual capabilities of multi-modal large language models . they focus on effectiveness, efficiency, generalizability, and robustness . |
| Outcome: | The proposed models exhibit strong zero-shot and few-shot generalization abilities . their success relies heavily on the vision modality, which impairs performance when visual input is corrupted or missing. |
Rethinking Table Pruning in TableQA: From Sequential Revisions to Gold Trajectory-Supervised Parallel Search (2026.acl-long)
Copied to clipboard
Yu Guo, Shenghao Ye, Shuangwu Chen, Zijian Wen, Tao Zhang, Bai Qirui, Dong Jin, Yunpeng Hou, Huasen He, null Jianyang, Xiaobin Tan
| Challenge: | Existing pruning methods rely on sequential revisions and unreliable critique signals . Existing methods fail to detect the loss of answer-critical data . |
| Approach: | They propose a table pruning framework which transforms table pruning to gold trajectory-supervised parallel search. |
| Outcome: | The proposed framework outperforms the strongest baseline pruning framework by 3.2% on various tabular reasoning tasks. |
TCSinger 2: Customizable Multilingual Zero-shot Singing Voice Synthesis (2025.findings-acl)
Copied to clipboard
Yu Zhang, Wenxiang Guo, Changhao Pan, Dongyu Yao, Zhiyuan Zhu, Ziyue Jiang, Yuhan Wang, Tao Jin, Zhou Zhao
| Challenge: | Existing zero-shot singing voice synthesis models depend on phoneme and note boundary annotations, limiting their robustness and producing poor transitions between phonemes and notes. |
| Approach: | They propose a multi-task multilingual zero-shot SVS model with style transfer and style control based on various prompts. |
| Outcome: | Experimental results show that TCSinger 2 outperforms baseline models in subjective and objective metrics across multiple related tasks. |
RiskLab: A Controlled Toolkit for Probing Emergent Risks in LLM-Based Multi-Agent Systems (2026.acl-demo)
Copied to clipboard
Yu Jiang, Wenjie Wang, Yue Huang, Yanbo Wang, Zhenhong Zhou, Xiuying Chen, Yang Liu, Pin-Yu Chen, Wei Wang, Xiangliang Zhang
| Challenge: | Recent advances in large language model (LLM) agents have accelerated deployment of multi-agent systems for complex tasks. |
| Approach: | They propose an open-source toolkit for instantiating, probing, and measuring emergent risks in LLM-based multi-agent systems under controlled conditions. |
| Outcome: | The proposed toolkit is based on a structured topology–environment–protocol–agent–task quintuple enabling reproducible studies of how communication structure, coordination mechanisms, and incentives shape system-level risks. |
SSMLoRA: Enhancing Low-Rank Adaptation with State Space Model (2025.naacl-long)
Copied to clipboard
| Challenge: | Fine-tuning requires substantial computational resources and is prone to overfitting when applied to small datasets. |
| Approach: | They propose a parameter-efficient fine-tuning method that integrates a State Space Model (SSM) to interconnect low-rank matrices. |
| Outcome: | The proposed method achieves comparable performance to LoRA on the general language understanding evaluation (GLUE) benchmark while using only half the parameters. |
SearchGym: Bootstrapping Real-World Search Agents via Cost-Effective and High-Fidelity Environment Simulation (2026.acl-long)
Copied to clipboard
Xichen Zhang, Ziyi He, Yinghao Zhu, Sitong Wu, Shaozuo Yu, Meng Chu, Wenhu Zhang, Haoru Tan, Jiaya Jia
| Challenge: | Search agents are a pivotal paradigm for solving open-ended, knowledge-intensive reasoning tasks. |
| Approach: | They propose a search agent simulation environment that bootstraps robust search agents using Reinforcement Learning. |
| Outcome: | The proposed model outperforms the web-enhanced ASearcher model by 10.6%. |
Easy Samples Are All You Need: Self-Evolving LLMs via Data-Efficient Reinforcement Learning (2026.findings-acl)
Copied to clipboard
| Challenge: | Experimental results show that EasyRL consistently outperforms state-of-the-art baselines due to the substantial annotation cost and issues such as model collapse or reward hacking. |
| Approach: | They propose a supervised RL approach with a divide-and-conquer strategy that simulates the human cognitive acquisition curve using easy labeled data. |
| Outcome: | The proposed approach outperforms state-of-the-art models on mathematical and scientific benchmarks using only 10% of easy labeled data. |
ReGen: Zero-Shot Text Classification via Training Data Generation with Progressive Dense Retrieval (2023.findings-acl)
Copied to clipboard
| Challenge: | Recent studies show that large pretrained language models can generate training data with no task-specific or cross-task data. |
| Approach: | They propose a retrieval-enhanced framework to create training data from a general-domain unlabeled corpus. |
| Outcome: | The proposed framework achieves 4.3% gain over baselines and saves 70% of time compared with baselines using large language models. |
To See a World in a Spark of Neuron: Disentangling Multi-Task Interference for Training-Free Model Merging (2025.emnlp-main)
Copied to clipboard
Zitao Fang, Guodong Du, Shuyang Yu, Yifei Guo, Yiwei Zhang, Yiyao Cao, Jing Li, Ho-Kin Tang, Sim Kuan Goh
| Challenge: | Existing approaches to model merging ignore the fundamental roles of neurons, connectivity and activation. |
| Approach: | They propose a framework that relies on neuronal mechanisms to mitigate task interference . they decomposed task-specific representations into two complementary subspaces . their results offer new insights into mitigating task interference and improving knowledge fusion . |
| Outcome: | The proposed framework reduces task interference within neurons and improves knowledge fusion. |
Discriminative Nearest Neighbor Few-Shot Intent Detection by Transferring Natural Language Inference (2020.emnlp-main)
Copied to clipboard
Jianguo Zhang, Kazuma Hashimoto, Wenhao Liu, Chien-Sheng Wu, Yao Wan, Philip Yu, Richard Socher, Caiming Xiong
| Challenge: | Existing work on few-shot intent classification without OOS has focused on the few-shot intent classification with out-of-scope intents. |
| Approach: | They propose to use BERT-style pairwise encoding to train a binary classifier that estimates the best matched training example for a user input. |
| Outcome: | The proposed approach achieves more stable and accurate in-domain and OOS detection accuracy than RoBERTa-based classifiers and embedding-based nearest neighbor approaches. |
UI-Hawk: Unleashing the Screen Stream Understanding for Mobile GUI Agents (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing GUI agents depend on current visual observations and plain-text action history, ignoring the significance of history screens. |
| Approach: | They propose a multi-modal GUI agent specifically designed to process screen streams . they propose UI-Hawk incorporates a history-aware visual encoder to handle the sequences . |
| Outcome: | The proposed GUI agent can process screen streams encountered during GUI navigation. |
TRAC: Teacher-Guided Token Reward with Adaptive Calibration for Robust Policy Optimization (2026.acl-long)
Copied to clipboard
| Challenge: | Current reward models for reinforcement learning (RL) rely on outcome rewards that propagate a single scalar value across all tokens based on final correctness. |
| Approach: | They propose a framework that derives dense token-level supervision from LLMs . they use a multi-granularity calibration mechanism to modulate teacher influence . |
| Outcome: | The proposed framework evaluates teacher reliability across problem-level expertise, trajectory-level discrimination, and token-level confidence. |
Breaking Consensus Bias: Unsupervised Reinforcement Learning for Machine Translation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing RL approaches for MT face fixed references or the production of homogeneous references leading to mode collapse in unsupervised settings. |
| Approach: | They propose an Entropy-Driven Unsupervised RL framework for machine translation that leverages entropy for supervision construction and self-evolution. |
| Outcome: | The proposed framework outperforms supervised and unsupervised baselines in multiple language pairs. |
Me-Agent: A Personalized Mobile Agent with Two-Level User Habit Learning for Enhanced Interaction (2026.findings-acl)
Copied to clipboard
Shuoxin Wang, Chang Liu, Gowen Loo, Lifan Zheng, Kaiwen Wei, Huanqian Yan, Xinyi Zeng, Jingyuan Zhang, Yu Tian
| Challenge: | Existing Large Language Model (LLM)-based mobile agents follow explicit user instructions without personalized needs. |
| Approach: | They propose a user preference learning strategy enhanced with a Personal Reward Model to improve personalization performance. |
| Outcome: | The proposed agent achieves state-of-the-art performance while maintaining competitive instruction execution performance. |
Beyond Dialogue: A Profile-Dialogue Alignment Framework Towards General Role-Playing Language Model (2025.acl-long)
Copied to clipboard
| Challenge: | Existing role-playing training methods often lack profile-dialogue alignment at the sentence level. |
| Approach: | They propose a framework that aligns dialogue with profile traits for each scenario, eliminating biases during training. |
| Outcome: | The proposed model outperforms most proprietary role-playing models and is fully automated and low-cost. |
COIG-P: A High-Quality and Large-Scale Chinese Preference Dataset for Alignment with Human Values (2026.findings-eacl)
Copied to clipboard
Siwei Wu, JinCheng Ren, Xeron Du, Shuyue Guo, Xingwei Qu, Yiming Liang, Jie Liu, Yunwen Li, Tyler Loakman, Tianyu Zheng, Boyu Feng, Huaqing Yuan, Zili Wang, Jiaheng Liu, Wenhao Huang, Chenglin Cai, Haoran Que, Jian Yang, Yuelin Bai, Zekun Moore Wang, Zhouliang Yu, Qunshu Lin, Ding Pan, Yuchen Eleanor Jiang, Tiannan Wang, Wangchunshu Zhou, Shenzhi Wang, Xingyuan Bu, Minghao Liu, Guoyin Wang, Ge Zhang, Chenghua Lin
| Challenge: | Existing Chinese preference datasets suffer from limited scale, restricted domain coverage, and insufficiently rigorous data validation. |
| Approach: | They propose an LLM-based data annotation pipeline with no human intervention to annotate Chinese preference datasets. |
| Outcome: | The proposed pipeline outperforms existing Chinese preference datasets on AlignBench and Chinese Reward Benchmark. |
Persuasion for Good: Towards a Personalized Persuasive Dialogue System for Social Good (P19-1)
Copied to clipboard
| Challenge: | Persuasion agents are a form of communication that can be used to change people's opinions and actions for social good. |
| Approach: | They designed an online persuasion task where one participant was asked to persult the other to donate to a specific charity. |
| Outcome: | The proposed system could change people's opinions and actions for social good. |
Grape: Knowledge Graph Enhanced Passage Reader for Open-domain Question Answering (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Open-domain question answering (QA) models employ a retriever-reader pipeline . however, state-of-the-art readers fail to capture complex relationships between entities . |
| Approach: | They propose a knowledge graph enhanced passage reader that captures entities in questions and retrieved passages. |
| Outcome: | The proposed knowledge graph enhanced passage reader improves on open-domain QA benchmarks by up to 2.2 exact match scores. |
Graph Chain-of-Thought: Augmenting Large Language Models by Reasoning on Graphs (2024.findings-acl)
Copied to clipboard
Bowen Jin, Chulin Xie, Jiawei Zhang, Kashob Kumar Roy, Yu Zhang, Zheng Li, Ruirui Li, Xianfeng Tang, Suhang Wang, Yu Meng, Jiawei Han
| Challenge: | Existing studies suggest augmenting LLMs with external text corpora to alleviate hallucination problems. |
| Approach: | They propose to augment large language models with text units retrieved from external knowledge corpora to alleviate the issue. |
| Outcome: | The proposed framework outperforms baselines on GRBench with three LLMs and shows that iterative reasoning outperformed the baselines. |
Long-tailed Extreme Multi-label Text Classification by the Retrieval of Generated Pseudo Label Descriptions (2023.findings-eacl)
Copied to clipboard
| Challenge: | Extreme Multi-label text classification (XMTC) is a tough challenge due to the sheer size of the label spaces and the severe data scarcity problem associated with the long tail of rare labels in highly skewed distributions. |
| Approach: | They propose to use a trained bag-of-words classifier to generate pseudo label descriptions from a training bag- of-word classifier. |
| Outcome: | The proposed approach outperforms the existing models in the tail label prediction problem and achieves state-of-the-art (SOTA) performance on XMTC benchmark datasets. |
Dimension Reduction for Efficient Dense Retrieval via Conditional Autoencoder (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing work reserves the principle dimensions of query and document embeddings for building more efficient retrieval systems. |
| Approach: | They propose to use Conditional Autoencoder to compress high-dimensional embeddings to maintain the same embeddable distribution and better recover ranking features. |
| Outcome: | The proposed algorithm achieves comparable ranking performance with its teacher model and makes the retrieval system more efficient. |
Correcting Chinese Spelling Errors with Phonetic Pre-training (2021.findings-acl)
Copied to clipboard
Ruiqing Zhang, Chao Pang, Chuanqiang Zhang, Shuohuan Wang, Zhongjun He, Yu Sun, Hua Wu, Haifeng Wang
| Challenge: | Existing methods for Chinese spelling correction only use pre-trained language model or incorporate phonological information as external knowledge. |
| Approach: | They propose a phonetic Chinese spelling correction model that integrates phonetic features into language model by leveraging pre-training and fine-tuning methods. |
| Outcome: | The proposed model outperforms existing methods on SIGHAN datasets and improves on other datasets. |
Revitalizing Black-Box Interpretability: Actionable Interpretability for LLMs via Proxy Models (2026.acl-long)
Copied to clipboard
| Challenge: | Applying model-agnostic explanations to Large Language Models is hindered by prohibitive computational costs rendering them dormant for real-world applications. |
| Approach: | They propose a budget-friendly proxy framework that leverages efficient models to approximate the decision boundaries of expensive Large Language Models. |
| Outcome: | The proposed framework achieves over 90% fidelity with only 9.5% of the oracle’s cost and is open-source to facilitate future research. |
Ground Every Sentence: Improving Retrieval-Augmented LLMs with Interleaved Reference-Claim Generation (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods to enhance credibility and verifiability of large language models (LLMs) mainly focus on passage-level or paragraph-level references or citations, which fall short in verifikatability. |
| Approach: | They propose a method that provides sentence-level citations in LLM-generated responses. |
| Outcome: | The proposed method achieves 90% accuracy in long-form question-answering tasks. |
Enhanced Visual Instruction Tuning with Synthesized Image-Dialogue Data (2024.findings-acl)
Copied to clipboard
Yanda Li, Chi Zhang, Gang Yu, Wanqi Yang, Zhibin Wang, Bin Fu, Guosheng Lin, Chunhua Shen, Ling Chen, Yunchao Wei
| Challenge: | OpenAI's GPT-4 has demonstrated remarkable multimodal capabilities, but specific mechanics of GPT4 remain unknown. |
| Approach: | They propose a data collection methodology that synchronously synthesizes images and dialogues for visual instruction tuning. |
| Outcome: | The proposed method improves on ten commonly assessed models and provides greater flexibility compared to existing methods. |
MinT: Boosting Generalization in Mathematical Reasoning via Multi-view Fine-tuning (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods focus on specializing LMs in mathematical reasoning and rely on knowledge distillation. |
| Approach: | They propose a multi-view fine-tuning method that exploits existing mathematical problem datasets with diverse annotation styles. |
| Outcome: | The proposed method outperforms existing methods that rely heavily on LLM teachers . it grants models generalization ability across views and datasets, and the capability to learn from inaccurate or incomplete data. |
CENTAUR: Bridging the Impossible Trinity of Privacy, Efficiency, and Performance in Privacy-Preserving Transformer Inference (2025.acl-long)
Copied to clipboard
Jinglong Luo, Guanzhong Chen, Yehong Zhang, Shiyu Liu, Hui Wang, Yue Yu, Xun Zhou, Yuan Qi, Zenglin Xu
| Challenge: | Existing privacy-preserving Transformer Inference frameworks suffer from high computational overhead and performance losses. |
| Approach: | They propose a framework that integrates random permutations and SMPC to address the "impossible trinity" CENTAUR resists diverse data reconstruction attacks and boosts inference speed by 5.030.4 times . |
| Outcome: | CENTAUR achieves an unprecedented balance between privacy, efficiency, and performance. |
Can Reasoning Path still be Effective as Input? Bridging Post-Reasoning to Chain-of-Thought Compression (2026.acl-long)
Copied to clipboard
Chengzhengxu Li, Xiaoming Liu, Zhaohan Zhang, Shengchao Liu, Guoxin Ma, Yu Lan, Cong Wang, Chao Shen
| Challenge: | Existing work on reducing CoT generation in reasoning impairs the necessary information for deriving the correct answer. |
| Approach: | They propose a reasoning paradigm that takes CoT as a part of context to simplify the reasoning task for Large Language Models (LLMs). |
| Outcome: | The proposed framework reduces the generation length of LLMs, but its effectiveness hinges on the efficiency and reliability of the contextual CoT generation. |
EcomScriptBench: A Multi-task Benchmark for E-commerce Script Planning via Step-wise Intention-Driven Product Association (2025.acl-long)
Copied to clipboard
Weiqi Wang, Limeng Cui, Xin Liu, Sreyashi Nag, Wenju Xu, Chen Luo, Sheikh Muhammad Sarwar, Yang Li, Hansu Gu, Hui Liu, Changlong Yu, Jiaxin Bai, Yifan Gao, Haiyang Zhang, Qi He, Shuiwang Ji, Yangqiu Song
| Challenge: | Goal-oriented script planning is used by humans to plan for typical activities . however, this capability remains underexplored due to several challenges . |
| Approach: | They propose a framework that enables product-enriched scripts by associating products with each step based on the semantic similarity between the actions and their purchase intentions. |
| Outcome: | The proposed framework can generate product-enriched scripts from 2.4 million scripts . human annotations are conducted to provide gold labels for a sampled subset . |
RIVAL: Reinforcement Learning with Iterative and Adversarial Optimization for Machine Translation (2025.findings-emnlp)
Copied to clipboard
Tianjiao Li, Mengran Yu, Chenyu Shi, Yanjun Zhao, Xiaojing Liu, Qi Zhang, Xuanjing Huang, Qiang Zhang, Jiayin Wang
| Challenge: | Using reinforcement learning from human feedback, large language models perform poorly when applied to colloquial subtitle translation tasks. |
| Approach: | They propose an adversarial training framework that iteratively updates the offline reward model and the online LLM to improve training outcomes. |
| Outcome: | The proposed training framework significantly improves upon translation baselines. |
Rethinking the Reversal Curse of LLMs: a Prescription from Human Knowledge Reversal (2024.emnlp-main)
Copied to clipboard
Zhicong Lu, Li Jin, Peiguang Li, Yu Tian, Linhao Zhang, Sirui Wang, Guangluan Xu, Changyuan Tian, Xunliang Cai
| Challenge: | Existing methods for large language models (LLMs) are limited by their aggressive sample permutation and lack a detailed understanding of the underlying reasons for the reversal curse. |
| Approach: | They propose a method which enhances bidirectional entity correlation modeling and pairwise relationship reasoning to overcome the reversal curse. |
| Outcome: | The proposed method overcomes the reversal curse by augmenting the samples with entity order-reversals and semantically preserved question-answer pairs. |
WebAnchor: Anchoring Agent Planning to Stabilize Long-Horizon Web Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for reinforcement learning (RL)-based agents struggle with long-horizon planning and strategy coherence. |
| Approach: | They propose a reinforcement learning framework that decouples planning and execution. |
| Outcome: | The proposed framework outperforms baseline and first-step RL frameworks on four benchmarks. |
ALinFiK: Learning to Approximate Linearized Future Influence Kernel for Scalable Third-Parity LLM Data Valuation (2025.naacl-long)
Copied to clipboard
Yanzhou Pan, Huawei Lin, Yide Ran, Jiamin Chen, Xiaodong Yu, Weijie Zhao, Denghui Zhang, Zhaozhuo Xu
| Challenge: | Large Language Models (LLMs) heavily rely on high-quality training data, making data valuation crucial for optimizing model performance. |
| Approach: | They propose a third-party data valuation approach that assesses the value of individual data samples and proposes a learning strategy to approximate LinFiK. |
| Outcome: | The proposed approach surpasses baselines in effectiveness and efficiency, showing significant scalability advantages as LLM parameters increase. |
FocalOrder: Focal Preference Optimization for Reading Order Detection (2026.acl-long)
Copied to clipboard
Fuyuan Liu, Dianyu Yu, He Ren, Nayu Liu, Xiaomian Kang, Delai Qiu, Fa Zhang, Genpeng Zhen, Shengping Liu, Liang Jiaen, null Weihuang, Yining Wang, Junnan Zhu
| Challenge: | Existing methods for document comprehension rely on uniform supervision, resulting in a performance degradation in the intermediate sections. |
| Approach: | They propose a framework driven by Focal Preference Optimization to detect reading order in document layouts. |
| Outcome: | The proposed framework outperforms competing baselines and surpasses large-scale general VLMs. |
Measure Twice, Click Once: Co-evolving Proposer and Visual Critic via Reinforcement Learning for GUI Grounding (2026.acl-long)
Copied to clipboard
| Challenge: | Graphical User Interface (GUI) grounding requires mapping natural language instructions to precise pixel coordinates due to visually homogeneous elements and dense layouts. |
| Approach: | They propose to replace static consistency strategies with a learnable selection mechanism that selects the optimal target by critiquing its own proposals rendered on the screenshot. |
| Outcome: | The proposed model significantly improves both grounding and critiquing capabilities over 6 benchmarks. |
Interactive Language Acquisition with One-shot Visual Concept Learning through a Conversational Game (P18-1)
Copied to clipboard
| Challenge: | supervised language learning is limited by the ability of capturing mainly the statistics of training data. |
| Approach: | They propose to use conversational games to train agents to use new knowledge . they propose to mimic and reinforce conversational game and use it in one-shot fashion . |
| Outcome: | The proposed approach is able to acquire information by asking questions about novel objects and use the just-learned knowledge in subsequent conversations in a one-shot fashion. |
Protein Large Language Models: A Comprehensive Survey (2025.findings-emnlp)
Copied to clipboard
Yijia Xiao, Wanjia Zhao, Junkai Zhang, Yiqiao Jin, Han Zhang, Zhicheng Ren, Renliang Sun, Haixin Wang, Guancheng Wan, Pan Lu, Xiao Luo, Yu Zhang, James Zou, Yizhou Sun, Wei Wang
| Challenge: | Existing studies focus on specific aspects or applications, but this study provides a comprehensive overview of Protein-specific large language models. |
| Approach: | This paper proposes a structured taxonomy of state-of-the-art ProteinLLMs . they analyze how they leverage large-scale protein sequence data for improved accuracy . |
| Outcome: | The proposed model covers their architectures, training datasets, evaluation metrics, and diverse applications. |
Detecting AI-Generated Content on Social Media with Multi-modal Language Models (2026.acl-industry)
Copied to clipboard
Chenyang Yang, Shen Yan, Yibo Yang, Litao Hu, Yuchen Liu, Yuan Zeng, Hanchao Yu, Yinan Zhu, Sumedha Singla, Brian Vanover, Huijun Qian, Zihao Wang, Fujun Liu, Aashu Singh, Jianyu Wang, Xuewen Zhang
| Challenge: | Existing methods for AI-generated content detection face poor generalization to newer models, reliance on single modalities, and lack of interpretable explanations. |
| Approach: | They propose a model that curates diverse social media data and trains a vision-language model for detection and explanation. |
| Outcome: | The proposed model achieves state-of-the-art detection performance on public benchmarks and observes positive downstream impacts on user engagement. |
SR-LLM: Rethinking the Structured Representation in Large Language Model (2025.acl-long)
Copied to clipboard
Jiahuan Zhang, Tianheng Wang, Ziyi Huang, Yulong Wu, Hanqing Wu, DongbaiChen DongbaiChen, Linfeng Song, Yue Zhang, Guozheng Rao, Kaicheng Yu
| Challenge: | Structured representations have long been pivotal in computational linguistics, but their role remains ambiguous in the Large Language Models (LLMs) era. |
| Approach: | They propose a framework that integrates structured representations into LLMs from training-free and training-dependent perspectives. |
| Outcome: | The proposed framework integrates structured representations through natural language descriptions in LLM prompts while augmenting the model’s inference capability through fine-tuning on linguistically described structured representation. |
Bridging Continuous and Discrete Spaces: Interpretable Sentence Representation Learning via Compositional Operations (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to learn sentence embeddings do not capture the semantic similarity of sentences. |
| Approach: | They propose a framework that integrates compositional sentence operations into the embedding space and optimizes operator networks and a bottleneck encoder-decoder model to produce meaningful and interpretable sentence embeddables. |
| Outcome: | The proposed framework improves the interpretability of sentence embeddings on four textual generation tasks while maintaining strong performance on traditional semantic similarity tasks. |
Large Language Models Know What is Key Visual Entity: An LLM-assisted Multimodal Retrieval for VQA (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing visual language models struggle to capture longtail knowledge in the real world due to redundant visual information. |
| Approach: | They propose a method leveraging the reasoning capability of a large language model to identify key visual entities. |
| Outcome: | The proposed method outperforms other strong visual language model-based systems in two knowledge-intensive VQA benchmarks and performs comparably to models with 1-2 orders larger parameters. |
CCIM: Cross-modal Cross-lingual Interactive Image Translation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing research on text image machine translation (TIMT) lacks recognized source language information resulting in a decrease in translation performance. |
| Approach: | They propose a cross-modal cross-lingual interactive model which incorporates source language information by synchronizing source and target language results. |
| Outcome: | The proposed model outperforms end-to-end models and has faster decoding speed with smaller model size than cascade models. |
NCLS: Neural Cross-Lingual Summarization (D19-1)
Copied to clipboard
| Challenge: | Existing approaches to cross-lingual summarization divide the task into two steps: summarizing and translation. |
| Approach: | They propose to integrate two related tasks into the training process of CLS under multi-task learning to improve cross-lingual summarization. |
| Outcome: | The proposed framework improves on English-to-Chinese and Chinese-to English CLS human-corrected test sets. |
On the Generation of Medical Dialogs for COVID-19 (2021.acl-short)
Copied to clipboard
Meng Zhou, Zechen Li, Bowen Tan, Guangtao Zeng, Wenmian Yang, Xuehai He, Zeqian Ju, Subrato Chakravorty, Shu Chen, Xingyi Yang, Yichen Zhang, Qingyang Wu, Zhou Yu, Kun Xu, Eric Xing, Pengtao Xie
| Challenge: | under the pandemic of COVID-19, people experiencing COVI D19-related symptoms have a pressing need to consult doctors. |
| Approach: | They develop a medical dialog system that can provide COVID19-related consultations . they use two dialog datasets containing conversations between doctors and patients . |
| Outcome: | The proposed system can provide COVID19-related consultations, but is too small compared with general-domain dialog datasets. |
A Unified Taxonomy-Guided Instruction Tuning Framework for Entity Set Expansion and Taxonomy Expansion (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing studies view entity set expansion, taxonomy expansion, and seed-guided taxonomies as three separate tasks. |
| Approach: | They propose a taxonomy-guided instruction tuning framework to teach a large language model to generate siblings and parents for query entities. |
| Outcome: | The proposed framework outperforms baselines on multiple benchmark datasets. |
Beyond Emotion: A Multi-Modal Dataset for Human Desire Understanding (2022.naacl-main)
Copied to clipboard
| Challenge: | Desire is a primitive instinct and a need for strongly expressing human desires to get or possess something. |
| Approach: | They propose to use MSED to model and understand human desire . they propose to provide a benchmark for human desire analysis . |
| Outcome: | The proposed dataset contains 9,190 text-image pairs with English text. |
What You See is What You Get: Visual Pronoun Coreference Resolution in Dialogues (D19-1)
Copied to clipboard
| Challenge: | a core task of natural language understanding is to ground a pronoun to a visual object it refers to . problem arises when people use pronounos to refer to something they can see without prior introduction . a novel visual-aware PCR model is proposed to solve this problem . |
| Approach: | They propose a visual-aware PCR model to ground a pronoun to a visible object . they propose PCR using a large-scale dialogue dataset to investigate this problem . |
| Outcome: | The proposed model can help resolve pronouns in conversational contexts. |
ImplicitAVE: An Open-Source Dataset and Multimodal LLMs Benchmark for Implicit Attribute Value Extraction (2024.findings-acl)
Copied to clipboard
Henry Zou, Vinay Samuel, Yue Zhou, Weizhi Zhang, Liancheng Fang, Zihe Song, Philip Yu, Cornelia Caragea
| Challenge: | Existing datasets for attribute value extraction focus on explicit attribute values while neglecting the implicit ones. |
| Approach: | They present a multimodal dataset for implicit attribute value extraction that includes AVE and multimodality. |
| Outcome: | The proposed dataset includes 68k training and 1.6k testing data across five domains. |
Domain Adaptive Text Style Transfer (D19-1)
Copied to clipboard
| Challenge: | Text style transfer without parallel data is a promising method for learning, but in the scenario where less data is available, it may yield poor performance. |
| Approach: | They propose to leverage available data to learn domain-adaptive text style transfer models . they evaluate two style transfer tasks where only limited non-parallel data is available . |
| Outcome: | The proposed models learn from the source domain to: (i) distinguish stylized information and generic content information; (ii) maximally preserve content information and (iv) adaptively transfer the styles in a domain-aware manner. |
DRIFT: Transferring Reasoning Priors for Efficient MLLM Fine-Tuning (2026.findings-acl)
Copied to clipboard
Chao Huang, Zeliang Zhang, Jiang Liu, Ximeng Sun, Jialian Wu, Xiaodong Yu, Ze Wang, Chenliang Xu, Emad Barsoum, Zicheng Liu
| Challenge: | Multimodal large language models (MLLMs) have made rapid progress in perception and alignment, but their reasoning ability often lags behind strong text-only LLMs. |
| Approach: | They propose a method that transfers reasoning knowledge in the gradient space while preserving multimodal alignment. |
| Outcome: | Experiments on multimodal reasoning benchmarks show that DRIFT outperforms naive merging and standard SFT. |
Knowledge Distillation with Reptile Meta-Learning for Pretrained Language Model Compression (2022.coling-1)
Copied to clipboard
| Challenge: | Knowledge distillation (KD) can transfer knowledge from the original model into a compact model to achieve model compression. |
| Approach: | They propose a knowledge distillation method with reptile meta-learning to facilitate the transfer of knowledge from the teacher to the student. |
| Outcome: | Extensive experiments on the GLUE benchmark show the proposed method performs better than previous methods. |
UniRAG: Unified Query Understanding Method for Retrieval Augmented Generation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing query augmentation methods face knowledge update lag and hallucinations in large language models (LLMs) Existing methods face two key challenges: (1) separation of query augmented and encoding tasks, which hinders information sharing and introduces cumulative errors; (2) difficulty of selecting optimal augmentation strategy for different scenarios. |
| Approach: | They propose a unified framework for query understanding in RAG that integrates internal and external knowledge to enhance query augmentation and encoding tasks. |
| Outcome: | The proposed framework outperforms traditional query augmentation methods in five knowledge-intensive benchmark tasks in both closed and open domain question answering. |
Medico: Towards Hallucination Detection and Correction with Multi-source Evidence Fusion (2024.emnlp-demo)
Copied to clipboard
| Challenge: | Existing studies show that LLMs can confidently state non-existent facts rather than answering "I don't know". |
| Approach: | They propose a multi-source evidence fusion enhanced hallucination detection and correction framework that fuses evidence from multiple sources and iteratively revises the hallucinous content. |
| Outcome: | The proposed framework detects whether the generated content contains factual errors, provides the rationale behind the judgment, and iteratively revises the hallucinated content. |
A Survey of Reinforcement Learning for Large Language Models under Data Scarcity: Challenges and Solutions (2026.acl-long)
Copied to clipboard
Zhiyin Yu, Yuchen Mou, Juncheng Yan, Junyu Luo, Chunchun Chen, Xing Wei, Yunhui Liu, Hongru Sun, Yuxing Zhang, Jun Xu, Yatao Bian, Ming Zhang, Wei Ye, Tieke He, Jie Yang, Guanjie Zheng, Zhonghai Wu, Bo Zhang, Lei Bai, Xiao Luo
| Challenge: | Existing research on reinforcement learning for LLMs under data scarcity has not been unified. |
| Approach: | They propose a top-up hierarchical framework built around three complementary perspectives: data-centric, training-centric and framework-centric. |
| Outcome: | The proposed framework provides a clear conceptual foundation for understanding the design space of data-efficient RL for large language models and to guide researchers working in this emerging area. |
HETFORMER: Heterogeneous Transformer with Sparse Attention for Long-Text Extractive Summarization (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for summarizing semantic graph structure from raw text are cumbersome and inefficient for long-text documents. |
| Approach: | They propose a Transformer-based pre-trained model with multi-granularity sparse attentions for long-text extractive summarization. |
| Outcome: | The proposed model performs state-of-the-art on single- and multi-document summarization tasks while using less memory and fewer parameters. |
Glancing Transformer for Non-Autoregressive Neural Machine Translation (2021.acl-long)
Copied to clipboard
| Challenge: | Existing non-autoregressive neural machine translation methods are either inferior to Transformer or require multiple decoding passes, leading to reduced speedup. |
| Approach: | They propose a Glancing Language Model (GLM) for single-pass parallel generation models and Glancing Transformer (GLAT) with only single- pass decoding, GLAT is able to generate high-quality translation with 8-15 speedup. |
| Outcome: | The proposed model outperforms all previous non-autoregressive methods on multiple language directions and is nearly comparable to Transformer. |
RARE: Retrieval-Augmented Reasoning Enhancement for Large Language Models (2025.acl-long)
Copied to clipboard
Hieu Tran, Zonghai Yao, Zhichao Yang, Junda Wang, Yifan Zhang, Shuo Han, null Feiyun Ouyang, Hong Yu
| Challenge: | Existing work aims to improve reasoning accuracy and factual integrity across large language models for knowledge-intensive tasks such as medical and commonsense reasoning. |
| Approach: | They propose a versatile extension to the mutual reasoning framework (rStar) that enhances reasoning accuracy and factual integrity across large language models. |
| Outcome: | The proposed extension to the mutual reasoning framework improves reasoning accuracy and factual integrity across large language models for complex, knowledge-intensive tasks. |
PersonaAgent: Bridging Memory and Action for Personalized LLM Agents (2026.findings-acl)
Copied to clipboard
Weizhi Zhang, Xinyang Zhang, Chenwei Zhang, Liangwei Yang, Jingbo Shang, Zhepei Wei, Henry Peng Zou, Zijie Huang, Zhengyang Wang, Yifan Gao, Xiaoman Pan, Lian Xiong, Jingguo Liu, Philip S. Yu, Xian Li
| Challenge: | Existing Large Language Model (LLM) enabled agents lack flexibility to respond to users’ varying needs and preferences. |
| Approach: | They propose a test-time user-preference alignment strategy that optimizes the persona prompt, ensuring real-time preference alignment through textual loss feedback between simulated and ground-truth responses. |
| Outcome: | The proposed framework outperforms baseline methods in real-time and in real applications. |
Speech Sense Disambiguation: Tackling Homophone Ambiguity in End-to-End Speech Translation (2024.acl-long)
Copied to clipboard
| Challenge: | End-to-end speech translation (ST) models require simultaneous crossmodal and crosslingual transformations to be effective. |
| Approach: | They propose a homophone-aware contrastive learning approach that integrates a speech-text masking strategy to reduce ambiguity. |
| Outcome: | The proposed approach achieves SOTA results on BLEU scores on different MuST-C and CoVoST ST tasks, underlining its effectiveness in reducing speech sense ambiguity. |
Automatic Evaluation of Attribution by Large Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Generative large language models (LLMs) incorporate external references to generate and support claims. however, evaluating the attribution remains an open problem. |
| Approach: | They investigate automatic evaluation of attribution given by large language models . they define different types of attributed errors and then explore two approaches . |
| Outcome: | The proposed methods highlight promising signals and challenges. |
PLUG: Leveraging Pivot Language in Cross-Lingual Instruction Tuning (2024.acl-long)
Copied to clipboard
| Challenge: | Instruction tuning has advanced large language models (LLMs) but its application in lower-resource languages faces challenges due to the imbalanced foundational abilities of LLMs across different languages. |
| Approach: | They propose a pivot language guided generation approach that utilizes a high-resource language as the pivot to enhance instruction tuning in lower-resourced languages. |
| Outcome: | The proposed approach improves instruction-following abilities of LLMs by 29% on average compared to directly responding in the target language alone. |
Joint Optimization of Training Data and Policy in RLHF (2026.findings-acl)
Copied to clipboard
Zhuohao Yu, Jiali Zeng, Weizheng Gu, Mengyuan Sun, Yidong Wang, Fandong Meng, Jie Zhou, Shikun Zhang, Wei Ye
| Challenge: | JODP optimizes policies on fixed training inputs, limiting the diversity of learning signals. |
| Approach: | They propose a framework where policy generates improved variants of training problems to enhance its own learning. |
| Outcome: | The proposed framework improves on safety alignment tasks by allowing 4B models to reach 8B model performance with less than 1% additional computational overhead. |
Explanation Graph Generation via Generative Pre-training over Synthetic Graphs (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing frameworks for explanation graph generation are limited due to the large number of datasets available. |
| Approach: | They propose a text-to-graph generative task to pre-train a model to bridge the text-graph gap. |
| Outcome: | The proposed framework surpasses all baseline systems with remarkable margins on ExplaGraphs and CommonsenseQA. |
Salience Allocation as Guidance for Abstractive Summarization (2022.emnlp-main)
Copied to clipboard
Fei Wang, Kaiqiang Song, Hongming Zhang, Lifeng Jin, Sangwoo Cho, Wenlin Yao, Xiaoyang Wang, Muhao Chen, Dong Yu
| Challenge: | Abstractive summarization models implicitly learn to capture the salient information from scratch. |
| Approach: | They propose a method that uses salience expectation to guide abstractive summarization by averaging salient content to a fixed threshold. |
| Outcome: | The proposed method can be easily adapted to documents with various abstractiveness and achieves high performance. |
GALLa: Graph Aligned Large Language Models for Improved Source Code Understanding (2025.acl-long)
Copied to clipboard
| Challenge: | Programming languages have rich semantics that are represented by graphs and not available from the surface form of source code. |
| Approach: | They propose to use graph neural networks and cross-modal alignment technologies to inject structural information of code into LLMs as an auxiliary task during finetuning. |
| Outcome: | The proposed framework improves on five code tasks with six different baseline LLMs, while incurring no cost at inference time. |
Exploring Contrast Consistency of Open-Domain Question Answering Systems on Minimally Edited Questions (2023.tacl-1)
Copied to clipboard
| Challenge: | Existing studies on the ability of a model to make consistently correct predictions in the presence of perturbations have not been conducted in open-domain question answering (OpenQA). |
| Approach: | They propose a query-side contrastive loss to improve the dense passage retriever (DPR) to improve DPR training. |
| Outcome: | The proposed approach improves the density of the dense passage retriever (DPR) training set without sacrificing accuracy on standard test sets. |
WebSRC: A Dataset for Web-Based Structural Reading Comprehension (2021.emnlp-main)
Copied to clipboard
| Challenge: | Using a web page and a question, a machine can't understand the contents of web pages. |
| Approach: | They propose a novel dataset for web-based structural reading comprehension that consists of 400K question-answer pairs and a dataset of 6.4K web pages. |
| Outcome: | The proposed dataset consists of 400K question-answer pairs, collected from 6.4K web pages with corresponding HTML source code, screenshots, and metadata. |
Planning First, Question Second: An LLM-Guided Method for Controllable Question Generation (2024.findings-acl)
Copied to clipboard
| Challenge: | Current CQG methods focus on difficulty control, neglecting the control of question content and assessed abilities, which are also crucial in educational QG. |
| Approach: | They propose an LLM-guided method PFQS which utilizes Llama 2 to generate an answer plan and then generates questions based on it. |
| Outcome: | The proposed method outperforms state-of-the-art methods and achieves better consistency with requirements in a zero-shot setting. |
ESF: Efficient Sensitive Fingerprinting for Black-Box Tamper Detection of Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) are increasingly utilized in diverse applications, including code generation, legal document analysis, medical diagnosis, and decision-making. |
| Approach: | They propose a fingerprinting method tailored for black-box tamper detection of large language models. |
| Outcome: | The proposed method detects tampering with a 99.2% detection rate using 5 fingerprint samples across state-of-the-art LLMs. |
Gunrock: A Social Bot for Complex and Engaging Long Conversations (D19-3)
Copied to clipboard
Dian Yu, Michelle Cohn, Yi Mang Yang, Chun Yen Chen, Weiming Wen, Jiaping Zhang, Mingyang Zhou, Kevin Jesse, Austin Chau, Antara Bhowmick, Shreenath Iyer, Giritheja Sreenivasulu, Sam Davidson, Ashwin Bhandare, Zhou Yu
| Challenge: | Gunrock is a speech-based social chatbot that can be used to understand complex sentences and have in-depth conversations. |
| Approach: | They propose a system that allows users to understand complex sentences and have in-depth conversations in open domains. |
| Outcome: | The proposed system produces longer sentences, which are directly related to user engagement (e.g., ratings, number of turns). |
LEPO: Latent Reasoning Policy Optimization for Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing latent reasoning methods that use chain of thought (CoT) are limited to selecting one discrete token at each reasoning step, which potentially induces information loss. |
| Approach: | They propose a framework that injects controllable stochasticity into latent reasoning via Gumbel-Softmax, restoring LLMs' exploratory capacity and enhancing their compatibility with Reinforcement Learning (RL). |
| Outcome: | The proposed framework preserves richer information for more comprehensive reasoning and is compatible with Reinforcement Learning (RL). |
Improving Distantly-Supervised Named Entity Recognition with Self-Collaborative Denoising Learning (2021.emnlp-main)
Copied to clipboard
| Challenge: | Named entity recognition (NER) is a method of detecting entity spans and classifying them into predefined categories. |
| Approach: | They propose a method to iteratively perform noisy label refinery by using self-collaborative denoising learning. |
| Outcome: | The proposed learning paradigm exploits reliable labels and communicates with unreliable annotations by collaborative denoising. |
CityNavAgent: Aerial Vision-and-Language Navigation with Hierarchical Semantic Planning and Global Memory (2025.acl-long)
Copied to clipboard
Weichen Zhang, Chen Gao, Shiquan Yu, Ruiying Peng, Baining Zhao, Qian Zhang, Jinqiang Cui, Xinlei Chen, Yong Li
| Challenge: | Existing ground VLN agents struggle in aerial VLLN due to the lack of predefined navigation graphs and the exponentially expanding action space in long-horizon exploration. |
| Approach: | They propose a large language model-empowered aerial VLN agent that decomposes the long-horizon task into sub-goals with different semantic levels. |
| Outcome: | The proposed method achieves state-of-the-art performance with significant improvement in continuous city environments. |
Simulating Classroom Education with LLM-Empowered Agents (2025.naacl-long)
Copied to clipboard
Zheyuan Zhang, Daniel Zhang-Li, Jifan Yu, Linlu Gong, Jinchang Zhou, Zhanxin Hao, Jianxiao Jiang, Jie Cao, Huiqin Liu, Zhiyuan Liu, Lei Hou, Juanzi Li
| Challenge: | Initial studies have focused on task-specific, independent LLM-empowered agents, but the potential of LLMs within a multi-agent collaborative framework for classroom simulation with real user participation remains unexplored. |
| Approach: | They propose a multi-agent classroom simulation teaching framework that recognizes representative class roles and introduces a novel class control mechanism for automatic classroom teaching. |
| Outcome: | The proposed framework can simulate dynamic learning environment for users with active teacher-student and student-studente interactions. |
Transferable End-to-End Aspect-based Sentiment Analysis with Selective Adversarial Learning (D19-1)
Copied to clipboard
| Challenge: | Existing methods to extract aspects and sentiments are limited due to lack of annotated sequence data. |
| Approach: | They propose a Selective Adversarial Learning method to align latent correlation vectors . they propose tagging a set of aspect boundary tags and sentiment tags to create a joint label space . |
| Outcome: | The proposed method can learn weights for words to achieve fine-grained adaptation. |
UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Models (2022.emnlp-main)
Copied to clipboard
Tianbao Xie, Chen Henry Wu, Peng Shi, Ruiqi Zhong, Torsten Scholak, Michihiro Yasunaga, Chien-Sheng Wu, Ming Zhong, Pengcheng Yin, Sida I. Wang, Victor Zhong, Bailin Wang, Chengzu Li, Connor Boyle, Ansong Ni, Ziyu Yao, Dragomir Radev, Caiming Xiong, Lingpeng Kong, Rui Zhang, Noah A. Smith, Luke Zettlemoyer, Tao Yu
| Challenge: | Structured knowledge grounding (SKG) uses structured knowledge to complete user requests . since inputs and outputs of SKG tasks are heterogeneous, they have been studied separately . |
| Approach: | They propose a framework that unifies 21 SKG tasks into a text-to-text format . they use unifiedSKG to benchmark T5 with different sizes . |
| Outcome: | The proposed framework unifies 21 SKG tasks into a text-to-text format . it achieves state-of-the-art performance on almost all of the 21 tasks, the authors show . |
AlignMMBench: Evaluating Chinese Multimodal Alignment in Large Vision-Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks focus on basic abilities using nonverbal methods, such as yes-no and multiple-choice questions. |
| Approach: | They propose a benchmark that provides more nuanced evaluations of alignment capabilities for large Vision-Language Models (VLMs) they use a rule-calibrated evaluator that exceeds GPT-4's evaluation ability and a “alignment score” to assess the robustness and stability of models across diverse prompts. |
| Outcome: | The proposed benchmark covers 13 tasks across three categories and includes both single-turn and multi-turn dialogue scenarios. |
Other Roles Matter! Enhancing Role-Oriented Dialogue Summarization via Role Interactions (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods for role-oriented dialogue summarization ignore information from other roles, resulting in omitted information. |
| Approach: | They propose a novel method that uses cross attention and decoder self-attention interactions to acquire other roles' critical information. |
| Outcome: | The proposed method significantly outperforms baselines on two public role-oriented dialogue summarization datasets. |
TableLLM: Enabling Tabular Data Manipulation by LLMs in Real Office Usage Scenarios (2025.findings-acl)
Copied to clipboard
Xiaokang Zhang, Sijia Luo, Bohan Zhang, Zeyao Ma, Jing Zhang, Yang Li, Guanlin Li, Zijun Yao, Kangli Xu, Jinchang Zhou, Daniel Zhang-Li, Jifan Yu, Shu Zhao, Juanzi Li, Jie Tang
| Challenge: | TableLLM is a robust large language model capable of handling tabular data manipulation tasks. |
| Approach: | They propose a distant supervision method for training which includes a reasoning process extension strategy and a cross-way validation strategy. |
| Outcome: | The proposed model has 8 billion parameters and is capable of handling tabular data tasks. |
Dunhuang-Bench: How Well Do MLLMs Understand Cultural Heritage? (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in Multimodal Large Language Models (MLLMs) have led to extensive evaluations on Chinese cultural benchmarks. |
| Approach: | They construct a large-scale benchmark comprising 486 images and 22,970 QA pairs to evaluate MLLMs' cultural understanding. |
| Outcome: | The proposed benchmark incorporates three task formats to evaluate MLLMs’ cultural understanding: Question Answering with Text Description, Multi-turn Dialogue, and Question Answers with Choices. |
GeoPQA: Bridging the Visual Perception Gap in MLLMs for Geometric Reasoning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Recent advances in reinforcement learning (RL) have enhanced the reasoning abilities of large language models, but the impact on multimodal LLMs is limited. |
| Approach: | They propose a two-stage RL framework that enhances visual perception and fosters reasoning capabilities. |
| Outcome: | The proposed framework improves geometric reasoning by 9.7% and problem-solving by 9.1% compared to direct reasoning training approach. |
ZPR2: Joint Zero Pronoun Recovery and Resolution using Multi-Task Learning and BERT (2020.acl-main)
Copied to clipboard
| Challenge: | Zero pronoun recovery and resolution aim at recovering the dropped pronounce and pointing out its anaphoric mentions. |
| Approach: | They propose to solve two tasks together to recover the dropped pronoun and point out its anaphoric mentions. |
| Outcome: | The proposed model outperforms previous state of the arts benchmarks on two benchmarks. |
Efficient Federated Learning on Knowledge Graphs via Privacy-preserving Relation Embedding Aggregation (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing frameworks that share entity embeddings of knowledge graphs (KGs) would incur a severe privacy leakage. |
| Approach: | They propose a new attack method that aims to recover the original embedding information based on the known entity embeddables of FedE. |
| Outcome: | The proposed framework can be used to infer whether a specific relation exists in a private client. |
Logic-level Evidence Retrieval and Graph-based Verification Network for Table-based Fact Verification (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods leverage programs that contain rich logical information to enhance the verification process. |
| Approach: | They propose a table-based fact verification task as an evidence retrieval framework . they retrieve logic-level program-like evidence from the given table and a statement as supplementary evidence for the table . |
| Outcome: | The proposed method is able to retrieve logic-level program-like evidence from a table and a statement as supplementary evidence for the table. |
Does DetectGPT Fully Utilize Perturbation? Bridging Selective Perturbation to Fine-tuned Contrastive Learning Detector would be Better (2024.acl-long)
Copied to clipboard
Shengchao Liu, Xiaoming Liu, Yichen Wang, Zehua Cheng, Chengzhengxu Li, Zhaohan Zhang, Yu Lan, Chao Shen
| Challenge: | Existing methods to detect MGT from human-written texts are inadequate . existing methods are fine-tuned and zero-shot metric-based, but they can be more accurate. |
| Approach: | They propose a novel fine-tuned detector that can detect MGT from human-written texts by contrastive learning on selective perturbation. |
| Outcome: | The proposed method outperforms the state-of-the-art by 1.20% on four public datasets. |
Self-Training with Differentiable Teacher (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods for self-training are interpreted as teacher-student frameworks, where the teacher generates pseudo-labels and the student makes predictions. |
| Approach: | They propose a differentiable self-training method that treats teacher-student as a Stackelberg game where a leader is always in a more advantageous position than a follower. |
| Outcome: | The proposed model outperforms existing methods on semi- and weakly-supervised learning tasks on semi and weak supervised tasks. |
Exploring Better Text Image Translation with Multimodal Codebook (2023.acl-long)
Copied to clipboard
| Challenge: | Current studies on text image translation face bottlenecks due to lack of a publicly available dataset and poor optical character recognition. |
| Approach: | They propose a text image translation model with a multimodal codebook and an OCR dataset for Chinese-English translation. |
| Outcome: | The proposed model can associate the image with relevant texts, providing useful supplementary information for translation. |
Sparse-to-Dense: A Free Lunch for Lossless Acceleration of Video Understanding in LLMs (2025.acl-short)
Copied to clipboard
| Challenge: | Recent advances in Video Large Language Models (Video-LLMs) have achieved exceptional performance on tasks like video question answering and captioning. |
| Approach: | They propose a decoding strategy that leverages sparse top-K attention and dense full attention to accelerate Video-LLMs without loss. |
| Outcome: | The proposed approach achieves a 1.94 walltime speedup in video processing. |
Few-Shot Class-Incremental Learning for Named Entity Recognition (2022.acl-long)
Copied to clipboard
| Challenge: | Existing models of Named Entity Recognition (NER) are trained on large datasets with predefined entity classes, but data of new classes arrives constantly. Existing work on NER relies on the assumption that there exists abundance of labeled data for the training of new class. |
| Approach: | They propose a few-shot class-incremental learning problem where NER model is trained with only few labeled samples of the new classes without forgetting knowledge of the old ones. |
| Outcome: | The proposed model improves over existing baselines by reconstructing training data of old classes and real data from the training set. |
Unveiling Attractor Cycles in Large Language Models: A Dynamical Systems View of Successive Paraphrasing (2025.acl-long)
Copied to clipboard
| Challenge: | Dynamical systems theory provides a framework for understanding iterative processes and evolution over time. |
| Approach: | They propose to apply this perspective to large language models which iteratively map input text to output text and re-express meaning with linguistic variation. |
| Outcome: | The proposed model reveals that paraphrases re-express meaning with linguistic variation limiting linguistic diversity . |
Internal and External Impacts of Natural Language Processing Papers (2025.acl-short)
Copied to clipboard
| Challenge: | a new study examines the impact of NLP research published in top-tier conferences from 1979 to 2024 . language modeling has the widest internal and external influence, while linguistic foundations have lower impacts . |
| Approach: | They analyze citations from research articles and external sources to determine how NLP topics are consumed internally and externally. |
| Outcome: | The findings show that language modeling has the widest internal and external influence . ethics, bias, and fairness show significant attention in policy documents with fewer academic citations . |
MR-ALIGN: Meta-Reasoning Informed Factuality Alignment for Large Reasoning Models (2026.findings-acl)
Copied to clipboard
Xinming Wang, Jian Xu, Bin Yu, Sheng Lian, yi Chen, Boran Wang, Yingjian Zhu, Hongzhu Yi, Hong-Ming Yang, Han Hu, Cheng-Lin Liu, Xu-Yao Zhang
| Challenge: | Large reasoning models (LRMs) show strong capabilities in complex reasoning, yet their marginal gains on evidence-dependent factual questions are limited. |
| Approach: | They propose a Meta-Reasoning informed alignment framework that quantifies state-transition probabilities along the model’s thinking process and constructs a transition-aware implicit reward that reinforces beneficial reasoning patterns while suppressing defective ones at the atomic thinking segments. |
| Outcome: | Empirical evaluations of four factual QA datasets and one long-form factuality benchmark show that MR-ALIGN consistently improves accuracy and truthfulness while reducing misleading reasoning. |
Document-level Relation Extraction with Dual-tier Heterogeneous Graph (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods focus on extracting relations from single sentence . document-level relation extraction requires a comprehension of the whole document . |
| Approach: | They propose a graph-based model with Dual-tier Heterogeneous Graph (DHG) for document-level relation extraction. |
| Outcome: | The proposed model achieves state-of-the-art performance on two widely used datasets. |
Prompt-Based Rule Discovery and Boosting for Interactive Weakly-Supervised Learning (2022.acl-long)
Copied to clipboard
| Challenge: | Weakly-supervised learning (WSL) has shown promising results in addressing label scarcity on many NLP tasks, but manual designing a comprehensive, high-quality set of labeling rules is tedious and difficult. |
| Approach: | They propose a weakly-supervised learning model that iterates and discovers new labeling rules from data to improve the WSL model. |
| Outcome: | The proposed model outperforms state-of-the-art models on four tasks and bridges the gaps with fully supervised models. |
DPEPO: Diverse Parallel Exploration Policy Optimization for LLM-based Agents (2026.acl-long)
Copied to clipboard
JunShuo Zhang, Chengrui Huang, Feng Guo, Zihan Li, Ke Shi, Menghua Jiang, Jiguo Yu, Shuo Shang, Shen Gao
| Challenge: | Existing approaches to large language model (LLM) agents that follow the sequential "reason-then-act" paradigm suffer from limited exploration and incomplete environmental understanding as they interact with only a single environment per step. |
| Approach: | They propose a paradigm that enables an agent to interact with multiple environments simultaneously and share cross-trajectory experiences. |
| Outcome: | The proposed paradigm achieves state-of-the-art (SOTA) success rates while maintaining comparable efficiency to strong sequential baselines. |
Inter-sentence Context Modeling and Structure-aware Representation Enhancement for Conversational Sentiment Quadruple Extraction (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies struggle to capture complete dialogue semantics due to inadequate inter-utterance modeling and the underutilization of dialogue structure. |
| Approach: | They propose a model to extract dialogue aspect sentiment quadruples from dialogues using a sentence-by-sentence encoding module. |
| Outcome: | The proposed model extracts quadruples of target-aspect-opinion-sentiment from dialogues. |
MA-BERT: Learning Representation by Incorporating Multi-Attribute Knowledge in Transformers (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for incorporating external attribute knowledge into deep neural networks are concatenating multiple attributes to word/text representation or treating them as biases to adjust attention distribution. |
| Approach: | They propose a multi-attribute BERT to incorporate external attribute knowledge into deep neural networks. |
| Outcome: | The proposed method outperforms existing models and models on three benchmark datasets. |
Born a BabyNet with Hierarchical Parental Supervision for End-to-End Text Image Machine Translation (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing research on text image machine translation (TIMT) is divided into two types: Cascade methods combine text image recognition and MT models to recognize source language text images. |
| Approach: | They propose a method which is optimized with hierarchical parental supervision to improve translation performance. |
| Outcome: | The proposed method significantly outperforms existing methods on synthetic and real-world tests on both synthetic and realistic images. |
A Multi-modal Debiasing Model with Dynamical Constraint for Robust Visual Question Answering (2023.findings-acl)
Copied to clipboard
| Challenge: | Recent studies have shown that many well-developed Visual Question Answering systems suffer from bias problem. |
| Approach: | They propose a way to mitigate bias problem by subtracting bias score from standard VQA base score. |
| Outcome: | The proposed method improves on the VQA v2.0 and VQA-CP V2,0 datasets. |
How do Visual Attributes Influence Web Agents? A Comprehensive Evaluation of User Interface Design Factors (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on the effect of environmental variation on web agents have focused on robustness to adversarial attacks with less attention to agents’ preferences in benign scenarios. |
| Approach: | They propose a controlled evaluation pipeline to quantify how visual attributes influence web-agent decision-making by comparing variants and browsing interactions. |
| Outcome: | Extensive experiments on 8 variant families, 5 real-world websites and 4 representative web agents show that background color contrast, item size, position, and card clarity have a strong influence on agents’ actions, whereas font styling, text color, and item image clarity exhibit minor effects. |
Pru-CoT: Towards Efficient Reasoning Distillation via Pruning Chain-of-Thought (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing heuristics fail to capture global causal logic due to rigid rules and limited search spaces. |
| Approach: | They propose a framework that extracts the essential logical structure from reasoning chains. |
| Outcome: | Experiments show that Pru-CoT models generate more compact reasoning paths compared to models trained on verbose data. |
GA-S3: Comprehensive Social Network Simulation with Group Agents (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing social network simulations focus on discrete events or system dynamics instead of elucidating underlying mechanisms or causal relationships. |
| Approach: | They propose a Social network simulation system that leverages newly designed Group Agents to make intelligent decisions regarding various online events. |
| Outcome: | The proposed system can make intelligent decisions regarding online events at a manageable cost. |
MathAgent: Adversarial Evolution of Constraint Graphs for Mathematical Reasoning Data Synthesis (2026.findings-acl)
Copied to clipboard
| Challenge: | Current approaches to synthesising high-quality mathematical reasoning data without human priors suffer from mode collapse and limited logical complexity. |
| Approach: | They propose a hierarchical synthesis framework that formulates data synthesis as an unsupervised optimization problem over a constraint graph followed by semantic instantiation rather than a direct text generation task. |
| Outcome: | The proposed framework outperforms widely-used datasets on eight mathematical benchmarks. |
Improving MLLM’s Document Image Machine Translation via Synchronously Self-reviewing Its OCR Proficiency (2025.findings-acl)
Copied to clipboard
| Challenge: | Multimodal Large Language Models (MLLMs) have shown strong performance in document image tasks, especially Optical Character Recognition (OCR). However, they struggle with Document Image Machine Translation (DIMT), which requires handling both cross-modal and cross-lingual challenges. |
| Approach: | They propose a novel fine-tuning paradigm that allows the model to generate OCR text before producing translation text, which allows it to leverage its strong monolingual OCR ability while learning to translate text across languages. |
| Outcome: | The proposed model can leverage its strong monolingual OCR ability while learning to translate text across languages. |
AceGPT, Localizing Large Language Models in Arabic (2024.naacl-long)
Copied to clipboard
Huang Huang, Fei Yu, Jianqing Zhu, Xuening Sun, Hao Cheng, Song Dingjie, Zhihong Chen, Mosen Alharthi, Bang An, Juncai He, Ziche Liu, Junying Chen, Jianquan Li, Benyou Wang, Lian Zhang, Ruoyu Sun, Xiang Wan, Haizhou Li, Jinchao Xu
| Challenge: | Significant concerns emerge when addressing cultural sensitivity and local values. |
| Approach: | They propose a localized Large Language Model (LLM) specifically for Arabic, a language imbued with unique cultural characteristics inadequately addressed by current mainstream models. |
| Outcome: | The proposed model sets the state-of-the-art standard for open Arabic LLMs across various benchmarks. |
CoLLiE: Collaborative Training of Large Language Models in an Efficient Way (2023.emnlp-demo)
Copied to clipboard
Kai Lv, Shuo Zhang, Tianle Gu, Shuhao Xing, Jiawei Hong, Keyu Chen, Xiaoran Liu, Yuqing Yang, Honglin Guo, Tengxiao Liu, Yu Sun, Qipeng Guo, Hang Yan, Xipeng Qiu
| Challenge: | Large language models (LLMs) are increasingly pivotal in a wide range of tasks . however, the resources required for training these models necessitate efficient solutions . |
| Approach: | They propose a library that facilitates collaborative training of large language models . they use 3D parallelism, parameter-efficient fine-tuning methods and optimizers . |
| Outcome: | The proposed library has proven superior training efficiency in comparison with prevalent solutions in pre-training and fine-tuning scenarios. |
Theorem-Validated Reverse Chain-of-Thought Problem Generation for Geometric Reasoning (2025.emnlp-main)
Copied to clipboard
Deng Linger, Linghao Zhu, Yuliang Liu, Yu Wang, Qunyi Xie, Jingjing Wu, Gang Zhang, Yingying Zhu, Xiang Bai
| Challenge: | Existing methods for generating geometric reasoning data through Chain-of-Thought (CoT) frameworks face three fundamental limitations: 1) lack of high-quality annotations and domain-specific expertise to ensure theorem-grounded diagrams. 2) lack of a coherent model; 3) lack of coherent model. |
| Approach: | They propose a two-stage Theorem-Validated Reverse Chain-of-Thought Reasoning Synthesis framework that synthesizes theorematic diagrams with structured descriptions and properties. |
| Outcome: | The proposed framework expands theorem-type coverage, corrects misunderstandings, and enhances geometric reasoning. |
Inference Compute-Optimal Video Vision Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Using video vision language models, inference costs are often more expensive than finetuning. |
| Approach: | They investigate the optimal allocation of inference compute across three key scaling factors in video vision language models. |
| Outcome: | The proposed model configurations are based on three key scaling factors . the results can be applied to real-world tasks and tasks with fixed inference budgets. |
SQL Injection Jailbreak: A Structural Disaster of Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to jailbreak Large Language Models (LLMs) exploited internal properties or capabilities of the model, such as optimization-based jailbreak methods and methods that leveraged the model’s context-learning abilities. |
| Approach: | They propose a new method which injects jailbreak information into user prompts and induces the model to generate harmful content. |
| Outcome: | The proposed method achieves near 100% success rates on open-source models while incurring lower time costs compared to previous methods. |
SURf: Teaching Large Vision-Language Models to Selectively Utilize Retrieved Information (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on the text modality or are limited to specific tasks. |
| Approach: | They propose a framework to teach Large Vision-Language Models to selectively utilize retrieved information and improve their robustness against irrelevant or misleading references. |
| Outcome: | The proposed framework improves LVLMs’ ability to utilize retrieved multimodal references and their robustness against irrelevant or misleading information. |
Bringing Pedagogy into Focus: Evaluating Virtual Teaching Assistants’ Question-Answering in Asynchronous Learning Environments (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing assessments rely on surface-level metrics and lack sufficient grounding in educational theory . a new framework is proposed to evaluate VTAs in asynchronous learning environments . |
| Approach: | They propose a pedagogically-oriented evaluation framework tailored to asynchronous forum discussions . they construct classifiers using expert annotations of VTA responses on a diverse set of forum posts . |
| Outcome: | The proposed evaluation framework is rooted in learning sciences and tailored to asynchronous forum discussions. |
QAEncoder: Towards Aligned Representation Learning in Question Answering Systems (2025.acl-long)
Copied to clipboard
Zhengren Wang, Qinhan Yu, Shida Wei, Zhiyu Li, Feiyu Xiong, Xiaoxing Wang, Simin Niu, Hao Liang, Wentao Zhang
| Challenge: | Modern QA systems entail retrieval-augmented generation (RAG) for accurate and trustworthy responses, but the inherent gap between user queries and relevant documents hinders precise matching. |
| Approach: | They propose a retrieval-augmented generation (RAG)-based approach to bridge this gap by attaching document fingerprints to the embedding to estimate the expectation of potential queries. |
| Outcome: | Experiments across diverse datasets, languages, and embedding models confirm the proposed solution is simple-yet-effective with zero additional index storage, retrieval latency, training costs, or catastrophic forgetting and hallucination issues. |
Beyond Glass-Box Features: Uncertainty Quantification Enhanced Quality Estimation for Neural Machine Translation (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Quality Estimation (QE) is an essential role in applications of Machine Translation (MT). |
| Approach: | They propose to fuse uncertainty quantification into a pre-trained cross-lingual language model to predict the translation quality. |
| Outcome: | The proposed method achieves state-of-the-art on the datasets of WMT 2020 QE shared task. |
Contrastive Attention Mechanism for Abstractive Sentence Summarization (D19-1)
Copied to clipboard
| Challenge: | Existing attention mechanisms for abstractive sentence summarization are based on rule-based methods and large-scale training corpora. |
| Approach: | They propose a contrastive attention mechanism that extends the sequence-to-sequence framework for abstractive sentence summarization task. |
| Outcome: | The proposed mechanism improves the state-of-the-art on the abstractive sentence summarization task. |
Multi-Modal Generative Adversarial Network for Short Product Title Generation in Mobile E-Commerce (N19-2)
Copied to clipboard
| Challenge: | Existing methods for short product title generation only consider textual information from long titles . MM-GAN incorporates image information and attribute tags from product, as well as textual info from original long titles. |
| Approach: | They propose a multi-modal generative adversarial network for short product title generation in E-commerce . they incorporate image information and attribute tags from product, as well as textual information from original long titles . |
| Outcome: | The proposed model outperforms state-of-the-art methods on a large-scale E-commerce dataset. |
T2R-BENCH: A Benchmark for Real World Table-to-Report Task (2025.emnlp-main)
Copied to clipboard
Jie Zhang, Changzai Pan, Sishi Xiong, Kaiwen Wei, Yu Zhao, Xiangyu Li, Jiaxin Peng, Xiaoyan Gu, Jian Yang, Wenhan Chang, Zhenhe Wu, Jiang Zhong, Shuangyong Song, Xuelong Li
| Challenge: | Existing table benchmarks lack the capacity to adequately assess the practical application of table reasoning in industrial applications. |
| Approach: | They propose a bilingual table-to-report task and a table-based benchmark to assess the quality of table reasoning. |
| Outcome: | The proposed task is based on a bilingual benchmark with 457 industrial tables and evaluation criteria to measure the quality of report generation. |
MMRA: A Benchmark for Evaluating Multi-Granularity and Multi-Image Relational Association Capabilities in Large Visual Language Models (2026.findings-eacl)
Copied to clipboard
Siwei Wu, King Zhu, Yu Bai, Yiming Liang, Yizhi Li, Haoning Wu, Jiaheng Liu, Ruibo Liu, Xingwei Qu, Xuxin Cheng, Ge Zhang, Wenhao Huang, Chenghua Lin
| Challenge: | Current multimodal benchmarks focus on facts within individual images, but neglect associative relations among multiple images. |
| Approach: | They propose a multi-image relational association task and a MMRA benchmark to evaluate LVLMs. |
| Outcome: | The proposed benchmarks show that entity-level multi-image perception tasks pose greater challenges than image-level tasks. |
Source Critical Reinforcement Learning for Transferring Spoken Language Understanding to a New Language (C18-1)
Copied to clipboard
| Challenge: | a study aims to develop a language transferring system to avoid the trouble of acquiring and labeling a new big SLU corpus . general-purpose translators cannot handle the lot of semantic labels, not to mention cultural differences . a RL-based language transfer method can be used to adapt the adapted translator to a target language . |
| Approach: | They propose to use reinforcement learning to adapt a spoken language understanding model to a target language. |
| Outcome: | The proposed language transferring method improves domain classification accuracy by 22% compared with naive translation . the proposed language transfer method can be used on Chinese to English translators with more proper slot tags . |
ConFit v2: Improving Resume-Job Matching using Hypothetical Resume Embedding and Runner-Up Hard-Negative Mining (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to model resume-job fit are sparse since job seekers apply to only a few jobs. |
| Approach: | They propose two techniques to enhance the encoder’s contrastive training process by augmenting job data with hypothetical reference resume generated by a large language model and creating high-quality hard negatives from unlabeled resume/job pairs using a novel hard-negative mining strategy. |
| Outcome: | The proposed method outperforms ConFit and prior methods on two real-world datasets and achieves an average improvement of 13.8% in recall and 17.5% in nDCG across job-ranking and resume-ranker tasks. |
GUI Agents: A Survey (2025.findings-acl)
Copied to clipboard
Dang Nguyen, Jian Chen, Yu Wang, Gang Wu, Namyong Park, Zhengmian Hu, Hanjia Lyu, Junda Wu, Ryan Aponte, Yu Xia, Xintong Li, Jing Shi, Hongjie Chen, Viet Dac Lai, Zhouhang Xie, Sungchul Kim, Ruiyi Zhang, Tong Yu, Mehrab Tanjim, Nesreen K. Ahmed, Puneet Mathur, Seunghyun Yoon, Lina Yao, Branislav Kveton, Jihyung Kil, Thien Huu Nguyen, Trung Bui, Tianyi Zhou, Ryan A. Rossi, Franck Dernoncourt
| Challenge: | Large Foundation Models (LFMs) have transformed the landscape of AI research and day-to-day life. |
| Approach: | They propose a framework that delineates GUI agents' perception, reasoning, planning, and acting capabilities. |
| Outcome: | The proposed framework delineates their perception, reasoning, planning, and acting capabilities. |
PIEClass: Weakly-Supervised Text Classification with Prompting and Noise-Robust Iterative Ensemble Training (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for text classification use label names of target classes as the only supervision. |
| Approach: | They propose a method that uses keyword-based keyword matching to generate pseudo labels . they propose 'pieclass' module that iteratively trains classifiers and updates pseudo labels. |
| Outcome: | The proposed method achieves better performance than existing strong baselines on seven benchmark datasets and similar performance to fully-supervised classifiers on sentiment classification tasks. |
Deep Reinforcement Learning for Chinese Zero Pronoun Resolution (P18-1)
Copied to clipboard
| Challenge: | Recent models for zero pronoun resolution in Chinese are short-sighted and do not capture semantic information for zeros and candidate antecedents. |
| Approach: | They propose to integrate a deep reinforcement learning approach to Chinese zero pronoun resolution. |
| Outcome: | The proposed approach outperforms the state-of-the-art methods in three experimental settings. |
CoT-based Synthesizer: Enhancing LLM Performance through Answer Synthesis (2025.acl-long)
Copied to clipboard
| Challenge: | Existing inference scaling methods rely heavily on the quality of candidate responses . however, they are unable to produce correct answers when all candidates are flawed . |
| Approach: | They propose a CoT-based inference scaling strategy that leverages CoT reasoning to synthesize superior answers by analyzing complementary information from multiple candidate responses. |
| Outcome: | The proposed method improves performance on four benchmark datasets with seven policy models. |
An Inversion Attack Against Obfuscated Embedding Matrix in Language Model Inference (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have explored transforming user inputs to obfuscated embedded vectors, so that the data will not be eavesdropped by service providers. |
| Approach: | They propose to transform user inputs to obfuscated embedded vectors so that the data will not be eavesdropped by service providers. |
| Outcome: | The proposed inversion attack can recover user input 100% from the obfuscated vectors without a solid and deliberate security design and analysis . |
A Silver Bullet or a Compromise for Full Attention? A Comprehensive Study of Gist Token-based Context Compression (2025.acl-long)
Copied to clipboard
| Challenge: | gist-based context compression methods can achieve only slight performance loss on tasks like retrieval-augmented generation and long-document QA, but it faces challenges in tasks like synthetic recall. |
| Approach: | They propose two strategies to improve gist-based context compression in large language models. |
| Outcome: | The proposed methods can achieve only slight performance loss on retrieval-augmented generation and long-document QA tasks, but they face challenges in tasks like synthetic recall. |
AutoSDT: Scaling Data-Driven Discovery Tasks Toward Open Co-Scientists (2025.emnlp-main)
Copied to clipboard
Yifei Li, Hanane Nour Moussa, Ziru Chen, Shijie Chen, Botao Yu, Mingyi Xue, Benjamin Burns, Tzu-Yao Chiu, Vishal Dey, Zitong Lu, Chen Wei, Qianheng Zhang, Tianyu Zhang, Song Gao, Xuhui Huang, Xia Ning, Nesreen K. Ahmed, Ali Payani, Huan Sun
| Challenge: | AutoSDT-5K is the only automatically collected and the largest open dataset for data-driven scientific discovery. |
| Approach: | They propose an automatic pipeline that collects high-quality coding tasks in real-world data-driven discovery workflows. |
| Outcome: | The proposed pipeline synthesizes accurate tasks and tasks from a dataset of 5,404 tasks covering four scientific disciplines and 756 Python packages. |
Takin-VC: Expressive Zero-Shot Voice Conversion via Adaptive Hybrid Content Encoding and Enhanced Timbre Modeling (2025.acl-long)
Copied to clipboard
Yang Yuguang, Yu Pan, Jixun Yao, Xiang Zhang, Jianhao Ye, Hongbin Zhou, Lei Xie, Lei Ma, Jianjun Zhao
| Challenge: | Expressive zero-shot voice conversion (VC) aims to modify source timbre to match unseen speaker . existing zero- shot VC systems struggle to reproduce paralinguistic information in highly expressive speech . |
| Approach: | They propose a framework for expressive zero-shot voice conversion that uses hybrid content encoding and memory-augmented context-aware timbre modeling. |
| Outcome: | The proposed framework surpasses state-of-the-art VC systems in speech naturalness, speaker similarity, and speaker similarness. |
Enhancing Multimodal Continual Instruction Tuning with BranchLoRA (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to fine tune Multimodal Large Language Models (MLLMs) are prone to Catastrophic Forgetting (CF) existing approaches rely on the Mixture-of-Experts (MoE) LoRA framework to preserve previous instruction alignments. |
| Approach: | They propose an asymmetric tuning-freezing mechanism to mitigate parameter inefficiency . branch-specific routers are introduced to ensure optimal branch distribution over time . |
| Outcome: | The proposed framework outperforms existing frameworks on the latest MCIT benchmarks. |
Certified Mitigation of Worst-Case LLM Copyright Infringement (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models are trained on vast datasets that include copyrighted material or content with usage restrictions. |
| Approach: | They propose a "copyright takedown" method that provides certified copyright take down . they use a combination of inference-time and rewriting techniques to transform potentially infringing segments . |
| Outcome: | The proposed method reduces infringement risk, preserves utility, and accommodates different levels of enforcement stringency with adaptive abstention. |
CharacterGLM: Customizing Social Characters with Large Language Models (2024.emnlp-industry)
Copied to clipboard
Jinfeng Zhou, Zhuang Chen, Dazhen Wan, Bosi Wen, Yi Song, Jifan Yu, Yongkang Huang, Pei Ke, Guanqun Bi, Libiao Peng, JiaMing Yang, Xiyao Xiao, Sahand Sabour, Xiaohan Zhang, Wenjing Hou, Yijia Zhang, Yuxiao Dong, Hongning Wang, Jie Tang, Minlie Huang
| Challenge: | Character-based dialogue systems (CharacterDial) allow users to customize social characters for social interactions. |
| Approach: | They will collect a large-scale Chinese corpus of characters with diverse categories and behaviors and develop CharacterGLM models to address these challenges. |
| Outcome: | Experiments show that CharacterGLM outperforms most popular open- and closed-source LLMs and performs comparable to GPT-4. |
VisKoP: Visual Knowledge oriented Programming for Interactive Knowledge Base Question Answering (2023.acl-demo)
Copied to clipboard
Zijun Yao, Yuanyong Chen, Xin Lv, Shulin Cao, Amy Xin, Jifan Yu, Hailong Jin, Jianjun Xu, Peng Zhang, Lei Hou, Juanzi Li
| Challenge: | Existing knowledge base question answering systems that parse natural language questions into knowledge oriented program language (KoPL) . |
| Approach: | They propose a knowledge base question answering system that integrates human into the loop to edit and debug queries. |
| Outcome: | The proposed system can debug and edit knowledge base questions on a million-entity-level . it provides auto-completion for its knowledge base schema and user interaction can fix a large portion of wrong KoPL programs to acquire the correct answer. |
A Unified Encoder-Decoder Framework with Entity Memory (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to index, retrieve, and read documents as evidence suffer from large computational overheads. |
| Approach: | They propose an encoder-decoder framework with an entity memory that stores entity knowledge as latent representations and pre-trained on Wikipedia along with encoder parameters. |
| Outcome: | The proposed framework outperforms memory-based and non-memory encoder-decoder models on various entity-intensive question answering and generation tasks. |
EvoRoute: Experience-Driven Self-Routing LLM Agent Systems (2026.acl-long)
Copied to clipboard
| Challenge: | EvoRoute is a self-evolving model routing paradigm that transcends static, pre-defined model assignments. |
| Approach: | They propose a model routing paradigm that transcends static, pre-defined model assignments. |
| Outcome: | Experiments on GAIA and BrowseComp+ show that EvoRoute reduces execution cost and latency by over 70%. |
Disentangling Task Relations for Few-shot Text Classification via Self-Supervised Hierarchical Task Clustering (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for Few-Shot Text Classification are limited by their global knowledge-shared mechanisms. |
| Approach: | They propose a self-supervised hierarchical task clustering method to address task heterogeneity . they use prior knowledge from historical tasks to leverage prior knowledge . |
| Outcome: | The proposed method can learn a classifier efficiently with few examples . it disentangles the underlying relations between tasks to improve interpretability . |
AQuilt: Weaving Logic and Self-Inspection into Low-Cost, High-Relevance Data Synthesis for Specialist LLMs (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to synthesis large language models often suffer from performance limitations and high computational costs. |
| Approach: | They propose a framework for constructing instruction-tuning data from unlabeled data for any specialized domains from corresponding unlabed data. |
| Outcome: | The proposed framework is comparable to DeepSeek-V3 while utilizing just 17% of the production cost. |
Retrieval-Augmented Process Reward Model for Generalizable Mathematical Reasoning (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have advanced mathematical reasoning, but they still struggle with out-of-distribution (OOD) issues. |
| Approach: | They propose a framework to evaluate the logical validity of reasoning steps . they retrieves semantically similar questions and steps for PRM as a warmup . |
| Outcome: | The proposed framework outperforms baseline models on multiple real-world datasets. |
Few-Shot Multi-Hop Relation Reasoning over Knowledge Bases (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for multi-hop relation reasoning require limited data for each query relation, resulting in limited interpretation. |
| Approach: | They propose a few-shot multi-hop relation learning model that uses reinforcement learning to model sequential steps of multi-hopping reasoning and performs heterogeneous structure encoding and knowledge-aware search space pruning. |
| Outcome: | Empirical results show that the proposed model outperforms state-of-the-art models over few-shot relations. |
Dynamic Semantic Matching and Aggregation Network for Few-shot Intent Detection (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies show that multi-level matching is difficult due to the scarcity of available annotated utterances. |
| Approach: | They propose a method where semantic components are distilled from utterances via multi-head self-attention with additional dynamic regularization constraints. |
| Outcome: | The proposed method improves representations of labeled and unlabeled instances while retaining high-level information. |
Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures inside Arguments (2022.coling-1)
Copied to clipboard
| Challenge: | Recent works of SRL mainly fall into two lines: 1) BIO-based; 2) span-based. |
| Approach: | They propose to regard flat argument spans as latent subtrees, thus reducing SRL to a tree parsing task. |
| Outcome: | The proposed model performs better than previous syntax-agnostic models on CoNLL05 and CoNll12 benchmarks. |
METGEN: A Module-Based Entailment Tree Generation Framework for Answer Explanation (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing work on QA explanation proposes to explain the answers with entailment trees composed of multiple enlargement steps. |
| Approach: | They propose a Module-based Entailment Tree GENeration framework that has multiple modules and a reasoning controller. |
| Outcome: | The proposed framework outperforms state-of-the-art models on the standard benchmark with only 9% of the parameters. |
QAVA: Query-Agnostic Visual Attack to Large Vision-Language Models (2025.naacl-long)
Copied to clipboard
| Challenge: | Currently, large vision-language models are limited in their ability to provide correct answers for multimodal tasks . however, they can still provide correct responses for multiple images associated with a single image . a query-agnostic visual attack (QAVA) provides robust adversarial examples that generate incorrect responses to unspecified and unknown questions. |
| Approach: | They propose a query-agnostic visual attack to create adversarial examples that generate incorrect answers to unspecified and unknown questions. |
| Outcome: | The proposed model improves performance on images when the question is unknown compared to known target questions . |
PathwiseRAG: Multi-Dimensional Exploration and Integration Framework (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing retrieval-augmented generation systems employ rigid retrieval strategies . static retrieval produces knowledge blind spots, missing connections between quantum algorithms and encryption vulnerabilities . |
| Approach: | PathwiseRAG addresses these challenges through intent-aware strategy selection . it constructs a directed acyclic graph of interconnected sub-problems and explores multiple reasoning trajectories . |
| Outcome: | The proposed framework achieves higher accuracy and better reliability than current systems. |
Bidirectional LMs are Better Knowledge Memorizers? A Benchmark for Real-world Knowledge Injection (2026.acl-long)
Copied to clipboard
Yuwei Zhang, Wenhao Yu, Shangbin Feng, Yifan Zhu, Letian Peng, Jayanth Srinivasa, Gaowen Liu, Jingbo Shang
| Challenge: | Existing knowledge injection benchmarks for large language models lack standardized testing grounds. |
| Approach: | They propose a knowledge injection benchmark that leverages recently-added and expert-curated facts from Wikipedia’s “Did You Know...” entries. |
| Outcome: | The proposed framework improves reliability accuracy by 29.1%. |
SpeechT5: Unified-Modal Encoder-Decoder Pre-Training for Spoken Language Processing (2022.acl-long)
Copied to clipboard
Junyi Ao, Rui Wang, Long Zhou, Chengyi Wang, Shuo Ren, Yu Wu, Shujie Liu, Tom Ko, Qing Li, Yu Zhang, Zhihua Wei, Yao Qian, Jinyu Li, Furu Wei
| Challenge: | Existing work shows that pre-trained models can improve in various natural language processing tasks. |
| Approach: | They propose a unified-modal encoder-decoder framework that pre-trains speech-text representations using large-scale unlabeled speech and text data. |
| Outcome: | The proposed framework is superior to existing models on speech-to-text processing tasks. |
CoreCodeBench: Decoupling Code Intelligence via Fine-Grained Repository-Level Tasks (2026.acl-long)
Copied to clipboard
Lingyue Fu, Hao Guan, Bolun Zhang, Haowei Yuan, Yaoming Zhu, Lin Qiu, ZongYu Wang, Xuezhi Cao, Xunliang Cai, Weiwen Liu, Weinan Zhang, Yong Yu
| Challenge: | Existing large language models for software engineering rely on coarse-grained pass rates obscuring specific cognitive bottlenecks. |
| Approach: | They propose a repository-level benchmark that dissects coding capabilities through atomized tasks. |
| Outcome: | The proposed framework achieves a 78.55% validity yield, surpassing the 31.7% retention rate of SWE-bench-Verified. |
Faster and Better LLMs via Latency-Aware Test-Time Scaling (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing research has overlooked the efficiency of TTS from a latency-sensitive perspective. |
| Approach: | They propose two approaches to achieve latency-optimal TTS by branch-wise parallelism and sequence-wise parallelism. |
| Outcome: | The proposed approach achieves latency-optimal TTS for large models . branch-wise parallelism and sequence-wise parallelism are key approaches . |
MM-Verify: Enhancing Multimodal Reasoning with Chain-of-Thought Verification (2025.acl-long)
Copied to clipboard
| Challenge: | MM-Verifier and MM Reasoner are a powerful multimodal reasoning model . large language models (LLMs) have demonstrated exceptional performance across tasks spanning myriad domains. |
| Approach: | They propose a method which combines tree search and verification to generate high-quality chain-of-thought data. |
| Outcome: | The proposed method outperforms all larger models on the MathCheck, MathVista, and MathVerse benchmarks. |
Alternating Recurrent Dialog Model with Large-scale Pre-trained Language Models (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing dialog system models require extensive human annotations and are difficult to generalize to different tasks. |
| Approach: | They propose a framework that uses pre-trained language to model each speaker separately . it can be generalized to more challenging, non-collaborative tasks such as persuasion . |
| Outcome: | The proposed framework outperforms or is on par with state-of-the-art methods on two popular datasets: CamRest676 and MultiWOZ. |
Stand on The Shoulders of Giants: Building JailExpert from Previous Attack Experience (2025.emnlp-main)
Copied to clipboard
Xi Wang, Songlei Jian, Shasha Li, Xiaopeng Li, Bin Ji, Ma Jun, Xiaodong Liu, Jing Wang, Jianfeng Zhang, Jie Yu, Feilong Bao, null Wangbaosheng
| Challenge: | Existing methods to generate human-aligned content with a “jailbreak prompt” are inefficient and repetitive, causing inefficiency and a lack of experience. |
| Approach: | They propose a framework that integrates past attack experiences to aid current jailbreak attempts. |
| Outcome: | The proposed framework improves both attack effectiveness and efficiency compared to the current black-box jailbreak method. |
CaDRL: Document-level Relation Extraction via Context-aware Differentiable Rule Learning (2025.coling-main)
Copied to clipboard
Kunli Zhang, Pengcheng Wu, Bohan Yu, Kejun Wu, Aoze Zheng, Xiyang Huang, Chenkang Zhu, Min Peng, Hongying Zan, Yu Song
| Challenge: | Existing methods for document-level relation extraction (DocRE) lack logic and transparency. |
| Approach: | They propose a Context-aware differentiable rule learning framework that learns the doc-specific logical rule to avoid suboptimal constraints. |
| Outcome: | The proposed framework outperforms existing rule-based frameworks on three DocRE datasets. |
DA-Code: Agent Data Science Code Generation Benchmark for Large Language Models (2024.emnlp-main)
Copied to clipboard
Yiming Huang, Jianwen Luo, Yan Yu, Yitong Zhang, Fangyu Lei, Yifan Wei, Shizhu He, Lifu Huang, Xiao Liu, Jun Zhao, Kang Liu
| Challenge: | DA-Code is a code generation benchmark designed to assess LLMs on agent-based data science tasks. |
| Approach: | They propose a code generation benchmark specifically designed for LLMs on agent-based data science tasks. |
| Outcome: | The benchmark performs better than existing frameworks, but lacks accuracy . it is based on real-world data, and includes examples that cover a wide range of tasks . |
Speaker-Aware Discourse Parsing on Multi-Party Dialogues (2022.coling-1)
Copied to clipboard
| Challenge: | Discourse parsing on multi-party dialogues is an important but difficult task in dialogue systems and conversational analysis. |
| Approach: | They propose a speaker-aware model for parsing on multi-party dialogues using interaction features between different speakers. |
| Outcome: | The proposed model achieves the best-reported performance on two standard benchmark datasets. |
Sparse Growing Transformer: Training-Time Sparse Depth Allocation via Progressive Attention Looping (2026.findings-acl)
Copied to clipboard
Yao Chen, Yilong Chen, Yinqi Yang, Junyuan Shang, Zhenyu Zhang, Zefeng Zhang, Shuaiyi Nie, Shuohuan Wang, Yu Sun, Hua Wu, Haifeng Wang, Tingwen Liu
| Challenge: | Existing approaches to increasing effective depth of LLMs rely on parameter reuse, extending computation through recursive execution. |
| Approach: | They propose a training-time sparse depth allocation framework that progressively increases depth for a small subset of parameters as training evolves. |
| Outcome: | The proposed model outperforms existing approaches to increasing the effective depth of language models while reducing training FLOPs overhead from approximately 16–20% to only 1–3% relative to a standard Transformer backbone. |
Conditional Memory via Scalable Lookup: A New Axis of Sparsity for Large Language Models (2026.acl-long)
Copied to clipboard
Xin Cheng, Wangding Zeng, Damai Dai, Qinyu Chen, Bingxuan Wang, Zhenda Xie, Kezhao Huang, Xingkai Yu, Zhewen Hao, Han Zhang, Yu-Kun Li, Huishuai Zhang, Dongyan Zhao, Wenfeng Liang
| Challenge: | Mixture-of-Experts (MoE) scales capacity via conditional computation, but lacks knowledge lookup primitive. |
| Approach: | They propose a conditional memory instantiated via Deep Sparse Embedding (DSE) they propose 'u-shaped scaling law' that identifies optimal balance between MoE experts and DSE memory . |
| Outcome: | The proposed model outperforms an iso-parameter and isoFLOPs MoE baseline across knowledge and reasoning benchmarks and is infrastructure-efficient. |
MedINST: Meta Dataset of Biomedical Instructions (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Medical data and tasks require extensive preprocessing and standardization for effective use in training LLMs. |
| Approach: | They propose to use MedINST as a meta-dataset to evaluate LLMs' generalization ability. |
| Outcome: | The meta-dataset of biomedical instruction measures the generalization ability of LLMs across multiple open-domain tasks. |
Understanding the Therapeutic Relationship between Counselors and Clients in Online Text-based Counseling using LLMs (2024.findings-emnlp)
Copied to clipboard
| Challenge: | In traditional face-to-face therapy, the assessment of therapeutic alliance is not directly translated to text-based settings. |
| Approach: | They propose an automatic approach to understand the development of therapeutic alliance in text-based counseling by using large language models. |
| Outcome: | The proposed approach demonstrates that the framework is effective in identifying the therapeutic alliance in text-based counseling. |
SecureSQL: Evaluating Data Leakage of Large Language Models as Natural Language Interfaces to Databases (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies on the vulnerability of large language models to SQL injection have been limited. |
| Approach: | They propose to evaluate the potential of language models to leak sensitive data when generating SQL queries. |
| Outcome: | The proposed model with the best performance has an accuracy of 61.7%, compared to humans who achieve 94% accuracy. |
From Chaotic OCR Words to Coherent Document: A Fine-to-Coarse Zoom-Out Network for Complex-Layout Document Image Translation (2025.coling-main)
Copied to clipboard
| Challenge: | Document Image Translation (DIT) aims to translate documents in images from one language to another. |
| Approach: | They propose a novel end-to-end network called Zoom-out DIT to improve document translation by combining word positioning, sentence recognition and document organization. |
| Outcome: | The proposed network improves word positioning, sentence recognition and document organization, and improves translation quality. |
Constructing coherent spatial memory in LLM agents through graph rectification (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to map construction and map repair are limited by context constraints and inconsistencies in text processing environments. |
| Approach: | They propose a framework for LLM-driven construction and map repair . it detects, localizes, and corrects structural inconsistencies in incremental navigation graphs . |
| Outcome: | The proposed method significantly improves map correctness and robustness in entangled or chained inconsistencies. |
When Hearst Is not Enough: Improving Hypernymy Detection from Corpus with Distributional Models (2020.emnlp-main)
Copied to clipboard
| Challenge: | a taxonomy is a semantic hierarchy of words or concepts organized w.r.t. their hypernymy relationships. |
| Approach: | They propose a framework for hypernymy detection using large textual corpora . they quantify the non-negligible existence of specific sparsity cases . |
| Outcome: | The proposed framework quantifies the non-negligible existence of specific sparsity cases on several benchmark datasets. |
ChartAssistant: A Universal Chart Multimodal Language Model via Chart-to-Table Pre-training and Multitask Instruction Tuning (2024.findings-acl)
Copied to clipboard
| Challenge: | Charts are an effective tool for understanding data patterns, but their combination of graphical elements and textual components poses challenges for general-purpose multimodal models. |
| Approach: | They propose a chart-based vision-language model for universal chart comprehension and reasoning that leverages a dataset of chart-related tasks. |
| Outcome: | The proposed model outperforms the state-of-the-art charts with zero-shot setting on various chart tasks. |
OpenUE: An Open Toolkit of Universal Extraction from Text (2020.emnlp-demos)
Copied to clipboard
Ningyu Zhang, Shumin Deng, Zhen Bi, Haiyang Yu, Jiacheng Yang, Mosha Chen, Fei Huang, Wei Zhang, Huajun Chen
| Challenge: | a large number of natural language processing tasks focus on token-level or sentence-level understandings. |
| Approach: | They propose an open-source and extensible toolkit for various extraction tasks . they deploy an online demo with restful APIs to support real-time extraction . |
| Outcome: | The proposed model can be used to extract information from text without training and deployment. |
ChemActor: Enhancing Automated Extraction of Chemical Synthesis Actions with LLM-Generated Data (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for extracting chemical procedures from literature are insufficient and low-quality due to the inherent ambiguity of chemical language and the high cost of human annotation. |
| Approach: | They propose a fully fine-tuned large language model (LLM) as a chemical executor to convert between unstructured experimental procedures and structured action sequences. |
| Outcome: | The proposed model outperforms the baseline model on R2D and D2A tasks by 10%. |
Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on *broadening* the training set with data augmentation techniques to maximize such benefits. |
| Approach: | They propose a method that embeds problem reflection into each training instance. |
| Outcome: | The proposed method enhances performance in standard and complex scenarios that require reflective thinking. |
MedCite: Can Language Models Generate Verifiable Text for Medicine? (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing LLM-based medical question answering systems lack citation generation and evaluation capabilities, raising concerns about their adoption in practice. |
| Approach: | They propose a framework that facilitates the design and evaluation of LLM citations for medical tasks and a retrieval-citation method that generates high-quality citation. |
| Outcome: | The proposed method achieves superior citation precision and recall improvements compared to strong baseline methods and correlates well with annotation results from professional experts. |
RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQL (2022.emnlp-main)
Copied to clipboard
Jiexing Qi, Jingyao Tang, Ziwei He, Xiangpeng Wan, Yu Cheng, Chenghu Zhou, Xinbing Wang, Quanshi Zhang, Zhouhan Lin
| Challenge: | Experimental results show RASAT can leverage a variety of relational structures while inheriting the pretrained parameters from the T5 model. |
| Approach: | They propose a Transformer seq2seq architecture augmented with relation-aware self-attention that leverages relational structures while inheriting pretrained parameters from the T5 model. |
| Outcome: | The proposed model can leverage relational structures while inheriting pretrained parameters from the T5 model effectively. |
EFSA: Towards Event-Level Financial Sentiment Analysis (2024.acl-long)
Copied to clipboard
| Challenge: | a large-scale Chinese dataset contains 12,160 news articles and 13,725 quintuples . a four-hop Chain-of-Thought LLM-based approach is devised for this task . |
| Approach: | They propose to extend financial sentiment analysis to event-level since events usually serve as the subject of the sentiment in financial text. |
| Outcome: | The proposed method can reach the current state-of-the-art on a large-scale Chinese dataset. |
Chain-of-Reasoning: Towards Unified Mathematical Reasoning in Large Language Models via a Multi-Paradigm Perspective (2025.acl-long)
Copied to clipboard
Yiyao Yu, Yuxiang Zhang, Dongdong Zhang, Xiao Liang, Hengyuan Zhang, Xingxing Zhang, Mahmoud Khademi, Hany Hassan Awadalla, Junjie Wang, Yujiu Yang, Furu Wei
| Challenge: | Existing work shows that LLMs rely on single-paradigm reasoning that limits their effectiveness across diverse tasks. |
| Approach: | They propose a new framework that integrates multiple reasoning paradigms to enable synergistic collaboration. |
| Outcome: | The proposed model outperforms current SOTA models in theorem proving tasks and the MATH benchmark in arithmetic tasks. |
CopyNE: Better Contextual ASR by Copying Named Entities (2024.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to transcribe contextual named entities (NEs) treat entities as tokens and generate them token-by-token, which may result in incomplete transcriptions of entities. |
| Approach: | They propose a mechanism that can copy entities from the NE dictionary and reduce errors during entity transcription. |
| Outcome: | The proposed mechanism can copy entities from the NE dictionary, reducing errors during entity transcription, ensuring the completeness of the entity. |
A Survey of Large Language Model-Based Search Agents (2026.acl-long)
Copied to clipboard
Yunjia Xi, Jianghao Lin, Yongzhao Xiao, Zheli Zhou, Rong Shan, Te Gao, Jiachen Zhu, Weiwen Liu, Yong Yu, Weinan Zhang
| Challenge: | Large Language Models (LLMs) have revolutionized web search, but their integration is static and cannot handle complex contexts. |
| Approach: | They analyze existing research and analyze existing work from the perspectives of architecture, optimization, application, and evaluation. |
| Outcome: | The proposed models can comprehend user intentions and context and execute multi-turn retrieval with dynamic planning, extending search capabilities far beyond the web. |
The Law of Knowledge Overshadowing: Towards Understanding, Predicting and Preventing LLM Hallucination (2025.findings-acl)
Copied to clipboard
Yuji Zhang, Sha Li, Cheng Qian, Jiateng Liu, Pengfei Yu, Chi Han, Yi R. Fung, Kathleen McKeown, ChengXiang Zhai, Manling Li, Heng Ji
| Challenge: | Hallucination is a persistent challenge in large language models where even with rigorous quality control, models often generate distorted facts. |
| Approach: | They propose a new framework to quantify factual hallucinations by modeling knowledge overshadowing. |
| Outcome: | The proposed framework improves model factuality on Overshadow (27.9%), MemoTrap (13.1%) and NQ-Swap (18.3%). |
Dense X Retrieval: What Retrieval Granularity Should We Use? (2024.emnlp-main)
Copied to clipboard
| Challenge: | a learned dense retrieval model is often overlooked when using a corpus for inference, resulting in a design choice of retrieval unit . granularity of retrievals is important for both retrieval and downstream tasks . |
| Approach: | They propose a retrieval unit for dense retrieval that uses propositions to index corpus . propositions are defined as atomic expressions within text, each encapsulating a distinct factoid . |
| Outcome: | The proposed retrieval unit outperforms passage-level units on retrieval and downstream tasks. |
A Comprehensive Survey of Process Reward Models: Data Generation, Model Construction, and Usage (2026.acl-long)
Copied to clipboard
Congmin Zheng, Jiachen Zhu, Zhuoying Ou, Yuxiang Chen, Kangning Zhang, Rong Shan, Zeyu Zheng, Mengyue Yang, Jianghao Lin, Yong Yu, Weinan Zhang
| Challenge: | Large Language Models (LLMs) have advanced reasoning ability, yet conventional alignment remains dominated by outcome reward models that judge only final answers. |
| Approach: | They summarize applications across math, code, text, multimodal reasoning, robotics, and agents . goal is to clarify design spaces, reveal open challenges, and guide future research toward fine-grained, robust reasoning alignment. |
| Outcome: | The proposed model enables finer credit assignment, richer diagnostics, and improved robustness. |
CoSQL: A Conversational Text-to-SQL Challenge Towards Cross-Domain Natural Language Interfaces to Databases (D19-1)
Copied to clipboard
Tao Yu, Rui Zhang, Heyang Er, Suyi Li, Eric Xue, Bo Pang, Xi Victoria Lin, Yi Chern Tan, Tianze Shi, Zihan Li, Youxuan Jiang, Michihiro Yasunaga, Sungrok Shim, Tao Chen, Alexander Fabbri, Zifan Li, Luyao Chen, Yuwen Zhang, Shreya Dixit, Vincent Zhang, Caiming Xiong, Richard Socher, Walter Lasecki, Dragomir Radev
| Challenge: | CoSQL is a corpus for building cross-domain, general-purpose database querying dialogue systems. |
| Approach: | They present a corpus for building cross-domain, general-purpose database querying dialogue systems . they use a Wizard-of-Oz collection of 3k turns plus 10k+ annotated SQL queries . |
| Outcome: | The proposed corpus is based on a Wizard-of-Oz dataset of 3k dialogues querying 200 complex DBs spanning 138 domains. |
SeqMix: Augmenting Active Sequence Labeling via Sequence Mixup (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing active sequence labeling methods use the queried samples alone in each iteration, which is inefficient for leveraging human annotations. |
| Approach: | They propose a data augmentation method to augment queried samples by generating extra labeled sequences in each iteration. |
| Outcome: | The proposed method improves the standard active sequence labeling method by 2.27%–3.75% in terms of F1 scores. |
AgenticRAGTracer: A Hop-Aware Benchmark for Diagnosing Multi-Step Retrieval Reasoning in Agentic RAG (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks provide only final questions and answers, while lacking intermediate hop-level questions that gradually connect atomic questions to the final multi-hop query. |
| Approach: | They propose to build a multi-hop reasoning model that is primarily constructed automatically by large language models and designed to support step-by-step validation. |
| Outcome: | The proposed benchmark spans multiple domains, contains 1,305 data points, and has no overlap with existing mainstream benchmarks. |
InImageTrans: Multimodal LLM-based Text Image Machine Translation (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing multimodal large language models suffer from repetition and omission hallucinations when transferred to text image machine translation task. |
| Approach: | They propose an efficient MLLM named InImageTrans for TiMT and a method for advancing it. |
| Outcome: | The proposed method outperforms existing open-source MLLMs on the MCiT benchmark. |
Rethinking the Role of LLMs for Document-level Relation Extraction: a Refiner with Task Distribution and Probability Fusion (2025.naacl-long)
Copied to clipboard
| Challenge: | Document-level relation extraction (DocRE) provides a broad context for extracting relations for entities. |
| Approach: | They propose a method that utilizes LLMs as a refiner and task distribution and probability fusion to refine LLM-based relation extraction methods. |
| Outcome: | The proposed method outperforms existing LLM-based methods without fine-tuning by 25.2% F1. |
CritiQ: Mining Data Quality Criteria from Human Preferences (2025.acl-long)
Copied to clipboard
Honglin Guo, Kai Lv, Qipeng Guo, Tianyi Liang, Zhiheng Xi, Demin Song, Qiuyinzhe Zhang, Yu Sun, Kai Chen, Xipeng Qiu, Tao Gui
| Challenge: | Existing methods to train language models rely on manual design, perplexity, or careful prompt engineering. |
| Approach: | They propose a method that automatically mines criteria from human preferences for data quality with only 30 human-annotated pairs and performs efficient data selection. |
| Outcome: | The proposed method improves on human-annotated test sets and shows high accuracy on code, math, and logic domains. |
Semi-supervised Relation Extraction via Incremental Meta Self-Training (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods suffer from the gradual drift problem, where noisy pseudo labels are incorporated during training. |
| Approach: | They propose a method that uses pseudo labels to assess quality on unlabeled samples . they use a relation label generation network to learn from successful and failed attempts . |
| Outcome: | Experimental results show the proposed method can improve on two public datasets. |
WaveCoder: Widespread And Versatile Enhancement For Code Large Language Models By Instruction Tuning (2024.acl-long)
Copied to clipboard
| Challenge: | Recent work shows that Code Large Language Models can address a wide range of code-related tasks. |
| Approach: | They propose a method to generate widespread and versatile instruction data from open source code datasets and use it to train code-related models. |
| Outcome: | The proposed model outperforms open-source models in generalization ability across code-related tasks. |
Token-level Adaptive Training for Neural Machine Translation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing token imbalance phenomenon in natural language as different tokens appear with different frequencies, which leads to different learning difficulties for tokens in Neural machine translation (NMT). |
| Approach: | They propose to assign tokens with different frequencies to target tokens during training to encourage the model to pay more attention to low-frequency tokens. |
| Outcome: | The proposed model yields consistent improvements on ZH-EN, EN-RO, and EN-DE translation tasks, especially on sentences that contain more low-frequency tokens. |
Contextual Text Style Transfer (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for text style transfer are limited by the lack of parallel data. |
| Approach: | They propose a task to translate a sentence into a desired style with its surrounding context taken into account. |
| Outcome: | The proposed model outperforms state-of-the-art methods across style accuracy, content preservation and contextual consistency metrics. |
MAXS: Meta-Adaptive Exploration with LLM Agents (2026.findings-acl)
Copied to clipboard
Jian Zhang, Zhiyuan Wang, Zhangqi Wang, Yu He, Haoran Luo, li Yuan, Lingling Zhang, Rui Mao, Qika Lin, Jun Liu
| Challenge: | Existing methods for inference are often myopic and have divergent reasoning paths . a meta-adaptive reasoning framework is proposed to improve the efficiency of LLM agents . |
| Approach: | They propose a meta-adaptive reasoning framework that integrates tool execution and reasoning planning. |
| Outcome: | The proposed framework outperforms existing methods in performance and inference efficiency. |
Mixture of insighTful Experts (MoTE): The Synergy of Reasoning Chains and Expert Mixtures in Self-Alignment (2025.acl-long)
Copied to clipboard
Zhili Liu, Yunhao Gou, Kai Chen, Lanqing Hong, Jiahui Gao, Fei Mi, Yu Zhang, Zhenguo Li, Xin Jiang, Qun Liu, James Kwok
| Challenge: | Recent studies show that reasoning abilities contribute significantly to model safety, while integrating Mixture-of-Experts (MoE) architectures can further enhance alignment. |
| Approach: | They propose a framework that synergistically combines reasoning chains and expert mixtures to improve self-alignment. |
| Outcome: | The proposed framework improves model safety, jailbreak resistance, and over-refusal capabilities, achieving performance comparable to OpenAI’s state-of-the-art o1 model. |
Rectifying the Emotional Flow: Aligning Priors and Dynamic Guidance for High-Arousal Text-to-Speech (2026.acl-long)
Copied to clipboard
| Challenge: | Existing systems suffer from linguistic collapse when pursuing high intensity or fail to meet target emotional levels. |
| Approach: | They propose an inference framework that introduces a neutral prosody bias and a uniform Classifier-Free Guidance that distorts the acoustic manifold, leading to artifacts. |
| Outcome: | The proposed framework achieves superior linguistic accuracy and expressiveness without model retraining. |
Aligning Instruction Tasks Unlocks Large Language Models as Zero-Shot Relation Extractors (2023.findings-acl)
Copied to clipboard
| Challenge: | Recent work has shown that fine-tuning large language models on large instruction-following datasets improves their performance on a wide range of NLP tasks, but they fail to outperform small LMs on relation extraction (RE), a fundamental information extraction task. |
| Approach: | They propose a framework that aligns RE with question answering (QA), a predominant task in instruction-tuning datasets. |
| Outcome: | The proposed framework outperforms small LLMs on relation extraction (RE), a fundamental information extraction task, by a large margin. |
BeamLoRA: Beam-Constraint Low-Rank Adaptation (2025.acl-long)
Copied to clipboard
Naibin Gu, Zhenyu Zhang, Xiyu Liu, Peng Fu, Zheng Lin, Shuohuan Wang, Yu Sun, Hua Wu, Weiping Wang, Haifeng Wang
| Challenge: | Low-Rank Adaptation (LoRA) is one of the most efficient parameter-efficient fine-tuning methods. |
| Approach: | They propose to conceptualize each LoRA module as a beam where each rank corresponds to a potential sub-solution. |
| Outcome: | The proposed method improves performance on three base models and 12 datasets. |
HoneyComb: A Flexible LLM-Based Agent System for Materials Science (2024.findings-emnlp)
Copied to clipboard
| Challenge: | specialized large language models (LLMs) have shown promise in materials science but often struggle with the distinct complexities of materials science tasks. |
| Approach: | They propose a new LLM-based agent system specifically designed for materials science that leverages a reliable materials science knowledge base and a sophisticated tool hub. |
| Outcome: | The proposed system outperforms baseline models across tasks in materials science while ensuring accuracy and relevance. |
Robust Singing Voice Transcription Serves Synthesis (2024.acl-long)
Copied to clipboard
| Challenge: | Current AST methods struggle with accuracy and robustness when used for practical annotation. |
| Approach: | They propose a model that converts singing recordings into note sequences for automatic annotation of singing datasets. |
| Outcome: | The proposed model outperforms baseline models on enlarged, automatically annotated datasets. |
Anchoring the Cache: Mitigating Contextual Hallucination in KV-Compressed Long-Context Summarization (2026.acl-long)
Copied to clipboard
| Challenge: | Recent studies show that KV cache compression can increase hallucination scores in LLMs . modern LLM models support extremely long sequences, but their impact on model hallucinosity remains underexplored. |
| Approach: | They propose a decoding-phase strategy that selectively removes generated KV pairs from retrieval heads responsible for retrieving critical information from source context. |
| Outcome: | The proposed method reduces hallucination across multiple models and datasets while preserving computational efficiency. |
Cross-lingual Terminology Extraction for Translation Quality Estimation (L18-1)
Copied to clipboard
| Challenge: | Using common statistical measures for termhood and unithood, we identify terms from monolingual texts and investigate the contribution of terminology to translation quality. |
| Approach: | They propose to use common statistical measures for termhood and unithood as features to train classifiers for identifying terms in cross-domain and cross-language settings. |
| Outcome: | The proposed method has shown some reliability in automatically identifying terms in human translations, but drawbacks in handling low frequency terms and term variations shall be dealt with in the future. |
Calibrating Verbal Uncertainty as a Linear Feature to Reduce Hallucinations (2025.emnlp-main)
Copied to clipboard
Ziwei Ji, Lei Yu, Yeskendir Koishekenov, Yejin Bang, Anthony Hartshorn, Alan Schelten, Cheng Zhang, Pascale Fung, Nicola Cancedda
| Challenge: | LLMs often use assertive language when making false claims, resulting in harm and loss of trust. |
| Approach: | They find that a mismatch between semantic and verbal uncertainty is a better predictor of hallucinations than semantic uncertainty alone. |
| Outcome: | a new study shows that mismatch between semantic and verbal uncertainty is better predictor of hallucinations than semantic uncertainty alone. |
Knowledge-aware Pronoun Coreference Resolution (P19-1)
Copied to clipboard
| Challenge: | Existing models for pronoun coreference resolution only use triplets, the most common format for knowledge graphs. |
| Approach: | They propose a model that leverages different types of knowledge to resolve pronoun coreference with a neural model. |
| Outcome: | The proposed model outperforms state-of-the-art baselines on two datasets from different domains. |
LocalTweets to LocalHealth: A Mental Health Surveillance Framework Based on Twitter Data (2024.lrec-main)
Copied to clipboard
| Challenge: | Prior research on Twitter has provided positive evidence of its utility in developing supplementary health surveillance systems. |
| Approach: | They propose a framework to surveil public health, focusing on mental health outcomes by using tweets from 765 neighborhoods in the USA. |
| Outcome: | The proposed framework achieves the highest F1-score and accuracy over the previous framework, and extrapolates CDC’s estimates to proxy unreported neighborhoods. |
Incorporating Object-Level Visual Context for Multimodal Fine-Grained Entity Typing (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Experimental results show that fine-grained entity typing is superior to text-based methods. |
| Approach: | They propose a task called fine-grained entity typing to classify entities . they propose combining textual and visual contexts to capture fine-granular semantic information . |
| Outcome: | The proposed approach achieves superior classification performance compared to previous text-based approaches. |
Video-aided Unsupervised Grammar Induction (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing methods of multi-modal grammar induction focus on grammar inducing from text-image pairs, but videos provide even richer information, such as static objects and actions. |
| Approach: | They propose a video-aided grammar induction model which learns a constituency parser from unlabeled text and its corresponding video. |
| Outcome: | The proposed model outperforms existing systems on three benchmarks. |
Interactively-Propagative Attention Learning for Implicit Discourse Relation Recognition (2020.coling-main)
Copied to clipboard
| Challenge: | Existing models for discourse relation recognition use self-attention and interactive-attention mechanisms. |
| Approach: | They develop a propagative attention learning model using a cross-coupled two-channel network. |
| Outcome: | The proposed model improves on the baseline models on a Penn Discourse Treebank. |
A Pretraining Numerical Reasoning Model for Ordinal Constrained Question Answering on Knowledge Base (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing knowledge bases (KBs) can explicitly facilitate the QA process. |
| Approach: | They propose a numerical reasoning model pretraining NumGNN and NumTransformer, guided by explicit self-supervision signals, to enhance numerical reasoning ability for IR-based KBQA models. |
| Outcome: | Extensive experiments on two KBQA benchmarks confirm the effectiveness of the proposed model. |
Scaling Behaviors of LLM Reinforcement Learning Post-Training: An Empirical Study in Mathematical Reasoning (2026.acl-long)
Copied to clipboard
Zelin Tan, Hejia Geng, Xiaohang Yu, Mulei Zhang, Guancheng Wan, Yifan Zhou, Qiang He, Xiangyuan Xue, Heng Zhou, Yutao Fan, Zhong-Zhi Li, Zaibin Zhang, Guibin Zhang, Chen Zhang, Zhenfei Yin, Philip Torr, Lei Bai
| Challenge: | elucidating scaling laws for large language models (LLMs) during pre-training remains unexplored. |
| Approach: | They characterize how model scale, data, and compute interact during pre-training . they find that large models consistently demonstrate superior compute and data efficiency . |
| Outcome: | The proposed scaling laws offer practical guidance for scaling reasoning capabilities through reinforcement learning post-training. |
MM-LLMs: Recent Advances in MultiModal Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | MultiModal Large Language Models (MM-LLMs) have undergone significant advances in the past year . traditional MM models incur substantial computational costs, especially when trained from scratch . |
| Approach: | They propose a taxonomy encompassing 126 MM-LLMs and summarize key training recipes to enhance their potency. |
| Outcome: | The proposed models preserve the reasoning and decision-making capabilities of LLMs and empower diverse range of MM tasks. |
MemPO: Self-Memory Policy Optimization for Long-Horizon Agents (2026.findings-acl)
Copied to clipboard
Ruoran Li, Xinghua Zhang, Haiyang Yu, Shitong Duan, Xiang Li, Wenxin Xiang, Chonghua Liao, Xudong Guo, Yongbin Li, Jinli Suo
| Challenge: | Existing methods for long-horizon agents introduce the external memory module and look up the relevant information from the stored memory, which prevents the model from proactively managing its memory content and aligning with the agent’s overarching task objectives. |
| Approach: | They propose an algorithm which enables agents to autonomously manage their memory during interaction with environment and selectively retain crucial information. |
| Outcome: | Extensive experiments show that the proposed algorithm achieves absolute F1 score gains of 25.98 over the base model and 7.1 over the previous SOTA baseline while preserving task performance. |
ERNIE-Gram: Pre-Training with Explicitly N-Gram Masked Language Modeling for Natural Language Understanding (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing methods to model coarse-grained linguistic information do not integrate coarse-gram information into pre-training. |
| Approach: | They propose an explicitly n-gram masking method to enhance integration of coarse-grained linguistic information into pre-training. |
| Outcome: | The proposed method outperforms existing models on English and Chinese text corpora and fine-tunes on 19 downstream tasks. |
Code-Switching for Enhancing NMT with Pre-Specified Translation (N19-1)
Copied to clipboard
| Challenge: | Existing methods to constrain NMT use placeholder tags for lexicon words and hard constraints during decoding. |
| Approach: | They propose to use placeholder tags to replace lexicon words with target translations . they use a data augmentation method to make code-switched training data . |
| Outcome: | The proposed method improves translation quality without hurting unconstrained words. |
QualiSpeech: A Speech Quality Assessment Dataset with Natural Language Reasoning and Descriptions (2025.acl-long)
Copied to clipboard
Siyin Wang, Wenyi Yu, Xianzhao Chen, Xiaohai Tian, Jun Zhang, Lu Lu, Yu Tsao, Junichi Yamagishi, Yuxuan Wang, Chao Zhang
| Challenge: | Existing datasets lack comprehensive annotations for speech quality assessment . existing methods lack detailed annotations, resulting in inaccurate evaluations. |
| Approach: | They propose a low-level speech quality assessment dataset incorporating natural language descriptions and a Benchmark to evaluate low- level speech understanding capabilities of auditory large language models. |
| Outcome: | The proposed model can be used to evaluate the low-level speech understanding capabilities of auditory large language models. |
When Personalization Misleads: Understanding and Mitigating Hallucinations in Personalized LLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Personalization can inadvertently distort factual reasoning when faced with factual queries. |
| Approach: | They propose a lightweight inference-time approach that mitigates personalization-induced factual distortions while preserving personalized behavior. |
| Outcome: | Experiments across multiple LLM backbones and personalization methods show that FPPS significantly improves factual accuracy while maintaining personalized performance. |
Root Defense Strategies: Ensuring Safety of LLM at the Decoding Level (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods to detect harmful outputs from prefill-level lacks utilization of the model’s decoding outputs, leading to relatively lower effectiveness and robustness. |
| Approach: | They propose a robust decoding mechanism that corrects harmful queries directly rather than rejecting them outright. |
| Outcome: | The proposed model improves model security without compromising reasoning speed. |
Marco-o1 v2: Towards Widening The Distillation Bottleneck for Reasoning Models (2025.acl-long)
Copied to clipboard
Huifeng Yin, Yu Zhao, Minghao Wu, Xuanfan Ni, Bo Zeng, Huaiyu.wh Huaiyu.wh, Tianqi Shi, Liangying Shao, Chenyang Lyu, Longyue Wang, Weihua Luo, Kaifu Zhang
| Challenge: | Recent efforts to distill large reasoning models into smaller lightweight models have shown competitive performances. |
| Approach: | They propose to distill long Chain-of-Thought data to improve SFT and RL methods by constructing data from scratch using Monte Carlo Tree Search. |
| Outcome: | The proposed method significantly improves reasoning performance on various benchmarks such as math (GSM8K, MATH, AIME). |
Similarity = Value? Consultation Value-Assessment and Alignment for Personalized Search (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods rely on semantic similarity to align historical consultations with current queries due to the absence of ‘value’ labels, but this lacks exploration of needs in user consultations. |
| Approach: | They propose a consultation value assessment framework that evaluates historical consultations from three novel perspectives: (1) Scenario Scope Value, (2) Posterior Action Value, and (3) Time Decay Value. |
| Outcome: | The proposed model outperforms baselines on public and commercial datasets on both retrieval and ranking tasks. |
CultureBank: An Online Community-Driven Knowledge Base Towards Culturally Aware Language Technologies (2024.findings-emnlp)
Copied to clipboard
| Challenge: | CultureBank is a knowledge base built upon users’ self-narratives with 12K cultural descriptors sourced from TikTok and 11K from Reddit. |
| Approach: | They construct a pipeline to construct cultural knowledge bases from different online communities on a massive scale. |
| Outcome: | The proposed pipeline improves cultural awareness of language models by evaluating them on two cultural tasks in a zero-shot setting. |
Few-shot Intent Classification and Slot Filling with Retrieved Examples (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing methods for few-shot learning are based on labeled examples, but they are non-trivial . few-sshot learning is challenging due to the imbalance in the amount of data between the source and target domains. |
| Approach: | They propose retrieval-based methods for intent classification and slot filling tasks . they use a batch-softmax objective to learn similar contextualized representations for spans . |
| Outcome: | The proposed method outperforms previous systems on the CLINC and SNIPS benchmarks. |
Federated Domain Adaptation for Named Entity Recognition via Distilling with Heterogeneous Tag Sets (2023.findings-acl)
Copied to clipboard
| Challenge: | a federated domain adaptation approach is used to learn with NER datasets from multiple platforms while not violating data privacy. |
| Approach: | They propose to use a distillation approach to facilitate knowledge transfer across platforms. |
| Outcome: | The proposed model performs better in the clinic domain. |
ProLex: A Benchmark for Language Proficiency-oriented Lexical Substitution (2024.findings-acl)
Copied to clipboard
| Challenge: | Lexical Substitution fails to consider substitutes of equal or higher proficiency than the target word. |
| Approach: | They propose a task to find appropriate substitutes for a given word in a context sentence but not those that are of equal or higher proficiency than the target. |
| Outcome: | The proposed model outperforms ChatGPT by an average of 3.2% in F-score and achieves comparable results with GPT-4 on ProLex. |
Sparse Frame Grouping Network with Action Centered for Untrimmed Video Paragraph Captioning (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for paragraph captioning videos without event ground truths generate one sentence for each event, but without event labels, it is difficult to locate the transitions between events and minimize repetition. |
| Approach: | They propose a module that dynamically groups event information with the help of action information for the entire video and excludes redundant frames within pre-defined clips. |
| Outcome: | The proposed module outperforms the state-of-the-art methods on all metrics. |
HopRAG: Multi-Hop Reasoning for Logic-Aware Retrieval-Augmented Generation (2025.findings-acl)
Copied to clipboard
| Challenge: | Traditional retrieval systems focus on lexical or semantic similarity rather than logical relevance. |
| Approach: | They propose a new RAG framework that augments retrieval with logical reasoning . hopRAG uses a retrieve-reason-prune mechanism to explore multi-hop neighbors . |
| Outcome: | The proposed framework outperforms conventional retrieval systems and state-of-the-art benchmarks on multi-hop QA tasks. |
Zero-shot User Intent Detection via Capsule Neural Networks (D18-1)
Copied to clipboard
| Challenge: | Existing methods to classify intents are labor-intensive and time-consuming as intents will be diverse and new intents may be involved. |
| Approach: | They propose a zero-shot intent detection problem which aims to detect emerging user intents where no labeled utterances are currently available. |
| Outcome: | The proposed model can discriminate emerging intents when no labeled utterances are available in training data. |
Explanation-aware Soft Ensemble Empowers Large Language Model In-context Learning (2024.acl-long)
Copied to clipboard
Yue Yu, Jiaming Shen, Tianqi Liu, Zhen Qin, Jing Nathan Yan, Jialu Liu, Chao Zhang, Michael Bendersky
| Challenge: | Recent advances in natural language processing (NLP) have witnessed the remarkable capabilities of Large Language Models (LLMs). |
| Approach: | They propose an Explanation-Aware Soft Ensemble framework to empower in-context learning with Large language models. |
| Outcome: | The proposed framework can be used to enhance in-context learning on seven natural language understanding tasks and four varying-size LLMs. |
Chatbot To Help Patients Understand Their Health (2025.findings-emnlp)
Copied to clipboard
Won Seok Jang, Hieu Tran, Manav Shaileshkumar Mistry, Sai Kiran Gandluri, Yifan Zhang, Sharmin Sultana, Sunjae Kwon, Yuan Zhang, Zonghai Yao, Hong Yu
| Challenge: | NoteAid-Chatbot is a conversational AI designed to help patients better understand their health . |
| Approach: | They propose a new learning paradigm that leverages a multi-agent large language model and reinforcement learning framework without relying on costly human-generated training data. |
| Outcome: | The proposed framework surpasses non-expert human training methods. |
Task Compass: Scaling Multi-task Pre-training with Task Prefix (2022.findings-emnlp)
Copied to clipboard
Zhuosheng Zhang, Shuohang Wang, Yichong Xu, Yuwei Fang, Wenhao Yu, Yang Liu, Hai Zhao, Chenguang Zhu, Michael Zeng
| Challenge: | Existing studies show that multi-task learning with large-scale supervised tasks suffers from negative effects across tasks. |
| Approach: | They propose a task prefix guided multi-task pre-training framework to explore the relationships among tasks. |
| Outcome: | The proposed model can be used as a foundation backbone for a wide range of tasks and as augmentation tool for data augmentation with complementary tasks. |
AdvancedIF: Rubric-Based Benchmarking and Reinforcement Learning for Advancing LLM Instruction Following (2026.acl-long)
Copied to clipboard
Yun He, Wenzhe Li, Hejia Zhang, Songlin Li, Karishma Mandyam, Sopan Khosla, Yuanhao Xiong, Nanshu Wang, Xiaoliang Peng, Beibin Li, Shengjie Bi, Shishir G Patil, Qi Qi, Shengyu Feng, Julian Katz-Samuels, Richard Yuanzhe Pang, Sujan Kumar Gonugondla, Hunter Lang, Yue Yu, Yundi Qian, Maryam Fazel-Zarandi, Licheng Yu, Amine Benhalloum, Hany Hassan Awadalla, Manaal Faruqui
| Challenge: | Recent advances in large language models (LLMs) have shown impressive performance on a range of tasks, yet advanced instruction following (IF) remains a significant challenge. |
| Approach: | They propose a benchmark that features over 1,600 prompts and expert-curated rubrics that assess LLMs’ ability to follow complex, multi-turn, and system-level instructions. |
| Outcome: | The proposed framework improves instruction-following abilities of large language models, achieving a 6.7% gain on AdvancedIF and strong results on public benchmarks. |
PIVOINE: Instruction Tuning for Open-world Entity Profiling (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for information extraction focus on a closed-world setting, but PIVOINE is a promising solution to tackle the open-world problem of entity profiling. |
| Approach: | They propose to develop an LLM that performs Open-world Entity Profiling with instruction tuning to extract desirable entity profiles . they construct INSTRUCTOPENWIKI, a substantial instruction-tuning dataset for Open-World Entity Profiles . |
| Outcome: | The proposed model outperforms existing methods and ChatGPT-based baselines on unseen and out-of-ontology cases. |
MDS: A Fine-Grained Dataset for Multi-Modal Dialogue Summarization (2024.lrec-main)
Copied to clipboard
| Challenge: | Summarizing the dialogue into a short message has drawn much attention due to the explosion of various dialogue scenes. |
| Approach: | They develop a multi-modal dialogue summarization dataset to enhance the variety of data available for this research area. |
| Outcome: | The proposed dataset provides a demanding testbed for multi-modal dialogue summarization. |
LlmFixer: Fix the Helpfulness of Defensive Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Several defense strategies have been introduced to defend against jailbreak attacks, but these strategies weakened the usefulness of large language models. |
| Approach: | They propose a framework that acts on large language models equipped with any defense strategy to recover their usefulness. |
| Outcome: | The proposed framework can be used on large language models to recover their usefulness without updating the parameters of a defensive large language model. |
LLMs Can Also Do Well! Breaking Barriers in Semantic Role Labeling via Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Semantic role labeling (SRL) is a crucial task of natural language processing (NLP). |
| Approach: | They propose to equip LLMs with retrieval-augmented generation and self-correction mechanisms to enable SRL to perform better in Chinese and English. |
| Outcome: | The proposed method achieves state-of-the-art in Chinese and English on three widely-used benchmarks. |
TypeSQL: Knowledge-Based Type-Aware Neural Text-to-SQL Generation (N18-2)
Copied to clipboard
| Challenge: | Existing systems that can understand natural language questions and generate corresponding SQL queries are not able to do this. |
| Approach: | They propose a novel approach which formats the problem as a slot filling task in a more reasonable way and utilizes type information to better understand rare entities and numbers in the questions. |
| Outcome: | The proposed approach outperforms the prior art on the WikiSQL dataset and can reach 82.6% accuracy, a 17.5% improvement compared to the previous content-sensitive model. |
Easy Guided Decoding in Providing Suggestions for Interactive Machine Translation (2023.acl-long)
Copied to clipboard
| Challenge: | In order to improve translation efficiency, human translators perform post-editing on machine translations to correct errors. |
| Approach: | They propose to use the parameterized objective function of neural machine translation to deal with the TS problem without additional training. |
| Outcome: | The proposed method improves translation quality by 10.6 BLEU and reduces time overhead by 63.4% on benchmark datasets. |
Are LLMs Rational Investors? A Study on the Financial Bias in LLMs (2025.findings-acl)
Copied to clipboard
Yuhang Zhou, Yuchen Ni, Zhiheng Xi, Zhangyue Yin, Yu He, Gan Yunhui, Xiang Liu, Zhang Jian, Sen Liu, Xipeng Qiu, Yixin Cao, Guangnan Ye, Hongfeng Chai
| Challenge: | Existing studies on biases within specific domains, such as finance, remain limited. |
| Approach: | They propose a framework to detect, detect, analyze and mitigate financial biases in large language models. |
| Outcome: | The proposed framework reduces bias by 68% for the most biased model, according to key metrics. |
CLIP-MoE: Towards Building Mixture of Experts for CLIP with Diversified Multiplet Upcycling (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies found that CLIP can only encode one aspect of the feature space, leading to substantial information loss and indistinctive features. |
| Approach: | They propose a model-agnostic approach that fine-tunes complementary CLIP models and transforms them into a CLIP-MoE. |
| Outcome: | The proposed framework fine-tunes a series of complementary CLIP models and transforms them into a CLIP-MoE. |
A Study on the Calibration of In-context Learning (2024.naacl-long)
Copied to clipboard
Hanlin Zhang, YiFan Zhang, Yaodong Yu, Dhruv Madeka, Dean Foster, Eric Xing, Himabindu Lakkaraju, Sham Kakade
| Challenge: | Prior research has demonstrated improvements in the calibration of language models (LMs) in-context learning is a popular method for adapting static LMs to safety-critical domains. |
| Approach: | They use in-context learning to adapt static language models through tailored prompts to a wide range of tasks and find that miscalibration occurs in low-shot settings. |
| Outcome: | The proposed calibrations show that models exhibit increased miscalibration before achieving better calibration in low-shot settings. |
Flexible Weight Tuning and Weight Fusion Strategies for Continual Named Entity Recognition (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for Named Entity Recognition (CNER) use knowledge distillation to retain old knowledge, but they are too expensive and fail to integrate with existing state-of-the-art models. |
| Approach: | They propose a weight tuning and weightfusion strategy to learn new entity types while mitigating catastrophic forgetting of old models. |
| Outcome: | The proposed strategies improve the performance of existing models and are model-agnostic. |
QA-Driven Zero-shot Slot Filling with Weak Supervision Pretraining (2021.acl-short)
Copied to clipboard
| Challenge: | Existing methods to predict slots and their values do not encode enough semantic information, limiting the models’ zero-shot capability. |
| Approach: | They propose a QA-driven slot filling model which extracts slot-filler spans from utterances with a span-based QA model. |
| Outcome: | The proposed model outperforms baselines by over 5% on the SNIPS benchmark. |
AI4Reading: Chinese Audiobook Interpretation System Based on Multi-Agent Collaboration (2025.acl-demo)
Copied to clipboard
| Challenge: | Interpretative audiobooks are becoming more popular, but their manual creation process remains time-consuming and resource-intensive. |
| Approach: | They propose a multi-agent collaboration system that leverages large language models and speech synthesis technology to generate podcast-like audiobook interpretations. |
| Outcome: | The proposed system is open source and open to the public. |
Unsolvable Problem Detection: Robust Understanding Evaluation for Large Multimodal Models (2025.acl-long)
Copied to clipboard
Atsuyuki Miyai, Jingkang Yang, Jingyang Zhang, Yifei Ming, Qing Yu, Go Irie, Yixuan Li, Hai Helen Li, Ziwei Liu, Kiyoharu Aizawa
| Challenge: | Multiple-choice question answering (MCQA) is widely used to assess the understanding capability of Large Multimodal Models (LMMs). |
| Approach: | They propose a task to evaluate the robust understanding capability of Large Multimodal Models (LMMs) they introduce a benchmark to assess performance across various ability dimensions . |
| Outcome: | The proposed model can withhold answers when encountering unsolvable problems of MCQA, proving it understands the answer. |
Continual Named Entity Recognition without Catastrophic Forgetting (2023.emnlp-main)
Copied to clipboard
| Challenge: | Named Entity Recognition (CNER) is a burgeoning area of research . a new paradigm has ushered NER into a non-entity type at the current step t . |
| Approach: | They propose a pooled feature distillation loss that skillfully navigates the trade-off between retaining knowledge of old entity types and acquiring new ones. |
| Outcome: | The proposed method outperforms state-of-the-art approaches on ten CNER settings using three datasets. |
Revisiting Audio-language Pretraining for Learning General-purpose Audio Representation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for learning general-purpose audio representations are limited in scope and coverage of audio attributes. |
| Approach: | They propose to use a 10.7M caption dataset to compare ALP with captioning . they find that contrastive learning yields competitive, transferable representations . |
| Outcome: | The proposed model yields competitive, transferable representations, while captioning exhibits better scalability. |
When Agents Look the Same: Quantifying Distillation-Induced Similarity in Tool-Use Behaviors (2026.acl-long)
Copied to clipboard
| Challenge: | Existing metrics fail to distinguish mandatory behaviors required for task success from non-mandatory patterns that reflect a model’s autonomous preferences. |
| Approach: | They propose to use response pattern similarity and action graph similarity to isolate non-mandatory behaviors from mandatory behaviors. |
| Outcome: | Evaluating 18 models from 8 providers on -Bench and 2-Bench against Claude Sonnet 4.5, the authors find that within-family model pairs score 5.9 pp higher in response pattern similarity and action graph similarity . |
LMOD: A Large Multimodal Ophthalmology Dataset and Benchmark for Large Vision-Language Models (2025.findings-naacl)
Copied to clipboard
Zhenyue Qin, Yu Yin, Dylan Campbell, Xuansheng Wu, Ke Zou, Ninghao Liu, Yih Chung Tham, Xiuzhen Zhang, Qingyu Chen
| Challenge: | Existing benchmarks for large vision-language models (LVLMs) are limited to ophthalmology-specific applications. |
| Approach: | They introduce a large-scale multimodal ophthalmology benchmark consisting of 21,993 instances across five ocular imaging modalities and 13 state-of-the-art LVLM representatives from closed-source, open-source and medical domains. |
| Outcome: | The proposed model shows significant performance drop in ophthalmology compared to other domains. |
Abstraction-of-Thought Makes Language Models Better Reasoners (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Abstract reasoning is a key to generalization in human reasoning, but eliciting language models to perform reasoning with abstraction remains unexplored. |
| Approach: | They propose a new structured reasoning format called Abstraction-of-Thought (AoT) this approach elicits language models to first contemplate on the abstract level before incorporating concrete details . |
| Outcome: | The proposed model outperforms the prevailing Chain-of-Thought (CoT) reasoning on 23 unseen tasks. |
Deep Research with Open-Domain Evaluation and Multi-Stage Guardrails for Safety (2026.acl-long)
Copied to clipboard
Wei-Chieh Huang, Henry Peng Zou, Yaozu Wu, Dongyuan Li, Yankai Chen, Weizhi Zhang, Yangning Li, Angelo Zangari, Jizhou Guo, Chunyu Miao, Liancheng Fang, Langzhou He, Yinghui Li, Renhe Jiang, Philip S. Yu
| Challenge: | Existing deep research frameworks lack adequate evaluation procedures and stage-specific protections. |
| Approach: | They propose a framework with open-domain evaluation and a stage-wise safety benchmark to address this oversight. |
| Outcome: | The proposed framework improves defense success rates by 16.53% while reducing over-refusal rates to approximately 6%. |
Learn to Combine Linguistic and Symbolic Information for Table-based Fact Verification (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for fact verification lack attention to combine linguistic and symbolic information. |
| Approach: | They propose a graph-based reasoning approach that learns to combine linguistic and symbolic information effectively. |
| Outcome: | The proposed method can combine linguistic and symbolic information effectively. |
MZET: Memory Augmented Zero-Shot Fine-grained Named Entity Typing (2020.coling-main)
Copied to clipboard
| Challenge: | Named entity typing (NET) is a classification task of assigning an entity mention in the context with given semantic types. |
| Approach: | They propose a memory-augmented FNET model to tackle unseen types in a zero-shot manner. |
| Outcome: | The proposed model outperforms the state-of-the-art models with up to 8% gain in Micro-F1 and Macro-F1. |
ARGUS: Policy-Adaptive Ad Governance via Evolving Reinforcement with Adversarial Umpiring (2026.acl-industry)
Copied to clipboard
Deyi Ji, Junyu Lu, Xuanyi Liu, Liqun Liu, Hailong Zhang, Peng Shu, Huan Yu, Jie Jiang, Tianrun Chen, Lanyun Zhu
| Challenge: | Existing regulatory policies create label inconsistencies and reasoning ambiguities in historical datasets. |
| Approach: | They propose a policy-adaptive governance system that enables evolving reinforcement through multi-agent adversarial umpiring. |
| Outcome: | The proposed system outperforms fine-tuning baselines on industrial and public datasets . it enables evolving reinforcement through multi-agent adversarial umpiring . |
The Digital Dunning-Kruger Effect: Decoupling Hallucinations via Geometric Hidden-state Observation for Semantic Truthfulness (2026.acl-long)
Copied to clipboard
Yueheng Mao, Min Yu, Gengwang Li, Jianguo Jiang, Gang Li, Meng Zhang, Zhen Xu, Weiqing Huang, Ming Liu
| Challenge: | Large Language Models (LLMs) often generate overconfident yet factually incorrect hallucinations. |
| Approach: | They propose a black-box-based framework that captures stubborn hallucinations by integrating internal geometric dynamics with output probability distributions. |
| Outcome: | The proposed framework outperforms white-box methods and reduces computational overhead by over 90%. |
Every Document Owns Its Structure: Inductive Text Classification via Graph Neural Networks (2020.acl-main)
Copied to clipboard
| Challenge: | Existing graph-based methods for text classification cannot capture contextual word relationships within each document nor can they produce inductive learning of new words. |
| Approach: | They propose to use Graph Neural Networks to learn the local word representations and then aggregate the word nodes as the document embeddings. |
| Outcome: | The proposed method outperforms state-of-the-art methods on four benchmark datasets. |
Chain-of-Note: Enhancing Robustness in Retrieval-Augmented Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Standard RALMs often neglect their intrinsic knowledge due to the interference from retrieved information. |
| Approach: | They propose a new approach to improve robustness of RALMs by generating sequential reading notes for each retrieved document. |
| Outcome: | The proposed approach outperforms standard RALMs on four open-domain QA benchmarks. |
SafeScientist: Enhancing AI Scientist Safety for Risk-Aware Scientific Discovery (2025.emnlp-main)
Copied to clipboard
Kunlun Zhu, Jiaxun Zhang, Ziheng Qi, Nuoxing Shang, Zijia Liu, Peixuan Han, Yue Su, Haofei Yu, Jiaxuan You
| Challenge: | Recent advances in large language model (LLM) agents have significantly accelerated scientific discovery automation, yet raised critical ethical and safety concerns. |
| Approach: | They propose a framework to enhance safety and ethical responsibility in AI-driven scientific exploration. |
| Outcome: | The proposed framework significantly improves safety performance by 35% compared to traditional frameworks. |
Generating Visual Spatial Description via Holistic 3D Scene Understanding (2023.acl-long)
Copied to clipboard
| Challenge: | Existing VSD work focuses on skewed spatial understanding of target objects . Existing work merely models the 2D geometrical vision features . |
| Approach: | They propose to incorporate 3D scene features into visual spatial description tasks by sampling topologically-diverse subgraphs from Go3D-S2G. |
| Outcome: | The proposed framework outperforms baselines on two VSD datasets and produces more spatially-diversified generation. |
VenusFactory: An Integrated System for Protein Engineering with Data Retrieval and Language Model Fine-Tuning (2025.acl-demo)
Copied to clipboard
Yang Tan, Chen Liu, Jingyuan Gao, Wu Banghao, Mingchen Li, Ruilin Wang, Lingrong Zhang, Huiqun Yu, Guisheng Fan, Liang Hong, Bingxin Zhou
| Challenge: | Pre-trained protein language models have been used in protein engineering, but their adoption is limited due to data collection, task benchmarking, and application challenges. |
| Approach: | They propose a versatile engine that integrates biological data retrieval, standardized task benchmarking, and modular fine-tuning of PLMs. |
| Outcome: | The proposed engine integrates biological data retrieval, task benchmarking, and modular fine-tuning of PLMs. |
TPLinker: Single-stage Joint Extraction of Entities and Relations Through Token Pair Linking (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods to extract entities and relations from unstructured text are susceptible to cascading errors due to the separation of entity detection and relation classification. |
| Approach: | They propose a one-stage joint extraction model that detects overlapping relations while being immune from exposure bias. |
| Outcome: | The proposed model can identify overlapping relations while being immune from exposure bias. |
Tree-Instruct: A Preliminary Study of the Intrinsic Relationship between Complexity and Alignment (2024.lrec-main)
Copied to clipboard
| Challenge: | Extensive research has highlighted the importance of data complexity as a crucial metric, but the impact of complexity remains relatively unexplored. |
| Approach: | They propose to add a specified number of nodes to instructions’ semantic trees to enhance the instruction complexity in a controllable manner. |
| Outcome: | The proposed approach outperforms diverse yet complex instructions under the same token budget and can control the difficulty level of modified instructions. |
Speed Up Your Code: Progressive Code Acceleration Through Bidirectional Tree Editing (2025.acl-long)
Copied to clipboard
Longhui Zhang, Jiahao Wang, Meishan Zhang, GaoXiong Cao, Ensheng Shi, Mayuchi Mayuchi, Jun Yu, Honghai Liu, Jing Li, Min Zhang
| Challenge: | Existing training methods, such as direct instruction fine-tuning, overlook hierarchical relationships among acceleration patterns. |
| Approach: | They propose a new training paradigm that uses bidirectional tree editing and progressive code acceleration learning to improve LLMs’ CA capabilities. |
| Outcome: | The proposed training paradigm outperforms prompt-enhanced GPT-4 and current training-based methods on average across five programming languages. |
StablePT : Towards Stable Prompting for Few-shot Learning via Input Separation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies on prompt tuning have shown that language models can be effective few-shot learners with prompting. |
| Approach: | They propose to treat the hard prompt and soft prompt as separate inputs to mitigate noise brought by prompt initialization. |
| Outcome: | Experimental results show that the proposed method outperforms state-of-the-art methods by 6.97% in accuracy and reduces the standard deviation by 1.92 on average. |
Upcycling Instruction Tuning from Dense to Mixture-of-Experts via Parameter Merging (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for tuning large language models from dense to MoE face significant data requirements and require large-scale post-training. |
| Approach: | They propose an upcycling instruction tuning approach for tuning a dense pre-trained model into a MoE instruction model using genetic algorithm and parameter merging. |
| Outcome: | The proposed approach improves the performance of large language models with a small amount of seed data and improves their scaling. |
Improving Personalized Sentiment Representation with Knowledge-enhanced and Parameter-efficient Layer Normalization (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies on personalized sentiment classification consider document reviews as overall text unit and incorporate backgrounds (i.e., user and product information) Existing methods for personalized sentiment modeling have quadratic costs that increase with text length and heterogeneous mixes of background information and textual information. |
| Approach: | They propose a knowledge-enhanced and parameter-efficient layer normalization model that leverages pretrained checkpoints and background information into transformer structures. |
| Outcome: | The proposed model can be used to improve pretrained language models in document reviews and incorporate background information with parameter-efficient fine-tuning and knowledge injecting. |
A.S.E: A Repository-Level Benchmark for Evaluating Security in AI-Generated Code (2026.findings-acl)
Copied to clipboard
Keke Lian, Wang Bin, Lei Zhang, Libo Chen, Junjie Wang, Ziming Zhao, Yujiu Yang, Miaoqian Lin, Haotong Duan, Haoran Zhao, Shuang Liao, Mingda Guo, Quan Jiazheng, Yilu Zhong, Chenhao He, Chen Zichuan, Jie Wu, Haoling Li, Zhaoxuan Li, Jiongchi Yu, Hui LI, Dong Zhang
| Challenge: | Existing security evaluation benchmarks lack relevance to real-world AI programming tasks . current LLMs struggle with secure coding, research shows . |
| Approach: | They propose a repository-level evaluation benchmark to assess security of AI-generated code. |
| Outcome: | The proposed framework mirrors real-world AI programming tasks and offers valuable insights into the state of AI code generation. |
KIEval: A Knowledge-grounded Interactive Evaluation Framework for Large Language Models (2024.acl-long)
Copied to clipboard
Zhuohao Yu, Chang Gao, Wenjin Yao, Yidong Wang, Wei Ye, Jindong Wang, Xing Xie, Yue Zhang, Shikun Zhang
| Challenge: | Existing methods to detect contaminated texts focus on quantifying contamination status instead of accurately gauging model performance. |
| Approach: | They propose a Knowledge-grounded Interactive Evaluation framework which incorporates an LLM-powered “interactor” role for the first time to accomplish a dynamic contamination-resilient evaluation. |
| Outcome: | The proposed framework is based on a question in a standard LLM benchmark and can be used to evaluate models in real-world conversations. |
ERNIE-Layout: Layout Knowledge Enhanced Pre-training for Visually-rich Document Understanding (2022.findings-emnlp)
Copied to clipboard
Qiming Peng, Yinxu Pan, Wenjin Wang, Bin Luo, Zhenyu Zhang, Zhengjie Huang, Yuhui Cao, Weichong Yin, Yongfeng Chen, Yin Zhang, Shikun Feng, Yu Sun, Hao Tian, Hua Wu, Haifeng Wang
| Challenge: | Existing methods for visually rich document understanding lack layout-centered knowledge . experimental results show that ERNIE-Layout improves layout awareness . |
| Approach: | They propose a document pre-training solution with layout knowledge enhancement in the whole workflow to learn better representations that combine the features from text, layout, and image. |
| Outcome: | The proposed model outperforms existing models on key downstream tasks. |
Safety Alignment via Constrained Knowledge Unlearning (2025.acl-long)
Copied to clipboard
Zesheng Shi, Yucheng Zhou, Jing Li, Yuxin Jin, Yu Li, Daojing He, Fangming Liu, Saleh Alharbi, Jun Yu, Min Zhang
| Challenge: | Existing defense mechanisms have not fully deleted harmful knowledge in large language models (LLMs) Existing methods to address safety alignment have not completely deleted harmful information in LLMs. |
| Approach: | They propose a safety alignment strategy that uses scoring neurons to identify useful knowledge in LLMs and pruning the gradients of neurons in U to preserve beneficial information. |
| Outcome: | The proposed method significantly improves model safety while maintaining utility compared to existing methods. |
Attention Calibration for Transformer in Neural Machine Translation (2021.acl-long)
Copied to clipboard
| Challenge: | Attention mechanisms have been ubiquitous in neural machine translation (NMT) however, many studies doubt whether highlyattended inputs have a large impact on the model outputs. |
| Approach: | They propose to introduce a mask perturbation model that automatically evaluates each input’s contribution to the model outputs. |
| Outcome: | The proposed model is more uniform at lower layers while more concentrated on the specific inputs at higher layers. |
TiMem: Temporal-Hierarchical Memory Consolidation for Long-Horizon Conversational Agents (2026.findings-acl)
Copied to clipboard
Kai Li, Xuanqing Yu, Ziyi Ni, Yi Zeng, Yao Xu, Zheqing Zhang, Xin Li, Jitao Sang, Xiaogang Duan, Xuelei Wang, Chengbao Liu, Jie Tan
| Challenge: | Existing memory frameworks provide limited support for temporally structured information across hierarchical levels, leading to fragmented memories and unstable long-horizon personalization. |
| Approach: | They propose a temporal–hierarchical memory framework that organizes conversations through a Temporal Memory Tree. |
| Outcome: | The proposed framework outperforms baselines while reducing the recalled memory length by 52.20%. |
ReviewGrounder: Improving Review Substantiveness with Rubric-Guided, Tool-Integrated Agents (2026.acl-long)
Copied to clipboard
Zhuofeng Li, Yi Lu, Dongfu Jiang, Haoxiang Zhang, Yuyang Bai, Chuan Li, Yu Wang, Shuiwang Ji, Jianwen Xie, Yu Zhang
| Challenge: | Rapid rise in AI conference submissions has driven increasing exploration of large language models (LLMs) for peer review support. |
| Approach: | They propose a peer review benchmarking tool based on paper-specific rubrics and a rubric-guided framework that decomposes reviewing into drafting and grounding stages. |
| Outcome: | The proposed framework outperforms baselines with stronger/larger backbones in both alignment with human judgments and rubric-based review quality across 8 dimensions. |
MSMO: Multimodal Summarization with Multimodal Output (D18-1)
Copied to clipboard
| Challenge: | Existing studies show that multimodal summarization can improve user satisfaction for informativeness of summaries by using information in visual modality. |
| Approach: | They propose a task to generate text and select the most relevant image from the multimodal input and a novel multimodal automatic evaluation method to evaluate multimodal outputs. |
| Outcome: | The proposed method improves user satisfaction by 12.4% compared to the current system . |
SciImpact: A Multi-Dimensional, Multi-Field Benchmark for Scientific Impact Prediction (2026.findings-acl)
Copied to clipboard
| Challenge: | Prior work on scientific impact prediction has focused on citation counts and its variants, leaving limited evaluation of models’ capability to reason about other dimensions. |
| Approach: | They propose a large-scale, multi-dimensional benchmark for scientific impact prediction spanning 19 fields. |
| Outcome: | The proposed model outperforms larger models and close-source models in a wide range of fields and measures of scientific impact across 19 fields. |
Distantly-Supervised Named Entity Recognition with Noise-Robust Learning and Language Model Augmented Self-Training (2021.emnlp-main)
Copied to clipboard
| Challenge: | Named entity recognition models require abundant high-quality annotations to train . distant supervision may induce incomplete and noisy labels, making supervised learning ineffective. |
| Approach: | They propose a noise-robust learning scheme for training named entity recognition models using only distantly-labeled data and a self-training method that uses contextualized augmentations created by pre-trained language models. |
| Outcome: | The proposed method outperforms existing supervised NER models on three datasets by significant margins. |
Learn to Cross-lingual Transfer with Meta Graph Learning Across Heterogeneous Languages (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing mPLM-based methods focus on designing costly model pre-training while ignoring equally crucial downstream adaptation. |
| Approach: | They propose a meta graph learning method that extracts meta-knowledge from historical CLT experiences to learn to cross-lingual transfer. |
| Outcome: | The proposed method can learn to cross-lingual transfer by extracting meta-knowledge from historical CLT experiences (tasks) it can also capture intrinsic language relationships to explicitly guide cross-linguistic transfer. |
FreeEval: A Modular Framework for Trustworthy and Efficient Evaluation of Large Language Models (2024.emnlp-demo)
Copied to clipboard
Zhuohao Yu, Chang Gao, Wenjin Yao, Yidong Wang, Zhengran Zeng, Wei Ye, Jindong Wang, Yue Zhang, Shikun Zhang
| Challenge: | Large language models (LLMs) have revolutionized natural language processing with impressive performance across various tasks. |
| Approach: | They propose a framework for automated evaluations of large language models . they open-source their code at https://github.com/WisdomShell/FreeEval . |
| Outcome: | The framework is open-source and can be used to develop and validate new evaluation methods. |
Enhancing Open-Domain Task-Solving Capability of LLMs via Autonomous Tool Integration from GitHub (2025.acl-long)
Copied to clipboard
Bohan Lyu, Xin Cong, Heyang Yu, Pan Yang, Cheng Qian, Zihe Wang, Yujia Qin, Yining Ye, Yaxi Lu, Chen Qian, Zhong Zhang, Yukun Yan, Yankai Lin, Zhiyuan Liu, Maosong Sun
| Challenge: | Existing approaches lack flexibility to address diverse and ever-evolving user queries in open domains. |
| Approach: | They propose to evaluate LLMs on open-domain knowledge that requires tools to solve diverse and ever-evolving user queries. |
| Outcome: | The proposed system outperforms baselines in the open domain task-solving benchmark. |
CoF-CoT: Enhancing Large Language Models with Coarse-to-Fine Chain-of-Thought Prompting for Multi-domain NLU Tasks (2023.emnlp-main)
Copied to clipboard
| Challenge: | Chain-of-Thought prompting is popular in reasoning tasks, but its application to Large Language Models (LLMs) in Natural Language Understanding (NLU) is under-explored. |
| Approach: | They propose a Coarse-to-Fine Chain-of-Thought approach that breaks down NLU tasks into multiple reasoning steps where LLMs can learn to acquire essential concepts. |
| Outcome: | The proposed approach is effective in assisting the LLMs adapt to multi-grained NLU tasks under zero-shot and few-shot multi-domain settings. |
Multi-grained Named Entity Recognition (P19-1)
Copied to clipboard
| Challenge: | Existing approaches treat Named Entity Recognition (NER) as a sequence labeling task. |
| Approach: | They propose a framework for Multi-Grained Named Entity Recognition where multiple entities or entity mentions in a sentence could be non-overlapping or totally nested. |
| Outcome: | The proposed framework outperforms current state-of-the-art frameworks by 4.4% in terms of the F1 score among nested/non-overlapping NER tasks. |
VarBench: Robust Language Model Benchmarking Through Dynamic Variable Perturbation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Recent benchmarks release only training and validation sets, keeping the test set labels closed-source. |
| Approach: | They propose to extract variables from each test case and define a value range for each variable. |
| Outcome: | The proposed method improves the accuracy of the evaluations on four datasets covering mathematical generation and multiple-choice tasks. |
Scaling Law for Multimodal Large Language Model Supervised Fine-Tuning (2026.acl-long)
Copied to clipboard
YiFan Zhang, Tao Yu, Feng Li, Chaoyou Fu, Yibo Hu, Kun Wang, Qingsong Wen, Zhang Zhang, Liang Wang, Rong Jin
| Challenge: | supervised fine-tuning (SFT) is crucial for multimodal large language models, yet a comprehensive scaling law is lacking . et al.: scaling laws focus on model size, pre-training tokens, and MLLM SFT data volumes . |
| Approach: | They propose two scaling laws to guide optimal model-data configuration . they propose one applicable when training data volumes are well defined by researchers . |
| Outcome: | The proposed scaling laws provide valuable recommendations for optimal resource allocation . they show that the proposed laws are more accurate than existing models . |
RST Discourse Parsing with Second-Stage EDU-Level Pre-training (2022.acl-long)
Copied to clipboard
| Challenge: | Existing pre-trained language models (PLMs) are based on sentence-level pre-training, which is different from the basic processing unit, i.e. element discourse unit (EDU). |
| Approach: | They propose a second-stage EDU-level pre-training approach to learn effective EDU representations continually based on well pre-trained language models. |
| Outcome: | The proposed method improves F1 score by 2.1 points on a benckmark dataset. |
Hyperlink-induced Pre-training for Passage Retrieval in Open-domain Question Answering (2022.acl-long)
Copied to clipboard
Jiawei Zhou, Xiaoguang Li, Lifeng Shang, Lan Luo, Ke Zhan, Enrui Hu, Xinyu Zhang, Hao Jiang, Zhao Cao, Fan Yu, Xin Jiang, Qun Liu, Lei Chen
| Challenge: | Existing methods to train dense passage retrieval have a large data gap between upstream and downstream relevance. |
| Approach: | They propose a method to pre-train the dense retriever with the text relevance induced by hyperlinks within Web documents. |
| Outcome: | The proposed method outperforms existing methods under different scenarios and in the open-domain question answering domain. |
UniCreative: Unifying Long-form Logic and Short-form Sparkle via Reference-Free Reinforcement Learning (2026.findings-acl)
Copied to clipboard
Xiaolong Wei, Zerun Zhu, Simin Niu, Xingyu Zhang, Peiying Yu, Changxuan Xiao, Yuchen Li, Jicheng Yang, Zhejun Zhao, Chong Meng, Long Xia, Daiting Shi
| Challenge: | Existing alignment paradigms for creative writing use static reward signals and supervised data. |
| Approach: | They propose a constraint-aware reward model that synthesizes query-specific criteria to provide fine-grained preference judgments. |
| Outcome: | The proposed framework aligns models with human preferences across content quality and structural paradigms without supervised fine-tuning and ground-truth references. |
Improving Long-Context Translation via Self-Supervised Dual Learning (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models with long context windows suffer from catastrophic information distortion, undermining the strict faithfulness required for translation. |
| Approach: | They propose a self-supervised post-training framework that improves long-document translation reliability via round-trip consistency. |
| Outcome: | The proposed framework improves long-document translation reliability via round-trip consistency. |
Forward-Backward Reasoning in Large Language Models for Mathematical Verification (2024.findings-acl)
Copied to clipboard
| Challenge: | Extensive experiments on six standard mathematical data sets and three LLMs show that FOBAR achieves state-of-the-art performance. |
| Approach: | They propose to combine forward and backward reasoning to verify candidate answers . they propose to use a template to mask a number and ask the LLM to answer a backward question . |
| Outcome: | Experiments on mathematical data show that proposed backward reasoning outperforms Self-Consistency. |
Towards Accurate and Consistent Evaluation: A Dataset for Distantly-Supervised Relation Extraction (2020.coling-main)
Copied to clipboard
| Challenge: | Distant Supervision (DS) generates large-scale annotated data but has wrong labels that result in incorrect evaluation scores during testing. |
| Approach: | They build a dataset using DS-generated data as training data and hire annotators to label test data. |
| Outcome: | The proposed dataset NYTH has a much larger test set and performs more accurate and consistent evaluation. |
Free-MAD: Consensus-Free Multi-Agent Debate (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing multi-agent debate methods rely on multiple rounds of interaction among agents to reach consensus, and the final output is decided by majority voting in the last round. |
| Approach: | They propose a multi-agent debate framework that eliminates the need for consensus among agents and reconstructs the debate phase by introducing anti-conformity. |
| Outcome: | Experiments on eight benchmark datasets show that Free-MAD significantly improves reasoning performance while requiring only a single-round debate and thus reducing token costs. |
TOREE: Evaluating Topic Relevance of Student Essays for Chinese Primary and Middle School Education (2024.findings-acl)
Copied to clipboard
Xinlin Zhuang, Hongyi Wu, Xinshu Shen, Peimin Yu, Gaowei Yi, Xinhao Chen, Tu Hu, Yang Chen, Yupei Ren, Yadong Zhang, Youqi Song, Binxuan Liu, Man Lan
| Challenge: | Existing research on Automatic Essay Scoring (AES) for Chinese essays has overlooked topic relevance and lacks detailed feedback. |
| Approach: | They propose to use TOREE to assess topic relevance in Chinese primary and middle school students’ essays to improve automatic and human evaluations. |
| Outcome: | The proposed method significantly improves both automatic and human evaluations across four diverse LLMs. |
Towards Text-Image Interleaved Retrieval (2025.acl-long)
Copied to clipboard
Xin Zhang, Ziqi Dai, Yongqi Li, Yanzhao Zhang, Dingkun Long, Pengjun Xie, Meishan Zhang, Jun Yu, Wenjie Li, Min Zhang
| Challenge: | Existing multimodal information retrieval models rely on single-image inputs . current models use a dense retrieval paradigm, but this approach is not effective . |
| Approach: | They propose a text-image interleaved retrieval task where query and document are interleaves . they adapt off-the-shelf retrievers and build a dense baseline by interleaded multimodal large language model . |
| Outcome: | The proposed model achieves significant improvements over the baseline by substantially fewer visual tokens. |
MetaLogic: Logical Reasoning Explanations with Fine-Grained Structure (2022.emnlp-main)
Copied to clipboard
| Challenge: | Current explanation datasets often employ synthetic data with simple reasoning structures. |
| Approach: | They propose a comprehensive logical reasoning explanation form that incorporates three main components to better fit the human cognitive process. |
| Outcome: | The proposed model performs better than existing models on real-life scenarios, but is more challenging for the current models. |
HoneyBee: Progressive Instruction Finetuning of Large Language Models for Materials Science (2023.findings-emnlp)
Copied to clipboard
| Challenge: | LLaMa-based language model for materials science is first of its kind in the world . |
| Approach: | They propose an instruction-based process for trustworthy data curation in materials science (MatSci-Instruct) they then apply this process to finetune a LLaMa-based language model targeted for materials science. |
| Outcome: | The proposed model outperforms existing language models on materials science tasks and improves in successive stages of refinement. |
BERT-BC: A Unified Alignment and Interaction Model over Hierarchical BERT for Response Selection (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent performance boosting for dialogue response selection task achieved by Cross-Encoder based models is limited and the learned models have poor generalization capability in realistic scenarios. |
| Approach: | They propose a model that combines the representation-based Bi-Encoder and interaction-based Cross-Encoding to achieve better semantic representation. |
| Outcome: | The proposed model can achieve state-of-the-art performance on three benchmark datasets for multi-turn response selection. |
Joint Slot Filling and Intent Detection via Capsule Neural Networks (P19-1)
Copied to clipboard
| Challenge: | Existing models that label slots and detect intent do not preserve hierarchical relationship between words, slots, and intents. |
| Approach: | They propose a capsule-based neural network model which performs slot filling and intent detection via a dynamic routing-by-agreement schema. |
| Outcome: | The proposed model performs better than existing models and existing models on real-world datasets. |
Chinese Spoken Named Entity Recognition in Real-world Scenarios: Dataset and Approaches (2024.findings-acl)
Copied to clipboard
| Challenge: | Current Chinese Spoken NER datasets are laboratory-controlled and are limited in topics. |
| Approach: | They propose to use Chinese Spoken NER datasets to extract entities from speech to help voice assistants better grasp the intent behind user's questions and instructions. |
| Outcome: | The proposed methods improve on self-training-asr and mapping then distilling, and even compared with GPT4.0, they achieve better results. |
LoopTool: Closing the Data–Training Loop for Robust LLM Tool Calls (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are powerful tools for multi-step tasks, but static data pipelines hinder tool learning and cause noisy labels to persist. |
| Approach: | They propose a fully automated, model-aware data evolution framework that tightly integrates data synthesis and model training. |
| Outcome: | Experiments show that LoopTool-8B significantly surpasses its 32B data generator and achieves new state-of-the-art results on the BFCL-v3 and ACEBench benchmarks for its scale. |
A Cause-Effect Look at Alleviating Hallucination of Knowledge-grounded Dialogue Generation (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing dialogue systems have demonstrated impressive performance conducting fluent and natural-sounding conversations, but they are plagued by the Knowledge Hallucination problem. |
| Approach: | They propose a method that exploits the dialogue-knowledge interaction to reduce hallucination by using external knowledge resources to generate more informative responses. |
| Outcome: | The proposed method reduces hallucination without disrupting other dialogue performance while keeping adaptive to different generation models. |
Confusion is the Final Barrier: Rethinking Jailbreak Evaluation and Investigating the Real Misuse Threat of LLMs (2025.findings-emnlp)
Copied to clipboard
Yu Yan, Sheng Sun, Zhe Wang, Yijun Lin, Zenghao Duan, Zhifei Zheng, Min Liu, Zhiyi Yin, Jianping Zhang
| Challenge: | Large Language Models have been developed to deal with real-world crimes, but it remains unclear whether they internalize authentic knowledge or are forced to simulate toxic language patterns. |
| Approach: | They construct knowledge-intensive Q&A to investigate misuse threats of Large Language Models in terms of dangerous knowledge possession, harmful task planning utility, and harmfulness judgment robustness. |
| Outcome: | The findings raise concerns that jailbreak success is often attributable to a hallucination loop between jailbroken LLM and judger LLM . |
Grounded Graph Decoding improves Compositional Generalization in Question Answering (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Current compositional generalization models lose syntax context when learning a flat input . a new method to improve compositional globalization is proposed to ground structured predictions with an attention mechanism. |
| Approach: | They propose a method to ground structured predictions by a structure-based attention mechanism. |
| Outcome: | The proposed method performs competitively on the Compositional Freebase Questions dataset. |
Prosody-TTS: Improving Prosody with Masked Autoencoder and Conditional Diffusion Model For Expressive Text-to-Speech (2023.findings-acl)
Copied to clipboard
| Challenge: | Expressive text-to-speech aims to generate high-quality samples with rich prosody . prosodic attributes in highly dynamic voices are difficult to capture and model without intonation . |
| Approach: | They propose a pipeline that enhances prosody modeling and sampling by introducing a self-supervised masked autoencoder and a diffusion model to sample diverse prosodic patterns within the latent space. |
| Outcome: | The proposed pipeline achieves new state-of-the-art in text-to-speech with natural and expressive synthesis. |
Concise Math Reasoning via Difficulty-Aware Distillation (2026.findings-acl)
Copied to clipboard
Yifan Wu, Jingze Shi, Bingheng Wu, Jiayi Zhang, Xiaotian Lin, Yizhang Zhu, Zhaoyang Yu, Bang Liu, Chenglin Wu, Nan Tang, Yuyu Luo
| Challenge: | Human experts tackle difficult math problems by identifying and executing a few pivotal steps rather than listing every intermediate thought. |
| Approach: | They propose a method for producing training data that mirrors concise human reasoning by rewriting a problem's solution to retain only the essential steps. |
| Outcome: | The proposed method outperforms models trained on 800k long CoT and cuts training and inference costs. |
ASTRA: An Automated Framework for Strategy Discovery, Retrieval, and Evolution for Jailbreaking LLMs (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods lack the capability for continuous learning and self-evolution from interactions, limiting the diversity and adaptability of attack strategies. |
| Approach: | They propose an automated framework capable of discovering, retrieving, and evolving attack strategies. |
| Outcome: | The proposed framework outperforms existing baselines in a black-box setting. |
Just Fine-tune Twice: Selective Differential Privacy for Large Language Models (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to protect language models from privacy leakage suffer from limited user control and low utility . et al., 2018: a novel framework that achieves SDP for state-of-the-art large transformer-based models. |
| Approach: | They propose a framework that applies differential privacy to large language models . they use redacted in-domain data to fine-tune the model with original in- domain data . |
| Outcome: | The proposed framework achieves strong utility compared to baselines. |