Papers by Cao Liu
Enhancing Continual Relation Extraction via Classifier Decomposition (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing studies only adopt a vanilla strategy when learning representations of new relations . experimental results show that the importance of the first training stage to CRE models may be underestimated. |
| Approach: | They propose a framework that splits the last FFN layer into separated previous and current classifiers to maintain previous knowledge and encourage model to learn more robust representations at this training stage. |
| Outcome: | The proposed framework outperforms the state-of-the-art models on two benchmarks. |
Progra: Progress-Aware Reinforcement Learning for Multi-Turn Function Calling (2026.findings-acl)
Copied to clipboard
Huacan Chai, Zijie Cao, Maolin Ran, Yingxuan Yang, Jianghao Lin, Xin Peng, Hairui Wang, Renjie Ding, Ziyu Wan, Muning Wen, Weiwen Liu, Weinan Zhang, Fei Huang, Ying Wen
| Challenge: | Existing methods for multi-turn function calling are limited by redundancy and lack explicit integration of progress awareness into training. |
| Approach: | They propose a framework that explicitly integrates progress awareness into LLM training for multi-turn function calling. |
| Outcome: | Empirical results show that Progra outperforms existing methods on two public benchmarks. |
Chinese SafetyQA: A Safety Short-form Factuality Benchmark for Large Language Models (2025.acl-long)
Copied to clipboard
Yingshui Tan, Boren Zheng, Baihui Zheng, Kerui Cao, Huiyun Jing, Jincheng Wei, Jiaheng Liu, Yancheng He, Wenbo Su, Xiaoyong Zhu, Bo Zheng, Kaifu Zhang
| Challenge: | Large language models have created significant safety concerns . factuality ability is crucial in determining whether they can be deployed and applied safely and compliantly within specific regions. |
| Approach: | They propose a benchmark to evaluate the factuality of large language models in China . they evaluate the models' ability to provide accurate and reliable information . |
| Outcome: | The proposed benchmark evaluates the factuality abilities of existing LLMs and compares them to LLM abilities. |
ConfSpec: Efficient Step-Level Speculative Reasoning via Confidence-Gated Verification (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to chain-of-thought reasoning incur high inference latency due to long generation traces. |
| Approach: | They propose a confidence-gated cascaded verification framework that reduces the trade-off between generation and verification. |
| Outcome: | The proposed framework achieves 2.24 speedups while matching target-model accuracy. |
Agent-RewardBench: Towards a Unified Benchmark for Reward Modeling across Perception, Planning, and Safety in Real-World Multimodal Agents (2025.acl-long)
Copied to clipboard
| Challenge: | Multimodal Large Language Models (MLLMs) are developing but lack external feedback . there is no clear on how to select reward models for agents . |
| Approach: | They propose a benchmark to evaluate agent reward modeling ability in MLLMs . they use multiple dimensions and real-world agent scenarios evaluation . |
| Outcome: | The proposed benchmark evaluates agent performance in multimodal large language models . it covers perception, planning, and safety with 7 scenarios and is highly difficult and high-quality . |
SILO-BENCH: A Scalable Environment for Evaluating Distributed Coordination in Multi-Agent LLM Systems (2026.acl-long)
Copied to clipboard
Yuzhe Zhang, Feiran Liu, Yi Shan, Xinyi Huang, Xin Yang, Yueqi Zhu, Xuxin Cheng, Cao Liu, Ke Zeng, Terry Jingchen Zhang, Wenyuan Jiang
| Challenge: | Existing benchmarks conflate coordination ability with role-based priors. |
| Approach: | They propose a role-free benchmark for evaluating free-form collaboration under information silos. |
| Outcome: | The proposed benchmark systematically probes coordination capabilities under information silos using 54 configurations and 3 frontier LLMs. |
A Dialogue-based Information Extraction System for Medical Insurance Assessment (2021.findings-acl)
Copied to clipboard
Shuang Peng, Mengdi Zhou, Minghui Yang, Haitao Mi, Shaosheng Cao, Zujie Wen, Teng Xu, Hongbin Wang, Lei Liu
| Challenge: | a new system that integrates advanced NLP technologies for medical insurance assessment is proposed . the average time cost of the procedure is reduced from 55 minutes to 35 minutes . |
| Approach: | They propose a dialogue-based information extraction system that integrates advanced NLP technologies for medical insurance assessment. |
| Outcome: | The proposed system reduces the time cost of the procedure from 55 minutes to 35 minutes and saves 30% human resources cost compared with the previous offline procedure. |
VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent research has focused on pushing weight-only quantization to extremely low-bit due to numerical representation limitations. |
| Approach: | They propose a vector-based quantization approach that pushes LLMs to extremely low-bit . they propose scalar-based weight quantization that reduces memory requirements and optimizes storage costs . |
| Outcome: | The proposed method reduces model quantization perplexity by 0.01-0.34 on LLaMA-2, 0.38-0.68 on mistral-7B, 4.41-7.34, on llaMA-3 on QA tasks on average. |
AppBench: Planning of Multiple APIs from Various APPs for Complex User Instruction (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing state-of-the-art Large Language Models (LLMs) still cannot perform well in this situation even with the help of in-context learning and finetuning. |
| Approach: | They propose a benchmark to evaluate LLMs’ ability to plan and execute multiple APIs from various sources in order to complete the user’s task. |
| Outcome: | The proposed benchmarks show that the existing state-of-the-art LLMs still cannot perform well in this situation even with in-context learning and finetuning. |
Event Ontology Completion with Hierarchical Structure Evolution Networks (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for event detection require predefined schemas, but manual defining is expensive and labor-intensive. |
| Approach: | They propose a task to achieve event clustering, hierarchy expansion and type naming . they propose 'neighbor Contrastive Clustering' module and a Hierarchy-Aware Linking module . |
| Outcome: | The proposed method outperforms baseline methods on three datasets. |
MolCA: Molecular Graph-Language Modeling with Cross-Modal Projector and Uni-Modal Adapter (2023.emnlp-main)
Copied to clipboard
| Challenge: | Language Models (LMs) have demonstrated impressive molecule understanding ability on 1D text-related tasks, but lack 2D graph perception, a critical ability of human professionals in comprehending molecules’ topological structures. |
| Approach: | They propose to combine a cross-modal projector and a uni-modal adapter to enable an LM to understand both text- and graph-based molecular contents via a Q-Former. |
| Outcome: | The proposed model outperforms the baselines on tasks such as molecule captioning, IUPAC name prediction, and molecule-text retrieval. |
Completely Modular Fine-tuning for Dynamic Language Adaptation (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing studies on multilingual fine-tuning with a fixed set of languages lack dynamic adaptability to new languages. |
| Approach: | They propose a modular fine-tuning pipeline that enables dynamic language adaptation for LLMs by first training English-centric adapters for each language separately and then merging them for arbitrary-direction translation. |
| Outcome: | The proposed pipeline achieves 86% performance over traditional fine-tuning on four languages, while training only 0.1% parameters and relying on English as a bridge language without catastrophic forgetting. |
DialogQAE: N-to-N Question Answer Pair Extraction from Customer Service Chatlog (2023.findings-emnlp)
Copied to clipboard
Xin Zheng, Tianyu Liu, Haoran Meng, Xu Wang, Yufan Jiang, Mengliang Rao, Binghuai Lin, Yunbo Cao, Zhifang Sui
| Challenge: | Existing work on question-answer extraction fails to integrate incomplete utterances from dialog context for composite QA retrieval. |
| Approach: | They propose a task where questions and corresponding answers might be separated across different utterances. |
| Outcome: | The proposed methods perform well on 5 customer service datasets and set a benchmark for N-to-N DialogQAE with utterance and session level evaluation metrics. |
Beyond Demographics: Enhancing Cultural Value Survey Simulation with Multi-Stage Personality-Driven Cognitive Reasoning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Introducing **MARK**, a framework for cultural value survey simulation . based on type dynamics theory, it improves accuracy and interpretation of models . |
| Approach: | They propose a framework that integrates psychological theory into cultural value survey simulations. |
| Outcome: | The proposed framework outperforms baseline models on the World Values Survey by 10% accuracy and reduces divergence between model predictions and human preferences. |
LLMs Assist NLP Researchers: Critique Paper (Meta-)Reviewing (2024.emnlp-main)
Copied to clipboard
Jiangshu Du, Yibo Wang, Wenting Zhao, Zhongfen Deng, Shuaiqi Liu, Renze Lou, Henry Zou, Pranav Narayanan Venkit, Nan Zhang, Mukund Srinath, Haoran Zhang, Vipul Gupta, Yinghui Li, Tao Li, Fei Wang, Qin Liu, Tianlin Liu, Pengzhi Gao, Congying Xia, Chen Xing, Cheng Jiayang, Zhaowei Wang, Ying Su, Raj Shah, Ruohao Guo, Jing Gu, Haoran Li, Kangda Wei, Zihao Wang, Lu Cheng, Surangika Ranathunga, Meng Fang, Jie Fu, Fei Liu, Ruihong Huang, Eduardo Blanco, Yixin Cao, Rui Zhang, Philip Yu, Wenpeng Yin
| Challenge: | a comparative analysis of paper (meta-)reviews by large language models (LLMs) aims to identify and distinguish LLMs from human activities . |
| Approach: | They present a comparative analysis to identify and distinguish LLM activities from human activities. |
| Outcome: | The proposed analysis aims to improve recognition of instances when someone implicitly uses LLMs for reviewing activities. |
Joint Representation Learning of Cross-lingual Words and Entities via Attentive Distant Supervision (D18-1)
Copied to clipboard
| Challenge: | Existing methods for learning word and entity representations in monolingual settings are limited. |
| Approach: | They propose a method for joint representation learning of cross-lingual words and entities that captures mutually complementary knowledge and enables cross-linguistic inferences. |
| Outcome: | The proposed method captures mutually complementary knowledge and enables cross-lingual inferences among knowledge bases and texts. |
Beyond Under-Alignment: Atomic Preference Enhanced Factuality Tuning for Large Language Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing work evaluates the factuality of large language models on in-domain (ID) datasets and the factuality on out-of-domain datasets. |
| Approach: | They propose a framework that enhances model’s awareness of factuality at the granularity of individual facts and propose 'Atomic Preference Enhanced Factuality Tuning' this framework enhances the model’ s awareness and accuracy of factual information at the level of individual factual facts. |
| Outcome: | The proposed framework improves model performance by an average of on ID and OOD datasets, which is highly effective. |
Continual Few-shot Event Detection via Hierarchical Augmentation Networks (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for continual few-shot event detection use labeled data, but in real-world applications, new event types emerge continually. |
| Approach: | They propose a memory-based framework for continual few-shot event detection . they incorporate prototypical augmentation into the memory set to memorize previous event types . |
| Outcome: | The proposed method outperforms existing methods in multiple continual few-shot event detection tasks. |
Large Language Models are not Fair Evaluators (2024.acl-long)
Copied to clipboard
Peiyi Wang, Lei Li, Liang Chen, Zefan Cai, Dawei Zhu, Binghuai Lin, Yunbo Cao, Lingpeng Kong, Qi Liu, Tianyu Liu, Zhifang Sui
| Challenge: | Existing evaluation frameworks that use large language models as referees are insufficient for accurately assessing their alignment with human intent. |
| Approach: | They propose a calibration framework to address positional bias in large language models as evaluators by manually annotating the “win/tie/lose” outcomes of responses from ChatGPT and Vicuna-13B in the Vicun A Benchmark’s question prompt. |
| Outcome: | The proposed framework alleviates evaluation bias, resulting in closer alignment with human judgments. |
LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-Context QA (2025.findings-acl)
Copied to clipboard
Jiajie Zhang, Yushi Bai, Xin Lv, Wanjun Gu, Danqing Liu, Minhao Zou, Shulin Cao, Lei Hou, Yuxiao Dong, Ling Feng, Juanzi Li
| Challenge: | Current long-context large language models lack citations to support their responses, making verification difficult due to potential hallucinations. |
| Approach: | They propose to use off-the-shelf LLMs to automatically construct long-context QA instances with precise sentence-level citations and leverage this pipeline to construct a large-scale SFT dataset for LQAC. |
| Outcome: | The proposed pipeline can generate responses with fine-grained citations on the fly, surpassing existing models including GPT-4o. |
LEGO: A Multi-agent Collaborative Framework with Role-playing and Iterative Feedback for Causality Explanation Generation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Causality explanation generation is a generative task that aims to explain why a given cause-effect pair is true using natural language. |
| Approach: | They propose a multi-agent framework with role-playing and iterative feedback for causality explanation generation. |
| Outcome: | The proposed framework is superior to existing frameworks on WIKIWHY and e-CARE datasets. |
Bi-Drop: Enhancing Fine-tuning Generalization via Synchronous sub-net Estimation and Optimization (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Pretrained language models can be fine-tuned on limited training data, which can overfit and thus diminish performance. |
| Approach: | They propose a fine-tuning strategy that selectively updates model parameters using gradients from various sub-nets dynamically generated by dropout. |
| Outcome: | The proposed method outperforms existing methods on the GLUE benchmark and exhibits excellent generalization ability and robustness for domain transfer, data imbalance, and low-resource scenarios. |
MemoBrain: Executive Memory as an Agentic Brain for Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) are inherently long-horizon, causing reasoning traces and tool artifacts to accumulate and strain the working context of large language models. |
| Approach: | They propose a model that constructs a dependency-aware memory over reasoning steps and captures salient intermediate states and their logical relations. |
| Outcome: | The proposed model prunes invalid steps, folds completed sub-trajectories, and preserves a compact, high-salience reasoning backbone under a fixed context budget. |
Does Mapo Tofu Contain Coffee? Probing LLMs for Food-related Cultural Knowledge (2025.naacl-long)
Copied to clipboard
Li Zhou, Taelin Karidi, Wanlong Liu, Nicolas Garneau, Yong Cao, Wenyu Chen, Haizhou Li, Daniel Hershcovich
| Challenge: | Recent studies have highlighted the presence of cultural biases in Large Language Models (LLMs), yet lack a robust methodology to dissect these phenomena comprehensively. |
| Approach: | They propose a multilingual dataset centered on food-related cultural facts and variations in food practices. |
| Outcome: | The proposed model incorporates cultural context significantly and improves its ability to access cultural knowledge. |
AWARE: Agentic Knowledge Warehousing for Contextual Intelligence (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models excel in information seeking tasks, but their knowledge is limited in coverage and timeliness. |
| Approach: | They propose an agentic knowledge warehousing framework that transforms unstructured data into minimal, task-conditioned knowledge representations consumable by LLMs. |
| Outcome: | Experiments on GAIA, WebWalker, and BrowseComp-Plus show improvements over baselines. |
Learning or Self-aligning? Rethinking Instruction Fine-tuning (2024.acl-long)
Copied to clipboard
| Challenge: | Instruction fine-tuning (IFT) is a crucial phase in building large language models (LLMs). |
| Approach: | They propose a knowledge intervention framework to decouple the potential underlying factors of IFT and enable individual analysis of different factors. |
| Outcome: | The proposed framework decouples the potential underlying factors of IFT, enabling individual analysis of different factors. |
Look Light, Think Heavy: What Multimodal Chain-of-Thought Reasoning Can and Cannot Do (2026.acl-long)
Copied to clipboard
| Challenge: | Existing open-source models often yield only marginal overall improvements, possibly due to an overemphasis on mathematical reasoning at the expense of broader capabilities. |
| Approach: | They evaluate 12 multimodal tasks using 14 non-reasoning models and 8 reasoning models. |
| Outcome: | The proposed method is effective in multimodal reasoning tasks, the authors show . they show that it lacks the ability to maintain deep visual introspection throughout the reasoning process. |
FFN Lens: How Transformers Divide Labor for Multilingual Tasks (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) exhibit strong performance on multilingual tasks, yet the process of constructing predictions in the target language remains under-explored. |
| Approach: | They propose a novel interpretability method focusing on the Feed-Forward Network (FFN) layers of Large Language Models. |
| Outcome: | The proposed interpretability method is based on the Feed-Forward Network (FFN) layer of Large Language Models. |
WilKE: Wise-Layer Knowledge Editor for Lifelong Knowledge Editing (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing knowledge editing methods focus on single editing, failing to meet the requirements for lifelong editing. |
| Approach: | They propose an approach that selects editing layer based on the pattern matching degree of editing knowledge across different layers in language models. |
| Outcome: | The proposed method improves on GPT2-XL and GPT-J in lifelong editing compared to state-of-the-art methods . |
Unsupervised Dual Paraphrasing for Two-stage Semantic Parsing (2020.acl-main)
Copied to clipboard
| Challenge: | Existing semantic parsing frameworks rely on nontrivial human labor to generate canonical utterances. |
| Approach: | They propose a framework that uses an unsupervised paraphrase model to parse canonical utterances. |
| Outcome: | The proposed framework is effective and compatible with supervised training. |
Tug-of-War between Knowledge: Exploring and Resolving Knowledge Conflicts in Retrieval-Augmented Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing knowledge conflicts in RALMs can ensnare them in a tug-of-war between knowledge and evidence, limiting their practical applicability. |
| Approach: | They propose a method called Conflict-Disentangle Contrastive Decoding (CD2) to better calibrate the model’s confidence. |
| Outcome: | The proposed method can resolve knowledge conflicts in large language models with the help of conflict-disentangle contrast decoding (CD2) . |
Uncertain Local-to-Global Networks for Document-Level Event Factuality Identification (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on identifying event factuality at sentence level, which leads to conflicts between different mentions of the same event. |
| Approach: | They propose a document-level event factuality identification model that uses local uncertainty and global structure to model event factuality. |
| Outcome: | The proposed method outperforms existing models on two widely used datasets. |
Towards Advanced Mathematical Reasoning for LLMs via First-Order Logic Theorem Proving (2025.emnlp-main)
Copied to clipboard
Chuxue Cao, Mengze Li, Juntao Dai, Jinluan Yang, Zijian Zhao, Shengyu Zhang, Weijie Shi, Chengzhong Liu, Sirui Han, Yike Guo
| Challenge: | Large language models (LLMs) have shown promising first-order logic (FOL) reasoning capabilities with applications in various areas, but their effectiveness in complex mathematical reasoning involving multi-step FOL deductions remains under-explored. |
| Approach: | They propose a self-adaptive solution that enhances the Diversity and REAsonability of LLMs’ generation strategies by introducing an Axiom-Driven Strategy Diversification mechanism and a Sub-Proposition Error Feedback to help LLM reflect on and correct their proofs. |
| Outcome: | The proposed model improves diversity and REAsonability of LLMs’ generation strategies by introducing an Axiom-Driven Strategy Diversification mechanism and a Sub-Proposition Error Feedback to help LLM reflect on and correct proofs. |
A Dual Contrastive Learning Framework for Enhanced Multimodal Conversational Emotion Recognition (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods struggle to capture emotion shifts due to label replication and fail to preserve positive independent modality contributions during fusion. |
| Approach: | They propose a Dual Contrastive Learning Framework that enhances existing MERC models without additional data. |
| Outcome: | The proposed framework outperforms existing models on two MERC benchmark datasets and shows that it reduces label dependence and enhances emotion-sensitive independent modality features. |
IW-Bench: Evaluating Large Multimodal Models for Converting Image-to-Web (2025.findings-acl)
Copied to clipboard
Hongcheng Guo, Wei Zhang, Junhao Chen, Yaonan Gu, Jian Yang, Junjia Du, Shaosheng Cao, Binyuan Hui, Tianyu Liu, Jianxin Ma, Chang Zhou, Zhoujun Li
| Challenge: | Existing models have been introduced to improve image comprehension, but there is no robust benchmark for imagetoweb conversion. |
| Approach: | They propose a benchmark to assess imagetoweb conversion proficiency of large multimodal models . they propose to measure layout information of web pages by parsing the Document Object Model tree . |
| Outcome: | The proposed benchmark measures the layout information of web pages—i.e., the positional relationships between elements—which has been overlooked by prior work. |
A Chain-of-Task Framework for Instruction Tuning of LLMs Based on Chinese Grammatical Error Correction (2025.coling-main)
Copied to clipboard
| Challenge: | Existing approaches to address Grammatical Error Correction (GEC) tasks are based on large scale labeled data, which leads to extremely high data annotation costs. |
| Approach: | They propose a Chain-of-Task framework to reduce over-correction in large language models . they propose supervised fine-tuning strategy and an algorithm for automatic dataset annotation . |
| Outcome: | The proposed framework achieves state-of-the-art on both FCGEC (in-domain) and NaCGEC (out-of domain) test sets. |
Unveiling Project-Specific Bias in Neural Code Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) based neural code models struggle to generalize effectively to real-world inter-project out-of-distribution data. |
| Approach: | They propose a Cond-Idf measurement to measure the relatedness of a token with a label and its project-specificness. |
| Outcome: | The proposed framework improves both inter-project OOD generalization and adversarial robustness while not sacrificing accuracy on intra-project IID data. |
RetroMAE-2: Duplex Masked Auto-Encoder For Pre-Training Retrieval-Oriented Language Models (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods for retrieval-oriented language models focus on contextualized embedding of the [CLS] token, but recent study shows that ordinary tokens besides [CLL] may provide extra information, which help to produce a better representation effect. |
| Approach: | They propose a method where all contextualized embeddings of pre-trained model can be jointly pre-trained for retrieval tasks. |
| Outcome: | The proposed method improves the quality of representation where all contextualized embeddings of the pre-trained model can be leveraged. |
PRISM: Probabilistic Reward Model with Inherent Structural Modeling (2026.acl-long)
Copied to clipboard
| Challenge: | Existing evaluators compress diverse human judgments into a single scalar, leading to brittle alignment and reward hacking. |
| Approach: | They propose a Gaussian-based reinterpretation of reward evaluation as a conditional distribution and a mixture of Gaussians to capture conflicting preference dimensions. |
| Outcome: | The proposed model outperforms scalar baselines in accuracy and generalization. |
CogKTR: A Knowledge-Enhanced Text Representation Toolkit for Natural Language Understanding (2022.emnlp-demos)
Copied to clipboard
Zhuoran Jin, Tianyi Men, Hongbang Yuan, Yuyang Zhou, Pengfei Cao, Yubo Chen, Zhipeng Xue, Kang Liu, Jun Zhao
| Challenge: | Existing knowledge-enhanced methods are limited to knowledge-intensive tasks. |
| Approach: | They propose a knowledge-enhanced text representation toolkit for natural language understanding . it combines knowledge acquisition, knowledge representation, knowledge injection and knowledge application . |
| Outcome: | The proposed toolkit supports knowledge acquisition, knowledge representation, knowledge injection, and knowledge application. |
Long Text and Multi-Table Summarization: Dataset and Method (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing document summarization methods focus on the text and filter out the non-textual content. Existing methods cannot meet the requirements of summarizing long text and multiple tables in each report. |
| Approach: | They propose a dataset for automatic document summarization that uses text and tabular data to produce a concise summary covering the input document's salient information. |
| Outcome: | The proposed method can produce a concise summary covering the input document's salient information. |
NCRE: A Benchmark for Document-level Nominal Compound Relation Extraction (2025.coling-main)
Copied to clipboard
| Challenge: | Existing work focuses on detecting specific relations between entities, often constrained to specific fields and lacking general applicability. |
| Approach: | They propose a novel task that concentrates on abstract relation extraction between noun phrases . they annotate a Chinese dataset and develop a model incorporating a rotary position-enhanced word pair detection schema. |
| Outcome: | The proposed task is more efficient than previous methods. |
Know-MRI: A Knowledge Mechanisms Revealer&Interpreter for Large Language Models (2025.acl-demo)
Copied to clipboard
Jiaxiang Liu, Boxuan Xing, Chenhao Yuan, ChenxiangZhang ChenxiangZhang, Di Wu, Xiusheng Huang, Haida Yu, Chuhan Lang, Pengfei Cao, Jun Zhao, Kang Liu
| Challenge: | Existing interpretation methods only support tasks with specific inputs, limiting their practical applications. |
| Approach: | They propose an extensible module that matches different input data with interpretation methods and consolidates the interpreting outputs. |
| Outcome: | The proposed module can match different input data with interpretation methods and consolidate the interpreting outputs. |
A Troublemaker with Contagious Jailbreak Makes Chaos in Honest Towns (2025.acl-long)
Copied to clipboard
| Challenge: | Existing research focuses on single-agent attacks and shared memory attacks, but real-world scenarios often involve independent memory. |
| Approach: | They propose a large-scale, multi-agent, multitopology attack evaluation framework that exploits the memory of an agent to make it more vulnerable to jailbreak attacks. |
| Outcome: | The proposed framework improves on the troublemaker makes chaos in Honest Town task with 23.51%, 18.95%, and 52.93% improvements in line, star topologies, and 100-agent settings. |
MAIN: Mutual Alignment Is Necessary for instruction tuning (2025.emnlp-main)
Copied to clipboard
Fanyi Yang, Jianfeng Liu, Xin Zhang, Haoyu Liu, Xixin Cao, Yuefeng Zhan, Hao Sun, Weiwei Deng, Feng Sun, Qi Zhang
| Challenge: | Instruction tuning has enabled large language models to achieve remarkable performance, yet its success heavily depends on the availability of high-quality instruction-response pairs. |
| Approach: | They propose a mutual alignment framework which enforces coherence between instructions and responses through mutual constraints. |
| Outcome: | The proposed framework generalizes well across model architectures and sizes, achieving state-of-the-art performance on LLaMA, Mistral, and Qwen models across diverse benchmarks. |
ELTLM: Evaluation of Longitudinal Temporal Large Multimodal Models in Clinical Scenarios (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluation benchmarks focus on static evaluation of large multimodal models . existing evaluation paradigms neglect a critical aspect of clinical practice: longitudinal analysis . |
| Approach: | They propose a temporal perception and reasoning benchmark to assess models' temporal grounding and consistency. |
| Outcome: | ELTLM features a hierarchical task taxonomy comprising Temporal Perception QA and Temporal Reasoning QA. |
MT3: A Synergistic Multi-Task RL Framework for Specializing MLLMs in Text Image Machine Translation (2026.acl-long)
Copied to clipboard
Zhaopeng Feng, Yupu Liang, Shaosheng Cao, Jiayuan Su, Jiahan Ren, Zhijie Zhou, Wenxuan Huang, Jian Wu, Zuozhu Liu
| Challenge: | Text Image Machine Translation (TIMT) is a critical subfield of machine translation . it requires accurate optical character recognition, robust visual-text reasoning, and high-quality translation a challenge . |
| Approach: | They propose a multi-task optimization framework to specialize MLLMs into expert TIMT models. |
| Outcome: | The proposed model outperforms baselines on the latest in-domain MIT-10M benchmark. |
RAG or Learning? Understanding the Limits of LLM Adaptation under Continuous Knowledge Drift in the Real World (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to update or supplement large language models struggle under continuous knowledge drift. |
| Approach: | They propose a dynamic event benchmark and time-aware retrieval baseline that captures how knowledge evolves over time. |
| Outcome: | The proposed method enables systematic evaluation of model adaptation under continuous knowledge drift. |
Towards Efficient NLP: A Standard Evaluation and A Strong Baseline (2022.naacl-main)
Copied to clipboard
Xiangyang Liu, Tianxiang Sun, Junliang He, Jiawen Wu, Lingling Wu, Xinyu Zhang, Hao Jiang, Zhao Cao, Xuanjing Huang, Xipeng Qiu
| Challenge: | Rather than pursuing the reachless SOTA accuracy, researchers are focusing on model efficiency and usability. |
| Approach: | They propose an evaluation and a public leaderboard for efficient NLP models that depicts the Pareto Frontier for various language understanding tasks. |
| Outcome: | The proposed model outperforms or performs on par with SOTA compressed and early exiting models. |
Cutting Off the Head Ends the Conflict: A Mechanism for Interpreting and Mitigating Knowledge Conflicts in Language Models (2024.findings-acl)
Copied to clipboard
Zhuoran Jin, Pengfei Cao, Hongbang Yuan, Yubo Chen, Jiexin Xu, Huaijun Li, Xiaojian Jiang, Kang Liu, Jun Zhao
| Challenge: | Existing methods to expand internal memory boundaries of language models by providing external context can often conflict, leading to knowledge conflicts. |
| Approach: | They propose a method that prunes conflicting attention heads without updating model parameters. |
| Outcome: | The proposed method can flexibly control eight LMs to use internal memory or external context without updating model parameters. |
AMO-Bench: Large Language Models Still Struggle in High School Math Competitions (2026.findings-acl)
Copied to clipboard
Junlin Liu, Shengnan An, Shuang Zhou, Dan Ma, Yehao Lin, Xinxuan Lv, Xuanlin Wang, Xiaoyu Li, Ziwen Wang, Xuezhi Cao, Xunliang Cai
| Challenge: | Existing benchmarks for mathematical reasoning are becoming less effective due to performance saturation. |
| Approach: | They propose to use a mathematical reasoning benchmark with Olympiad difficulty to evaluate top-tier LLMs. |
| Outcome: | The proposed benchmarks are cross-validated by experts to meet IMO difficulty standards and entirely original problems to prevent performance leakages from data memorization. |
Rhetorically Controlled Encoder-Decoder for Modern Chinese Poetry Generation (P19-1)
Copied to clipboard
| Challenge: | Rhetoric is a vital element in modern Chinese poetry, and plays an essential role in improving its aesthetics. however, to date, it has not been considered in research on automatic poetry generation. |
| Approach: | They propose a rhetorically controlled encoder-decoder for modern Chinese poetry generation . their model captures various rhetorical patterns in an encoder and incorporates mixtures . |
| Outcome: | The proposed model outperforms state-of-the-art methods in terms of fluency, coherence, meaningfulness, and rhetorical aesthetics. |
Program Transfer for Answering Complex Questions over Knowledge Bases (2022.acl-long)
Copied to clipboard
| Challenge: | Program induction for complex questions over knowledge bases relies on a large number of parallel question-program pairs for the given KB, but the gold program annotations are usually lacking, making learning difficult. |
| Approach: | They propose an approach to leverage program annotations on rich KBs as external supervision signals to aid program induction for low-resourced KB. |
| Outcome: | The proposed approach outperforms SOTA methods on ComplexWebQuestions and WebQuestionSP. |
The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding (2020.acl-demos)
Copied to clipboard
Xiaodong Liu, Yu Wang, Jianshu Ji, Hao Cheng, Xueyun Zhu, Emmanuel Awa, Pengcheng He, Weizhu Chen, Hoifung Poon, Guihong Cao, Jianfeng Gao
| Challenge: | MT-DNN is an open-source natural language understanding toolkit . it allows researchers and developers to train customized deep learning models . |
| Approach: | They present MT-DNN, an open-source natural language understanding toolkit . it is designed to facilitate rapid customization for a broad spectrum of NLU tasks . MT supports multi-task knowledge distillation, which can substantially compress a deep neural model without significant performance drop. |
| Outcome: | The proposed model can significantly compress a large model without significant performance drop. |
Focus on Your Question! Interpreting and Mitigating Toxic CoT Problems in Commonsense Reasoning (2024.acl-long)
Copied to clipboard
| Challenge: | Large language models exhibit high-level commonsense reasoning abilities, especially with enhancement methods like Chain-of-Thought (CoT). |
| Approach: | They propose a chain-of-thought-like method to elicit models' potential abilities to generate rationales and answers that are based on attribution tracing and causal tracers to probe the internal working mechanism of the LLM. |
| Outcome: | The proposed method eliminates Toxic CoT problems and improves the model’s overall commonsense reasoning performance by 5.5%. |
Topology Matters: Measuring Memory Leakage in Multi-Agent LLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Multi-agent LLMs are rapidly moving from prototype to real-world use . network topology is a first-order security parameter in multi-aggent systems . |
| Approach: | They propose a framework for comparing topology-conditioned memory leakage in multi-agent LLM systems. |
| Outcome: | The proposed framework evaluates topology-conditioned memory leakage in multi-agent LLM systems. |
MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsing (2026.acl-industry)
Copied to clipboard
Junbo Niu, Zheng Liu, Zhuangcheng Gu, Bin Wang, Linke Ouyang, Zhiyuan Zhao, Tao Chu, Tianyao He, Fan Wu, Qintong Zhang, Zhenjiang Jin, Guang Liang, Rui Zhang, Wenzheng Zhang, Yuan Qu, Zhifei Ren, Yuefeng Sun, Zirui Tang, Boyu Niu, Yuanhong Zheng, Dongsheng Ma, Ziyang Miao, Hejun Dong, Siyi Qian, Junyuan Zhang, Fangdong Wang, Jingzhou Chen, Xiaomeng Zhao, Liqun Wei, Wei Li, Shasha Wang, RuiLiang Xu, Yuanyuan Cao, Lu Chen, Qianqian Wu, Huaiyu Gu, Lindong Lu, Dechen Lin, null Shenguanlin, Xuanhe Zhou, Linfeng Zhang, Yuhang Zang, Xiaoyi Dong, Jiaqi Wang, Bo Zhang, Lei Bai, Pei Chu, Weijia Li, Jiang Wu, Lijun Wu, Zhenxiang Li, Guangyu Wang, Zhongying Tu, Chao Xu, Kai Chen, Bowen Zhou, Dahua Lin, Wentao Zhang, Conghui He
| Challenge: | Document images are characterized by higher resolutions, denser content, and more complex structural layouts. |
| Approach: | They propose a 1.2B-parameter document parsing vision-language model that decouples layout analysis from local content recognition. |
| Outcome: | The proposed model surpasses general-purpose and domain-specific models on multiple benchmarks while maintaining significantly lower computational overhead. |
TongGu: Mastering Classical Chinese Understanding with Knowledge-Grounded Large Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated remarkable capability in Natural Language Processing (NLP), but struggle with Classical Chinese Understanding (CCU) Existing models, including general-purpose and preliminary LLMs, lack the ability to address CCU in data-demanding and knowledge-intensive tasks. |
| Approach: | They propose to use a classical Chinese corpora-based instruction-tuning dataset to unlock the full CCU potential of LLMs. |
| Outcome: | The proposed model unlocks the full CCU potential of LLMs by preserving its foundational knowledge while maintaining redundancy-aware tuning (RAT) and CCU-RAG. |
Denoising Bottleneck with Mutual Information Maximization for Video Multimodal Fusion (2023.acl-long)
Copied to clipboard
| Challenge: | Prior denoising methods suppress redundant and noisy information at risk of losing critical information. |
| Approach: | They propose a denoising bottleneck fusion model for fine-grained video multimodal fusion . they employ a bottleneck mechanism to filter out noise and redundancy with a restrained receptive field . |
| Outcome: | The proposed model improves on state-of-the-art video multimodal fusion benchmarks. |
Interpreting Sentiment Composition with Latent Semantic Tree (2023.findings-acl)
Copied to clipboard
| Challenge: | Current researches on sentiment classification are shifting from improving model performance to interpretability. |
| Approach: | They propose a new tree form capable of interpreting sentiment composition in a principled way. |
| Outcome: | The proposed tree can explain sentiment composition in a principled way. |
Emotion Transfer with Enhanced Prototype for Unseen Emotion Recognition in Conversation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing research on emotion recognition in conversation does not reach a consensus on classification theories . despite this, there is no clear consensus on how to recognize previously unseen emotions in real-world applications. |
| Approach: | They propose a prototype-based emotion transfer framework that can be used in real-world applications. |
| Outcome: | The proposed framework shows promise but still faces key challenges in the field of emotion recognition in conversation. |
MULFE: A Multi-Level Benchmark for Free Text Model Editing (2024.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have impressive capabilities in comprehending human language and vast parametric knowledge obtained from large corpora. |
| Approach: | They propose a multi-level benchmark for free text model editing to bridge the gap . they categorize probe queries into three levels of generalization . |
| Outcome: | The proposed method improves the generalization performance of large langugae models. |
ArchiDocGen: Multi-Agent Framework for Expository Document Generation in the Architectural Industry (2025.acl-industry)
Copied to clipboard
Junjie Jiang, Haodong Wu, Yongqi Zhang, Songyue Guo, Bingcen Liu, Caleb Chen Cao, Ruizhe Shao, Chao Guan, Peng Xu, Lei Chen
| Challenge: | drafting method statements is labor-intensive and time-consuming . traditional methods involve using static templates filled in manually by engineers . |
| Approach: | They propose a framework that automates method statement generation by using multi-agent collaboration. |
| Outcome: | The proposed framework achieves 4.38 ContentScore, excelling in specialization, completeness, organization, and clarity. |
ℛ3: Advertisement Compliance ℛectification via Group-ℛelative Experience Extractor and Curriculum ℛeinforcement (2026.acl-industry)
Copied to clipboard
| Challenge: | Existing methods of content moderation are infeasible due to over-editing and compromise the advertiser’s original semantic intent. |
| Approach: | They propose a framework to harmonize compliance with original intent preservation that integrates a data-driven framework and a curriculum to enforce compliance while maximizing semantic consistency. |
| Outcome: | The proposed framework outperforms state-of-the-art baselines on industrial datasets and on online A/B testing on industrial video. |
RA-ISF: Learning to Answer and Understand from Retrieval Augmentation via Iterative Self-Feedback (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated excellent performance in numerous tasks but the parameterized knowledge stored within LLMs may be incomplete and hard to incorporate up-to-date knowledge. |
| Approach: | They propose a framework that iteratively decomposes tasks and processes them in three submodules to enhance the model’s problem-solving capabilities. |
| Outcome: | The proposed method outperforms existing benchmarks on GPT3.5, Llama2 and other large language models significantly enhancing factual reasoning capabilities and reducing hallucinations. |
Examining Inter-Consistency of Large Language Models Collaboration: An In-depth Analysis via Debate (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies focus on inconsistency issues within a single LLM, while we explore the inter-consistencies among multiple LLMs for collaboration. |
| Approach: | They propose a formal debate framework to examine whether LLMs can collaborate effectively to achieve a consensus for a shared goal. |
| Outcome: | The proposed framework enables LLMs to achieve consensus in three real-world debate scenarios with real-time scenarios aligned to the LLM's goals. |
Learning Robust Representations for Continual Relation Extraction via Adversarial Class Augmentation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies attribute catastrophic forgetting to the corruption of the learned representations as new relations come . Continual relation extraction models suffer from catastrophic forgetting when learning new relations . |
| Approach: | They propose to use adversarial class augmentation mechanism to learn more precise representations . they propose to train the model on a sequence of tasks where two new relations are discovered . |
| Outcome: | The proposed model improves on two popular benchmarks. |
Do LLMs Know Tool Irrelevance? Demystifying Structural Alignment Bias in Tool Invocations (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have impressive capabilities in utilizing external tools, but in practice, they are often exposed to tools that are irrelevant to the user’s query, in which case the desired behavior is to refrain from invocations. |
| Approach: | They propose a new dataset that decouples structural alignment from semantic relevance and propose rebalancing strategies that effectively mitigates structural alignment bias. |
| Outcome: | The proposed approach effectively mitigates structural alignment bias without degrading general tool-use capabilities. |
Two Streams, One Sarcasm: Orthogonal Expert Tuning for Holistic Multimodal Sarcasm Understanding (2026.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks for multimodal satirical cognition hinder evaluation of multimodal Sarcasm Understanding . lack of a unified benchmark for holistic satire cognition hampers evaluation of MSU . |
| Approach: | They propose a framework to decouple experts into orthogonal shared perception and private execution streams to physically block gradient interference between tasks. |
| Outcome: | The proposed framework achieves superior performance on DocMSU-PLUS. |
InsightEval: An Expert-Curated Benchmark for Assessing Insight Discovery in LLM-Driven Data Agents (2026.findings-acl)
Copied to clipboard
Zhenghao Zhu, Yuanfeng Song, Xing Chen, Chengzhong Liu, Cui Yakun, Caleb Chen Cao, Sirui Han, Yike Guo
| Challenge: | Existing frameworks for data analysis and insight exploration are lacking in terms of benchmarks . existing frameworks suffer from format inconsistencies, poorly conceived objectives, and redundant insights. |
| Approach: | They propose a data-curation pipeline to construct a new dataset named InsightEval. |
| Outcome: | The proposed benchmarks highlight prevailing challenges in automated insight discovery and raise key findings to guide future research. |
HPT: Hierarchy-aware Prompt Tuning for Hierarchical Text Classification (2022.emnlp-main)
Copied to clipboard
| Challenge: | Hierarchical text classification (HTC) is a multi-label classification problem with a complex label hierarchy. |
| Approach: | They propose a Hierarchy-aware Prompt Tuning method to handle HTC from a multi-label perspective using a dynamic virtual template and label words that take the form of soft prompts to fuse the label hierarchy knowledge. |
| Outcome: | The proposed method achieves state-of-the-art performance on 3 popular HTC datasets and is adept at handling imbalance and low resource situations. |
Seeking Patterns, Not just Memorizing Procedures: Contrastive Learning for Solving Math Word Problems (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing models memorize procedures from context and rely on shallow heuristics to solve MWPs. |
| Approach: | They propose a contrastive learning approach where the neural network perceives the divergence of patterns. |
| Outcome: | The proposed method greatly improves performance in monolingual and multilingual settings. |
Multi-Programming Language Sandbox for LLMs (2025.acl-demo)
Copied to clipboard
Shihan Dou, Jiazheng Zhang, Jianxiang Zang, Yunbo Tao, Weikang Zhou, Haoxiang Jia, Shichun Liu, Yuming Yang, Shenxi Wu, Zhiheng Xi, Muling Wu, Rui Zheng, Changze Lv, Limao Xiong, Shaoqing Zhang, Lin Zhang, Wenyu Zhan, Rongxiang Weng, Jingang Wang, Xunliang Cai, Yueming Wu, Ming Wen, Yixin Cao, Tao Gui, Xipeng Qiu, Qi Zhang, Xuanjing Huang
| Challenge: | MPLSandbox is an out-of-the-box multi-programming language sandbox designed to provide unified and comprehensive feedback from compiler and analysis tools for Large Language Models (LLMs). |
| Approach: | They propose a multi-programming language sandbox that provides unified feedback from compilers and analysis tools for Large Language Models. |
| Outcome: | The proposed multi-language sandbox can provide comprehensive feedback from compilers and analysis tools for large language models (LLMs). |
Hierarchical Curriculum Learning for AMR Parsing (2022.acl-short)
Copied to clipboard
| Challenge: | Abstract Meaning Representation (AMR) parsing aims to translate sentences to semantic representation with a hierarchical structure, but there is a gap between their flat training objective and the hierarchic structure, which limits the model generalization. |
| Approach: | They propose a Hierarchical Curriculum Learning framework with Structure-level (SC) and Instance-level curricula (IC) that aims to translate sentences to semantic representation with a hierarchical structure. |
| Outcome: | Experiments on AMR2.0, AMR3.0, structure-complex and out-of-distribution situations confirm the effectiveness of the proposed framework. |
Dual-Path Counterfactual Integration for Multimodal Aspect-Based Sentiment Classification (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for multimodal aspect-based sentiment classification rely on superficial correlations and spurious cues. |
| Approach: | They propose a Dual-Path Counterfactual Integration framework that explicitly models counterfactual reasoning in multimodal contexts. |
| Outcome: | The proposed framework improves model robustness by explicitly modeling counterfactual reasoning in multimodal contexts. |
Jointly Learning to Align and Summarize for Neural Cross-Lingual Summarization (2020.acl-main)
Copied to clipboard
| Challenge: | Existing studies on cross-lingual summarization focus on pipeline methods and training end-to-end models. |
| Approach: | They propose to jointly learn to align and align to train a neural cross-lingual summarization model by using a large-scale corpus. |
| Outcome: | The proposed model outperforms competing models in most cases and can generate cross-lingual summaries without access to any cross-linguistic corpus. |
APPSI-139: A Parallel Corpus of English Application Privacy Policy Summarization and Interpretation (2026.acl-long)
Copied to clipboard
Pengyun Zhu, Qiheng Sun, Long Wen, Yanbo Wang, Yang Cao, Junxu Liu, Deyi Xiong, Jinfei Liu, Zhibo Wang, Kui Ren
| Challenge: | a lack of high-quality English privacy policy corpus optimized for legal clarity and readability is limiting translation of privacy policies . 139 privacy policies are often considered "incomprehensible" due to technical jargon, legal language, and convoluted grammatical structures. |
| Approach: | They propose a high-quality English privacy policy corpus annotated by domain experts . they propose APPSI-139 to summarize and interpret privacy policies in English . |
| Outcome: | The proposed framework outperforms large language models in terms of readability and accuracy. |
Task-adaptive Label Dependency Transfer for Few-shot Named Entity Recognition (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for Named Entity Recognition (NER) ignore label dependency, resulting in suboptimal performance. |
| Approach: | They propose a meta-learning method to make label dependency transferable by learning general initialization and individual parameter update rule for label dependency. |
| Outcome: | The proposed method improves existing methods by learning general initialization and individual parameter update rule for label dependency. |
MAGRET: Machine-generated Text Detection with Rewritten Texts (2025.coling-main)
Copied to clipboard
| Challenge: | Existing studies focus on detecting machine-generated text in open-source models, but their performance on closed-source large models is limited. |
| Approach: | They propose a method to detect rewritten text from large language models using a BERT encoder and propose to refine it to achieve semantic alignment. |
| Outcome: | The proposed method outperforms baseline methods on three text-generated datasets. |
HyperCore: Hyperbolic and Co-graph Representation for Automatic ICD Coding (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for ICD coding ignore Code Hierarchy and Code Co-occurrence . cost of manual coding estimated to be $25 billion per year in the US . |
| Approach: | They propose a hyperbolic representation method to leverage the code hierarchy and a graph convolutional network to utilize the code co-occurrence. |
| Outcome: | The proposed model outperforms state-of-the-art methods on two widely used datasets. |
DocAgent: A Multi-Agent System for Automated Code Documentation Generation (2025.acl-demo)
Copied to clipboard
| Challenge: | Existing methods for generating documentation using Large Language Models (LLMs) produce incomplete, unhelpful, or factually incorrect outputs. |
| Approach: | They propose a novel collaborative system that uses topological code processing for incremental context building to generate documentation by agents. |
| Outcome: | The proposed system outperforms baselines in completeness, helpfulness, and truthfulness evaluations. |
FLAG-TRADER: Fusion LLM-Agent with Gradient-based Reinforcement Learning for Financial Trading (2025.findings-acl)
Copied to clipboard
Guojun Xiong, Zhiyang Deng, Keyi Wang, Yupeng Cao, Haohang Li, Yangyang Yu, Xueqing Peng, Mingquan Lin, Kaleb E Smith, Xiao-Yang Liu, Jimin Huang, Sophia Ananiadou, Qianqian Xie
| Challenge: | Large language models (LLMs) have impressive reasoning capabilities in financial tasks, but struggle with multi-step, goal-oriented scenarios in interactive financial markets. |
| Approach: | They propose a framework that integrates large language models with gradient-driven reinforcement learning (RL) policy optimization. |
| Outcome: | The proposed framework improves performance in trading and other financial domain tasks. |
DialogUSR: Complex Dialogue Utterance Splitting and Reformulation for Multiple Intent Detection (2022.findings-emnlp)
Copied to clipboard
Haoran Meng, Zheng Xin, Tianyu Liu, Zizhen Wang, He Feng, Binghuai Lin, Xuemin Zhao, Yunbo Cao, Zhifang Sui
| Challenge: | DialogUSR is a plug-in and domain-agnostic module that empowers multi-intent detection for chatbots . a single user query triggers inquiries on highspeed train ticket price and weather of destination. |
| Approach: | They propose a dialog utterance splitting and reformulation task that splits multi-intent user query into multiple single-intention sub-queries and recovers all coreferred and omitted information in the sub-questions. |
| Outcome: | The proposed model can be used to split multi-intent user queries into multiple sub-queries . it can be trained in two stages and perform in-depth analyses on the proposed models . |
Automatically Select Emotion for Response via Personality-affected Emotion Transition (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing studies focus on rendering specified emotions in responses, yet the individual difference in emotion expression is overlooked. |
| Approach: | They propose to equip a dialog system with personality and enable it to select emotions in responses like humans. |
| Outcome: | The proposed system can select emotions in responses like humans by simulating the emotion transition of humans in conversation. |
DIFFA-2: A Practical Diffusion Large Language Model for General Audio Understanding (2026.findings-acl)
Copied to clipboard
| Challenge: | Autoregressive (AR) large audio language models are expensive in data and computation . prior work shows diffusion-based LALMs can improve audio understanding under matched settings . |
| Approach: | They propose a diffusion-based LALM that upgrades the speech encoder and employs dual semantic and acoustic adapters. |
| Outcome: | a new model improves over existing autoregressive large language models and is competitive to strong AR models . the proposed model can make use of limited training data and improve inference efficiency . a recent study shows that diffusion-based models can improve audio understanding . |
KoRC: Knowledge Oriented Reading Comprehension Benchmark for Deep Text Understanding (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks for deep text understanding have encountered two major limitations . most require human annotation of knowledge, which leads to limited knowledge coverage . |
| Approach: | They propose a benchmark to help readers understand a document with prior knowledge . they use massive knowledge bases to guide annotators and large language models to construct knowledgable questions . |
| Outcome: | The proposed benchmarks have limited knowledge coverage and use choices or spans as answers, which results in narrow answer space. |
Revealing the Parallel Multilingual Learning within Large Language Models (2024.emnlp-main)
Copied to clipboard
Yongyu Mu, Peinan Feng, Zhiquan Cao, Yuzhang Wu, Bei Li, Chenglong Wang, Tong Xiao, Kai Song, Tongran Liu, Chunliang Zhang, JingBo Zhu
| Challenge: | Large language models (LLMs) can handle multilingual and cross-lingual text within a single input; however, previous studies focusing on using English as the pivot language to enhance language understanding and reasoning focus on using multiple languages. |
| Approach: | They propose to use parallel multilingual input to enhance the model's comprehension of the input and to examine how multilingual processing affects prediction. |
| Outcome: | The proposed model can handle multilingual and cross-lingual text within a single input, but previous studies focused on using English as the pivot language to enhance language understanding and reasoning. |
Whispers that Shake Foundations: Analyzing and Mitigating False Premise Hallucinations in Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models generate hallucinated text when confronted with false premise questions . authors propose a method to mitigate false premises hallucinosity . |
| Approach: | They propose a method to constrain false premise attention heads during the model inference process. |
| Outcome: | The proposed method improves performance by constraining false premise attention heads . it yields a notable increase of nearly 20% of model performance . |
HyperEdit: Unlocking Instruction-based Text Editing in LLMs via Hypernetworks (2026.findings-acl)
Copied to clipboard
Yiming Zeng, Jinghan Cao, Zexin Li, Wanhao Yu, Zhankai Ye, Dawei Xiang, Ting Hua, Xin Liu, Shangqian Gao, Tingting Yu
| Challenge: | Existing approaches treat instruction-based text editing as a generic text generation problem. Existing methods either over-edit or fail to apply modifications consistently. |
| Approach: | They propose a framework that processes each editing request to best align with it. |
| Outcome: | The proposed framework achieves 9% improvement over the state-of-the-art model. |
LINKED: Eliciting, Filtering and Integrating Knowledge in Large Language Model for Commonsense Reasoning (2024.findings-emnlp)
Copied to clipboard
Jiachun Li, Pengfei Cao, Chenhao Wang, Zhuoran Jin, Yubo Chen, Kang Liu, Xiaojian Jiang, Jiexin Xu, Jun Zhao
| Challenge: | Large language models (LLMs) often exhibit poor performance on knowledge-intensive tasks, such as commonsense reasoning. |
| Approach: | They propose a method to elicit, filter and integrate knowledge in large language models (LINKED) they propose 'reward model' to filter out noisy knowledge and 'take marginal consistent reasoning module' |
| Outcome: | The proposed method outperforms SOTA baselines on two commonsense reasoning tasks. |
STORM-BORN: A Challenging Mathematical Derivations Dataset Curated via a Human-in-the-Loop Multi-Agent Framework (2025.findings-acl)
Copied to clipboard
Wenhao Liu, Zhenyi Lu, Xinyu Hu, Jerry Zhang, Dailin Li, Jiacheng Cen, Huilin Cao, Haiteng Wang, Yuhan Li, Xie Kun, Dandan Li, Pei Zhang, Chengbo Zhang, Yuxiang Ren, Xiaohong Huang, Yan Ma
| Challenge: | Existing datasets suffer from outdated and insufficient challenging content, neglecting human-like reasoning, and limited reliability due to single-LLM generation. |
| Approach: | They propose a human-in-the-loop, multi-agent data generation framework that integrates reasoning-dense filters, multiagent collaboration, and human mathematicians’ evaluations to ensure the reliability and quality of the dataset. |
| Outcome: | The proposed framework improves accuracy and quality of the 2,000-synthesized datasets by integrating reasoning-dense filters, multi-agent collaboration, and human mathematicians’ evaluations. |
LogicPro: Improving Complex Logical Reasoning via Program-Guided Learning (2025.acl-long)
Copied to clipboard
Jin Jiang, Yuchen Yan, Yang Liu, Jianing Wang, Shuai Peng, Xunliang Cai, Yixin Cao, Mengdi Zhang, Liangcai Gao
| Challenge: | LogicPro is a data synthesis method that uses LeetCode-style algorithm problems and their corresponding Program solutions to generate complex logic data. |
| Approach: | They propose a new method which leverages LeetCode-style algorithm Problems and their corresponding Program solutions to synthesize complex logic data in text format. |
| Outcome: | The proposed method outperforms existing models for BBH27, LogicBench, DROP, AR-LSAT, and GSM8K, and a wide range of reasoning datasets. |
DiffusionSL: Sequence Labeling via Tag Diffusion Process (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Sequence Labeling (SL) is a long-standing field of natural language processing. |
| Approach: | They propose a framework that utilizes a conditional discrete diffusion model for generating discrete tag data. |
| Outcome: | The proposed framework outperforms gpt-3.5-turbo on multiple benchmark datasets and tasks. |
Planning Like Human: A Dual-process Framework for Dialogue Planning (2024.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) operate in a reactive mode, often resulting in efficiency issues or suboptimal performance. |
| Approach: | They propose a dual-process dialogue planning framework that leverages the dual-process theory of human cognition and a deliberative Monte Carlo Tree Search mechanism to emulate human-like conversational dynamics. |
| Outcome: | The proposed framework outperforms existing methods in achieving high-quality dialogues and operational efficiency. |
Mulan: A Multi-Level Alignment Model for Video Question Answering (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods focus on visual-language alignment at the video level, but they do not account for fine-grained semantic interaction between video and text. |
| Approach: | They propose a multi-level Alignment Model for Video Question Answering that establishes alignment between visual and textual modalities at the object-level, frame-level and video-level. |
| Outcome: | The proposed model outperforms state-of-the-art methods even with a small amount of extra visual-language pre-training data and a reduced number of trainable parameters. |
Same Claim, Different Judgment: Benchmarking Scenario-Induced Bias in Multilingual Financial Misinformation Detection (2026.findings-acl)
Copied to clipboard
Zhiwei Liu, Yupeng Cao, Yuechen Jiang, Mohsinul Kabir, Polydoros Giannouris, Chen Xu, Ziyang Xu, Tianlei Zhu, Md. Tariquzzaman, Triantafillos Papadopoulos, Yan Wang, Lingfei Qian, Xueqing Peng, Zhuohan Xie, Ye Yuan, Saeed Almheiri, Abdulrazzaq Alnajjar, Ming-Bin Chen, Harry Stuart, Paul Thompson, Prayag Tiwari, Alejandro Lopez-Lira, Xue Liu, Jimin Huang, Sophia Ananiadou
| Challenge: | Existing research on LLM biases has focused on direct questioning or general-purpose settings . pronounced behavioral biase despite their growing deployment in financial analysis, forecasting, and decision support. |
| Approach: | They propose a benchmark to evaluate behavioral biases of large language models in MFMD . they use a multilingual financial misinformation dataset to integrate these with misinformation claims . |
| Outcome: | The proposed benchmark evaluates behavioral biases of large language models across economic scenarios. |
See the World, Discover Knowledge: A Chinese Factuality Evaluation for Large Vision Language Models (2025.findings-acl)
Copied to clipboard
Jihao Gu, Yingyao Wang, Pi Bu, Chen Wang, Ziming Wang, Tengtao Song, Donglai Wei, Jiale Yuan, Yingxiu Zhao, Yancheng He, Shilong Li, Jiaheng Liu, Meng Cao, Jun Song, Yingshui Tan, Xiang Li, Wenbo Su, Xiaoyong Zhu, Bo Zheng
| Challenge: | Existing models for large vision language models do not fully reflect their knowledge capacity and reliability, resulting in erroneous outputs that do not align with the image content or provide answers lacking knowledge evidence. |
| Approach: | They propose a Chinese-based benchmark for visual factuality across 8 major topics and 56 subtopics and a multi-hop question construction. |
| Outcome: | The proposed model decouples visual factuality into two parts: seeing the world and discovering knowledge. |
InternLM-XComposer2.5-Reward: A Simple Yet Effective Multi-Modal Reward Model (2025.findings-acl)
Copied to clipboard
Yuhang Zang, Xiaoyi Dong, Pan Zhang, Yuhang Cao, Ziyu Liu, Shengyuan Ding, Shenxi Wu, Yubo Ma, Haodong Duan, Wenwei Zhang, Kai Chen, Dahua Lin, Jiaqi Wang
| Challenge: | Despite the promising performance of Large Vision Language Models, they sometimes generate incorrect outputs. |
| Approach: | They propose a multi-modal reward model that aligns LVLMs with human preferences. |
| Outcome: | The proposed model achieves excellent results on the latest multi-modal reward model benchmark and shows competitive performance on text-only reward model. |
CLUE: A Chinese Language Understanding Evaluation Benchmark (2020.coling-main)
Copied to clipboard
Liang Xu, Hai Hu, Xuanwei Zhang, Lu Li, Chenjie Cao, Yudong Li, Yechen Xu, Kai Sun, Dian Yu, Cong Yu, Yin Tian, Qianqian Dong, Weitang Liu, Bo Shi, Yiming Cui, Junyi Li, Jun Zeng, Rongzhao Wang, Weijian Xie, Yanting Li, Yina Patterson, Zuoyu Tian, Yiwen Zhang, He Zhou, Shaoweihua Liu, Zhe Zhao, Qipeng Zhao, Cong Yue, Xinrui Zhang, Zhengliang Yang, Kyle Richardson, Zhenzhong Lan
| Challenge: | Existing language evaluation benchmarks for English are limited to English . lack of such benchmarks makes it difficult to replicate success in other languages . |
| Approach: | They introduce a large-scale Chinese language understanding evaluation benchmark . the benchmark uses a set of current state-of-the-art pre-trained Chinese models . |
| Outcome: | The first large-scale Chinese Language Understanding Evaluation (CLUE) benchmark is released . the benchmark evaluates models across a wide range of tasks on original Chinese text . existing language evaluation benchmarks are mostly limited to English . |
TRIGO: Benchmarking Formal Mathematical Proof Reduction for Generative Language Models (2023.emnlp-main)
Copied to clipboard
Jing Xiong, Jianhao Shen, Ye Yuan, Haiming Wang, Yichun Yin, Zhengying Liu, Lin Li, Zhijiang Guo, Qingxing Cao, Yinya Huang, Chuanyang Zheng, Xiaodan Liang, Ming Zhang, Qun Liu
| Challenge: | Automated theorem proving (ATP) benchmarks focus on symbolic inference but rarely involve understanding complex number combination reasoning. |
| Approach: | They propose a benchmark that requires a model to reduce a trigonometric expression with step-by-step proof and evaluates a generative LM’s reasoning ability on formulas and ability to manipulate, group, and factor number terms. |
| Outcome: | The proposed benchmark evaluates a generative LM’s reasoning ability on formulas and ability to manipulate, group, and factor number terms. |
Intuitive or Dependent? Investigating LLMs’ Behavior Style to Conflicting Prompts (2024.acl-long)
Copied to clipboard
| Challenge: | Extensive experiments with seven Large Language Models reveal their varying behaviors. |
| Approach: | They investigate the behaviors of Large Language Models when faced with conflicting prompts versus their internal memory. |
| Outcome: | Extensive experiments with seven LLMs reveal their varying behaviors. |
ZhuJiu: A Multi-dimensional, Multi-faceted Chinese Benchmark for Large Language Models (2023.emnlp-demo)
Copied to clipboard
Baoli Zhang, Haining Xie, Pengfan Du, Junhao Chen, Pengfei Cao, Yubo Chen, Shengping Liu, Kang Liu, Jun Zhao
| Challenge: | Various types of LLMs have recently been rapidly developing, such as Llama2 and ChatGLM2 . |
| Approach: | They propose a benchmark that comprehensively evaluates LLMs across 7 ability dimensions covering 51 tasks. |
| Outcome: | The proposed benchmarks are comprehensive and systematic, with a high level of accuracy and authority. |
FRSUM: Towards Faithful Abstractive Summarization via Enhancing Factual Robustness (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models of abstractive summarization are able to generate fluent and coherent summaries, but they still suffer from the unfaithful generation problem. |
| Approach: | They propose to improve the faithfulness of existing models by enhancing their factual robustness by using a novel training strategy, namely FRSUM, which teaches the model to defend against both explicit adversarial samples and implicit factual adversarials. |
| Outcome: | The proposed training strategy improves faithfulness of various models, such as T5, BART, and T5 . |
Learning How to Remember: A Meta-Cognitive Management Method for Structured and Transferable Agent Memory (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches store memory in fixed representations and reuse it at a single or implicit level of abstraction, which limits generalization and often leads to negative transfer when distribution shift. |
| Approach: | They propose a Meta-Cognitive Memory Abstraction method which decouples task execution from memory management by combining a frozen task model with a learned memory copilot. |
| Outcome: | Experiments on ALFWorld, ScienceWorld, and BabyAI show that the proposed method improves performance, out-of-distribution generalization, and cross-task transfer over several baselines. |
Positive Text Reframing under Multi-strategy Optimization (2025.coling-main)
Copied to clipboard
| Challenge: | Existing positive reframing models can be fine-tuned to achieve acceptable results, but generating fluent, diverse text remains a challenge. |
| Approach: | They propose a positive reframing sentiment reward and content preservation reward framework . they propose re-ranking methods that optimize for style and consistency . |
| Outcome: | The proposed framework improves on unconstrained and controlled positive reframing tasks. |
CAPE: A Chinese Dataset for Appraisal-based Emotional Generation in Large Language Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing LLMs fail to capture the nuances of human emotions, making their interactions seem impersonal or inadequate. |
| Approach: | They propose a two-stage automatic data generation framework to generate a Chinese dataset called CAPE . their data is a cognitive appraisal theory-based Emotional corpus that accounts for personal and situational factors. |
| Outcome: | The proposed framework can generate human-like responses in conversation with large language models. |
Attribution-Based Analysis and Optimization of Modular Agentic Workflows (2026.findings-acl)
Copied to clipboard
Yingxuan Yang, Bo Huang, Siyuan Qi, Chao Feng, Haoyi Hu, Yuxuan Zhu, Jinbo Hu, Haoran Zhao, Ziyi He, Xiao Liu, ZongYu Wang, Muning Wen, Lin Qiu, Xuezhi Cao, Xunliang Cai, Yong Yu, Weinan Zhang
| Challenge: | Large Language Models (LLMs) have driven the rise of agentic workflows . yet, how can we attribute performance gains to individual upgrades and their interactions? |
| Approach: | They propose a game-theoretic framework that models component upgrades as players and evaluates component coalitions to compute Shapley values. |
| Outcome: | The proposed framework provides interaction-aware attribution and recommendation for model allocation under a fixed workflow structure. |
Low-Resource Name Tagging Learned with Weakly Labeled Data (D19-1)
Copied to clipboard
| Challenge: | Existing methods for name tagging in low-resource languages or domains require extensive human efforts for training annotations. |
| Approach: | They propose a neural model for name tagging based on weakly labeled (WL) data. |
| Outcome: | The proposed model outperforms existing models in five low-resource languages and fine-grained food domains and shows that it is more efficient and efficient than existing models. |
Remember Me, Refine Me: A Dynamic Procedural Memory Framework for Experience-Driven Agent Evolution (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing frameworks treat memory as a static append-only archive . Existing systems focus on passive accumulation, resulting in a 'passive accumulation' of memory. |
| Approach: | They propose a framework for experience-driven agent evolution that integrates procedural memory with contextual information to create a high-quality experience pool. |
| Outcome: | Experiments on BFCL-V3 and AppWorld show that ReMe outperforms memoryless Qwen3-8B. |
Pay More Attention to Relation Exploration for Knowledge Base Question Answering (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches focus on entity representation and final answer reasoning, which results in limited supervision for this task. |
| Approach: | They propose a framework that utilizes relations to enhance entity representation and introduce additional supervision. |
| Outcome: | The proposed framework improves the F1 score on two benchmark datasets by 5.8% . it improves by 6.7% on WebQSP, better than state-of-the-art methods . |
Expertise Style Transfer: A New Task Towards Better Communication between Experts and Laymen (2020.acl-main)
Copied to clipboard
| Challenge: | a curse of knowledge can impede communication between experts and laymen. |
| Approach: | They propose a task of expertise style transfer to automate the communication between experts and laymen using an annotated dataset. |
| Outcome: | The proposed task simplifies professional language and improves accuracy and expertise level of laymen descriptions using simple words. |
Improving Empathetic Response Generation by Recognizing Emotion Cause in Conversations (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to empathetic response generation ignore the emotion cause . existing dialogue systems lack emotion understanding and empathy . |
| Approach: | They propose a framework that integrates emotion cause information into empathetic response generation by predicting context emotion labels and sequence of emotion cause-oriented labels. |
| Outcome: | The proposed framework improves empathetic response generation by incorporating emotion cause information into the model. |
Specializing Large Language Models to Simulate Survey Response Distributions for Global Populations (2025.naacl-long)
Copied to clipboard
| Challenge: | Prior work has focused on using large language models to simulate human behaviors . but, LLMs are known to generate erroneous, stereotypical, or overconfident answers . |
| Approach: | They propose to specialize large language models for simulating survey response distributions by first-token probabilities. |
| Outcome: | The proposed model outperforms other methods and zero-shot classifiers on unseen questions, countries, and a completely unseened survey. |
X-LeBench: A Benchmark for Extremely Long Egocentric Video Understanding (2025.findings-emnlp)
Copied to clipboard
Wenqi Zhou, Kai Cao, Hao Zheng, Yunze Liu, Xinyi Zheng, Miao Liu, Per Ola Kristensson, Walterio W. Mayol-Cuevas, Fan Zhang, Weizhe Lin, Junxiao Shen
| Challenge: | Existing benchmark datasets focus on short to moderately long videos, leaving a substantial gap in evaluating extensive, ultra-long egocentric video recordings. |
| Approach: | X-LeBench is a benchmark dataset designed to evaluate long egocentric video recordings . it uses a life-logging pipeline to produce realistic, coherent daily plans . |
| Outcome: | X-LeBench is a new benchmark dataset designed to evaluate long-form egocentric video understanding . the approach produces realistic, coherent daily plans aligned with real-world video data . |
Not All Tokens Matter: Towards Efficient LLM Reasoning via Token Significance in Reinforcement Learning (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) often produce unnecessarily long explanations that reduce efficiency. |
| Approach: | They propose a length-aware reward that selectively penalizes insignificance tokens . they also propose 'dynamic length control' that encourages more detailed reasoning . |
| Outcome: | The proposed method reduces response length while maintaining correctness, the authors show . it selectively penalizes insignificance tokens while maintaining accuracy . |
Semantic Parsing with Dual Learning (P19-1)
Copied to clipboard
| Challenge: | Existing approaches to parse natural language queries are limited by lack of labeled data and constrained decoding. |
| Approach: | They propose a semantic parsing framework with the dual learning algorithm that makes full use of data through a dual-learning game. |
| Outcome: | The proposed approach achieves state-of-the-art performance on ATIS dataset and gets competitive performance on overnight dataset. |
Binarized LSTM Language Model (N18-1)
Copied to clipboard
| Challenge: | Long short-term memory (LSTM) language models are widely used for automatic speech recognition and natural language processing (NLP) however, they are limited by the word embedding layer. |
| Approach: | They propose to encode words into binary vectors and use binarized LSTM parameters to achieve high memory compression. |
| Outcome: | The proposed model achieves 11.3 compression ratio without loss of performance and 31.6 compression ratio with acceptable performance degradation. |
SeaKR: Self-aware Knowledge Retrieval for Adaptive Retrieval Augmented Generation (2025.acl-long)
Copied to clipboard
| Challenge: | Adaptive Retrieval-Augmented Generation (RAG) is an effective strategy to alleviate hallucination of large language models (LLMs). |
| Approach: | They propose a novel adaptive RAG model that extracts self-aware uncertainty of large language models from their internal states and invokes retrieval accordingly. |
| Outcome: | The proposed model outperforms existing adaptive RAG methods on complex and simple Question Answering datasets. |
Toward Secure Tuning: Mitigating Security Risks from Instruction Fine-Tuning (2026.acl-long)
Copied to clipboard
Yanrui Du, Fenglei Fan, Sendong Zhao, Jiawei Cao, Ming Ma, Danyang Zhao, Shuren Qi, Ting Liu, Bing Qin
| Challenge: | Instruction Fine-Tuning (IFT) has emerged as a critical technique for customizing Large Language Models (LLMs) however, recent studies have revealed that IFT can compromise the built-in security mechanisms of LLMs, posing significant security risks. |
| Approach: | They propose a method that shifts learning burden onto security-robust parameters and propose 'warm-up' phase that preferentially trains Mods_Rob to learn low-level features with minimal security risk. |
| Outcome: | The proposed method reduces security risks without sacrificing performance gains across knowledge-intensive datasets. |
Enhancing Chinese Pre-trained Language Model via Heterogeneous Linguistics Graph (2022.acl-long)
Copied to clipboard
| Challenge: | Experimental results show that pre-trained Chinese language models ignore linguistics knowledge to learn representations. |
| Approach: | They propose a task-free enhancement module to integrate linguistics knowledge into Chinese pre-trained language models. |
| Outcome: | The proposed model improves Chinese pre-trained language models on 6 tasks with 10 benchmark datasets. |
Prompt Chaining or Stepwise Prompt? Refinement in Text Summarization (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) can improve summary quality by mirroring a human-like iterative process of critique and refinement starting from the initial draft. |
| Approach: | They propose to use Prompt Chaining and Stepwise Prompting to perform iterative refinement . they propose to combine the two methods to produce a more favorable outcome . |
| Outcome: | The proposed methods can improve summary quality by mirroring a human-like iterative process . the results show that the prompt chaining method produces a more favorable outcome . |
Rethinking Text-based Protein Understanding: Retrieval or LLM? (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have focused on integrating protein-related knowledge into large language models through continued pretraining and multi-modal alignment. |
| Approach: | They propose a retrieval-enhanced method which significantly outperforms fine-tuned LLMs for protein-to-text generation and shows accuracy and efficiency in training-free scenarios. |
| Outcome: | The proposed method significantly outperforms fine-tuned LLMs for protein-to-text generation and shows accuracy and efficiency in training-free scenarios. |
MT-R1-Zero: Advancing LLM-based Machine Translation via R1-Zero-like Reinforcement Learning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large-scale reinforcement learning (RL) methods have proven effective in enhancing the reasoning abilities of large language models. |
| Approach: | They propose an open-source adaptation of the R1-Zero RL framework for machine translation (MT) their code is available at https://github.com/fzp0424/MT-R1-zero. |
| Outcome: | The proposed framework surpasses towerinstruct-7B-v0.2 on the english-chinese benchmark by 1.26 points. |
Pre-training to Match for Unified Low-shot Relation Extraction (2022.acl-long)
Copied to clipboard
| Challenge: | Low-shot relation extraction (RE) aims to recognize novel relations with very few or even no samples. |
| Approach: | They propose a method that leverages triplet paraphrase to pre-train zero-shot label matching ability and uses meta-learning paradigm to learn few-shot instance summarizing ability. |
| Outcome: | The proposed method outperforms strong baselines and achieves the best performance on few-shot RE leaderboard. |
Investigating BERT’s Knowledge of Language: Five Analysis Methods with NPIs (D19-1)
Copied to clipboard
Alex Warstadt, Yu Cao, Ioana Grosu, Wei Peng, Hagen Blix, Yining Nie, Anna Alsop, Shikha Bordia, Haokun Liu, Alicia Parrish, Sheng-Fu Wang, Jason Phang, Anhad Mohananey, Phu Mon Htut, Paloma Jeretic, Samuel R. Bowman
| Challenge: | Recent work evaluating sentence representation models' knowledge of grammar has been slower to emerge. |
| Approach: | They propose five experimental methods inspired by prior work evaluating pretrained sentence representation models to examine their grammatical knowledge. |
| Outcome: | The proposed methods show that the model has significant knowledge of the licensing environment but its success varies widely across different methods. |
Anchored Cyclic Generation: A Novel Paradigm for Long-Sequence Symbolic Music Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Autoregressive sequence modeling has been successful in many domains, but maintaining long-term coherence and structural integrity remains a challenge. |
| Approach: | They propose an ACG paradigm that relies on anchor features from previously generated musical content to guide subsequent generation during the autoregressive process. |
| Outcome: | The proposed framework outperforms existing methods in symbolic music generation tasks. |
MR. Judge: Multimodal Reasoner as a Judge (2025.emnlp-main)
Copied to clipboard
| Challenge: | Effective reward modeling is especially valuable in reinforcement learning (RLHF) . |
| Approach: | They propose a paradigm for empowering general-purpose MLLMs judges with strong reasoning capabilities by using multiple-choice problem models instead of directly assigning scores. |
| Outcome: | The proposed model surpasses GPT-4o on VL-RewardBench and improves performance on MM-Vet by up to 7.7%. |
ZhuJiu-Knowledge: A Fairer Platform for Evaluating Multiple Knowledge Types in Large Language Models (2024.naacl-demo)
Copied to clipboard
| Challenge: | evaluating the knowledge of large language models (LLMs) is crucial, and rapid advancement in large language modeling has heightened the importance of model evaluations. |
| Approach: | They propose a fairer benchmark for evaluating multiple knowledge types of LLMs by focusing on commonsense knowledge, world knowledge, and language knowledge. |
| Outcome: | The proposed framework evaluates 14 current mainstream LLMs and provides a detailed discussion and analysis of their results. |
LLM-empowered Dynamic Prompt Routing for Vision-Language Models Tuning under Long-Tailed Distributions (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Pre-trained vision-language models (VLMs) often suffer from bias in class-imbalanced scenes. |
| Approach: | They propose a multi-dimensional dynamic prompt routing framework that integrates a knowledge base for classes spanning multiple visual-semantic dimensions. |
| Outcome: | The proposed framework achieves comparable results with current SOTA methods on long-tailed benchmarks, including CIFAR-LT, ImageNet-LT and Places-LT. |
Direct Large Language Model Alignment Through Self-Rewarding Contrastive Prompt Distillation (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods to evaluate preference data without human annotations are difficult . et al., 2022b) is effective for aligning large language models with human expectations . |
| Approach: | They propose a method to evaluate the response preference using output probabilities under contrastive prompts. |
| Outcome: | The proposed method could surpass the RLHF method without human-annotated preference data. |
PKAD: Pretrained Knowledge is All You Need to Detect and Mitigate Textual Backdoor Attacks (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Current defense methods can be classified into inference-time and training-time ones based on their execution phase. |
| Approach: | They propose a two-stage poison detection strategy using pre-trained language models to detect poisoned samples before model training. |
| Outcome: | The proposed method achieves better performance than current methods more quickly and with fewer training costs. |
CriticLean: Critic-Guided Reinforcement Learning for Mathematical Formalization (2026.acl-long)
Copied to clipboard
Zhongyuan Peng, Yifan Yao, Kaijing Ma, Shuyue Guo, Yizhe Li, Yichi Zhang, Chenchen Zhang, Yifan Zhang, Zhouliang Yu, Luming Li, Minghao Liu, Yihang Xia, Jiawei Shen, Yuchen Wu, Yixin Cao, Zhaoxiang Zhang, Wenhao Huang, Jiaheng Liu, Ge Zhang
| Challenge: | Existing approaches to formalizing mathematical statements face limitations in accuracy, especially in the context of complex, highlevel problems that involve sophisticated mathematical reasoning. |
| Approach: | They propose a CriticLean framework that elevates the role of the critic from a passive validator to an active learning component and introduce a benchmark to measure models’ ability to distinguish semantically correct from incorrect formalizations. |
| Outcome: | The proposed framework outperforms open- and closed-source benchmarks and shows that it significantly outperformed existing models. |
All That Glisters Is Not Gold: A Benchmark for Reference-Free Counterfactual Financial Misinformation Detection (2026.acl-long)
Copied to clipboard
Yuechen Jiang, Zhiwei Liu, Yupeng Cao, Yueru He, Ziyang Xu, Chen Xu, Zhiyang Deng, Prayag Tiwari, Xi Chen, Alejandro Lopez-Lira, Jimin Huang, Junichi Tsujii, Sophia Ananiadou
| Challenge: | RFC-Bench evaluates large language models on financial misinformation under realistic news . current models struggle to maintain coherent belief states without external grounding, study finds . |
| Approach: | They propose a benchmark for evaluating large language models on financial misinformation under realistic news. |
| Outcome: | The proposed model performs better when context is available, while reference-free settings expose significant weaknesses. |
One Token Is Enough: Improving Diffusion Language Models with a Sink Token (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing Diffusion Language Models lack a structural constraint to stabilize attention sinks. |
| Approach: | They propose a simple but effective extra sink token that is constrained to attend to itself while remaining globally visible to all other tokens. |
| Outcome: | The proposed token is able to stabilize attention sinks and improve model performance. |
Forewarned is Forearmed: Pre-Synthesizing Jailbreak-like Instructions to Enhance LLM Safety Guardrail to Potential Attacks (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Despite advances in improving large language model (LLM) to refuse to answer malicious instructions, LLMs remain vulnerable to jailbreak attacks where attackers generate instructions with distributions differing from safety alignment corpora. |
| Approach: | They propose a framework that leverages embedding space distribution analysis to generate jailbreak-like instructions. |
| Outcome: | The proposed framework shows significant decreases in attack success rate on Qwen2.5, Llama3.1, and Llma3.2 without compromising their utility. |
API-Assisted Code Generation for Question Answering on Varied Table Structures (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to table question answering have been limited to specific table structures. |
| Approach: | They propose a unified TableQA framework that uses Python as a querying language and few-shot prompting to translate NL questions into Python programs. |
| Outcome: | The proposed framework provides a unified representation for structured tables as multi-index Pandas data frames and uses Python as a powerful querying language to translate NL questions into Python programs. |
Multi-Channel Graph Neural Network for Entity Alignment (P19-1)
Copied to clipboard
| Challenge: | Existing methods to learn alignment-oriented knowledge graph embeddings suffer from structural heterogeneity and limited seed alignments. |
| Approach: | They propose a multi-channel Graph Neural Network model to learn alignment-oriented knowledge graph embeddings by encoding two KGs via multiple channels. |
| Outcome: | The proposed model is expected to reconcile the structural differences of two KGs, and thus make better use of seed alignments. |
On the Complementarity between Pre-Training and Random-Initialization for Resource-Rich Machine Translation (2022.coling-1)
Copied to clipboard
| Challenge: | Pre-Training (PT) of text representations has been successfully applied to low-resource Neural Machine Translation (NMT) however, it often fails to achieve notable gains on resource-rich NMT on par with its Random-Initialization (RI) counterpart. |
| Approach: | They propose to combine pre-training and random-initialization techniques to achieve significant improvements in NMT. |
| Outcome: | The proposed model fusion algorithm can achieve significant improvements on two resource-rich translation benchmarks. |
CCTVBench: Contrastive Consistency Traffic VideoQA Benchmark for Multimodal LLMs (2026.findings-acl)
Copied to clipboard
Xingcheng Zhou, Hao Guo, Rui Song, Walter Zimmer, Mingyu Liu, André Schamschurko, Hu Cao, Alois Knoll
| Challenge: | Existing Vision-language models are prone to hallucinating nonexistent entities or events and missing subtle but critical visual cues. |
| Approach: | They propose a Traffic VideoQA Benchmark that enforces a single structured decision pattern over each video question quadruple and provides actionable diagnostics that decompose failures into positive omission, positive swap, negative hallucination, mutual-exclusivity violation. |
| Outcome: | The proposed model detects true hazards when an accident occurs, and rejects plausible-but-false hypotheses under near-identical counterfactual scenes. |
Shadow-Activated Backdoor Attacks on Multimodal Large Language Models (2025.findings-acl)
Copied to clipboard
Ziyi Yin, Muchao Ye, Yuanpu Cao, Jiaqi Wang, Aofei Chang, Han Liu, Jinghui Chen, Ting Wang, Fenglong Ma
| Challenge: | Existing backdoor attacks on Multimodal Large Language Models are less applicable to open-ended conversations with users. |
| Approach: | They propose a shadow-activated backdoor attack scenario where attackers inject malicious content into the responses of MLLMs when the responses explicitly relate to the shadowed object. |
| Outcome: | The proposed framework achieves the desired behaviors by constructing a poisoned dataset and implementing an attention-regularized tuning strategy. |
RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for dense retrieval are not effective, but there are still challenges. |
| Approach: | They propose a retrieval oriented pre-training paradigm based on Masked Auto-Encoder (MAE) where the sentence embedding is generated from the encoder’s masked input and the original sentence is recovered based upon the sentence embedded and decoded input via mangled language modeling. |
| Outcome: | The proposed model significantly improves the SOTA performance on a wide range of NLP benchmarks, like BEIR and MS MARCO. |
Sibyl: Empowering Empathetic Dialogue Generation in Large Language Models via Sensible and Visionary Commonsense Inference (2025.coling-main)
Copied to clipboard
Lanrui Wang, Jiangnan Li, Chenxu Yang, Zheng Lin, Hongyin Tang, Huan Liu, Yanan Cao, Jingang Wang, Weiping Wang
| Challenge: | Recent studies have focused on integrating commonsense knowledge into chatbots to enhance their ability to understand and generate dialogue responses. |
| Approach: | They propose a framework that integrates commonsense knowledge into chatbots to enable them to elicit more empathetic responses. |
| Outcome: | The proposed framework enables LLMs to uncover the implicit requirements of the conversation, aiming to elicit more empathetic responses. |
Deep Differential Amplifier for Extractive Summarization (2021.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to extract summary from document with a disproportionate ratio of selected and unselected sentences are far from human performance. |
| Approach: | They propose a model that rebalances sentence-level extractive summarization by amplifying the semantic difference between each sentence and all other sentences and applying the residual unit as the second item of the differential amplifier to deepen the architecture. |
| Outcome: | The proposed model performs competitively against state-of-the-art methods on two benchmark datasets. |
DeepGen: Diverse Search Ad Generation and Real-Time Customization (2022.emnlp-demos)
Copied to clipboard
| Challenge: | Existing systems that generate ads manually are not effective in generating ad copy and generating millions of ads for large businesses. |
| Approach: | They propose a system that generates fluent ads from advertiser’s web pages in an abstractive fashion and solves practical issues such as factuality and inference speed. |
| Outcome: | The proposed system generates fluent ads from advertiser’s web pages in an abstractive fashion and solves practical issues such as factuality and inference speed. |
Multi-View Incongruity Learning for Multimodal Sarcasm Detection (2025.coling-main)
Copied to clipboard
Diandian Guo, Cong Cao, Fangfang Yuan, Yanbing Liu, Guangjie Zeng, Xiaoyan Yu, Hao Peng, Philip S. Yu
| Challenge: | Existing methods for multimodal sarcasm detection rely on spurious correlations, demonstrating poor generalizability beyond training environments. |
| Approach: | They propose a method that integrates multimodal incongruities via contrastive learning for multimodal sarcasm detection by using three views to drive multi-view learning. |
| Outcome: | The proposed method outperforms existing methods on benchmark datasets and shows that it is more generalizable than existing methods. |
Language Models Can Easily Learn to Reason from Demonstrations (2025.findings-emnlp)
Copied to clipboard
Dacheng Li, Shiyi Cao, Tyler Griggs, Shu Liu, Xiangxi Mo, Eric Tang, Sumanth Hegde, Kourosh Hakhamaneshi, Shishir G Patil, Matei Zaharia, Joseph E. Gonzalez, Ion Stoica
| Challenge: | Large reasoning models (LRMs) tackle complex problems by following long chain-of-thoughts (Long CoT) however, the training techniques and data requirements to elicit Long CoT remain poorly understood. |
| Approach: | They propose to use data-efficient supervised fine-tuning and parameter-efficient low-rank adaptation to elicit Long CoT reasoning. |
| Outcome: | The proposed model can learn Long CoT reasoning through data-efficient supervised fine-tuning and parameter-efficient low-rank adaptation. |
Can Large Language Models Grasp Legal Theories? Enhance Legal Reasoning with Insights from Multi-Agent Collaboration (2024.findings-emnlp)
Copied to clipboard
Weikang Yuan, Junjie Cao, Zhuoren Jiang, Yangyang Kang, Jun Lin, Kaisong Song, Tianqianjin Lin, Pengwei Yan, Changlong Sun, Xiaozhong Liu
| Challenge: | Existing studies have found that when LLMs are given criminal facts and legal rules, then asked whether cases constitute a certain charge, they struggle to understand legal theories and perform basic legal reasoning tasks. |
| Approach: | They propose a task to assess LLMs' understanding of legal theories and reasoning capabilities by using a novel framework: Multi-Agent framework for improving complex legal reasoning capability. |
| Outcome: | The proposed framework improves LLMs' understanding of legal theories and reasoning abilities in real-world scenarios. |
LearnDA: Learnable Knowledge-Guided Data Augmentation for Event Causality Identification (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for event causality identification (ECI) rely on annotated training data. |
| Approach: | They propose a method to augment training data for event causality identification by iteratively generating new examples and classifying event causalities in a dual learning framework. |
| Outcome: | The proposed method outperforms existing methods on EventStoryLine and Causal-TimeBank. |
Geoparsing: Diagram Parsing for Plane and Solid Geometry with a Unified Formal Language (2026.findings-acl)
Copied to clipboard
Peijie Wang, Ming-Liang Zhang, Jun Cao, Chao Deng, Dekang Ran, Pi Bu, Hongda Sun, Xuan Zhang, Yingyao Wang, Jun Song, Bo Zheng, Fei Yin, Cheng-Lin Liu
| Challenge: | Recent advances in Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities across various vision reasoning tasks. |
| Approach: | They propose a unified formal language that integrates plane and solid geometry, comprehensively covering geometric structures and semantic relations. |
| Outcome: | The proposed language achieves state-of-the-art parsing performance and significantly boosts MLLMs’ capabilities for downstream geometry reasoning tasks. |
Vocabulary Pyramid Network: Multi-Pass Encoding and Decoding with Multi-Level Vocabularies for Response Generation (P19-1)
Copied to clipboard
| Challenge: | Conventional methods employ a fixed vocabulary and one-pass decoding, which make them prone to safe and general responses and lack further refinement to the first generated raw sequence. |
| Approach: | They propose a Vocabulary Pyramid Network which integrates multi-pass encoding and decoding with multi-level vocabularies into response generation. |
| Outcome: | The proposed system outperforms strong baselines on English Twitter and Chinese Weibo datasets. |
SupChain-Bench: Benchmarking Large Language Models for Real-World Supply Chain Management (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models have shown promise in complex reasoning and tool-based decision making, but supply chain workflows require reliable long-horizon, multi-step orchestration grounded in domain-specific procedures. |
| Approach: | They propose a unified real-world benchmark that assesses supply chain domain knowledge and long-horizon tool-based orchestration grounded in standard operating procedures. |
| Outcome: | The proposed framework achieves the strongest and consistent tool-calling performance in real-world operational settings. |
ATG: Benchmarking Automated Theorem Generation for Generative Language Models (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing generative language models (LMs) can generate new or reusable theorems, but their ability to generate new theorels is under-explored. |
| Approach: | They propose to use Metamath library to generate new theorems that can be saved as reusable knowledge for future theoretical proving. |
| Outcome: | The proposed benchmark evaluates whether an agent can generate valuable (and possibly brand new) theorems that are applicable for downstream theoretic proving as reusable knowledge. |
Domain-Lifelong Learning for Dialogue State Tracking via Knowledge Preservation Networks (2021.emnlp-main)
Copied to clipboard
Qingbin Liu, Pengfei Cao, Cao Liu, Jiansong Chen, Xunliang Cai, Fan Yang, Shizhu He, Kang Liu, Jun Zhao
| Challenge: | Existing offline DST models require a fixed dataset to train . Existing domain-lifelong learning methods are impractical in real-world applications . |
| Approach: | They propose a domain-lifelong learning method to continuously train a DST model on new data to learn incessantly emerging new domains while avoiding catastrophically forgetting old learned domains. |
| Outcome: | The proposed method outperforms state-of-the-art lifelong learning methods by 4.25% and 8.27% on the MultiWOZ and the SGD benchmarks. |
MoleculeQA: A Dataset to Evaluate Factual Accuracy in Molecular Comprehension (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models generate erroneous information and evaluations fail to assess factual correctness of models. |
| Approach: | They propose to use MoleculeQA to evaluate molecular factual correctness in large language models by organizing molecules into a taxonomy and building QA pairs through human and LLM efforts. |
| Outcome: | The proposed model improves the factual correctness of generated information and enables the development of new models. |
Exploring and Evaluating Attributes, Values, and Structures for Entity Alignment (2020.emnlp-main)
Copied to clipboard
| Challenge: | Entity alignment (EA) aims at building a Knowledge Graph (KG) of rich content by linking the equivalent entities from various KGs. |
| Approach: | They propose to use an attributed value encoder to partition a Knowledge Graph into subgraphs to model the various types of attribute triples efficiently. |
| Outcome: | The proposed method achieves significant improvements over 12 baselines in cross-lingual and monolingual datasets. |
Towards Robust Visual Question Answering: Making the Most of Biased Samples via Contrastive Learning (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies have shown that biased samples can be brittle for VQA models . however, the improvements on OOD data severely sacrifice the performance on the in-distribution (ID) data. |
| Approach: | They propose a contrastive learning approach that exploits biased samples for unbiased information that contributes to reasoning. |
| Outcome: | The proposed method achieves competitive performance on the OOD dataset while maintaining robustness on the ID dataset. |
How Proficient Are Large Language Models in Formal Languages? An In-Depth Insight for Knowledge Base Question Answering (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent studies have validated that large language models (LLMs) are capable of solving some KBQA problems, but there has been little discussion on the differences in LLMs’ proficiency in formal languages used in semantic parsing. |
| Approach: | They propose to evaluate the understanding and generation ability of large language models (LLMs) to deal with differently structured logical forms by examining the inter-conversion of natural and formal language through in-context learning of LLMs. |
| Outcome: | The proposed model can understand formal languages as well as humans, but generating correct logical forms remains a challenge. |
Too Consistent to Detect: A Study of Self-Consistent Errors in LLMs (2025.emnlp-main)
Copied to clipboard
Hexiang Tan, Fei Sun, Sha Liu, Du Su, Qi Cao, Xin Chen, Jingang Wang, Xunliang Cai, Yuanzhuo Wang, Huawei Shen, Xueqi Cheng
| Challenge: | Existing detection methods fail to account for **self-consistent error** . study identifies self-consistency errors and evaluates them . |
| Approach: | They propose a method that fuses hidden state evidence from an external verifier LLM to detect self-consistent errors. |
| Outcome: | The proposed method significantly enhances performance on self-consistent errors across three LLM families. |
MultiFinBen: Benchmarking Large Language Models for Multilingual and Multimodal Financial Application (2026.acl-long)
Copied to clipboard
Xueqing Peng, Lingfei Qian, Yan Wang, Ruoyu Xiang, Yueru He, Yang Ren, Mingyang Jiang, Vincent Jim Zhang, Yuqing Guo, Jeff Zhao, Huan He, Yi Han, Yun Feng, Yuechen Jiang, Yupeng Cao, Haohang Li, Yangyang Yu, Xiaoyu Wang, Penglei Gao, Shengyuan Lin, Keyi Wang, Shanshan Yang, Yilun Zhao, Zhiwei Liu, Peng Lu, Jerry Huang, Suyuchen Wang, Triantafillos Papadopoulos, Polydoros Giannouris, Efstathia Soufleri, Nuo Chen, Zhiyang Deng, Heming Fu, Yijia Zhao, Mingquan Lin, Meikang Qiu, Kaleb E Smith, Arman Cohan, Xiao-Yang Liu, Jimin Huang, Guojun Xiong, Alejandro Lopez-Lira, Xi Chen, Junichi Tsujii, Jian-Yun Nie, Sophia Ananiadou, Qianqian Xie
| Challenge: | Existing evaluations of LLMs in finance are text-only, monolingual, and largely saturated by current models. |
| Approach: | They propose a multilingual and multimodal benchmark for evaluating LLMs in real financial contexts. |
| Outcome: | The first expert-annotated multilingual and multimodal benchmark is released . it evaluates 21 leading LLMs and shows they perform better in multilingual settings . |
O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning (2026.findings-acl)
Copied to clipboard
Haotian Luo, Haiying He, Yibo Wang, Shiwei Liu, Wei Li, Xiaochun Cao, Dacheng Tao, Naiqiang Tan, Li Shen
| Challenge: | Recent long-thought reasoning models adopt extended reasoning processes similar to how humans ponder over complex problems. |
| Approach: | They propose a model that uses RL-style fine-tuning to reduce inference overhead while maintaining accuracy. |
| Outcome: | The proposed model reduces inference overhead while maintaining accuracy. |
Breaking the Reasoning Barrier A Survey on LLM Complex Reasoning through the Lens of Self-Evolution (2025.findings-acl)
Copied to clipboard
Tao He, Hao Li, Jingchang Chen, Runxuan Liu, Yixin Cao, Lizi Liao, Zihao Zheng, Zheng Chu, Jiafeng Liang, Ming Liu, Bing Qin
| Challenge: | OpenAI's O1 and subsequent projects like DeepSeek R1 have significantly advanced research on complex reasoning in LLMs. |
| Approach: | They analyze existing reasoning studies from the perspective of self-evolution and summarize O1-like works from open-source projects like DeepSeek R1 and Kimi-k1.5. |
| Outcome: | The proposed models are based on open-source models and pioneer advanced methodologies like Scaling Reinforcement Learning (RL). |
Neural Collective Entity Linking (C18-1)
Copied to clipboard
| Challenge: | Entity linking aims to link entity mentions in texts to knowledge bases, but existing methods rely on local contexts to resolve entities independently. |
| Approach: | They propose a neural model for collective entity linking that integrates local contextual features and global coherence information to improve the computation efficiency. |
| Outcome: | The proposed model improves its performance on five publicly available datasets and can be used to train on Wikipedia hyperlinks to avoid overfitting and domain bias. |
X-Eval: Generalizable Multi-aspect Text Evaluation via Augmented Instruction Tuning with Auxiliary Evaluation Aspects (2024.naacl-long)
Copied to clipboard
| Challenge: | X-Eval is a two-stage instruction tuning framework to evaluate text in both seen and unseen aspects customized by end users. |
| Approach: | They introduce a two-stage instruction tuning framework to evaluate text in both seen and unseen aspects customized by end users. |
| Outcome: | The proposed framework improves the model’s ability to follow evaluation instructions and enhances the learning stage to better assess text quality. |
Creating a Lens of Chinese Culture: A Multimodal Dataset for Chinese Pun Rebus Art Understanding (2025.findings-acl)
Copied to clipboard
Tuo Zhang, Tiantian Feng, Yibin Ni, Mengqin Cao, Ruying Liu, Kiana Avestimehr, Katharine Butler, Yanjun Weng, Mi Zhang, Shrikanth Narayanan, Salman Avestimehr
| Challenge: | a new study examines the performance of large vision-language models in understanding art . the Pun Rebus Art Dataset is a multimodal dataset for art understanding rooted in traditional Chinese culture . |
| Approach: | They propose a multimodal dataset for art understanding deeply rooted in traditional Chinese culture . they aim to facilitate the development of VLMs that can better understand culturally specific content . |
| Outcome: | The proposed dataset shows that state-of-the-art VLMs struggle with these tasks . the data will facilitate the development of VLM models that can better understand culturally specific content . |
Text Anomaly Detection with Simplified Isolation Kernel (2025.findings-emnlp)
Copied to clipboard
| Challenge: | High-dimensional dense embeddings extracted by large language models pose memory requirements and high computation time. |
| Approach: | They propose a method that maps high-dimensional dense embeddings to lower-dimensional sparse representations while preserving crucial anomaly characteristics. |
| Outcome: | The proposed method achieves better detection performance than 11 SOTA anomaly detection algorithms while maintaining computational efficiency and low memory cost. |
Coarse-to-Fine: Hierarchical Multi-task Learning for Natural Language Understanding (2022.coling-1)
Copied to clipboard
Zhaoye Fei, Yu Tian, Yongkang Wu, Xinyu Zhang, Yutao Zhu, Zheng Liu, Jiawen Wu, Dejiang Kong, Ruofei Lai, Zhao Cao, Zhicheng Dou, Xipeng Qiu
| Challenge: | Existing methods to learn downstream tasks by stitches skill block lack rationality and interpretation. |
| Approach: | They propose a hierarchical framework with a coarse-to-fine paradigm for generalized text representations from the large-scale corpus. |
| Outcome: | The proposed model learns basic language properties from all tasks and boosts performance on relevant tasks. |
Unlocking the Future: Exploring Look-Ahead Planning Mechanistic Interpretability in Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have shown that large language models may possess preliminary planning capabilities. |
| Approach: | They examine the look-ahead planning mechanism in large language models from the perspectives of information flow and internal representations. |
| Outcome: | The proposed model can decode the decision from the output of MHSA in the middle layers at the last token. |
Is Multi-Hop Reasoning Really Explainable? Towards Benchmarking Reasoning Interpretability (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for multi-hop reasoning are not able to evaluate their interpretability . a recent study found that many paths are unreasonable . |
| Approach: | They propose a framework to evaluate the interpretability of multi-hop reasoning models . they annotate all possible rules and establish a benchmark . |
| Outcome: | The proposed framework outperforms existing models in terms of performance and interpretability. |
CEPT: A Contrast-Enhanced Prompt-Tuning Framework for Emotion Recognition in Conversation (2024.lrec-main)
Copied to clipboard
| Challenge: | Emotion recognition in conversation research suffers from data imbalance and the presence of similar linguistic expressions for different emotions. |
| Approach: | They propose a Contrast-Enhanced Prompt-Tuning framework that transforms an ERC task into a Masked Language Modeling task and generates the emotion for each utterance in the conversation. |
| Outcome: | The proposed framework outperforms the state-of-the-art methods on all three benchmark datasets and excels in recognizing minority emotions. |
Large-Scale Corpus Construction and Retrieval-Augmented Generation for Ancient Chinese Poetry: New Method and Data Insights (2025.findings-naacl)
Copied to clipboard
| Challenge: | Ancient Chinese poetry presents unique challenges for Large Language Models due to data scarcity and limited ability of general LLMs when dealing with ACP. |
| Approach: | They propose a specialized Retrieval-Augmented Generation framework to improve LLMs' performance . they use 1.1 million ancient poems and 990K related texts to address hallucination issues . |
| Outcome: | The proposed framework improves performance of LLMs in ancient Chinese poetry domain from 49.2% to 89.0%. |
CHEER: Centrality-aware High-order Event Reasoning Network for Document-level Event Causality Identification (2023.acl-long)
Copied to clipboard
| Challenge: | Recent studies focus on building a document-level graph for cross-sentence reasoning, but ignore important causal structures. |
| Approach: | They propose a document-level event causality identification model which annotates central events and incorporates event centrality information into the reasoning network. |
| Outcome: | The proposed model performs high-order reasoning while considering event centrality. |
Semantic Parsing with Syntax- and Table-Aware SQL Generation (P18-1)
Copied to clipboard
Yibo Sun, Duyu Tang, Nan Duan, Jianshu Ji, Guihong Cao, Xiaocheng Feng, Bing Qin, Ting Liu, Ming Zhou
| Challenge: | Existing approaches generate a SQL query word-by-word but results are incorrect or not executable due to mismatch between question words and table contents. |
| Approach: | They propose a generative model to map natural language questions into SQL queries. |
| Outcome: | The proposed model significantly improves state-of-the-art execution accuracy from 69.0% to 74.4% on a large question- SQL dataset. |
AiM: Taking Answers in Mind to Correct Chinese Cloze Tests in Educational Applications (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods to correct handwritten assignments are to use OCR to recognize characters and compare them to answers. |
| Approach: | They propose a multimodal approach to correct handwritten Chinese characters by combining the visual information of students' handwriting with the encoded representations of answers. |
| Outcome: | The proposed model outperforms OCR-based methods by a large margin. |
Lexicon-Based Graph Convolutional Network for Chinese Word Segmentation (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for Chinese word segmentation have high performance on benchmarks but are limited by the small-scale annotated corpus. |
| Approach: | They propose a framework that incorporates a lexicon-based graph convolutional network into the Transformer encoder to improve Chinese word segmentation (CWS) Chinese word is an essential and pre-processing step for many downstream NLP tasks. |
| Outcome: | The proposed framework captures the information of candidate words and improves performance on benchmarks and datasets. |
Clinical-Coder: Assigning Interpretable ICD-10 Codes to Chinese Clinical Notes (2020.acl-demos)
Copied to clipboard
| Challenge: | Existing methods of automatic coding prediction have been successful, but the interpretability of predicted codes is a challenge. |
| Approach: | They propose an online system that can predict ICD codes for Chinese clinical notes by using a Dilated Convolutional Attention network with N-gram Matching mechanism. |
| Outcome: | The proposed system is able to provide supporting information in clinical decision making. |
Bridging the Domain Gaps in Context Representations for k-Nearest Neighbor Neural Machine Translation (2023.acl-long)
Copied to clipboard
Zhiwei Cao, Baosong Yang, Huan Lin, Suhang Wu, Xiangpeng Wei, Dayiheng Liu, Jun Xie, Min Zhang, Jinsong Su
| Challenge: | Existing methods to improve k-Nearest neighbor machine translation (kNN-MT) are based on the ability to non-parametrically adapt to new domains. |
| Approach: | They propose a method to boost the datastore retrieval of k-Nearest neighbor machine translation by reconstructing the original datastore. |
| Outcome: | The proposed method boosts the retrieval and translation quality of k-Nearest neighbor machine translation by reconstructing the original datastore. |
Do Pre-trained Models Benefit Knowledge Graph Completion? A Reliable Evaluation and a Reasonable Approach (2022.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained language models capture factual knowledge from massive texts . but they are still quite behind the SOTA KGC models in terms of performance . |
| Approach: | They propose to use open-world assumption to evaluate PLM-based knowledge graph completion models . they propose to convert each triple and its support information into natural prompt sentences . |
| Outcome: | The proposed model is more accurate under the open-world assumption (OWA) this setting manual checks the correctness of knowledge that is not in KGs. |
Reinforcing Agentic Search Via Reward Density Optimization (2026.acl-long)
Copied to clipboard
| Challenge: | Reinforcement Learning with Verifiable Rewards (RLVR) is a promising approach for enhancing agentic search, but its performance is often hindered by reward sparsity . |
| Approach: | They propose a new research problem to improve the reward obtained per unit of exploration cost by using a system that decomposes long-horizon tasks into intermediate objectives and assigns process-level rewards to provide denser learning signals. |
| Outcome: | The proposed framework outperforms strong baselines on several agentic search benchmarks and achieves comparable performance to that of advanced proprietary models. |
TISE: A Tripartite In-context Selection Method for Event Argument Extraction (2024.naacl-long)
Copied to clipboard
| Challenge: | Recent studies show that LLMs can finish inference by providing several examples. |
| Approach: | They propose a method which integrates three requirements when selecting an in-context example and integrates them into a set of determinantal point processes to enhance the reasoning capabilities of LLMs. |
| Outcome: | The proposed method can achieve superior performance with fewer examples and outperform some supervised methods. |
Responsible AI Considerations in Text Summarization Research: A Review of Current Practices (2023.findings-emnlp)
Copied to clipboard
| Challenge: | a recent study examines research and reporting practices for text summarization tasks . text summaries are often overlooked by the responsible AI community . |
| Approach: | They examine research and reporting practices in the context of text summarization . they find that relatively few papers engage with possible stakeholders . |
| Outcome: | The findings highlight current research practices and provide recommendations on research directions. |
Don’t Be Misled by Style: A Style-Adaptive Reranker for Capturing Effective Knowledge in Retrieval-Augmented Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing rerankers are mainly trained on well-edited texts, but stylistic features can be misled by reranked models. |
| Approach: | They propose a style-augmented multi-task framework that prioritizes effective knowledge over stylistic perturbations by using an LLM to derive passage-level supervision on whether a passage helps or harms answer correctness. |
| Outcome: | Extensive experiments show that SARK improves generation performance across multiple LLMs under mixed-style conditions. |
Efficient k-Nearest-Neighbor Machine Translation with Dynamic Retrieval (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing models for non-parametric domain adaptation lack kNN retrieval at each timestep, leading to substantial time overhead. |
| Approach: | They propose a kNN-MT-based model that uses a domain-specific translation knowledge store to interpolate the prediction distribution of the model. |
| Outcome: | The proposed model significantly extends kNN-MT with dynamic retrieval on widely-used datasets. |
Towards Better Chain-of-Thought: A Reflection on Effectiveness and Faithfulness (2025.findings-acl)
Copied to clipboard
| Challenge: | Chain-of-thought (CoT) prompting demonstrates varying performance under different reasoning tasks. |
| Approach: | They propose to recall extra information from the question to enhance CoT generation and evaluate CoTs based on their information gain. |
| Outcome: | The proposed method improves both the faithfulness and effectiveness of CoT and evaluates it based on their information gain. |
Linguistic Rules-Based Corpus Generation for Native Chinese Grammatical Error Correction (2022.findings-emnlp)
Copied to clipboard
Shirong Ma, Yinghui Li, Rongyi Sun, Qingyu Zhou, Shulin Huang, Ding Zhang, Li Yangning, Ruiyang Liu, Zhongli Li, Yunbo Cao, Haitao Zheng, Ying Shen
| Challenge: | Chinese Grammatical Error Correction (CGEC) is a challenging NLP task and a common application in human daily life. |
| Approach: | They propose a linguistic rules-based approach to construct large-scale CGEC training corpora with automatically generated grammatical errors. |
| Outcome: | The proposed method improves performance of existing CGEC models and the benchmark is excellent resource for further development. |
Learning to Win Lottery Tickets in BERT Transfer via Task-agnostic Mask Training (2022.naacl-main)
Copied to clipboard
| Challenge: | Recent studies show pre-trained language models contain matching subnetworks that have similar transfer learning performance as the original PLM. |
| Approach: | They propose to prune matching subnetworks using magnitude-based pruning . they propose to optimize the subnetwork structure towards the pre-training objectives . |
| Outcome: | The proposed method is more efficient in searching subnetworks and advantageous when fine-tuning within a range of data scarcity. |
CLIO: Role-interactive Multi-event Head Attention Network for Document-level Event Extraction (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for document-level event extraction struggle due to two intrinsic challenges: nested arguments and multiple events. |
| Approach: | They propose a role-interactive multi-event head attention network to solve two challenges . they map different events to multiple subspaces and then determine whether the current event exists . |
| Outcome: | The proposed model improves on two widely used DEE datasets on the Internet. |
XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generation (2020.emnlp-main)
Copied to clipboard
Yaobo Liang, Nan Duan, Yeyun Gong, Ning Wu, Fenfei Guo, Weizhen Qi, Ming Gong, Linjun Shou, Daxin Jiang, Guihong Cao, Xiaodong Fan, Ruofei Zhang, Rahul Agrawal, Edward Cui, Sining Wei, Taroon Bharti, Ying Qiao, Jiun-Hung Chen, Winnie Wu, Shuguang Liu, Fan Yang, Daniel Campos, Rangan Majumder, Ming Zhou
| Challenge: | XGLUE provides a benchmark dataset to train large-scale cross-lingual pre-trained models . XCLUE provides 11 diversified tasks that cover both understanding and generation scenarios . |
| Approach: | They introduce a new benchmark dataset to train large-scale cross-lingual pre-trained models using multilingual and bilingual corpora. |
| Outcome: | The proposed dataset is labeled in English and includes only natural language understanding tasks. |
SimRPD: Optimizing Recruitment Proactive Dialogue Agents through Simulator-Based Data Evaluation and Selection (2026.acl-industry)
Copied to clipboard
Zhiyong Cao, Dunqiang Liu, Qi Dai, Haojun Xu, Huai Yuen Khor, Hao Wang, Huan He, Yafei Liu, Ke Ma, Ruqian Shi, Sicheng Zhou, Sijia Yao
| Challenge: | High-quality data in training proactive dialogue agents is scarce, despite fine-tuning and reinforcement learning . a recent study has shown that the effectiveness of supervised fine-touring is limited by the lack of high-quality, domain-specific training data. |
| Approach: | They propose a framework for training recruitment proactive dialogue agents using a high-fidelity user simulator and a multi-dimensional evaluation framework based on Chain-of-Intention. |
| Outcome: | The proposed framework outperforms existing simulator-based data selection strategies in a real-world recruitment scenario. |
Global Context or Local Detail? Adaptive Visual Grounding for Hallucination Mitigation (2026.findings-acl)
Copied to clipboard
Yubo Jiang, Xin Yang, Abudukelimu Wuerkaixi, Zheming Yuan, Xuxin Cheng, Cao Liu, Ke Zeng, Fengying Xie, Zhiguo Jiang, Haopeng Zhang
| Challenge: | Large vision–language models suffer from object-existence hallucinations when multi-step deliberation decouples from visual evidence. |
| Approach: | They propose a framework that allocates visual computation by uncertainty . they propose highlighting retains global context, while selective zoom-in performs local verification. |
| Outcome: | The proposed framework reduces the complexity of multimodal reasoning by minimizing the operator trade-off. |
Sculpting the Vector Space: Towards Efficient Multi-Vector Visual Document Retrieval via Prune-then-Merge Framework (2026.findings-acl)
Copied to clipboard
| Challenge: | Visual Document Retrieval (VDR) is of importance in multimodal retrieval applications. |
| Approach: | They propose a two-stage pruning and merging frameworks that combine pruning and merge techniques to achieve higher compression rates. |
| Outcome: | The proposed framework outperforms existing methods on 29 visual document retrieval datasets. |
Plug-and-Play Data Module for Code RL: Adaptive Ambiguity Replay (2026.findings-acl)
Copied to clipboard
Jianqing Zhang, Wei Xia, Zhezheng Hao, Hong Wang, Hande Dong, Qiang Lin, Yang Liu, Jian Cao, Qiang Yang
| Challenge: | Existing approaches to reinforcement learning (RL) rely on static, in-epoch metrics that overlook training dynamics, often introducing low-utility or outdated data. |
| Approach: | They propose a plug-and-play module that prioritizes cross-epoch ambiguous samples to neutralize the noise from stale experiences. |
| Outcome: | Extensive experiments on nine LLMs show that Adaptive Ambiguity Replay outperforms state-of-the-art baselines on real-world code editing tasks. |
LeCoDe: A Benchmark Dataset for Interactive Legal Consultation Dialogue Evaluation (2026.acl-long)
Copied to clipboard
Weikang Yuan, Kaisong Song, Zhuoren Jiang, Junjie Cao, Yujie Zhang, Jun Lin, Kun Kuang, Ji Zhang, Xiaozhong Liu
| Challenge: | Current systems for legal consultation are insufficient to handle the knowledge-intensive nature of real-world consultations. |
| Approach: | They propose a multi-turn benchmark dataset to evaluate LLMs in legal consultation settings. |
| Outcome: | The proposed framework assesses LLMs’ consultation capabilities in terms of (1) clarification capability and (2) professional advice quality. |
Attention Basin: Why Contextual Position Matters in Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are sensitive to the contextual position of information in input. |
| Approach: | They introduce Attention-Driven Reranking (AttnRank) which estimates a model’s intrinsic positional attention preferences using a small calibration set and reorders retrieved documents or few-shot examples to align the most salient content with these high-attention positions. |
| Outcome: | Experiments on multi-hop QA and few-shot in-context learning tasks show that AttnRank achieves substantial improvements across 10 large language models of varying architectures and scales, without modifying model parameters or training procedures. |
Zero-Shot Cross-Lingual Document-Level Event Causality Identification with Heterogeneous Graph Contrastive Transfer Learning (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies focus on sentence-level ECI with high-resource languages, leaving document-level DECI with low-resourced languages under-explored. |
| Approach: | They propose a Heterogeneous Graph Interaction Model with Multi-granularity Contrastive Transfer Learning for zero-shot cross-lingual ECI. |
| Outcome: | The proposed model outperforms the state-of-the-art model on monolingual and multilingual scenarios by 9.4% and 8.2% of average F1 score. |
Learning from the Dictionary: Heterogeneous Knowledge Guided Fine-tuning for Chinese Spell Checking (2022.findings-emnlp)
Copied to clipboard
Yinghui Li, Shirong Ma, Qingyu Zhou, Zhongli Li, Li Yangning, Shulin Huang, Ruiyang Liu, Chao Li, Yunbo Cao, Haitao Zheng
| Challenge: | Chinese Spell Checking (CSC) aims to detect and correct Chinese spelling errors. |
| Approach: | They propose a framework which renders Chinese Spell Checking model to learn heterogeneous knowledge from the dictionary in terms of phonetics, vision, and meaning. |
| Outcome: | The proposed framework renders the CSC model to learn heterogeneous knowledge from the dictionary in terms of phonetics, vision, and meaning. |
When 20 Agents Fail to Sort: The Distributed Sorting Benchmark for Scalable Multi-Agent Systems (2026.findings-acl)
Copied to clipboard
| Challenge: | MAS-BENCH isolates coordination under explicit communication constraints . CAMOC significantly improves coordination success and efficiency across backends . |
| Approach: | They propose a distributed-sorting benchmark that isolates coordination under explicit communication constraints. |
| Outcome: | MAS-BENCH improves coordination success and efficiency across backends . CAMOC significantly improves efficiency under shared-state interaction . |
An Enhanced Span-based Decomposition Method for Few-Shot Sequence Labeling (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing approaches to tagging tasks are limited to predefined classes and require large-scale annotated data. |
| Approach: | They propose an Enhanced Span-based Decomposition method for Few-Shot Sequence Labeling to generalize on emerging, resource-scare domains. |
| Outcome: | The proposed method achieves state-of-the-art results on two popular FSSL benchmarks, FewNERD and SNIPS, and is more robust in noisy and nested tagging scenarios. |
CoVariance-based Causal Debiasing for Entity and Relation Extraction (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Named Entity Recognition and Relation Extraction are key tasks of Information Extraction. |
| Approach: | They propose a causal framework called c ovariance and variance optimization framework (OVO) to optimize feature representations and conduct general debiasing. |
| Outcome: | The proposed framework minimizes characterizing features’ covariance for alleviating selection and distribution bias and enhances feature representation in the feature space. |
Code to Think, Think to Code: A Survey on Code-Enhanced Reasoning and Reasoning-Driven Code Intelligence in LLMs (2025.emnlp-main)
Copied to clipboard
Dayu Yang, Tianyang Liu, Daoan Zhang, Antoine Simoulin, Xiaoyi Liu, Yuwei Cao, Zhaopu Teng, Xin Qian, Grey Yang, Jiebo Luo, Julian McAuley
| Challenge: | Recent breakthrough models like OpenAI-o1 and DeepSeek-R1 show powerful task-solving capabilities, particularly advances in reasoning. |
| Approach: | They propose future research directions that may deepen the synergy, ultimately advancing LLM performance in both complex reasoning and code intelligence. |
| Outcome: | The proposed research may deepen the synergy, ultimately advancing LLM performance in both complex reasoning and code intelligence. |
MIE: A Medical Information Extractor towards Medical Dialogues (2020.acl-main)
Copied to clipboard
| Challenge: | EMRs are important but many doctors suffer from writing them, which is time-consuming and tedious. |
| Approach: | They propose an automatic conversion of medical dialogues to EMRs using a window-sliding style . they propose a medical information extractor (MIE) that extracts medical information from medical dialogue . |
| Outcome: | The proposed model extracts medical information from doctor-patient dialogues. |
RedOne: Revealing Domain-specific LLM Post-Training in Social Networking Services (2025.emnlp-industry)
Copied to clipboard
Fei Zhao, Chonggang Lu, null Wangyue, Zheyong Xie, Ziyan Liu, Haofu Qian, Jianzhao Huang, Fangcheng Shi, Zijie Meng, Hongcheng Guo, Mingqian He, Xinze Lyu, Zheyu Ye, Weiting Liu, Boyang Wang, Shaosheng Cao
| Challenge: | Social networking services (SNS) have experienced rapid growth, which has proposed significant challenges for platform content management and interaction quality improvement. |
| Approach: | They propose a domain-specific LLM to break the performance bottleneck of single-task baselines and establish a comprehensive foundation for social networking services. |
| Outcome: | The proposed model achieves an average improvement of 14.02% across 8 major tasks and 7.56% in bilingual evaluation benchmark, compared with baseline models. |
Simulating Classroom Education with LLM-Empowered Agents (2025.naacl-long)
Copied to clipboard
Zheyuan Zhang, Daniel Zhang-Li, Jifan Yu, Linlu Gong, Jinchang Zhou, Zhanxin Hao, Jianxiao Jiang, Jie Cao, Huiqin Liu, Zhiyuan Liu, Lei Hou, Juanzi Li
| Challenge: | Initial studies have focused on task-specific, independent LLM-empowered agents, but the potential of LLMs within a multi-agent collaborative framework for classroom simulation with real user participation remains unexplored. |
| Approach: | They propose a multi-agent classroom simulation teaching framework that recognizes representative class roles and introduces a novel class control mechanism for automatic classroom teaching. |
| Outcome: | The proposed framework can simulate dynamic learning environment for users with active teacher-student and student-studente interactions. |
Complex Event Schema Induction with Knowledge-Enriched Diffusion Model (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies on event schema induction have been hindered by errors and data quality issues. |
| Approach: | They propose a knowledge-enriched discrete diffusion model that distills event scenario knowledge from LLMs. |
| Outcome: | The proposed model achieves outstanding performance across evaluation metrics. |
Search-Oriented Conversational Query Editing (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing CQR models are not learned toward improving the downstream search performance . existing models generate the rewrite token-by-token from scratch . |
| Approach: | They propose a text editing-based CQR model tailored for conversational search . they propose rewrite tokens are selected from the dialogue in a non-autoregressive fashion . |
| Outcome: | The proposed model outperforms state-of-the-art models on three conversational search benchmarks while having low rewriting latency. |
Aspect Is Not You Need: No-aspect Differential Sentiment Framework for Aspect-based Sentiment Analysis (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing approaches to classify aspects with aspect sentiment bias are hard to find . |
| Approach: | They propose a no-aspect differential sentiment framework for the ABSA task that eliminates aspect sentiment bias and uses differential sentiment loss instead of cross-entropy loss to better classify the sentiments. |
| Outcome: | The proposed framework can be combined with almost all traditional ABSA methods. |
Semantic Role Labeling Guided Out-of-distribution Detection (2024.lrec-main)
Copied to clipboard
Jinan Zou, Maihao Guo, Yu Tian, Yuhao Lin, Haiyao Cao, Lingqiao Liu, Ehsan Abbasnejad, Javen Qinfeng Shi
| Challenge: | Existing methods for identifying domain-shifted instances are prone to OOD and adversarial inputs. |
| Approach: | They propose an unsupervised method that separates, extracts, and learns the semantic role labeling guided out-of-distribution Detection (SRLOOD) they propose a self-supervised approach to enhance global-local feature learning by predicting SRL extracted role. |
| Outcome: | The proposed method achieves SOTA performance on four OOD benchmarks. |
Knowledge-Enriched Event Causality Identification via Latent Structure Induction Networks (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for identifying causal relations of events are limited . Existing approaches cannot handle well the problem, especially in the condition of lacking training data. |
| Approach: | They propose a Latent Structure Induction Network to integrate external structural knowledge into a causality reasoning task. |
| Outcome: | The proposed approach outperforms existing state-of-the-art methods on two widely used datasets. |
Automatic ICD Coding via Interactive Shared Representation Networks with Self-distillation Mechanism (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for ICD coding ignore the long-tail of code frequency or noisy clinical notes. |
| Approach: | They propose to use an interactive shared representation network to model code co-occurrences while focusing on the clinical note's noteworthy part and extract valuable information through a self-distillation learning mechanism to solve the long-tail problem. |
| Outcome: | The proposed model reduces the long-tail of code frequency and noise in clinical notes and extracts valuable information through a self-distillation learning mechanism. |
Can Prompt Probe Pretrained Language Models? Understanding the Invisible Risks from a Causal View (2022.acl-long)
Copied to clipboard
| Challenge: | Recent studies have found prompt-based probing evaluations inaccurate, inconsistent and unreliable. |
| Approach: | They propose to conduct debiasing via causal intervention to uncover biases in probing evaluations . authors argue that prompt-based probing is inaccurate, inconsistent and unreliable . |
| Outcome: | This paper examines the effectiveness of prompt-based probing in pretrained language models . it highlights critical biases which could induce biased results and conclusions . authors suggest rethinking criteria for evaluating better pretrained models based on such evaluations . |
Com2 : A Causal-Guided Benchmark for Exploring Complex Commonsense Reasoning in Large Language Models (2025.acl-long)
Copied to clipboard
Kai Xiong, Xiao Ding, Yixin Cao, Yuxiong Yan, Li Du, Yufei Zhang, Jinglong Gao, Jiaqian Liu, Bing Qin, Ting Liu
| Challenge: | Existing works focus on complex tasks like math and code, while complex commonsense reasoning remains underexplored due to its uncertainty and lack of structure. |
| Approach: | They propose to build a benchmark for large language models based on complex commonsense reasoning based upon causal event graphs and causal theory. |
| Outcome: | The proposed benchmark combines a complex commonsense reasoning benchmark with a detective story to achieve a more challenging subset. |
RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment (2025.findings-acl)
Copied to clipboard
Zhuoran Jin, Hongbang Yuan, Tianyi Men, Pengfei Cao, Yubo Chen, Jiexin Xu, Huaijun Li, Xiaojian Jiang, Kang Liu, Jun Zhao
| Challenge: | Existing retrieval augmented language models often overlook effective alignment with human preferences. |
| Approach: | They propose a benchmark to evaluate RMs in retrieval augmented language models . they incorporate 18 RAG subsets, six retrievers, and 24 RALMs to increase diversity . |
| Outcome: | The proposed benchmark combines 18 RAG subsets, six retrievers, and 24 RALMs to increase diversity of data sources. |
Aligning Large Multimodal Models with Factually Augmented RLHF (2024.findings-acl)
Copied to clipboard
Zhiqing Sun, Sheng Shen, Shengcao Cao, Haotian Liu, Chunyuan Li, Yikang Shen, Chuang Gan, Liangyan Gui, Yu-Xiong Wang, Yiming Yang, Kurt Keutzer, Trevor Darrell
| Challenge: | Large Multimodal Models (LMMs) are built across modalities and the misalignment between two modality can result in "hallucination" . developing LMMs faces challenges such as a lack of data and a limited number of data sets. |
| Approach: | They propose a new algorithm that augments the reward model with additional factual information such as image captions and ground-truth multi-choice options. |
| Outcome: | The proposed approach improves on the LLaVA-Bench dataset with the 96% performance level of the text-only GPT-4 and an improvement of 60% on MMHAL-BENCH over other baselines. |
BASS: Boosting Abstractive Summarization with Unified Semantic Graph (2021.acl-long)
Copied to clipboard
| Challenge: | Abstractive summarization for long-document or multi-document remains challenging for Seq2Seq as it does not analyze long-distance relations in text. |
| Approach: | They propose a framework for Boosting Abstractive Summarization based on a unified Semantic graph which aggregates co-referent phrases distributing across a long range of context and conveys rich relations between phrases. |
| Outcome: | The proposed framework improves document representation and summary generation process by leveraging the graph structure. |
Learning from Miscellaneous Other-Class Words for Few-shot Named Entity Recognition (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods to classify named entity mentions with fewshots fail to differentiate rich semantics in other-class words, which will aggravate overfitting under few shot scenario. |
| Approach: | They propose a model that can automatically induce different unde- fined classes from the other class to improve few-shot Named Entity Recognition (NER) . |
| Outcome: | The proposed model outperforms five state-of-the-art models in 1- shot and 5-shots settings on four NER bench marks. |
DTELS: Towards Dynamic Granularity of Timeline Summarization (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing timeline summarizations lack flexibility to meet diverse granularity needs . a fine-grained timeline showing the technical details is preferred for news topics . |
| Approach: | They propose a new paradigm to construct adaptive timelines based on user instructions or requirements. |
| Outcome: | The proposed timelines are informative and granularly consistent, but they struggle to generate consistent timelines. |
ToolGate: Contract-Grounded and Verified Tool Execution for LLMs (2026.findings-acl)
Copied to clipboard
Yanming Liu, Xinyue Peng, Jiannan Cao, Xinyi Wang, Songhang Deng, Jintao Chen, Jianwei Yin, Xuhong Zhang
| Challenge: | Existing frameworks for tool-augmented LLMs rely heavily on natural language reasoning to determine when tools can be invoked and whether their results should be trusted. |
| Approach: | They propose a forward execution framework that provides logical safety guarantees and verifiable state evolution for LLM tool calling. |
| Outcome: | The proposed framework improves the reliability and verifiability of tool-augmented LLM systems while maintaining competitive performance on multi-step reasoning tasks. |
From Signal Degradation to Computation Collapse: Uncovering the Two Failure Modes of LLM Quantization (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing research on PTQ spans three primary directions. |
| Approach: | They conduct a systematic analysis of post-training quantization failures using PTQ . they show that targeted repair can mitigate Signal Degradation but remains ineffective for Computation Collapse . |
| Outcome: | The proposed method mitigates Signal Degradation but remains ineffective for Computation Collapse. |
Empowering GUI Agents via Autonomous Experience Exploration and Hindsight Experience Utilization for Task Planning (2026.acl-long)
Copied to clipboard
| Challenge: | Multimodal web agents are cost-efficient and privacy-preserving, but suffer from weak planning and limited cross-website generalization. |
| Approach: | They propose a method which autonomously explores environments to discover experiences and utilizes hindsight experience to synthesize strictly aligned, high-level training data. |
| Outcome: | The proposed method outperforms Qwen2.5-VL-32B model on real-world benchmarks and demonstrates that mastering low-level atomic skills does not guarantee high-level planning competence. |
Enhancing Multiple-choice Machine Reading Comprehension by Punishing Illogical Interpretations (2021.emnlp-main)
Copied to clipboard
| Challenge: | Multiple-choice MRC is one of the most studied tasks in MRC due to the convenience of evaluation and the flexibility of answer format. |
| Approach: | They propose to use multiple-choice MRC to explain a trained model and reveal how it arrives at the prediction by punishing illogical attributions. |
| Outcome: | The proposed method improves model performance without external information and model structure change without any external information. |
Towards Better Entity Linking with Multi-View Enhanced Distillation (2023.acl-long)
Copied to clipboard
Yi Liu, Yuan Tian, Jianxun Lian, Xinlong Wang, Yanan Cao, Fang Fang, Wen Zhang, Haizhen Huang, Weiwei Deng, Qi Zhang
| Challenge: | Entity linking is a fundamental task in Natural Language Processing (NLP), connecting mentions within unstructured contexts to their corresponding entities in a Knowledge Base (KB). |
| Approach: | They propose a dual-encoder framework that can efficiently match mentions to two-encoding frameworks by a global-view. |
| Outcome: | The proposed framework achieves state-of-the-art on several entity linking benchmarks. |
Runaway is Ashamed, But Helpful: On the Early-Exit Behavior of Large Language Model-based Agents in Embodied Environments (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Experiments with 4 different LLMs across 5 embodied environments show significant efficiency improvements, with only minor drops in agent performance. |
| Approach: | They propose an intrinsic method that injects exit instructions during generation and an extransic system that verifies task completion to determine when to halt an agent’s trial. |
| Outcome: | The proposed method injects exit instructions during generation and an exit method verifies task completion to determine when to halt an agent’s trial. |
Task-Stratified Knowledge Scaling Laws for Post-Training Quantized Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing scaling laws focus on general performance, overlooking crucial fine-grained factors and how quantization differentially impacts diverse knowledge capabilities. |
| Approach: | They propose a framework that unifies model size, bit-width, and fine-grained factors into memorization, application, and reasoning. |
| Outcome: | The proposed framework shows strong fit and cross-architecture consistency on 293 different PTQ configurations. |
GUI0: Self-Evolving Foundational GUI Agents in Super App Ecosystems (2026.acl-long)
Copied to clipboard
Xinyi Wang, Wei Dai, Kyle Qiao, Ke Wang, Peng Chen, Gang Cao, null Kangqin, Zhongpu Wang, Xiaode Zhang, Yanming Liu, Jihao Gu, Jingtao Xu, Gong Zhi
| Challenge: | Automated interaction with graphical user interfaces (GUIs) is central to general artificial intelligence, but remains challenging within Super App ecosystems. |
| Approach: | They propose a framework synergizing autonomous data synthesis with dual-agent co-evolution . GUI0 establishes a domain-aware foundation model via synthesized corpora and employs curriculum-driven reinforcement learning . |
| Outcome: | The proposed framework outperforms Gemini-2.5-Pro and Claude-4-Sonnet in the SuperAPP benchmark and has universal efficacy across base models. |
InstructoR: Instructing Unsupervised Conversational Dense Retrieval with Large Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for conversational retrieval only fine-tune on limited supervised data, making it difficult for the retriever to fully grasp the entire conversation. |
| Approach: | They propose a method to instruct unsupervised conversational dense retrieval with large language models (LLMs) they use supervised data to discover the user's query intent from the conversation context . |
| Outcome: | The proposed method can bring significant improvements across various ad-hoc retrievers, surpassing the current state-of-the-art method. |
CoreCodeBench: Decoupling Code Intelligence via Fine-Grained Repository-Level Tasks (2026.acl-long)
Copied to clipboard
Lingyue Fu, Hao Guan, Bolun Zhang, Haowei Yuan, Yaoming Zhu, Lin Qiu, ZongYu Wang, Xuezhi Cao, Xunliang Cai, Weiwen Liu, Weinan Zhang, Yong Yu
| Challenge: | Existing large language models for software engineering rely on coarse-grained pass rates obscuring specific cognitive bottlenecks. |
| Approach: | They propose a repository-level benchmark that dissects coding capabilities through atomized tasks. |
| Outcome: | The proposed framework achieves a 78.55% validity yield, surpassing the 31.7% retention rate of SWE-bench-Verified. |
Alignment Precedes Fusion: Open-Vocabulary Named Entity Recognition as Context-Type Semantic Matching (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Continual learning and zero-shot learning approaches have not been adopted to scale to novel-emerging types. |
| Approach: | They propose a method to recognize entities in novel types by their textual names or descriptions. |
| Outcome: | The proposed method outperforms the state-of-the-art methods on three challenging OVNER benchmarks by 9.7%, 9.5%, and 1.8% F1-score of novel types. |
SOM-NCSCM : An Efficient Neural Chinese Sentence Compression Model Enhanced with Self-Organizing Map (2021.emnlp-main)
Copied to clipboard
| Challenge: | Sentence Compression (SC) is an important natural language processing task . it aims to shorten sentences while preserving the original meanings of the words . improvements on Chinese SC models are still lacking due to several difficulties . |
| Approach: | They propose a neural Chinese SC model enhanced with a Self-Organizing Map from Chinese colloquial sentences from a real-life question answering system. |
| Outcome: | The proposed model achieves a promising F1 score of 89.655 and BLEU4 score of 70.116 . it improves the performance of the whole neural Chinese SC model in a valid manner . |
PsyAdvisor: A Plug-and-Play Strategy Advice Planner with Proactive Questioning in Psychological Conversations (2025.acl-long)
Copied to clipboard
| Challenge: | Current psychological LLMs are constrained by passive response mechanisms, limiting their capacity to deploy proactive strategies for psychological counseling. |
| Approach: | They propose a dataset that provides a multi-turn conversation dataset with interpretive labels including strategy decision logic and reaction attribution. |
| Outcome: | The proposed model significantly improves proactive questioning capacity, conversation depth, and response quality. |
Conformal Event Prediction with Temporal Knowledge Graph (2026.findings-acl)
Copied to clipboard
| Challenge: | Current event prediction methods lack rigorous uncertainty quantification, which limits their reliability for decision-making. |
| Approach: | They propose a conformal prediction framework that applies conformal predictions to event prediction to address this challenge. |
| Outcome: | The proposed framework guarantees coverage while improving efficiency on three public datasets. |
Enhancing Label Correlation Feedback in Multi-Label Text Classification via Multi-Task Learning (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to multi-task learning fail to capture label correlations . Existing methods suffer from label order dependency, label combination over-fitting and error propagation problems. |
| Approach: | They propose a novel approach with multi-task learning to enhance label correlation feedback. |
| Outcome: | The proposed method outperforms baselines on AAPD and RCV1-V2 datasets. |
Cracking Factual Knowledge: A Comprehensive Analysis of Degenerate Knowledge Neurons in Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) are believed to store extensive factual knowledge, yet the mechanisms of knowledge storage in LLMs remain largely unexplored. |
| Approach: | They propose that some multi-layer perceptron neurons can store "knowledge". |
| Outcome: | The proposed model can store "knowledge" in multi-layer perceptron neurons, but not redundancy. |
HeteroSpec: Leveraging Contextual Heterogeneity for Efficient Speculative Decoding (2026.acl-long)
Copied to clipboard
| Challenge: | Autoregressive decoding limits the inference throughput of Large Language Models due to its sequential dependency. |
| Approach: | They propose a framework that allocates verification effort in proportion to candidate uncertainty. |
| Outcome: | Speculative decoding achieves an average speedup over state-of-the-art methods . a small subset of high-confidence predictions accounts for most successful verifications . |
TablePilot: Recommending Human-Preferred Tabular Data Analysis with Large Language Models (2025.acl-industry)
Copied to clipboard
| Challenge: | Tabular data analysis is crucial in many scenarios, yet its complexity and density can make it challenging to determine the most appropriate analysis operations for a new table. |
| Approach: | They propose a tabular data analysis framework that recommends query-code-result triplets for new tables . they propose Rec-Align, a method to further improve recommendation quality . |
| Outcome: | The proposed framework achieves 77.0% top-5 recommendation recall on a dataset designed for tabular data analysis recommendation. |
Revealing the Deceptiveness of Knowledge Editing: A Mechanistic Analysis of Superficial Editing (2025.acl-long)
Copied to clipboard
| Challenge: | Existing knowledge editing algorithms are prone to generating original knowledge . despite the fact that many models achieve near-perfect performance, superficial editing remains a challenge . |
| Approach: | They propose to use "**superficial editing**" to describe the phenomenon . they investigate the internal mechanisms of the attention module and their corresponding left singular vectors . |
| Outcome: | The proposed method can modify specific knowledge in a pretrained large language model while ensuring that unrelated knowledge remains unaffected. |
PRESTO: Progressive Pretraining Enhances Synthetic Chemistry Outcomes (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Multimodal Large Language Models (MLLMs) have seen growing adoption across various scientific domains. |
| Approach: | They propose a framework that bridges the molecule-text modality gap by integrating a comprehensive benchmark of pretraining strategies and dataset configurations. |
| Outcome: | The proposed framework improves multimodal LLMs through cross-modal alignment and multi-graph understanding. |
OpenKE: An Open Toolkit for Knowledge Embedding (D18-2)
Copied to clipboard
| Challenge: | Existing knowledge embedding tools are available for embeddable knowledge graphs. |
| Approach: | They propose a unified framework and various fundamental models to embed knowledge graphs into a continuous low-dimensional space. |
| Outcome: | The toolkit and pre-trained embeddings are available on http://openke.thunlp.org/. |
MCS-Bench: A Comprehensive Benchmark for Evaluating Multimodal Large Language Models in Chinese Classical Studies (2025.acl-long)
Copied to clipboard
| Challenge: | Multimodal Large Language Models (MLLMs) have advanced visual and language understanding, but their potential in Chinese Classical Studies (CCS) remains underexplored due to the lack of specialized benchmarks. |
| Approach: | They propose to develop a multimodal benchmark specifically designed for Chinese Classical Studies across multiple subdomains to bridge this gap. |
| Outcome: | The proposed benchmark spans seven core subdomains with a total of 45 meticulously designed tasks. |
Lightweight Haar Wavelet Subband Pruning for LLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have impressive performance but require computational and memory resources. |
| Approach: | They propose a post-training framework that uses a Haar wavelet transform to prune weights. |
| Outcome: | The proposed pruning framework reduces pruning time and computational costs by removing less important weights while preserving model architecture. |
CORN: Co-Reasoning Network for Commonsense Question Answering (2022.coling-1)
Copied to clipboard
| Challenge: | Existing work uses two independent modules to model QA content and external commonsense knowledge graph (KG) Existing research uses two separate modules to create QA contextual text representations and relationships between QA entities. |
| Approach: | They propose a commonsense question answering (QA) model that uses two independent modules to model QA contextual text representation and relationships between QA entities in KG. |
| Outcome: | The proposed model achieves state-of-the-art on QA benchmarks in the CommonsenseQA and OpenBookQA datasets. |
Diversity and Consistency: Exploring Visual Question-Answer Pair Generation (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing tasks to generate question-answer pairs from visual images are under-explored. |
| Approach: | They propose a task that targets question-answer pair generation from visual images. |
| Outcome: | The proposed model can generate diverse or consistent QAPs on two benchmarks. |
FinEval: A Chinese Financial Domain Knowledge Evaluation Benchmark for Large Language Models (2025.naacl-long)
Copied to clipboard
Xin Guo, Haotian Xia, Zhaowei Liu, Hanyang Cao, Zhi Yang, Zhiqiang Liu, Sizhe Wang, Jinyi Niu, Chuqi Wang, Yanhui Wang, Xiaolong Liang, Xiaoming Huang, Bing Zhu, Zhongyu Wei, Yun Chen, Weining Shen, Liwen Zhang
| Challenge: | Large language models have demonstrated outstanding performance in various natural language processing tasks, but their security capabilities in the financial domain have not been explored. |
| Approach: | They propose to use a benchmark to evaluate large language models' financial domain knowledge and practical abilities. |
| Outcome: | The proposed benchmark evaluates large language models' financial domain knowledge and practical abilities. |
iPET: An Interactive Emotional Companion Dialogue System with LLM-Powered Virtual Pet World Simulation (2025.acl-demo)
Copied to clipboard
Zheyong Xie, Shaosheng Cao, Zuozhu Liu, Zheyu Ye, Zihan Niu, Chonggang Lu, Tong Xu, Enhong Chen, Zhe Xu, Yao Hu, Wei Lu
| Challenge: | Existing approaches to role-playing emotional companion products lack sustained personalization and contextual adaptability, limiting their effectiveness in real-world settings. |
| Approach: | They propose a virtual pet agent that can enhance user engagement through rich, dynamic pet behaviors and interactions tailored to individual preferences. |
| Outcome: | The proposed system has been deployed in a real-world, non-commercial product for 200 days and has demonstrated its effectiveness in practical applications. |
A Good Neighbor, A Found Treasure: Mining Treasured Neighbors for Knowledge Graph Entity Typing (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to infer missing types for knowledge graphs only leverage one-hop neighbor information of the central entity, ignoring multi-hop neighbors that can provide valuable clues for inference. |
| Approach: | They propose a method to infer missing types for knowledge graph entities by using neighbor information and co-occurrence relations between types. |
| Outcome: | The proposed method significantly outperforms existing state-of-the-art methods on two widely used datasets. |
Improving Event Causality Identification via Self-Supervised Representation Learning on External Causal Statement (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for event causality identification (ECI) rely on labeled data, but the scale of annotated datasets is limited. |
| Approach: | They propose a self-supervised framework to learn context-specific causal patterns from external causal statements and adopt a contrastive transfer strategy to incorporate the learned context- specific causal patterns into the target ECI model. |
| Outcome: | The proposed method significantly outperforms existing methods on EventSto-ryLine and Causal-TimeBank (+2.0 and +3.4 points on F1 value respectively). |
SSR-A: Spatial- and Semantic-Aware Instructions and Curriculum Reinforcement for Advertisement Compliant Rectification (2026.acl-industry)
Copied to clipboard
| Challenge: | Existing methods to fix non-compliant images suffer from over-editing, destroying original intent and perceptual similarity. |
| Approach: | They propose a framework for the minimalist rectification of non-compliant image ads. |
| Outcome: | The proposed framework outperforms state-of-the-art baselines in both compliance and preservation of visual and commercial consistency. |
AgentsCourt: Building Judicial Decision-Making Agents with Court Debate Simulation and Legal Knowledge Augmentation (2024.findings-emnlp)
Copied to clipboard
Zhitao He, Pengfei Cao, Chenhao Wang, Zhuoran Jin, Yubo Chen, Jiexin Xu, Huaijun Li, Kang Liu, Jun Zhao
| Challenge: | Recent advances in deep learning have significantly impacted the legal domain. |
| Approach: | They propose a multi-agent framework for judicial decision-making that simulates the court trial process . they propose 420 Chinese judgment documents to support their framework and build a large-scale legal knowledge base . |
| Outcome: | The proposed framework outperforms existing methods in various aspects, especially in generating legal articles. |
M2Edit: Locate and Edit Multi-Granularity Knowledge in Multimodal Large Language Model (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing knowledge editing methods for MLLMs lack multi-granularity knowledge . existing knowledge editing approaches lack multimodality knowledge and generalize to multimodal data. |
| Approach: | They propose a multimodal knowledge editing method which integrates key knowledge layers within MLLMs and collaboratively edits them. |
| Outcome: | The proposed method improves visual generality performance on knowledge data of different granularities. |
FolkScope: Intention Knowledge Graph Construction for E-commerce Commonsense Discovery (2023.findings-acl)
Copied to clipboard
Changlong Yu, Weiqi Wang, Xin Liu, Jiaxin Bai, Yangqiu Song, Zheng Li, Yifan Gao, Tianyu Cao, Bing Yin
| Challenge: | Existing intention-based studies on recommendation tasks are limited and use models to implicitly model the intention memberships. |
| Approach: | They propose a framework that leverages the generation power of large language models and human-in-the-loop annotation to semi-automatically construct the intention knowledge graph. |
| Outcome: | The proposed framework can model e-commerce knowledge and have many potential applications. |
Are LLMs Rational Investors? A Study on the Financial Bias in LLMs (2025.findings-acl)
Copied to clipboard
Yuhang Zhou, Yuchen Ni, Zhiheng Xi, Zhangyue Yin, Yu He, Gan Yunhui, Xiang Liu, Zhang Jian, Sen Liu, Xipeng Qiu, Yixin Cao, Guangnan Ye, Hongfeng Chai
| Challenge: | Existing studies on biases within specific domains, such as finance, remain limited. |
| Approach: | They propose a framework to detect, detect, analyze and mitigate financial biases in large language models. |
| Outcome: | The proposed framework reduces bias by 68% for the most biased model, according to key metrics. |
Enhancing Reinforcement Learning with Dense Rewards from Language Model Critic (2024.emnlp-main)
Copied to clipboard
| Challenge: | Reinforcement learning (RL) can align language models with non-differentiable reward signals, such as human preferences, but the sparsity of these signals can lead to inefficient and unstable learning. |
| Approach: | They propose a framework that utilizes the critique capability of Large Language Models to produce intermediate-step rewards during RL training. |
| Outcome: | The proposed framework improves sample efficiency and the overall performance of the policy model, supported by both automatic and human evaluation. |
Generative Calibration for In-context Learning (2023.findings-emnlp)
Copied to clipboard
| Challenge: | In-context learning is one of the most exciting features of large language models . performance is sensitive to various configurations of the prompt, such as the choice or order of the training examples. |
| Approach: | They propose to calibrate the in-context predictive distribution by adjusting the label marginal . they find that the proposed method outperforms the ICL and state-of-the-art calibration methods . |
| Outcome: | The proposed method outperforms state-of-the-art methods by 27% absolute in macro-F1. |
Language Prior Is Not the Only Shortcut: A Benchmark for Shortcut Learning in VQA (2022.findings-emnlp)
Copied to clipboard
Qingyi Si, Fandong Meng, Mingyu Zheng, Zheng Lin, Yuanxin Liu, Peng Fu, Yanan Cao, Weiping Wang, Jie Zhou
| Challenge: | Visual Question Answering (VQA) models are prone to learn the shortcut solution formed by dataset biases rather than the intended solution. |
| Approach: | They propose a dataset that considers varying types of shortcuts by constructing different distribution shifts in multiple OOD test sets. |
| Outcome: | The proposed dataset considers varying types of shortcuts by constructing different distribution shifts in multiple OOD test sets. |
Plug-and-Play Document Modules for Pre-trained Models (2023.acl-long)
Copied to clipboard
Chaojun Xiao, Zhengyan Zhang, Xu Han, Chi-Min Chan, Yankai Lin, Zhiyuan Liu, Xiangyang Li, Zhonghua Li, Zhao Cao, Maosong Sun
| Challenge: | Large-scale pre-trained models have been widely adopted for document-oriented NLP tasks, such as question answering. |
| Approach: | They propose to decouple document encoding from downstream tasks by introducing a document plugin into the backbone of a PTM. |
| Outcome: | The proposed model can encode documents once and for all across different scenarios. |
Dynamic Guided and Domain Applicable Safeguards for Enhanced Security in Large Language Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing defense methods struggle with two key issues: inadequate defense capabilities and over-defensiveness. |
| Approach: | They propose a multi-agents-based framework that leverages accurate external information to provide an unbiased summary of user intentions and safety response guidance. |
| Outcome: | Experiments on popular jailbreak attacks and benign datasets show that the proposed framework can enhance LLM's robustness against jailbreaks without compromising its general functionality. |
Rank-Aware Negative Training for Semi-Supervised Text Classification (2023.tacl-1)
Copied to clipboard
| Challenge: | Semi-supervised text classification-based paradigms employ the spirit of self-training, but the accuracy of pseudo-labels can be a problem in real-world scenarios. |
| Approach: | They propose a Rank-aware Negative Training framework to address SSTC in noisy label learning . they rank unlabeled texts based on evidential support from the labeled texts. |
| Outcome: | The proposed framework overcomes state-of-the-art alternatives and achieves competitive performance in other scenarios. |
Generating Questions for Knowledge Bases via Incorporating Diversified Contexts and Answer-Aware Loss (D19-1)
Copied to clipboard
| Challenge: | Conventional methods for question generation neglect two crucial research issues: 1) the given predicate needs to be expressed; 2) the answer to the generated question needs to have a definitive answer. |
| Approach: | They propose a neural encoder-decoder model with multi-level copy mechanisms to generate questions . they also introduce answer-aware loss to make generated questions correspond to more definitive answers. |
| Outcome: | The proposed model achieves state-of-the-art performance while corresponding to more definitive answers. |
BIPEFT: Budget-Guided Iterative Search for Parameter Efficient Fine-Tuning of Large Pretrained Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for parameter-efficient fine-tuning are limited by computational and storage requirements. |
| Approach: | They propose a budget-guided iterative search strategy to disentangle binary module and rank dimension search spaces and early selection strategies based on parameter budgets. |
| Outcome: | The proposed method significantly improves search efficiency on public benchmarks. |
EquiBench: Benchmarking Large Language Models’ Reasoning about Program Semantics via Equivalence Checking (2025.emnlp-main)
Copied to clipboard
Anjiang Wei, Jiannan Cao, Ran Li, Hongyu Chen, Yuhui Zhang, Ziheng Wang, Yuan Liu, Thiago S. F. X. Teixeira, Diyi Yang, Ke Wang, Alex Aiken
| Challenge: | EquiBench is a new benchmark to evaluate large language models' ability to reason about program semantics . Unlike natural language, code is executable. |
| Approach: | They propose a benchmark to evaluate large language models through equivalence checking . EquiBench consists of 2400 program pairs across four languages and six categories . |
| Outcome: | The proposed benchmark consists of 2400 program pairs across four languages and six categories. |
RL-PLUS: Countering Capability Boundary Collapse of LLMs in Reinforcement Learning with Hybrid-policy Optimization (2026.acl-long)
Copied to clipboard
Yihong Dong, Xue Jiang, Yongding Tao, Huanyu Liu, Kechi Zhang, Lili Mou, Rongyu Cao, Yingwei MA, Jue Chen, Binhua Li, Zhi Jin, Fei Huang, Yongbin Li, Ge Li
| Challenge: | Reinforcement Learning with Verifiable Reward (RLVR) has significantly advanced the complex reasoning abilities of Large Language Models (LLMs). |
| Approach: | They propose a hybrid-policy optimization approach that synergizes internal exploitation with external data to achieve stronger reasoning capabilities. |
| Outcome: | The proposed approach achieves state-of-the-art performance on six math reasoning benchmarks and superior performance on out-of distribution reasoning tasks. |
Speed Up Your Code: Progressive Code Acceleration Through Bidirectional Tree Editing (2025.acl-long)
Copied to clipboard
Longhui Zhang, Jiahao Wang, Meishan Zhang, GaoXiong Cao, Ensheng Shi, Mayuchi Mayuchi, Jun Yu, Honghai Liu, Jing Li, Min Zhang
| Challenge: | Existing training methods, such as direct instruction fine-tuning, overlook hierarchical relationships among acceleration patterns. |
| Approach: | They propose a new training paradigm that uses bidirectional tree editing and progressive code acceleration learning to improve LLMs’ CA capabilities. |
| Outcome: | The proposed training paradigm outperforms prompt-enhanced GPT-4 and current training-based methods on average across five programming languages. |
Enhancing Large Language Model for Knowledge Graph Completion via Structure-Aware Alignment-Tuning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing knowledge graph completion methods ignore inconsistent representation spaces between natural language and graph structures, leading to duplicate works and time-consuming processes. |
| Approach: | They propose a framework that enhances LLMs for KGC via structure-aware alignment-tuning to align graph embeddings with the natural language space through multi-task contrastive learning. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on two KGC tasks across four benchmark datasets. |
DPWriter: Reinforcement Learning with Diverse Planning Branching for Creative Writing (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for enhancing large language models (LLMs) lack explicit mechanisms for guiding diverse exploration and instead prioritize efficiency and performance over diversity. |
| Approach: | They propose a reinforcement learning-based framework that decomposes the generation process into explicitly planned intermediate steps and introduces divergence at the planning phase based on diversity variation. |
| Outcome: | The proposed method significantly outperforms existing baselines on creative writing benchmarks on a semi-structured long chain-of-thought (CoT) it introduces divergence at the planning phase based on diversity variation, alongside a group-aware diversity reward to encourage distinct trajectories. |
OpenRLHF: A Ray-based Easy-to-use, Scalable and High-performance RLHF Framework (2025.emnlp-demos)
Copied to clipboard
Jian Hu, Xibin Wu, Wei Shen, Jason Klein Liu, Weixun Wang, Songlin Jiang, Haoran Wang, Hao Chen, Bin Chen, Wenkai Fang, null Xianyu, Yu Cao, Haotian Xu, Yiming Liu
| Challenge: | Existing RLHF frameworks face inference bottlenecks and complexity barriers restricting their accessibility for newcomers. |
| Approach: | They propose an open-source RLHF framework that can be used to train large language models. |
| Outcome: | The proposed framework achieves superior training efficiency with speedups ranging from 1.22 to 1.68 across different model sizes compared to state-of-the-art frameworks, while requiring significantly fewer lines of code for implementation. |
DialogVCS: Robust Natural Language Understanding in Dialogue System Upgrade (2024.naacl-long)
Copied to clipboard
Zefan Cai, Xin Zheng, Tianyu Liu, Haoran Meng, Jiaqi Han, Gang Yuan, Binghuai Lin, Baobao Chang, Yunbo Cao
| Challenge: | Existing models for natural language understanding are based on a well-defined intent 1 ontology. |
| Approach: | They propose to retrain the natural language understanding model as new data from real users are merged into existing data. |
| Outcome: | The proposed model shows that the semantically entangled intents can be recognized with an automatic workflow. |
Highlight-Transformer: Leveraging Key Phrase Aware Attention to Improve Abstractive Multi-Document Summarization (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing models do not consider key phrases in determining attention weights of self-attention . Existing work does not consider the importance of key phrases when determining weights . |
| Approach: | They propose a model with highlighting mechanism to assign greater attention weights to key phrases . they propose two structures of highlighting attention for each head and the multihead highlighting . experimental results show that their proposed model significantly outperforms the baseline model . |
| Outcome: | The proposed model outperforms the baseline models on a multi-news dataset. |
RAP: Efficient Text-Video Retrieval with Sparse-and-Correlated Adapter (2024.findings-acl)
Copied to clipboard
Meng Cao, Haoran Tang, Jinfa Huang, Peng Jin, Can Zhang, Ruyang Liu, Long Chen, Xiaodan Liang, Li Yuan, Ge Li
| Challenge: | Text-Video Retrieval (TVR) aims to align relevant video content with natural language queries. |
| Approach: | They propose to conduct efficient text-video Retrieval with a salient-and-correlated AdaPter . they propose a low-rank modulation module to refine per-image features from frozen CLIP backbone . |
| Outcome: | Experiments on four TVR datasets show that the proposed method performs better than other methods. |
Adversarial Transfer Learning for Chinese Named Entity Recognition with Self-Attention Mechanism (D18-1)
Copied to clipboard
| Challenge: | Existing methods for named entity recognition (NER) do not exploit word boundary information from CWS or cannot filter the specific information of CWS. |
| Approach: | They propose to exploit task-shared boundary information to make full use of Chinese NER task and Chinese word segmentation (CWS) . |
| Outcome: | The proposed model significantly outperforms other state-of-the-art methods on two widely used datasets. |
Ambiguous Learning from Retrieval: Towards Zero-shot Semantic Parsing (2023.acl-long)
Copied to clipboard
Shan Wu, Chunlei Xin, Hongyu Lin, Xianpei Han, Cao Liu, Jiansong Chen, Fan Yang, Guanglu Wan, Le Sun
| Challenge: | Existing neural semantic parsers require a large amount of training data which is expensive and difficult to obtain. |
| Approach: | They propose a framework for a supervised retrieval system based on pretrained language models . they propose ambiguous supervision to improve the precision and coverage of the task . |
| Outcome: | The proposed approach outperforms state-of-the-art zero-shot parsing methods in ambiguous supervision. |
G3R: A Graph-Guided Generate-and-Rerank Framework for Complex and Cross-domain Text-to-SQL Generation (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to complex and cross-domain Text-to-SQL generation lack domain knowledge . domain knowledge is not incorporated to enhance their ability to generalise to unseen databases. |
| Approach: | They propose a framework called G3R for complex and cross-domain Text-to-SQL generation . they propose re-ranking SQL queries based on domain knowledge and a graph-guided SQL generator . |
| Outcome: | The proposed framework achieves state-of-the-art results on the Spider and Spider-DK benchmarks. |
Compressing and Debiasing Vision-Language Pre-Trained Models for Visual Question Answering (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on VQA models have found that they suffer from dataset biases and inefficient memory footprints. |
| Approach: | They investigate whether a VLP can be compressed and debiased simultaneously by searching sparse and robust subnetworks. |
| Outcome: | The proposed compression and debiasing pipelines outperform the debiased full VLPs on VQA tasks. |
GMN: Generative Multi-modal Network for Practical Document Information Extraction (2022.naacl-main)
Copied to clipboard
| Challenge: | Document Information Extraction (DIE) has attracted increasing attention due to its various advanced applications in the real world. |
| Approach: | They propose a multi-modal generation method without predefined label categories for real-world scenarios using a spatial encoder and modal-aware mask module. |
| Outcome: | The proposed method can deal with complex documents that are hard to serialize into sequential order. |
MAIR: A Massive Benchmark for Evaluating Instructed Retrieval (2024.emnlp-main)
Copied to clipboard
Weiwei Sun, Zhengliang Shi, Wu Long, Lingyong Yan, Xinyu Ma, Yiding Liu, Min Cao, Dawei Yin, Zhaochun Ren
| Challenge: | Existing IR benchmarks focus on a limited scope of tasks, making them insufficient for evaluating the latest IR models. |
| Approach: | They propose a multi-task instruction-tuned IR benchmark that includes 126 distinct IR tasks across 6 domains. |
| Outcome: | The proposed model performs better on instruction-tuned models than non-instruction-tunned models on MAIR. |
Evaluating Personalized Tool-Augmented LLMs from the Perspectives of Personalization and Proactivity (2025.acl-long)
Copied to clipboard
| Challenge: | Personalized tool utilization is essential for aligning large language models (LLMs) with user preference in interaction scenarios with various tools. |
| Approach: | They propose a key-point-based LLM evaluation method that mitigates biases by manually annotating key points for each test case and providing them to LLM as the reference. |
| Outcome: | The proposed method mitigates biases in the LLM-as-a-judge system by manually annotating key points for each test case and providing them to LLM as the reference. |
Hyperlink-induced Pre-training for Passage Retrieval in Open-domain Question Answering (2022.acl-long)
Copied to clipboard
Jiawei Zhou, Xiaoguang Li, Lifeng Shang, Lan Luo, Ke Zhan, Enrui Hu, Xinyu Zhang, Hao Jiang, Zhao Cao, Fan Yu, Xin Jiang, Qun Liu, Lei Chen
| Challenge: | Existing methods to train dense passage retrieval have a large data gap between upstream and downstream relevance. |
| Approach: | They propose a method to pre-train the dense retriever with the text relevance induced by hyperlinks within Web documents. |
| Outcome: | The proposed method outperforms existing methods under different scenarios and in the open-domain question answering domain. |
Leros: Learning Explicit Reasoning on Synthesized Data for Commonsense Question Answering (2024.lrec-main)
Copied to clipboard
Chenhao Wang, Pengfei Cao, Jiachun Li, Yubo Chen, Kang Liu, Xiaojian Jiang, Jiexin Xu, Li Qiuxia, Jun Zhao
| Challenge: | Recent work shows large language models can generate useful rationales for commonsense question answering (CQA) however, the cost of deployment and further tuning is relatively expensive for the large models. |
| Approach: | They propose a framework that leverages both knowledge graphs and large language models to synthesize rationale-augmented CQA data. |
| Outcome: | The proposed model can generate useful rationales on unseen CQA benchmarks. |
BeautifulPrompt: Towards Automatic Prompt Engineering for Text-to-Image Synthesis (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Recent text-to-image models require multiple passes of prompt engineering by humans to produce satisfactory results for real-world applications. |
| Approach: | They propose a deep generative model to generate high-quality prompts from raw descriptions using visual feedback. |
| Outcome: | The proposed model produces high-quality prompts from simple raw descriptions . it can be integrated to a cloud-native AI platform to provide better image generation service in the cloud. |
Untangle the KNOT: Interweaving Conflicting Knowledge and Reasoning Skills in Large Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies have explained to what extent LLMs extract conflicting knowledge from the provided text, but they neglect the necessity to reason with conflicting information. |
| Approach: | They construct a dataset for knowledge conflict resolution examination in the form of question answering that divides reasoning with conflicting knowledge into three levels. |
| Outcome: | The proposed dataset enables analysis of reasoning with conflicting knowledge in the form of question answering. |
Re3: Relevance & Recency Retrieval for Mitigating Temporal Hallucination (2026.acl-long)
Copied to clipboard
| Challenge: | Existing retrievers suffer from temporal-semantic misalignment and outdated-document interference . Existing frameworks suffer from both temporal validity and outdated factual versions . |
| Approach: | They propose a framework that mitigates temporal hallucinations by embedding heterogeneous temporal signals into the semantic space to ensure retrieval fidelity. |
| Outcome: | Experiments show that Re3 outperforms baselines by 9.7% in generation accuracy . the framework outperformed strongest baselines on challenging dynamic tasks . |
LDEDE: LRP-Driven Efficient Detection and Editing Framework for LLM Privacy Neurons (2026.findings-acl)
Copied to clipboard
Zhao Zhengyuan, Cao Lifeng, null Sunhaodong, Shi Haotian, Du Xuehui, Liu Aodi, Niu Lanjie, Yang Xiaocheng
| Challenge: | Existing privacy protection methods fail to cover context-dependent sensitive information and are prone to performance degradation. |
| Approach: | They propose a Layer-wise Relevance Propagation-driven framework for efficient privacy neuron detection and editing. |
| Outcome: | The proposed framework achieves 80% higher efficiency than gradient attribution methods while reducing leakage risks of Phone, Email, and medical privacy by 42.7%–73.5% on average and cutting computational time by 60%–90%. |
Representative Demonstration Selection for In-Context Learning with Two-Stage Determinantal Point Process (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods tend to select different demonstrations for each test instance, which is time-consuming and poses limitations in practical scenarios. |
| Approach: | They propose to select a representative subset of in-context demonstrations that can prompt different test instances in a specific task. |
| Outcome: | The proposed method can be used to generate representative in-context demonstrations. |
The Past Mistake is the Future Wisdom: Error-driven Contrastive Probability Optimization for Chinese Spell Checking (2022.findings-acl)
Copied to clipboard
Yinghui Li, Qingyu Zhou, Yangning Li, Zhongli Li, Ruiyang Liu, Rongyi Sun, Zizhen Wang, Chao Li, Yunbo Cao, Hai-Tao Zheng
| Challenge: | Chinese Spell Checking (CSC) aims to detect and correct spelling errors, which are caused by the phonological or visual similarity. |
| Approach: | They propose an Error-driven COntrastive Probability Optimization framework to refine the knowledge representations of pre-trained language models to avoid predicting common characters. |
| Outcome: | Extensive experiments and detailed analyses on SIGHAN datasets demonstrate that ECOPO is simple yet effective. |
The Knowledge Microscope: Features as Better Analytical Lenses than Neurons (2025.acl-long)
Copied to clipboard
| Challenge: | Recent studies have shown that features are superior analytical units for understanding factual knowledge in Language Models. |
| Approach: | They propose a feature-based editing method that decomposes neurons into features rather than neurons to understand the mechanisms of factual knowledge in Language Models. |
| Outcome: | The proposed method demonstrates superior performance over neuron-based approaches in erasing privacy-sensitive information from LMs. |
InstructMol: Multi-Modal Integration for Building a Versatile and Reliable Molecular Assistant in Drug Discovery (2025.coling-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) can attain professional-level proficiency in specific domains through fine-tuning. |
| Approach: | They propose a multi-modal LLM that aligns molecular structures with natural language via an instruction-tuning approach. |
| Outcome: | InstructMol surpasses existing models and reduces the gap with specialists in drug discovery tasks. |
PaperScope: A Multi-Modal Multi-Document Benchmark for Agentic Deep Research Across Massive Scientific Papers (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks focus on single-document understanding, whereas real scientific workflows require integrating evidence from multiple papers. |
| Approach: | They propose a multi-modal multi-document benchmark for agentic deep research that integrates evidence from multiple documents. |
| Outcome: | Experimental results show that even advanced systems achieve limited scores on PaperScope . paper provides a rigorous benchmark alongside a pipeline for constructing large multi-modal, multi-source deep research datasets. |