Papers by Guo Li
NeuralFSM: Adaptive Multi-Agent Coordination via Learning Finite-State Execution Policy (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to multi-agent problem solving rely on hand-crafted protocols or automatically designed topologies. |
| Approach: | They propose a state-driven framework that formulates multi-agent problem solving as a finite-state execution process. |
| Outcome: | The proposed framework outperforms baselines on diverse benchmarks by 6.74%–19.39% while reducing token consumption. |
ThinkPersona: Thinking with Persona Graphs for Faithful Individualized Role-Playing (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models are increasingly utilized as role-playing agents to simulate personas in interactive settings. |
| Approach: | They propose a role-playing agent trained to explicitly ground responses in individual identity. |
| Outcome: | The proposed agent can generate persona-consistent responses in long-context dialogues while maintaining general instruction-following capabilities. |
Modeling Hierarchical Syntax Structure with Triplet Position for Source Code Summarization (2022.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to describe the syntax structure of code are lacking in retaining the semantic structure of source code. |
| Approach: | They propose to use a triplet position to model hierarchical syntax structure of code by introducing a graph neural network and Transformer to preserve the structural and sequential information of code. |
| Outcome: | The proposed model preserves the structural and sequential information of code and a pointer-generator network that pays attention to both the structure and sequential tokens of code for a better summary generation. |
FastMCTS: A Simple Sampling Strategy for Data Synthesis (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for generating multi-step reasoning data rely on rejection sampling, which generates trajectories independently and suffers from inefficiency and imbalanced sampling across problems of varying difficulty levels. |
| Approach: | They propose a data synthesis strategy inspired by Monte Carlo Tree Search . it offers step-level evaluation signals and promotes balanced sampling . |
| Outcome: | Experiments show that FastMCTS generates 30% more correct reasoning paths than rejection sampling. |
MTSA: Multi-turn Safety Alignment for LLMs through Multi-round Red-teaming (2025.acl-long)
Copied to clipboard
| Challenge: | Existing jailbreak techniques rely on single-round interactions, pro-Corresponding author. |
| Approach: | They propose a multi-turn safety alignment framework to address the challenge of securing large language models in multi-round interactions. |
| Outcome: | The proposed framework exhibits state-of-the-art attack capabilities while improving safety performance on safety benchmarks. |
Complex Evolutional Pattern Learning for Temporal Knowledge Graph Reasoning (2022.acl-short)
Copied to clipboard
Zixuan Li, Saiping Guan, Xiaolong Jin, Weihua Peng, Yajuan Lyu, Yong Zhu, Long Bai, Wei Li, Jiafeng Guo, Xueqi Cheng
| Challenge: | Existing models for TKG reasoning focus on modeling fact sequences of a fixed length, which cannot discover complex evolutional patterns that vary in length. |
| Approach: | They propose to use a length-aware Convolutional Neural Network to handle evolutional patterns of different lengths via an easy-to-difficult curriculum learning strategy. |
| Outcome: | The proposed model improves performance under both offline and online learning strategies. |
Guiding Neural Machine Translation with Semantic Kernels (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Empirical studies show that our approach gains approximately an improvement of 1 BLEU score on most benchmarks over the Transformer baseline. |
| Approach: | They propose to extract several semantic kernels from a source sentence to capture global semantic information. |
| Outcome: | Empirical results show that the proposed approach improves 1 BLEU score on benchmarks . it is also 1.7 times faster than previous works on average at inference time . |
Too Long, Do Re-weighting for Efficient LLM Reasoning Compression (2026.acl-long)
Copied to clipboard
Zhong-Zhi Li, Xiao Liang, Zihao Tang, Lei Ji, Peijie Wang, Haotian Xu, Xing W, Haizhen Huang, Weiwei Deng, Yeyun Gong, Zhijiang Guo, Xiao Liu, Fei Yin, Cheng-Lin Liu
| Challenge: | Large Language Models (LLMs) have recently achieved remarkable progress on complex reasoning tasks by leveraging extended Chain-of-Thought (CoT) techniques. |
| Approach: | They propose a method that uses Extended Chain-of-Thought (EFT) to reduce the number of output tokens by nearly 40% while maintaining the accuracy of the reasoning. |
| Outcome: | The proposed method reduces the number of output tokens by nearly 40% while maintaining the accuracy of the reasoning. |
Scaling Laws for Code: Every Programming Language Matters (2026.findings-acl)
Copied to clipboard
Jian Yang, Shuyue Guo, Linzheng Chai, Wei Zhang, Aishan Liu, Chuan Hao, Zhoujun Li, Xin Zhao, Xianglong Liu, Weifeng Lv, Bryan Dai
| Challenge: | Existing studies focus on language-agnostic settings, neglecting the inherently multilingual nature of modern software development. |
| Approach: | They propose a proportion-dependent scaling law that prioritizes high-utility languages . they propose PLs to have varying effects during pre-training that affect model performance . |
| Outcome: | The proposed scaling law is based on 1000+ experiments across multiple languages and models. |
InfiniteWeb: Scalable Web Environment Synthesis for GUI Agent Training (2026.acl-long)
Copied to clipboard
| Challenge: | Existing GUI agent benchmarks are manually constructed and lack scale and diversity as training environments. |
| Approach: | They propose a GUI agent training system that automatically generates web environments at scale. |
| Outcome: | The proposed system outperforms commercial GUI agents at realistic website construction and improves on OSWorld and Online-Mind2Web. |
A Mutual Information Perspective on Knowledge Graph Embedding (2025.acl-long)
Copied to clipboard
| Challenge: | Existing knowledge graph embedding techniques suffer from high intra-group similarity, loss of semantic information, and insufficient inference capability, particularly in complex relation patterns such as 1-N and N-1 relations. |
| Approach: | They propose a knowledge graph embedding framework that leverages mutual information maximization to improve the semantic representation of entities and relations. |
| Outcome: | Extensive experiments on benchmark datasets demonstrate the effectiveness of the proposed method, with consistent performance improvements across various baseline models. |
Better Process Supervision with Bi-directional Rewarding Signals (2025.findings-acl)
Copied to clipboard
Wenxiang Chen, Wei He, Zhiheng Xi, Honglin Guo, Boyang Hong, Jiazheng Zhang, Nijun Li, Tao Gui, Yun Li, Qi Zhang, Xuanjing Huang
| Challenge: | Existing processes that reward for each step are one-directional and lack a mechanism to model the distance to the final target. |
| Approach: | They propose a process supervision model that evaluates the correctness of previous steps and the probability of future success. |
| Outcome: | The proposed model outperforms existing supervision models like ORM and PRM on reasoning tasks and improves solution re-design. |
RSMeM: Knowledge-Enhanced Memory Evolution for Remote Sensing Agents with Systematic Evaluation (2026.acl-long)
Copied to clipboard
Bingxian Wu, Yu Zhang, Zonghao Guo, Tang Liu, Chen Qian, Yuxiang Lu, Xingbo Du, Yanghao Li, Yidan Zhang, Chi Chen, Ling Yao, Chenghu Zhou, Maosong Sun
| Challenge: | Existing RS agents built on general-purpose LLMs are domain-agnostic, resulting in brittle and error-prone workflows. |
| Approach: | They propose a knowledge-enhanced memory evolution mechanism that bootstraps RS agents with pre-distilled domain knowledge and iteratively integrates online experience for robust multi-step tool execution. |
| Outcome: | Experiments show that the new model improves tool-use performance and accuracy . iteratively, iteration of the model integrates online experience for robust multi-step tool execution . |
LLMs Assist NLP Researchers: Critique Paper (Meta-)Reviewing (2024.emnlp-main)
Copied to clipboard
Jiangshu Du, Yibo Wang, Wenting Zhao, Zhongfen Deng, Shuaiqi Liu, Renze Lou, Henry Zou, Pranav Narayanan Venkit, Nan Zhang, Mukund Srinath, Haoran Zhang, Vipul Gupta, Yinghui Li, Tao Li, Fei Wang, Qin Liu, Tianlin Liu, Pengzhi Gao, Congying Xia, Chen Xing, Cheng Jiayang, Zhaowei Wang, Ying Su, Raj Shah, Ruohao Guo, Jing Gu, Haoran Li, Kangda Wei, Zihao Wang, Lu Cheng, Surangika Ranathunga, Meng Fang, Jie Fu, Fei Liu, Ruihong Huang, Eduardo Blanco, Yixin Cao, Rui Zhang, Philip Yu, Wenpeng Yin
| Challenge: | a comparative analysis of paper (meta-)reviews by large language models (LLMs) aims to identify and distinguish LLMs from human activities . |
| Approach: | They present a comparative analysis to identify and distinguish LLM activities from human activities. |
| Outcome: | The proposed analysis aims to improve recognition of instances when someone implicitly uses LLMs for reviewing activities. |
LinguaLens: Towards Interpreting Linguistic Mechanisms of Large Language Models via Sparse Auto-Encoder (2025.emnlp-main)
Copied to clipboard
| Challenge: | Prior research on linguistic mechanisms of large language models is limited by coarse granularity, limited analysis scale, and narrow focus. |
| Approach: | They propose a framework for analyzing the linguistic mechanisms of large language models based on Sparse Auto-Encoders. |
| Outcome: | The proposed framework extracts Chinese and English linguistic features across four dimensions . it uncovers intrinsic representations of linguistic knowledge in LLMs and can control outputs . |
Search from History and Reason for Future: Two-stage Reasoning on Temporal Knowledge Graphs (2021.acl-long)
Copied to clipboard
| Challenge: | Temporal Knowledge Graphs (TKGs) are used in many different areas of research. |
| Approach: | They propose to use a beam search policy to induce multiple clues from historical facts . they propose to adopt a graph convolution network based sequence method to deduce answers from clues . |
| Outcome: | The proposed model can predict future facts in two stages, Clue Searching and Temporal Reasoning. |
Incorporating Syntax and Frame Semantics in Neural Network for Machine Reading Comprehension (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for machine reading comprehension rely on manually defined features and are difficult to generalize to other tasks. |
| Approach: | They propose a Syntax and Frame Semantics model for Machine Reading Comprehension which takes full advantage of syntax and frame semantics to get richer text representation. |
| Outcome: | The proposed model outperforms ten state-of-the-art models on machine reading comprehension tasks. |
Latent-Optimized Adversarial Neural Transfer for Sarcasm Detection (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing datasets for sarcasm detection are limited due to the difficulty in acquiring ground-truth annotations. |
| Approach: | They propose a generalized latent optimization strategy that allows different losses to accommodate each other and improves training dynamics. |
| Outcome: | The proposed approach outperforms transfer learning and meta-learning baselines and achieves 10.02% performance gain on the iSarcasm dataset. |
A Frame-based Sentence Representation for Machine Reading Comprehension (2020.acl-main)
Copied to clipboard
| Challenge: | Existing machine learning approaches do not have above semantic knowledge to address complicated MRC questions. |
| Approach: | They propose a frame-based Sentence Representation method which integrates frame semantic knowledge to facilitate sentence modelling. |
| Outcome: | The proposed method performs better than state-of-the-art methods on machine reading comprehension task. |
AnRe: Analogical Replay for Temporal Knowledge Graph Forecasting (2025.acl-long)
Copied to clipboard
| Challenge: | Temporal Knowledge Graphs (TKGs) are vital for event prediction, yet current methods face limitations. |
| Approach: | They propose a training-free Analogical Replay reasoning framework that uses LLMs to extract historical contexts and generate analogical reasoning examples as contextual inputs. |
| Outcome: | The proposed model outperforms existing training-free methods on four benchmarks. |
An Empirical Study of Iterative Refinements for Non-autoregressive Translation (2025.acl-long)
Copied to clipboard
| Challenge: | Iterative non-autoregressive (NAR) models have recently demonstrated impressive performance in varied generation tasks, surpassing the autoregressive Transformer. |
| Approach: | They propose a strategy to conduct efficient refinements without performance declines by using two simple metrics to identify potential problems existing in current refinement processes. |
| Outcome: | The proposed model outperforms the autoregressive Transformer by around one BLEU on average. |
CLaMP 3: Universal Music Information Retrieval Across Unaligned Modalities and Unseen Languages (2025.findings-acl)
Copied to clipboard
Shangda Wu, Guo Zhancheng, Ruibin Yuan, Junyan Jiang, SeungHeon Doh, Gus Xia, Juhan Nam, Xiaobing Li, Feng Yu, Maosong Sun
| Challenge: | Music information retrieval (MIR) is a field that aims at developing computational tools for processing, organizing, and accessing music data. |
| Approach: | They propose a framework that aligns music modalities with multilingual text in a shared representation space. |
| Outcome: | Experiments show CLaMP 3 performs state-of-the-art on multiple MIR tasks . it surpasses baselines and shows excellent generalization in multimodal and multilingual contexts . |
FLAIR: Steering LLM Mathematical Problem Solving based on A Fuzzy-Logic-AssIsted Reasoner (2026.acl-long)
Copied to clipboard
Hao Wu, Hongru Sun, Wanqing Li, Xinguo Yu, Hao Ming, Xiao Luo, Wenbin Zhang, Jiahong Zhao, Yi Guo, Jie Yang
| Challenge: | Existing approaches to mathematical reasoning rely on static heuristics or pre-determined reasoning strategies. |
| Approach: | They propose an adaptive framework that integrates fuzzy theory into LLM-based mathematical reasoning. |
| Outcome: | The proposed framework outperforms state-of-the-art models while offering effective and interpretable diagnostics of intermediate problem-solving states. |
CROP: Zero-shot Cross-lingual Named Entity Recognition with Multilingual Labeled Sequence Translation (2022.findings-emnlp)
Copied to clipboard
Jian Yang, Shaohan Huang, Shuming Ma, Yuwei Yin, Li Dong, Dongdong Zhang, Hongcheng Guo, Zhoujun Li, Furu Wei
| Challenge: | Named entity recognition (NER) suffers from the scarcity of annotated training data, especially for low-resource languages without labeled data. |
| Approach: | They propose a cross-lingual entity projection framework to enable zero-shot cross-linguistic NER with the help of a multilingual labeled sequence translation model. |
| Outcome: | The proposed method outperforms the baseline method on two benchmarks by a large margin of +3 7 F1 scores and achieves state-of-the-art performance. |
CtrlA: Adaptive Retrieval-Augmented Generation via Inherent Control (2025.findings-acl)
Copied to clipboard
Liu Huanshuo, Hao Zhang, Zhijiang Guo, Jing Wang, Kuicai Dong, Xiangyang Li, Yi Quan Lee, Cong Zhang, Yong Liu
| Challenge: | Existing methods focus on detecting LLM’s confidence via statistical uncertainty. |
| Approach: | They propose to use a representation perspective to solve adaptive RAG by enabling dynamic retrieval during generation and enabling retrieval only when the query exceeds LLM's internal knowledge. |
| Outcome: | The proposed framework is superior to existing adaptive RAG methods on a diverse set of tasks. |
STARS: A Unified Framework for Singing Transcription, Alignment, and Refined Style Annotation (2025.findings-acl)
Copied to clipboard
Wenxiang Guo, Yu Zhang, Changhao Pan, Zhiyuan Zhu, Ruiqi Li, ZheTao Chen, Wenhao Xu, Fei Wu, Zhou Zhao
| Challenge: | Existing automated singing annotation (ASA) methods tackle isolated aspects of the annotation pipeline. |
| Approach: | They propose a framework that addresses transcription, alignment, and refined style annotations. |
| Outcome: | The proposed framework delivers comprehensive multi-level annotations encompassing: (1) precise phoneme-audio alignment, (2) robust note transcription and temporal localization, (3) expressive vocal technique identification, and (4) global stylistic characterization including emotion and pace. |
AgentGym2: Benchmarking Large Language Model Agents in De-Idealized Real-World Environments (2026.acl-long)
Copied to clipboard
Zhiheng Xi, Dingwen Yang, Jiaqi Liu, Jixuan Huang, Honglin Guo, Baodai Huang, Tinggang Chen, Qi Zhang, Zhonghang Lu, Chenyu Liu, Jiajun Sun, Jiazheng Zhang, Dingwei Zhu, Xin Guo, Junzhe Wang, Zhihao Zhang, Yuming Yang, Junjie Ye, Minghe Gao, Dongrui Liu, Jiaming Ji, Guohao Li, Tao Gui, Qi Zhang, Xuanjing Huang
| Challenge: | Existing benchmarks evaluate agents in simplified, idealized settings, relying on pre-packaged tool interfaces, overlooking critical steps, and assume inputs are clean and fully specified. |
| Approach: | They propose a framework that evaluates language agents in simplified, idealized settings . they show that even SOTA systems like Gemini and GPT-5 struggle on AgentGym2 . |
| Outcome: | Experiments on 15 proprietary and open-source models show that even SOTA systems like Gemini and GPT-5 struggle on AgentGym2 . |
ProvBench: A Benchmark of Legal Provision Recommendation for Contract Auto-Reviewing (2025.acl-long)
Copied to clipboard
Xiuxuan Shen, Zhongyuan Jiang, Junsan Zhang, Junxiao Han, Yao Wan, Chengjie Guo, Bingcheng Liu, Jie Wu, Renxiang Li, Philip S. Yu
| Challenge: | Contract review is labor-intensive, time-consuming, and costly . a benchmark is proposed to detect potential legal conflicts . |
| Approach: | They propose a benchmark for legal provision recommendation and conflict detection for contract auto-reviewing which aims to recommend the legal provisions related to contract clauses and detect possible legal conflicts. |
| Outcome: | The proposed task recommends legal provisions related to contract clauses and detects legal conflicts. |
Towards Robustness of Text-to-SQL Models Against Natural and Realistic Adversarial Table Perturbation (2022.acl-long)
Copied to clipboard
| Challenge: | Existing Text-to-SQL parsers are vulnerable to perturbations in NL questions . we propose the Adversarial Table Perturbation (ATP) as a new attacking paradigm . |
| Approach: | They propose to use the Adversarial Table Perturbation to measure robustness of Text-to-SQL parsers against adversarial perturbations. |
| Outcome: | The proposed approach outperforms baseline methods in robustness evaluations on ADVETA and can be used in future projects. |
Add-One-In: Incremental Sample Selection for Large Language Models via a Choice-Based Greedy Paradigm (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on individual quality and do not assess the value of training data. |
| Approach: | They propose a choice-based sample selection framework that evaluates sample quality . they use LLMs to evaluate the value of each option during the selection process . |
| Outcome: | The proposed model outperforms the full dataset and recent studies on a larger medical dataset. |
Outlier Suppression+: Accurate quantization of large language models by equivalent and effective shifting and scaling (2023.emnlp-main)
Copied to clipboard
| Challenge: | asymmetric outliers in transformer language models are a challenge for post-training quantization . we propose a framework for outlier suppression that can be seamlessly migrated into subsequent modules . |
| Approach: | They propose a framework for post-training quantization that includes the channel-wise shifting and scaling for concentration. |
| Outcome: | The proposed framework can be migrated into subsequent modules while maintaining equivalence. |
Temporal Knowledge Graph Reasoning Based on N-tuple Modeling (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing Temporal Knowledge Graphs (TKGs) only contain their core entities and form them as quadruples. |
| Approach: | They propose to describe a temporal fact more accurately as an n-tuple . they propose to use a neural network to learn evolutional representations of entities . |
| Outcome: | The proposed model oversimplifies and causes information loss on two datasets. |
Temporal Token Matters: Investigating and Interpreting the Consistency of Temporal Ordering in Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) exhibit notable deficiencies in temporal reasoning . phrasing changes can lead LLMs to produce inconsistent outputs . |
| Approach: | They investigate the mechanistic interpretability of temporal ordering within event temporal reasoning . they identify a sparse subset of attention heads that are causally responsible for reasoning outcomes . |
| Outcome: | The proposed model outperforms other models in a variety of tasks and is validated by intervention-based experiments. |
Improving Numerical Reasoning Skills in the Modular Approach for Complex Question Answering on Text (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Neural Module Networks (NMNs) is an end-to-end differentiable model in the programmer-interpreter paradigm. |
| Approach: | They propose to make the interpreter question-aware and capture the relationship between entities and numbers in both questions and paragraphs. |
| Outcome: | The proposed models outperform the original models on the DROP dataset and are interpertable by nature. |
ZipVoice-Dialog: Non-Autoregressive Spoken Dialogue Generation with Flow Matching (2026.findings-acl)
Copied to clipboard
Han Zhu, Wei Kang, Liyong Guo, Zengwei Yao, Fangjun Kuang, Weiji Zhuang, Zhaoqing Li, Zhifeng Han, Dong Zhang, Xin Zhang, Xingchen Song, Lingxuan Ye, Long Lin, Daniel Povey
| Challenge: | Existing autoregressive models for dialogue generation suffer from high latency and stability issues. |
| Approach: | They propose a non-autoregressive (NAR) zero-shot spoken dialogue generation model based on flow-matching. |
| Outcome: | The proposed model outperforms existing models in speech generation due to poor speech intelligibility and turn-taking precision. |
Instruction Fusion: Advancing Prompt Evolution through Hybridization (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods for fine-tuning Large Language Models (LLMs) encounter performance limitations, impeding further enhancements in code generation tasks. |
| Approach: | They propose to combine two distinct prompts through a hybridization process to enhance the evolution of training prompts for code LLMs. |
| Outcome: | The proposed method significantly improves the performance of Code LLMs across five code generation benchmarks, namely HumanEval, HumanEva+, MBPP, mbap+ and MultiPL-E. |
Towards Advanced Mathematical Reasoning for LLMs via First-Order Logic Theorem Proving (2025.emnlp-main)
Copied to clipboard
Chuxue Cao, Mengze Li, Juntao Dai, Jinluan Yang, Zijian Zhao, Shengyu Zhang, Weijie Shi, Chengzhong Liu, Sirui Han, Yike Guo
| Challenge: | Large language models (LLMs) have shown promising first-order logic (FOL) reasoning capabilities with applications in various areas, but their effectiveness in complex mathematical reasoning involving multi-step FOL deductions remains under-explored. |
| Approach: | They propose a self-adaptive solution that enhances the Diversity and REAsonability of LLMs’ generation strategies by introducing an Axiom-Driven Strategy Diversification mechanism and a Sub-Proposition Error Feedback to help LLM reflect on and correct their proofs. |
| Outcome: | The proposed model improves diversity and REAsonability of LLMs’ generation strategies by introducing an Axiom-Driven Strategy Diversification mechanism and a Sub-Proposition Error Feedback to help LLM reflect on and correct proofs. |
Unveiling the Key Factors for Distilling Chain-of-Thought Reasoning (2025.findings-acl)
Copied to clipboard
Xinghao Chen, Zhijing Sun, Guo Wenjin, Miaoran Zhang, Yanjun Chen, Yirong Sun, Hui Su, Yijie Pan, Dietrich Klakow, Wenjie Li, Xiaoyu Shen
| Challenge: | Large Language Models (LLMs) excel in reasoning tasks through Chain-of-Thought prompting. |
| Approach: | They examine the factors influencing CoT distillation including granularity, format and teacher model. |
| Outcome: | The proposed model is based on four teacher models and seven student models across seven mathematical and commonsense reasoning datasets. |
IW-Bench: Evaluating Large Multimodal Models for Converting Image-to-Web (2025.findings-acl)
Copied to clipboard
Hongcheng Guo, Wei Zhang, Junhao Chen, Yaonan Gu, Jian Yang, Junjia Du, Shaosheng Cao, Binyuan Hui, Tianyu Liu, Jianxin Ma, Chang Zhou, Zhoujun Li
| Challenge: | Existing models have been introduced to improve image comprehension, but there is no robust benchmark for imagetoweb conversion. |
| Approach: | They propose a benchmark to assess imagetoweb conversion proficiency of large multimodal models . they propose to measure layout information of web pages by parsing the Document Object Model tree . |
| Outcome: | The proposed benchmark measures the layout information of web pages—i.e., the positional relationships between elements—which has been overlooked by prior work. |
Improving Knowledge Graph Embedding Using Simple Constraints (P18-1)
Copied to clipboard
| Challenge: | Recent efforts focused on designing more complicated models or incorporating extra information beyond triples. |
| Approach: | They propose to use non-negativity constraints on entity representations and approximate entailment constraints on relation representations to improve KG embedding. |
| Outcome: | The proposed model outperforms baseline models on WordNet, Freebase, and DBpedia. |
LoopCoder: Scaling Code Intelligence via Looped Language Models (2026.findings-acl)
Copied to clipboard
Jian Yang, Wei Zhang, Shuyue Guo, Yizhi LI, Linzheng Chai, Zhengmao Ye, Shukai Liu, Yuyang Song, Jiajun Wu, Che Liu, Tianyu Zheng, Siwei Wu, Leo L, Xudong Ma, Chuan Hao, Ran Tao, Yan Xing, Jianzhou Wang, Mingjie Tang, Aishan Liu, Zhoujun Li, Xianglong Liu, Weifeng Lv, Bryan Dai
| Challenge: | Large language models have mastered syntax-level code generation, but complex algorithmic reasoning remains a challenge. |
| Approach: | They propose a recurrent inductive bias that aligns with the recursive nature of programming logic. |
| Outcome: | The proposed model achieves comparable performance to standard dense models with more parameters. |
FAME: Towards Factual Multi-Task Model Editing (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models embed extensive knowledge and perform exceptionally well across tasks. outdated knowledge or factual errors within LLMs can lead to misleading or incorrect responses. |
| Approach: | They propose to use a dataset to enhance the practicality of model editing to correct inaccurate information within LLMs. |
| Outcome: | The proposed method performs excellently across tasks and scenarios, confirming its practicality. |
A Joint Model for Dropped Pronoun Recovery and Conversational Discourse Parsing in Chinese Conversational Speech (2021.acl-long)
Copied to clipboard
| Challenge: | Existing work regards dropped pronoun recovery and conversational discourse parsing as two separate tasks and tackles them separately. |
| Approach: | They propose a neural model for dropped pronoun recovery and conversational discourse parsing in Chinese conversational speech. |
| Outcome: | The proposed model outperforms the state-of-the-art models on a new dataset . the proposed model is based on linguistic and semantic information from Chinese conversational speech . |
Benchmarking Large Language Models on CFLUE - A Chinese Financial Language Understanding Evaluation Dataset (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in large language models have revolutionized natural language processing (NLP) there is an urgent need for new benchmarks to keep pace with the development of LLMs. |
| Approach: | They propose a benchmark to assess the capability of large language models (LLMs) they use a dataset to provide both knowledge assessment and application assessment . |
| Outcome: | The proposed benchmark provides datasets tailored for knowledge assessment and application assessment. |
TaCIE: Enhancing Instruction Comprehension in Large Language Models through Task-Centred Instruction Evolution (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for fine-tuning Large Language Models (LLMs) encounter performance limitations, impeding further enhancements in code generation tasks. |
| Approach: | They propose to combine two distinct prompts through a hybridization process to enhance the evolution of training prompts for code LLMs. |
| Outcome: | The proposed method significantly improves the performance of Code LLMs across five code generation benchmarks. |
Temp-R1: A Unified Autonomous Agent for Complex Temporal KGQA via Reverse Curriculum Reinforcement Learning (2026.acl-long)
Copied to clipboard
Zhaoyan Gong, Zhiqiang Liu, Songze Li, Xiaoke Guo, Yuanxiang Liu, Xinle Deng, Zhizhen Liu, Lei Liang, Huajun Chen, Wen Zhang
| Challenge: | Existing methods rely on fixed workflows and expensive closed-source APIs, limiting flexibility and scalability. |
| Approach: | They propose a temporal reasoning agent that trains on difficult questions first . they expand the action space with specialized internal actions alongside external action . |
| Outcome: | The proposed agent improves 19.8% over baselines on complex questions and multi-tasks. |
LiveCANNBench: Benchmark SWE AI Coding for Ascend CANN (2026.findings-acl)
Copied to clipboard
Sijie Wang, Kai Zhao, Wee Peng Tay, Shuo Zhang, Chengwen Liu, Quanjiang Guo, Ren Junhao, Xin Li, Heng Lian, Jingdi Lei, Rui She, Huacan Wang, Ronghao Chen
| Challenge: | Recent advances in agents have enabled multi-file, multi-language, and dependency-aware AI coding. |
| Approach: | They propose an SWE-level benchmark for AI coding in the Huawei Ascend CANN software stack. |
| Outcome: | The proposed benchmark is constructed from real-world CANN repositories and consists of over 400 task instances spanning multiple file, multi-language, and execution-aware coding challenges. |
Importance of Synthesizing High-quality Data for Text-to-SQL Parsing (2023.findings-acl)
Copied to clipboard
Yiqun Hu, Yiyun Zhao, Jiarong Jiang, Wuwei Lan, Henghui Zhu, Anuj Chauhan, Alexander Hanbo Li, Lin Pan, Jun Wang, Chung-Wei Hang, Sheng Zhang, Jiang Guo, Mingwen Dong, Joseph Lilien, Patrick Ng, Zhiguo Wang, Vittorio Castelli, Bing Xiang
| Challenge: | Existing text-to-SQL parsers lack the data to perform well with augmented synthetic data. |
| Approach: | They propose a framework that imposes strong typing constraints and incorporates key relationships from schema. |
| Outcome: | The proposed framework improves on the high-quality synthesized SQL and natural language question (NLQ) models have significant accuracy boosts and achieve new state-of-the-art performance on spider. |
AQE: Argument Quadruplet Extraction via a Quad-Tagging Augmented Generative Approach (2023.findings-acl)
Copied to clipboard
| Challenge: | Argument mining involves multiple subtasks, but each one is insufficient for understanding argumentative structure and reasoning process. |
| Approach: | They propose a quadruplet extraction task that extracts four argumentative components . they use a generative quadragging module to augment the training of the generative framework . |
| Outcome: | The proposed method can extract arguments from a large-scale dataset. |
TED-EL: A Corpus for Speech Entity Linking (2024.lrec-main)
Copied to clipboard
| Challenge: | Current entity linking tasks rely on textual information, but entities usually exist in textual, audio, and visual contexts in real-world data such as social media and video websites. |
| Approach: | They propose a speech entity linking task to recognize mentions from speech and link them to entities in knowledge bases. |
| Outcome: | The proposed model outperforms the existing models on the TED-EL dataset, scoring an F1 score of 60.68%. |
Generative Annotation for ASR Named Entity Correction (2025.emnlp-main)
Copied to clipboard
Yuanchang Luo, Daimeng Wei, Shaojun Li, Hengchao Shang, Jiaxin Guo, Zongyao Li, Zhanglin Wu, Xiaoyu Chen, Zhiqiang Rao, Jinlong Yang, Hao Yang
| Challenge: | Existing named entity correction models fail to transcribe domain-speciffcnamed entities when theforms of the wrongly-transcribed words and the ground-truth entity are signiffcantly different. |
| Approach: | They propose a method that utilizes speech sound features to retrieve candidate entities . it uses speech sound feature to annotate entityerrors in ASR transcripts . |
| Outcome: | The proposed method can bring signiffcant improvement to entity accuracy. |
Rethinking Text-to-SQL: Dynamic Multi-turn SQL Interaction for Real-world Database Exploration (2026.findings-acl)
Copied to clipboard
Linzhuang Sun, Tianyu Guo, Hao Liang, Ruitong Liu, Yuying Li, Qifeng Cai, Jingxuan Wei, Yuchen Wu, Bihui Yu, Xiangxiang Zhang, Wentao Zhang, Bin Cui
| Challenge: | Structured Query Language (SQL) is the cornerstone for data-driven decision-making. |
| Approach: | They propose a benchmark to rigorously evaluate Large Language Models within a dynamic interaction framework. |
| Outcome: | The proposed benchmark aims to rigorously evaluate LLMs within a dynamic interaction framework. |
Data Interpreter: An LLM Agent for Data Science (2025.findings-acl)
Copied to clipboard
Sirui Hong, Yizhang Lin, Bang Liu, Bangbang Liu, Binhao Wu, Ceyao Zhang, Danyang Li, Jiaqi Chen, Jiayi Zhang, Jinlin Wang, Li Zhang, Lingyao Zhang, Min Yang, Mingchen Zhuge, Taicheng Guo, Tuo Zhou, Wei Tao, Robert Tang, Xiangtao Lu, Xiawu Zheng, Xinbing Liang, Yaying Fei, Yuheng Cheng, Yongxin Ni, Zhibin Gou, Zongze Xu, Yuyu Luo, Chenglin Wu
| Challenge: | Large Language Models (LLMs) excel in various domains but face challenges when applied to data science workflows due to their complex, multi-stage nature. |
| Approach: | They propose a hierarchical graph-based agent that represents complexity and a progressive strategy for step-by-step verification, refinement, and consistent context management. |
| Outcome: | The proposed agent surpasses state-of-the-art baselines on the MATH dataset and performs better on InfiAgent-DABench. |
Chain of Ideas: Revolutionizing Research Via Novel Idea Development with LLM Agents (2025.findings-emnlp)
Copied to clipboard
Long Li, Weiwen Xu, Jiayan Guo, Ruochen Zhao, Xingxuan Li, Yuqian Yuan, Boqiang Zhang, Yuming Jiang, Yifei Xin, Ronghao Dang, Yu Rong, Deli Zhao, Tian Feng, Lidong Bing
| Challenge: | Existing methods for idea generation either trivially prompt LLMs or expose LLM to extensive literature without indicating useful information. |
| Approach: | They propose a chain-of-ideas agent that organizes literature in a chains structure . they propose evaluating idea-generation methods from different perspectives . |
| Outcome: | The proposed agent outperforms existing methods and matches human quality in idea generation. |
EventOA: An Event Ontology Alignment Benchmark Based on FrameNet and Wikidata (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on event ontologies focus on entity-based OA, and neglect event-based one . however, independent development of event ontoologies often results in heterogeneous representations that raise the need for establishing alignments between semantically related events. |
| Approach: | They propose a multi-view event ontology alignment method that utilizes description information and neighbor information to obtain richer representations of the event ontoologies. |
| Outcome: | The proposed method outperforms existing entity-based methods and can serve as a strong baseline for future research. |
Bridging Relevance and Reasoning: Rationale Distillation in Retrieval-Augmented Generation (2025.findings-acl)
Copied to clipboard
Pengyue Jia, Derong Xu, Xiaopeng Li, Zhaocheng Du, Xiangyang Li, Yichao Wang, Yuhao Wang, Qidong Liu, Maolin Wang, Huifeng Guo, Ruiming Tang, Xiangyu Zhao
| Challenge: | Existing approaches to rerank and align documents based on reasoning capabilities of large language models (LLMs) . prior work shows that LLMs have exceptional reasoning and text generation capabilities . |
| Approach: | They propose a rationale extraction method that leverages reasoning capabilities of large language models to extract the rationales necessary for answering a query. |
| Outcome: | The proposed method is compared with baseline methods on two tasks across three datasets. |
CofeNet: Context and Former-Label Enhanced Net for Complicated Quotation Extraction (2022.coling-1)
Copied to clipboard
| Challenge: | Existing solutions for quotation extraction use rule-based approaches and sequence labeling models. |
| Approach: | They propose a Context and Former-Label Enhanced Net for quotation extraction. |
| Outcome: | The proposed method achieves state-of-the-art performance on complicated quotation extraction on two public datasets and one proprietary dataset. |
TeamLoRA: Boosting Low-Rank Adaptation with Expert Collaboration and Competition (2025.acl-long)
Copied to clipboard
Tianwei Lin, Jiang Liu, Wenqiao Zhang, Yang Dai, Haoyuan Li, Zhelun Yu, Wanggui He, Juncheng Li, Jiannan Guo, Hao Jiang, Siliang Tang, Yueting Zhuang
| Challenge: | Existing methods for fine-tuning are resource-efficient, but performance often falls short . a new approach, TeamLoRA, integrates collaborative and competitive modules to improve performance. |
| Approach: | They propose to introduce task-specific LoRA as domain experts to improve learning efficiency . teamLoRA integrates collaborative and competition modules to improve model learning . |
| Outcome: | Experiments show that TeamLoRA improves performance in multi-task learning . teamLorea integrates collaborative and competitive modules to improve performance . |
AdapShot: Adaptive Many-Shot In-Context Learning with Semantic-Aware KV Cache Reuse (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for In-Context Learning (ICL) rely on a predetermined number of shots, leading to insufficient context or noise. |
| Approach: | They propose a probe-based evaluation mechanism that utilizes output entropy to determine the optimal number of shots and leverages KV cache reuse for efficient inference. |
| Outcome: | The proposed model achieves an average performance gain of 10% and a 4.64 speedup compared to state-of-the-art DBSA. |
Retrieving Multimodal Information for Augmented Generation: A Survey (2023.findings-emnlp)
Copied to clipboard
Ruochen Zhao, Hailin Chen, Weishi Wang, Fangkai Jiao, Xuan Long Do, Chengwei Qin, Bosheng Ding, Xiaobao Guo, Minzhi Li, Xingxuan Li, Shafiq Joty
| Challenge: | Large Language Models (LLMs) are increasingly using multimodality to augment their generation ability, but there is no unified perception of at which stage and how to incorporate different modalities. |
| Approach: | They propose to use multimodality to augment Large Language Models (LLMs) this will provide scholars with a deeper understanding of the methods' applications and encourage them to adapt existing techniques to the fast-growing field of LLMs. |
| Outcome: | The proposed methods improve factuality, reasoning, interpretability, and robustness of the generated content. |
Superpose Task-specific Features for Model Merging (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for model merging are limited by resource demands . recent studies validate the linear representation hypothesis . |
| Approach: | They propose a method that superposes task-specific features from individual models into a merged model. |
| Outcome: | The proposed method outperforms existing methods on multiple benchmarks and models. |
LLMs Trust Humans More, That’s a Problem! Unveiling and Mitigating the Authority Bias in Retrieval-Augmented Generation (2025.acl-long)
Copied to clipboard
Yuxuan Li, Xinwei Guo, Jiashi Gao, Guanhua Chen, Xiangyu Zhao, Jiaxin Zhang, Quanying Liu, Haiyan Wu, Xin Yao, Xuetao Wei
| Challenge: | Large language models (LLMs) generate outputs that stray from user input or contravene established knowledge. |
| Approach: | They propose a new phenomenon, Authority Bias, where LLMs favor one knowledge source over the other . they propose atomic information that generates conflicts and a Conflict Detection Enhanced Query framework . |
| Outcome: | The proposed framework reduces Authority bias in large language models . it detects conflicts, performs credibility assessment on conflicting paragraphs, and detects perturbed text . |
Rethinking Composed Image Retrieval Evaluation: A Fine-Grained Benchmark from Image Editing (2026.acl-long)
Copied to clipboard
Tingyu Song, Yanzhao Zhang, Mingxin Li, Zhuoning Guo, Dingkun Long, Pengjun Xie, Siyue Zhang, Yilun Zhao, Shu Wu
| Challenge: | Composed Image Retrieval (CIR) is a complex task in multimodal understanding . current CIR benchmarks lack a robust evaluation pipeline and limited query categories . |
| Approach: | They construct a fine-grained CIR benchmark that allows for precise control over modification types and content. |
| Outcome: | The proposed benchmark covers 5,000 high-quality queries structured across five main categories and fifteen subcategories. |
Distantly-Supervised Joint Extraction with Noise-Robust Learning (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to identifying entity pairs and relations with a single model are noisy . Existing methods only consider one source of noise or make decisions using external knowledge . |
| Approach: | They propose a framework that aligns entity mentions with corresponding tags for joint extraction . they propose DENRL, which employs a lightweight transformer backbone for joint tagging . |
| Outcome: | The proposed framework outperforms baseline models on two benchmark datasets with better interpretability. |
MatRank: Text Re-ranking by Latent Preference Matrix (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for text ranking have improved performance, but there are still challenges. |
| Approach: | They propose a method that learns to re-rank the text retrieved for a given query by learning to predict the most relevant passage based on a latent preference matrix. |
| Outcome: | The proposed method outperforms all prior methods on datasets with extensive results. |
LLMTreeRec: Unleashing the Power of Large Language Models for Cold-Start Recommendations (2025.coling-main)
Copied to clipboard
Wenlin Zhang, Chuhan Wu, Xiangyang Li, Yuhao Wang, Kuicai Dong, Yichao Wang, Xinyi Dai, Xiangyu Zhao, Huifeng Guo, Ruiming Tang
| Challenge: | Lack of training data leads to the system cold-start problem in recommendation systems, making them struggle to provide effective recommendations. |
| Approach: | They propose a tree-based LLM recommendation framework which structures all items into an item tree to improve the efficiency of LLM’s item retrieval. |
| Outcome: | The proposed framework outperforms the baseline model in the A/B test on Huawei industrial system. |
When Inverse Data Outperforms: Exploring the Pitfalls of Mixed Data in Multi-Stage Fine-Tuning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for o1-level performance focus on unidirectional supervised fine-tuning (SFT), overlooking the intricate interplay between diverse reasoning patterns. |
| Approach: | They construct a reverse reasoning dataset and examine how it is supervised . they find that naively mixing forward and reverse data during SFT weakens the directional distinction . |
| Outcome: | The proposed model improves accuracy by 1.6%–6.8% over a standard model. |
RealChart2Code: Bridging the Gap in Real-World Chart-to-Code Generation via Multi-Task Evaluation (2026.acl-long)
Copied to clipboard
Jiajun Zhang, Yuying Li, Zhixun Li, Xingyu Guo, Jingzhuo Wu, Leqi Zheng, Yiran Yang, Jianke Zhang, Qingbin Li, Shannan Yan, Changguo Jia, Junfei Wu, Zilei Wang, Qiang Liu, Liang Wang
| Challenge: | Vision-Language Models (VLMs) have demonstrated impressive capabilities in code generation across various domains, but their ability to replicate complex, multi-panel visualizations remains largely unassessed. |
| Approach: | They propose a large-scale benchmark to evaluate chart generation from large- scale raw data and assess iterative code refinement in a multi-turn conversational setting. |
| Outcome: | The new benchmark evaluates 14 leading VLMs on real-world data and shows they struggle with complex plot structures and authentic data. |
Multi-Modal Knowledge Graph Transformer Framework for Multi-Modal Entity Alignment (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Multi-modal entity alignment (MMEA) is a critical task that aims to identify equivalent entity pairs across multi-modal knowledge graphs (MMKGs). |
| Approach: | They propose a novel MMEA transformer that hierarchically introduces neighbor features, multi-modal attributes, and entity types to enhance alignment task. |
| Outcome: | The proposed transformer hierarchically introduces neighbor features, multi-modal attributes, and entity types to enhance the alignment task. |
Multi-Attribute Controlled Text Generation with Contrastive-Generator and External-Discriminator (2022.coling-1)
Copied to clipboard
| Challenge: | Existing studies on controlled text generation focus on single-attribute control, but in practical applications, they lack controllability. |
| Approach: | They propose a framework for multi-attribute controlled text generation that can effectively generate texts with more attributes. |
| Outcome: | The proposed framework achieves remarkable controllability while keeping the text fluent and diverse. |
BTC-LLM: Efficient Sub-1-Bit LLM Quantization via Learnable Transformation and Binary Codebook (2026.acl-long)
Copied to clipboard
Hao Gu, Lujun Li, Hao Wang, Lei Wang, Zheyu Wang, Bei Liu, Jiacheng Liu, Qiyuan Zhu, Sirui Han, Yike Guo
| Challenge: | Recent sparsity-aware binarization approaches can achieve sub-1-bit compression, but they face performance degradation, mask-management overhead, and limited hardware compatibility. |
| Approach: | They propose a binary quantization framework that leverages binary pattern clustering and weight transformation to overcome performance degradation and mask-management overhead. |
| Outcome: | The proposed framework achieves state-of-the-art compression (1.11–0.7 bits) it maintains high performance with only a 3.1% accuracy drop in zero-shot benchmarks while delivering a 1.6 speedup over FP16. |
Context-aware Watermark with Semantic Balanced Green-red Lists for Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent research suggests that watermarking methods cause degradation of text quality due to semantic disparities between the watermarked text and the unwatermarked text. |
| Approach: | They propose a semantic-aware watermark method that generates a watermark key considering contexts to split a green/red list for watermark injection. |
| Outcome: | The proposed method reduces performance drop due to adding bias on green lists . it also allows green lists to cover almost all semantics . |
A Parameter-Efficient and Fine-Grained Prompt Learning for Vision-Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Current vision-language models extract semantic information from large-scale cross-modal associations, limiting performance and efficiency. |
| Approach: | They propose a detail-oriented prompt learning method to implement fine-grained multi-modal semantic alignment with merely 0.25M trainable parameters. |
| Outcome: | The proposed method implements fine-grained multi-modal semantic alignment with merely 0.25M trainable parameters. |
Locomo-Plus: Beyond-Factual Cognitive Memory Evaluation Framework for LLM Agents (2026.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks and evaluation protocols focus on surface-level factual recall. |
| Approach: | They propose a benchmark for assessing cognitive memory under cue–trigger semantic disconnect. |
| Outcome: | The proposed framework reveals failures not captured by existing benchmarks. |
Clear Up Confusion: Advancing Cross-Domain Few-Shot Relation Extraction through Relation-Aware Prompt Learning (2024.naacl-short)
Copied to clipboard
Ge Bai, Chenji Lu, Daichi Guo, Shilong Li, Ying Liu, Zhang Zhang, Guanting Dong, Ruifang Liu, Sun Yong
| Challenge: | Existing approaches to few-shot Relation Extraction (RE) are prone to confusion when applying knowledge to a target domain with entirely new types of relations. |
| Approach: | They propose a relation-aware prompt learning method with pre-training to clear confusion by decomposing relation types through an innovative label prompt. |
| Outcome: | The proposed method outperforms previous sota methods and yields better results on cross-domain few-shot RE tasks. |
QiMeng-PRepair: Precise Code Repair via Edit-Aware Reward Optimization (2026.acl-long)
Copied to clipboard
Changxin Ke, Rui Zhang, Jiaming Guo, Yuanbo Wen, Li Ding, Shuo Wang, Xuyuan Zhu, Xiong Peng, Di Huang, Zidong Du, Xing Hu, Qi Guo, Yunji Chen
| Challenge: | Existing approaches to program repair are based on correctness alone. |
| Approach: | They propose a framework that mitigates over-editing and improves repair accuracy by generating buggy programs and re-edits. |
| Outcome: | The proposed framework improves repair precision by 31.4% under fix1@1, a metric that considers repair correctness and extent, and significantly increases decoding throughput when combined with speculative editing. |
Sentiment-Aware Word and Sentence Level Pre-training for Sentiment Analysis (2022.emnlp-main)
Copied to clipboard
Shuai Fan, Chen Lin, Haonan Li, Zhenghao Lin, Jinsong Su, Hang Zhang, Yeyun Gong, JIan Guo, Nan Duan
| Challenge: | Existing pre-trained language representation models (PLMs) capture sentiment information from word-level while under-considering sentence-level information. |
| Approach: | They propose a Sentiment-aware pre-trained language model with combined Word-level and Sentence-level Pre-training tasks that enhance the PLM’s knowledge about sentiment words. |
| Outcome: | The proposed model achieves state-of-the-art on various sentence-level and aspect-level sentiment classification benchmarks. |
Exons-Detect: Identifying and Amplifying Exonic Tokens via Hidden-State Discrepancy for Robust AI-Generated Text Detection (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for AI-generated text detection assume uniform token contributions, making them less robust under short sequences or localized token modifications. |
| Approach: | They propose a training-free method for AI-generated text detection based on an exon-aware token reweighting perspective. |
| Outcome: | The proposed method achieves state-of-the-art detection performance and robustness to adversarial attacks and varying input lengths. |
ASTRA: Adaptive Semantic Tree Reasoning Architecture for Complex Table Question Answering (2026.acl-long)
Copied to clipboard
| Challenge: | Existing serialization methods fail to capture explicit hierarchies and lack schema flexibility . Existing tree-based approaches suffer from limited semantic adaptability . |
| Approach: | They propose a method that leverages the global semantic awareness of LLMs to reconstruct tables into Logical Semantic Trees. |
| Outcome: | The proposed method achieves state-of-the-art (SOTA) performance on complex table benchmarks. |
Learning to Selectively Learn for Weakly-supervised Paraphrase Generation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to generate paraphrases with weak supervision are limited in real-world scenarios due to the lack of coherent and controllable generated paraphrase. |
| Approach: | They propose a method to generate high-quality paraphrases with weak supervision . they obtain abundant weakly-labeled parallel sentences via retrieval-based pseudo paraphrase expansion . |
| Outcome: | The proposed approach achieves significant improvements over existing methods and is even comparable in performance with supervised state-of-the-arts. |
LLM-Based Human-Agent Collaboration and Interaction Systems: A Survey (2026.findings-acl)
Copied to clipboard
Henry Peng Zou, Wei-Chieh Huang, Yaozu Wu, Jizhou Guo, Yankai Chen, Chunyu Miao, Hoang H Nguyen, Yue Zhou, Weizhi Zhang, Liancheng Fang, Hanrong Zhang, Fangxin Wang, Pengfei Zhang, Langzhou He, Yangning Li, Dongyuan Li, Renhe Jiang, Philip S. Yu
| Challenge: | Recent advances in large language models (LLMs) have sparked growing interest in building fully autonomous agents. |
| Approach: | They propose to integrate human-provided information, feedback, or control into the agent system to enhance system performance, reliability, and safety. |
| Outcome: | The proposed systems improve system performance, reliability, and safety by integrating human-provided information, feedback, or control into the agent system. |
Exploring Reversal Mathematical Reasoning Ability for Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have been a success in the wide range of natural language understanding and reasoning tasks. |
| Approach: | They propose a training method to improve general and reversal reasoning abilities by using a reversed dataset. |
| Outcome: | The proposed method improves general and reversal reasoning abilities and alleviates the reverse curse. |
HomoGraphAdapter: A Homogeneous Graph Neural Network as an Effective Adapter for Vision-Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing adaptation methods overlook structural knowledge between text and image modalities or create overly complex graphs containing redundant information for alignment. |
| Approach: | They propose a method to adapt visual models to downstream tasks using text and image modalities. |
| Outcome: | The proposed method improves classification accuracy by 1.51% for 1-shot and 0.74% for 16-shot on 11 datasets. |
REPT: Bridging Language Models and Machine Reading Comprehension via Retrieval-Based Pre-training (2021.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained language models have achieved great success on Machine Reading Comprehension (MRC) however, the poor support in evidence extraction hinders them from further advancing MRC. |
| Approach: | They propose a REtrieval-based pre-training approach that strengthens evidence extraction during pre-training by inherited downstream MRC tasks. |
| Outcome: | The proposed approach strengthens evidence extraction during pre-training, which is further inherited by downstream tasks. |
ToM: Leveraging Tree-oriented MapReduce for Long-Context Reasoning in Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Experimental results show ToM outperforms existing divide-and-conquer frameworks . RAG relies on similarity-based rankings to retrieve and reason over chunks based on logical coherence . |
| Approach: | They propose a Tree-oriented MapReduce framework for long-context reasoning . it leverages the hierarchical structure of long documents by constructing a DocTree . |
| Outcome: | Experimental results show that ToM outperforms existing divide-and-conquer frameworks and RAGs . the proposed framework improves logical coherence and long-context reasoning on 70B+ LLMs compared to existing approaches . |
Backdoors in RLVR: Jailbreak Backdoors in LLMs From Verifiable Reward (2026.acl-long)
Copied to clipboard
| Challenge: | Reinforcement Learning with Verifiable Rewards (RLVR) is an emerging paradigm that significantly boosts a Large Language Model’s reasoning abilities on complex logical tasks. |
| Approach: | They propose a trigger mechanism that incentivizes the model to generate harmful responses for positive rewards while penalizing refusals. |
| Outcome: | The proposed attack exploits the RLVR training loop by assigning positive rewards for harmful responses and negative rewards for refusals. |
IEvoAgent: Evolving Conversational Agent based on User Implicit Feedback (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to optimize conversational agents often rely on explicit preference pairs and expert evaluations. |
| Approach: | They propose a conversational agent framework that leverages the structured dependency between agent responses and user reactions to extract implicit feedback. |
| Outcome: | The proposed framework improves on MT-Bench-101, WildBench, and FB-Bech, and shows that mining implicit feedback supports better multi-turn alignment under evolving user preferences. |
DualGuard: Dual-stream Large Language Model Watermarking Defense against Paraphrase and Spoofing Attack (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing watermarking algorithms focus on defending against paraphrase and piggyback spoofing attacks, which can inject harmful content, compromise reliability, and undermine trust in attribution. |
| Approach: | They propose an algorithm capable of defending against paraphrase and spoofing attacks. |
| Outcome: | Experiments on large language models and language models show that DualGuard is the first watermarking algorithm capable of defending against both paraphrase and spoofing attacks. |
PRIM: Towards Practical In-Image Multilingual Machine Translation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Current research on in-image machine translation focuses on synthetic data with simple background, single font, fixed text position, and bilingual translation. |
| Approach: | They propose an end-to-end model to handle the challenge of practical conditions in PRIM . they annotate a real-world one-line text image with complex background, fonts, diverse text positions . |
| Outcome: | The proposed model improves translation quality and visual effect compared to other models. |
Turn Waste into Worth: Rectifying Top-k Router of MoE (2024.emnlp-main)
Copied to clipboard
Zhiyuan Zeng, Qipeng Guo, Zhaoye Fei, Zhangyue Yin, Yunhua Zhou, Linyang Li, Tianxiang Sun, Hang Yan, Dahua Lin, Xipeng Qiu
| Challenge: | Top-k router suffers from redundancy computation and memory costs due to unbalanced routing . some experts are overflow, where exceeding tokens are dropped, while others are empty, which are padded with zeros, negatively impacting model performance. |
| Approach: | They propose a top-k router that is unbalanced and uses a multi-gPU system to handle dropped tokens and padding. |
| Outcome: | The proposed model surpasses the top-1 router by 4.7% in terms of performance . the top-k router suffers from redundancy computation and memory costs . |
Teaching Large Language Models to Translate on Low-resource Languages with Textbook Prompting (2024.lrec-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated impressive results in Machine Translation by following instructions, even without training on parallel data. |
| Approach: | They propose a Translate After LEarNing Textbook approach which aims to enhance LLMs’ ability to translate low-resource languages by learning from a textbook. |
| Outcome: | The proposed approach improves translation performance by 14.8% using 112 low-resource languages from FLORES-200 with two LLMs: ChatGPT and BLOOMZ. |
UnitCoder: Scalable Code Synthesis from Pre-training Corpora (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) excel at code understanding and generation, yet code generation remains a challenge. |
| Approach: | They propose a model that supervises pre-training data quality through automatically generated unit tests while ensuring correctness via an iterative fix and refine flow. |
| Outcome: | The proposed model improves performance on a large dataset with high quality pre-training data. |
Rethinking LLM Watermark Detection in Black-Box Settings: A Non-Intrusive Third-Party Framework (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing secret-key schemes tightly couple detection with injection . this dependency creates a fundamental barrier for real-world governance . |
| Approach: | et al. introduce a black-box framework for non-intrusive, third-party watermark verification . they propose a proxy model to amplify watermark-relevant signals and complementary relative measurements . |
| Outcome: | a new framework decouples detection from injection and assesses alignment of query text with watermark distributions. |
Divide, Conquer, and Combine: Mixture of Semantic-Independent Experts for Zero-Shot Dialogue State Tracking (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods to enhance the zeroshot generalization of DST fail to effectively decouple semantics of samples, limiting the zero-shot performance of the system. |
| Approach: | They propose a new learning schema that explicitly disentangles the semantics of seen data and leverages the performance and robustness with the mixture-of-experts mechanism. |
| Outcome: | The proposed model achieves state-of-the-art on multiWOZ2.1 with 10M trainable parameters and is robust to the mixture-of experts mechanism. |
DocMEdit: Towards Document-Level Model Editing (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing models only output short phrases or sentences, raising doubts about their practical usability. |
| Approach: | They propose a dataset focused on document-level model editing that aims to correct errors and outdated knowledge in Large language models (LLMs) they propose to use document-based model editing to improve model capabilities in real-world scenarios. |
| Outcome: | The proposed model editing task improves model capabilities in real-world scenarios and reduces the cost of retraining. |
A Novel Matching Paradigm: Unified Generative and Discriminative LLM with Prompt Compression for Relevance Learning (2026.acl-industry)
Copied to clipboard
Guoliang Zhao, Zixin Cui, Chao Ye, Dengwu He, Fei Huang, Yubo Liu, Shuanglong Li, Tzungren Kuo, Bin Ding, Shuang Zhang, null KunhongZhu, Zhi Guo, Liu Lin
| Challenge: | Existing approaches to matching use Large Language Models as feature extractors, underutilizing their full modeling capabilities. |
| Approach: | They propose a matching paradigm that integrates two-tower, single-towing, and generative tasks within a unified LLM framework via attention-mask partitioning. |
| Outcome: | The proposed model achieves superior performance and strong practical value in an industrial search engine. |
PCQPR: Proactive Conversational Question Planning with Reflection (2024.emnlp-main)
Copied to clipboard
| Challenge: | Current CQG methods focus on immediate context without strategic consideration of the specified conversational outcome. |
| Approach: | They propose a method that uses a planning algorithm inspired by Monte Carlo Tree Search to generate contextually relevant questions. |
| Outcome: | The proposed approach surpasses existing methods in e-learning and customer service fields . it generates contextually appropriate questions strategically devised to reach a specified outcome . |
From What to Why: Improving Relation Extraction with Rationale Graph (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing neural relation extraction models are limited by entity type and textual context. |
| Approach: | They propose a novel RAtionale Graph to organize co-occurrence constraints among entity types, triggers and relations in a holistic graph view. |
| Outcome: | The proposed method outperforms baselines significantly and achieves state-of-the-art performance on document-level and sentence-level RE benchmarks. |
TabularMath: Understanding Math Reasoning over Tables with Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Mathematical reasoning has long been a key benchmark for evaluating large language models. |
| Approach: | They propose a framework that transforms math word problems into scalable tabular reasoning tasks. |
| Outcome: | The proposed framework transforms math word problems into scalable and verified tabular reasoning tasks. |
HomeBench: Evaluating LLMs in Smart Homes with Valid and Invalid Instructions Across Single and Multiple Devices (2025.acl-long)
Copied to clipboard
| Challenge: | Existing state-of-the-art LLMs cannot perform well in situations where instructions are invalid or multiple devices are involved. |
| Approach: | They propose to integrate large language models into smart home assistants by enhancing their ability to accurately understand user needs and respond appropriately. |
| Outcome: | The proposed dataset is the first with valid and invalid instructions across devices . it achieves only 0.0% success rate in the scenario of invalid multi-device instructions . |
RACQC: Advanced Retrieval-Augmented Generation for Chinese Query Correction (2025.findings-emnlp)
Copied to clipboard
Jinbo Su, Lingzhe Gao, Wei Li, Shihao Liu, Haojie Lei, Xinyi Wang, Yuanzhao Guo, Ke Wang, Daiting Shi, Dawei Yin
| Challenge: | Large language models (LLMs) exhibit remarkable capabilities across many tasks, but face critical challenges in the CSC scenario: (1) poor generalization to rare entities in open-domain searches; and (2) failure to adapt to temporal entity variations due to static parameters, resulting in serious over-correction issues. |
| Approach: | They propose a Chinese Spelling Check system with RAG and multi-task learning that integrates dynamic knowledge retrieval and entity-centric RAG to address rare entities. |
| Outcome: | The proposed system outperforms existing baselines in the CSC task and achieves a maximum improvement of +9.92% on the search scenario benchmark and +3.2% on the general-domain dataset. |
Packing Analysis: Packing Is More Appropriate for Large Models or Datasets in Supervised Fine-tuning (2025.findings-acl)
Copied to clipboard
| Challenge: | Packing is an optimization technique that optimizes training time and resources by combining different training sequences to fit the model’s maximum input length. |
| Approach: | They perform extensive comparisons between packing and padding methods, covering datasets ranging from 69K to 1.2M and models from 8B to 70B. |
| Outcome: | The proposed method has been shown to improve training efficiency while maintaining performance. |
HiSMatch: Historical Structure Matching based Temporal Knowledge Graph Reasoning (2022.findings-emnlp)
Copied to clipboard
Zixuan Li, Zhongni Hou, Saiping Guan, Xiaolong Jin, Weihua Peng, Long Bai, Yajuan Lyu, Wei Li, Jiafeng Guo, Xueqi Cheng
| Challenge: | Temporal Knowledge Graphs (TKGs) store facts as triples in the form of subject, relation, object, timestamps. |
| Approach: | They propose a Temporal Knowledge Graph (TKG) model that extends each triple with a timestamp to describe dynamic facts. |
| Outcome: | The proposed model improves on six benchmark datasets with up to 5.6% performance improvement compared to the state-of-the-art models. |
Tailoring Table Retrieval from a Field-aware Hybrid Matching Perspective (2025.emnlp-main)
Copied to clipboard
| Challenge: | Empirical results show that a hybrid retrieval approach to table retrieval outperforms state-of-the-art benchmarks. |
| Approach: | They propose a table-tailored HYbrid matching rEtriever which addresses table matching needs from a field-aware hybrid perspective. |
| Outcome: | Empirical results show that the proposed rEtriever outperforms state-of-the-art retrieval methods. |
Mitigating Language Bias of LMMs in Social Intelligence Understanding with Virtual Counterfactual Calibration (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing work on social intelligence using large multimodal models is under-explored due to the prevalence of text-based data in the pretraining stage. |
| Approach: | They propose a structure causal model to mitigate the negative language biases of large multimodal models by preserving beneficial priors. |
| Outcome: | The proposed model minimizes negative language bias while preserving beneficial priors while avoiding spurious correlations between LMMs' internal commonsense knowledge and the given context. |
Diversifying Question Generation over Knowledge Base via External Natural Questions (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods on knowledge base question generation focus on refining the quality of a single generated question. |
| Approach: | They propose a new diversity evaluation metric which measures the diversity among top-k generated questions for each instance while ensuring their relevance to the ground truth. |
| Outcome: | The proposed model outperforms pre-trained language model baselines and text-davinci-003 in diversity while achieving comparable performance with ChatGPT. |
Efficient Domain Adaptation for Non-Autoregressive Machine Translation (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing non-parametric approaches like nearest neighbor machine translation have made small Autoregressive translation models less efficient . despite their impressive generalization and task performance, LLMs suffer from prohibitive inference cost when confronted with specific domains. |
| Approach: | They propose a domain adaptation approach that tailors a k-nearest-neighbor algorithm for NAT models that incorporates the parallel nature of NAT. |
| Outcome: | The proposed approach achieves significant improvements over the Base-NAT model and exhibits enhanced efficiency. |
From Implicit Graph Encoding to Explicit Evidence: A Training-Free LLM Framework for Temporal Knowledge Graph Reasoning (2026.findings-acl)
Copied to clipboard
Guo Tang, Ke Cheng, Huiming Fan, Heng Chang, Wenxiang Zheng, Xianhao Ou, Junjia Xiang, Ming Liu, Yujun Zhou, Li Lanyu, Bing Qin
| Challenge: | Existing Large Language Models (LLMs) struggle with implicit modality alignment and suboptimal graph linearization. |
| Approach: | They propose a training-free, test-time adaptive framework that reframes TKG prediction as explicit evidence-driven reasoning. |
| Outcome: | ExE-LLM outperforms fully trained graph neural networks on four benchmarks . it achieves SOTA performance in inductive settings, significantly outperforming fully trained neural networks . |
What’s Missing in Screen-to-Action? Towards a UI-in-the-Loop Paradigm for Multimodal GUI Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing GUI reasoning methods rely on direct screen-based decision-making, which lacks interpretability and overlooks a comprehensive understanding of UI elements, ultimately leading to task failure. |
| Approach: | They propose a GUI reasoning paradigm that treats the GUI reasoning task as a cyclic ***Screen-UI elements-Action** process. |
| Outcome: | The proposed paradigm achieves state-of-the-art UI understanding performance while yielding superior results in GUI reasoning tasks. |
Guide the Many-to-One Assignment: Open Information Extraction via IoU-aware Optimal Transport (2023.acl-long)
Copied to clipboard
Kaiwen Wei, Yiran Yang, Li Jin, Xian Sun, Zequn Zhang, Jingyuan Zhang, Xiao Li, Linhao Zhang, Jintao Liu, Guo Zhi
| Challenge: | Open Information Extraction (OIE) aims to extract structured information from text without the limitations of close ontology. |
| Approach: | They propose a method to assign ground truth labels to parallelly generated tuple proposals . they leverage intersection-over-union (IoU) as assignment quality measurement . |
| Outcome: | The proposed method outperforms the state-of-the-art models on three benchmarks. |
TencentPretrain: A Scalable and Flexible Toolkit for Pre-training Models of Different Modalities (2023.acl-demo)
Copied to clipboard
Zhe Zhao, Yudong Li, Cheng Hou, Jing Zhao, Rong Tian, Weijie Liu, Yiren Chen, Ningyuan Sun, Haoyan Liu, Weiquan Mao, Han Guo, Weigang Gou, Taiqiang Wu, Tao Zhu, Wenhang Shi, Chen Chen, Shan Huang, Sihong Chen, Liqun Liu, Feifei Li, Xiaoshuai Chen, Xingwu Sun, Zhanhui Kang, Xiaoyong Du, Linlin Shen, Kimmo Yan
| Challenge: | Several pre-training models of different modalities are showing a rising trend of homogeneity in their model structures. |
| Approach: | They propose a toolkit that supports pre-training models of different modalities. |
| Outcome: | The proposed toolkit can match the performance of the original implementations on text, vision, and audio benchmarks. |
Contrastive Learning enhanced Author-Style Headline Generation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Current work only uses the article itself in the headline generation, but have not taken the writing style of headlines into account. |
| Approach: | They propose a model which takes historical headlines into account to integrate the stylistic features of the author into the model and integrate them into the decoder. |
| Outcome: | The proposed model can integrate the stylistic features of the author into the model and generate a headline that is appropriate for the article and consistent with the author’s style. |
Mind Reader: Latent User Demand-Guided Content Optimization for Generative Search Engine (2026.acl-long)
Copied to clipboard
Tong Chen, JiaWei Guo, Yuxi Li, Baiming Chen, Houxing Ren, Zhang Zhiwei, Yunxiang Zhang, Hanyang Xia, Kun Liang, Zhaoran Fan
| Challenge: | Generative Search Engines (GSEs) have reshaped information retrieval and Generating Engine Optimization (GEO) emerges to improve the content visibility in GSEs’ responses. |
| Approach: | They propose a method to optimize content to cover latent semantic information of GSEs by decomposing query into diverse perspectives and capturing underlying semantic information. |
| Outcome: | The proposed method outperforms baselines and effectively improves content visibility (with up to 2.44x objective metrics and 1.23x subjective metrics on average). |
SGSH: Stimulate Large Language Models with Skeleton Heuristics for Knowledge Base Question Generation (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods have significantly boosted the performance of Knowledge Base Question Generation (KBQG) through pre-trained language models thanks to the richly endowed semantic knowledge. |
| Approach: | They propose a framework to Stimulate GPT-3.5 with Skeleton Heuristics to enhance KBQG by combining skeleton heuristic guidance with a soft prompting approach. |
| Outcome: | The proposed framework incorporates "skeleton heuristics" which provides more fine-grained guidance associated with each input to stimulate LLMs to generate optimal questions. |
TreeReview: A Dynamic Tree of Questions Framework for Deep and Efficient LLM-based Scientific Peer Review (2025.emnlp-main)
Copied to clipboard
Yuan Chang, Ziyue Li, Hengyuan Zhang, Yuanbo Kong, Yanru Wu, Hayden Kwok-Hay So, Zhijiang Guo, Liya Zhu, Ngai Wong
| Challenge: | Large Language Models (LLMs) have shown significant potential in assisting peer review, but current methods struggle to generate thorough and insightful reviews while maintaining efficiency. |
| Approach: | They propose a framework that models paper review as a hierarchical and bidirectional question-answering process. |
| Outcome: | The proposed framework outperforms baselines on full review generation and actionable feedback comments generation tasks while reducing LLM token usage by up to 80% compared to computationally intensive approaches. |
RSA-Bench: Benchmarking Audio Large Models in Real-World Acoustic Scenarios (2026.findings-acl)
Copied to clipboard
Yibo Zhang, Kaiwen Luo, Liang Lin, Shilinlu Yan, Jin Wang, Yaoqi Guo, Yitian Chen, Yalan Qin, Zhenhong Zhou, Kun Wang, Li Sun
| Challenge: | Existing evaluations rely on synthetic Gaussian noise or simplistic single-source interference, failing to capture the intricate, multi-layered acoustic dynamics that characterize authentic physical environments. |
| Approach: | They propose a robustness benchmark to stress-test Audio Large Models (ALLMs) using high-fidelity auditory scene simulations. |
| Outcome: | The proposed model performs well on a wide range of tasks, including automatic speech recognition, speech translation, and audio-based reasoning. |
DSM: Question Generation over Knowledge Base via Modeling Diverse Subgraphs with Meta-learner (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods on knowledge base question generation learn a one-size-fits-all model by training together all subgraphs without distinguishing the diverse semantics of subgraph. |
| Approach: | They propose a graph contrastive learning-based retriever to model diverse subgraphs with meta-learner to learn semantics-specific and semantics agnostic knowledge on and across these tasks. |
| Outcome: | The proposed approach reduces learning difficulty and improves performance on two widely-adopted benchmarks on KBQG. |
FreeTransfer-X: Safe and Label-Free Cross-Lingual Transfer from Off-the-Shelf Models (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing work on cross-lingual transfer has not studied how to leverage knowledge of rich-resource languages without labels. |
| Approach: | They propose a 2-step knowledge distillation framework to achieve knowledge transfer from off-the-shelf models in rich-resource languages. |
| Outcome: | The proposed method reduces annotation cost and protects private labels. |
DGPO: Beyond Pairwise Preferences with Directional Consistent Groupwise Optimization (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for directional consistency alignment of large language models are limited . a recent study suggests reverse supervision as a complement to forward reasoning . |
| Approach: | They propose a framework that aggregates supervision signals at the group level and explicitly models direction-aware alignment through multi-candidate comparisons. |
| Outcome: | The proposed framework achieves 3.2% accuracy improvement across five benchmarks and multiple datasets. |
TTVS: Boosting Self-Exploring Reinforcement Learning via Test-time Variational Synthesis (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing test-time methods are limited in specialized or novel domains where supervision is prohibitively expensive or unavailable. |
| Approach: | They propose a framework that augments training stream from unlabeled test queries. |
| Outcome: | Extensive experiments show TTVS outperforms state-of-the-art RL-based techniques on unlabeled test-time data. |
MUCH: A Multimodal Corpus Construction for Conversational Humor Recognition Based on Chinese Sitcom (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing multimodal corpora for conversational humor are coarse-grained and insufficient to support the conversational comprehension task. |
| Approach: | They constructed a multimodal humor corpus based on a Chinese sitcom and used both unimodal and multimodal methods to test the corpus. |
| Outcome: | The proposed method outperforms unimodal and multimodal methods in the evaluation of a Chinese sitcom for conversational humor recognition. |
Compressing then Matching: An Efficient Pre-training Paradigm for Multimodal Embedding (2026.acl-long)
Copied to clipboard
Da Li, Yuxiao Luo, Keping Bi, Jiafeng Guo, Wei Yuan, Biao Yang, Yan Wang, Fan Yang, Tingting Gao, Guorui Zhou
| Challenge: | Recent approaches demonstrate that MLLMs can be adapted into competitive embedding models via large-scale contrastive learning. |
| Approach: | They propose a compressed pre-training phase which serves as a warm-up stage for contrastive learning. |
| Outcome: | The proposed model achieves state-of-the-art among MLLMs of comparable size on the MMEB, realizing optimization in both efficiency and effectiveness. |
DeSIQ: Towards an Unbiased, Challenging Benchmark for Social Intelligence Understanding (2023.emnlp-main)
Copied to clipboard
| Challenge: | Social intelligence is essential for understanding and reasoning about human expressions, intents and interactions. |
| Approach: | They propose a methodology to study the soundness of Social-IQ by applying simple perturbations to a dataset of multiple choice questions on videos of complex social interactions. |
| Outcome: | The proposed method reduces biases in the original dataset and improves performance. |
PSSAT: A Perturbed Semantic Structure Awareness Transferring Method for Perturbation-Robust Slot Filling (2022.coling-1)
Copied to clipboard
Guanting Dong, Daichi Guo, Liwen Wang, Xuefeng Li, Zechen Wang, Chen Zeng, Keqing He, Jinzheng Zhao, Hao Lei, Xinyue Cui, Yi Huang, Junlan Feng, Weiran Xu
| Challenge: | Existing slot filling models memorize inherent patterns of entities and contexts from training data. |
| Approach: | They propose a perturbed semantic structure awareness transferring method for slot filling models . they use two MLM-based training strategies to learn contextual semantic structure and word distribution . |
| Outcome: | The proposed method outperforms existing methods and gains strong generalization while preventing model from memorizing inherent patterns of entities and contexts. |
VQAGuider: Guiding Multimodal Large Language Models to Answer Complex Video Questions (2025.acl-long)
Copied to clipboard
| Challenge: | Multimodal large language models (MLLMs) can grasp the intention of a question and decomposing it to a series of visual recognition sub-tasks to find out the answer with the help of an agent. |
| Approach: | They propose a framework for multimodal large language models to grasp the intention of a question and decompose it into a series of visual recognition sub-tasks to find out the answer. |
| Outcome: | The proposed framework improves the accuracy of complex video-related questions by 29.6% and 17.2% on CVQA and the existing VQA datasets. |
Towards Robust Universal Information Extraction: Dataset, Evaluation, and Solution (2025.acl-long)
Copied to clipboard
| Challenge: | Existing robust benchmark datasets generate only a limited range of perturbations for a single Information Extraction (UIE) task, which fails to evaluate the robustness of UIE models effectively. |
| Approach: | They propose a new benchmark dataset that utilizes Large Language Models to generate more diverse and realistic perturbations across different IE tasks. |
| Outcome: | The proposed model performs better with only 15% of the data and is more robust with other models. |
KnowCoder: Coding Structured Knowledge into LLMs for Universal Information Extraction (2024.acl-long)
Copied to clipboard
Zixuan Li, Yutao Zeng, Yuxin Zuo, Weicheng Ren, Wenxuan Liu, Miao Su, Yucan Guo, Yantao Liu, Lixiang Lixiang, Zhilei Hu, Long Bai, Wei Li, Yidan Liu, Pan Yang, Xiaolong Jin, Jiafeng Guo, Xueqi Cheng
| Challenge: | None. None.. None! |
| Approach: | None. None.. None! |
| Outcome: | None. None. No. : |
MKT: A Multi-Stage Knowledge Transfer Framework to Mitigate Catastrophic Forgetting in Multi-Domain Chinese Spelling Correction (2025.emnlp-industry)
Copied to clipboard
Peng Xing, Yinghui Li, Shirong Ma, Xinnian Liang, Haojing Huang, Yangning Li, Shu-Yu Guo, Hai-Tao Zheng, Wenhao Jiang, Ying Shen
| Challenge: | Chinese Spelling Correction (CSC) is a model that detects and corrects spelling errors in given sentences. |
| Approach: | They propose a model-agnostic model with an evolving teacher model and dynamic distillation weights for knowledge transfer in each domain rather than focusing solely on new domain knowledge. |
| Outcome: | The proposed model-agnostic framework is based on an evolving teacher model and dynamic distillation weights for knowledge transfer in each domain, rather than focusing solely on new domain knowledge. |
Beyond Task-Level Context: Class-Conditional Context Vectors for Implicit In-Context Learning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches aggregate demonstrations from all classes into a shared, task-level context vector, capturing global task information but without explicitly preserving fine-grained, class-conditional semantic distinctions. |
| Approach: | They propose a class-conditional context vector extension to implicit in-context learning that explicitly models class-specific contextual information by constructing separate context vectors for each class. |
| Outcome: | The proposed extension outperforms task-level context vector baselines and achieves higher average accuracy than conventional few-shot learning on most models. |
TRIGO: Benchmarking Formal Mathematical Proof Reduction for Generative Language Models (2023.emnlp-main)
Copied to clipboard
Jing Xiong, Jianhao Shen, Ye Yuan, Haiming Wang, Yichun Yin, Zhengying Liu, Lin Li, Zhijiang Guo, Qingxing Cao, Yinya Huang, Chuanyang Zheng, Xiaodan Liang, Ming Zhang, Qun Liu
| Challenge: | Automated theorem proving (ATP) benchmarks focus on symbolic inference but rarely involve understanding complex number combination reasoning. |
| Approach: | They propose a benchmark that requires a model to reduce a trigonometric expression with step-by-step proof and evaluates a generative LM’s reasoning ability on formulas and ability to manipulate, group, and factor number terms. |
| Outcome: | The proposed benchmark evaluates a generative LM’s reasoning ability on formulas and ability to manipulate, group, and factor number terms. |
Bit-by-Bit: Progressive QAT Strategy with Outlier Channel Splitting for Stable Low-Bit LLMs (2026.acl-long)
Copied to clipboard
Binxing Xu, Hao Gu, Lujun Li, Hao Wang, Bei Liu, Jiacheng Liu, Qiyuan Zhu, Xintong Yang, Chao Li, Sirui Han, Yike Guo
| Challenge: | Existing approaches to training LLMs at ultra-low precisions suffer from convergence instability and substantial training costs. |
| Approach: | They propose a progressive QAT framework with outlier channel splitting to address these issues . they use nested structure of integer quantization grids to enable a "train once, deploy any precision" paradigm . |
| Outcome: | The proposed framework outperforms baselines on both Llama2/3 and W2A16, with an 11 speedup over BF16. |
Timely Machine: Awareness of Time Makes Test-Time Scaling Agentic (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) tackle complex reasoning tasks, but test-time scaling is becoming expensive. |
| Approach: | They propose to redefine test-time as wall-clock time, where models dynamically adjust strategies based on time budgets. |
| Outcome: | The proposed model improves time budget awareness and boosts performance across Timely-Eval. |
Noise-Robust Fine-Tuning of Pretrained Language Models via External Guidance (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Pretrained Language Models (PLMs) are advanced but data labels are noisy due to the complex annotation process. |
| Approach: | They propose a framework for fine-tuning PLMs using noisy labels that incorporates guidance from Large Language Models like ChatGPT. |
| Outcome: | Experiments on synthetic and real-world noisy datasets show that the proposed framework outperforms the state-of-the-art framework. |
Dual-Gated Fusion with Prefix-Tuning for Multi-Modal Relation Extraction (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for multi-modal relation extraction lack useful visual information. |
| Approach: | They propose a novel multi-modal relation extraction framework to capture deeper correlations of text, entity pair, and image/objects. |
| Outcome: | The proposed framework captures the deeper correlations of text, entity pair, and image/objects, and extracts useful information. |
ToolPRMBench: Evaluating and Advancing Process Reward Models for Tool-using Agents (2026.findings-acl)
Copied to clipboard
| Challenge: | Reward-guided search methods have shown potential in enhancing tool-using agents . however, there is a lack of reliable evaluation benchmarks for PRMs in tool-use settings . |
| Approach: | They propose a large-scale benchmark specifically designed to evaluate PRMs for tool-using agents. |
| Outcome: | The proposed benchmark shows that tool reward models perform better in tool-using environments. |
Support or Refute: Analyzing the Stance of Evidence to Detect Out-of-Context Mis- and Disinformation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Mis- and disinformation online are a major source of harms of different kinds . out-of-context information is where different pieces of information are falsely associated . past studies have attempted to defend against OOC mis- and deinformation through external evidence, but they disregard the role of different pieces with different stances. |
| Approach: | They propose a stance extraction network that can extract stances of different pieces of evidence in a single framework. |
| Outcome: | The proposed model outperforms the state-of-the-art models on a public large-scale dataset with a performance gain of 3.2% in accuracy. |
Exploring the Secrets Behind the Learning Difficulty of Meaning Representations for Semantic Parsing (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies show that the design of Meaning Representation (MR) greatly influences the final model performance of a neural semantic parser. |
| Approach: | They propose a data-aware metric called ISS to measure the final performance of MRs. |
| Outcome: | The proposed metric denoting incremental structural stability (ISS) of MRs can be used as an indicator for MR design to avoid the costly training-testing process. |
Dr. Assistant: Enhancing Clinical Diagnostic Inquiry via Structured Diagnostic Reasoning Data and Reinforcement Learning (2026.findings-acl)
Copied to clipboard
Yue Guo, Fanfu Wang, Jianwei Lv, Xincheng Shi, Yuchen Li, Youya Wang, Yunsheng Zeng, Yujing Liu, Yunhao Qiao, Gen Li, Junfeng Wang, Bo Yuan
| Challenge: | Clinical Decision Support Systems (CDSSs) provide reasoning and inquiry guidance for physicians, yet they face high maintenance costs and low generalization capability. |
| Approach: | They propose a clinical diagnostic model with clinical reasoning and inquiry skills, the Dr. Assistant, and a pipeline to capture abstract reasoning logic. |
| Outcome: | The proposed model outperforms open-source models and achieves competitive performance to closed-source model. |
PEC-Home: Interpretation of Progressively Elliptical Commands in Smart Homes (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing home assistants struggle to interpret elliptical commands based on ellipine expressions . current assistants overlook the progressive omission that occurs in human dialogue as context accumulates - limiting their effectiveness in real-world applications . |
| Approach: | They propose a simulated home dataset specifically designed for interpreting progressively elliptical commands in smart homes. |
| Outcome: | The proposed dataset shows that existing home assistants struggle to execute user-intended operations based solely on elliptical commands. |
M2C: Towards Automatic Multimodal Manga Complement (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Multimodal manga analysis focuses on enhancing manga understanding with visual and textual features. |
| Approach: | They propose a task to enhance manga understanding with visual and textual features by providing a shared semantic space for vision and language understanding. |
| Outcome: | The proposed task provides a shared semantic space for vision and language understanding. |
CLaMP 2: Multimodal Music Information Retrieval Across 101 Languages Using Large Language Models (2025.findings-naacl)
Copied to clipboard
Shangda Wu, Yashan Wang, Ruibin Yuan, Guo Zhancheng, Xu Tan, Ge Zhang, Monan Zhou, Jing Chen, Xuefeng Mu, Yuejie Gao, Yuanliang Dong, Jiafeng Liu, Xiaobing Li, Feng Yu, Maosong Sun
| Challenge: | Current music information retrieval systems struggle to meet linguistic diversity challenges . current systems struggle with text queries in non-English languages . |
| Approach: | They propose a music information retrieval system that supports both ABC notation and MIDI . CLaMP 2 includes a multilingual text encoder and a multiple-modal music encoder . |
| Outcome: | The proposed system achieves state-of-the-art results in multilingual semantic search and music classification across modalities. |
Contextual Rephrase Detection for Reducing Friction in Dialogue Systems (2021.emnlp-main)
Copied to clipboard
| Challenge: | Large-scale conversational AI based dialogue systems like Alexa, Siri, and Google Assistant, are getting more and more prevalent in real-world applications to help users across the globe. |
| Approach: | They propose a contextual rephrase detection model ContReph to automatically identify rephrasings from multi-turn dialogues using contextual information and user-agent interaction signals. |
| Outcome: | The proposed model outperforms the pairwise rephrase detection models by leveraging the context and user-agent interaction signals. |
Rethinking the Roles of Large Language Models in Chinese Grammatical Error Correction (2025.acl-industry)
Copied to clipboard
Yinghui Li, Shang Qin, Jingheng Ye, Haojing Huang, Yangning Li, Shu-Yu Guo, Libo Qin, Xuming Hu, Wenhao Jiang, Hai-Tao Zheng, Philip S. Yu
| Challenge: | Recent studies have shown that Large Language Models’ performance as correctors on Chinese Grammatical Error Correction (CGEC) remains unsatisfactory due to the challenging nature of the task. |
| Approach: | They propose a training framework EXAM that uses LLMs as explainers to enhance CGEC small models and a novel evaluation method SEE that utilizes LLM as evaluators to bring more reasonable evaluations. |
| Outcome: | The proposed methods improve the performance of LLMs on Chinese Grammatical Error Correction (CGEC) task. |
MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale (2025.acl-long)
Copied to clipboard
Jiawei Guo, Tianyu Zheng, Yizhi Li, Yuelin Bai, Bo Li, Yubo Wang, King Zhu, Graham Neubig, Wenhu Chen, Xiang Yue
| Challenge: | Current instruction-tuning datasets focus on simplistic visual question answering tasks, and provide phrase-level answers without any intermediate rationales. |
| Approach: | They propose to use open-source multimodal large language models to train MLLMs on a dataset with 12M instruction-response pairs to elicit CoT reasoning. |
| Outcome: | The proposed model achieves state-of-the-art performance on benchmarks such as MathVerse, MMMU-Pro, and MuirBench, and gains improvements of up to 4% on non-reasoning-based benchmarks. |
Neural Parameter Search for Slimmer Fine-Tuned Models and Better Transfer (2025.acl-long)
Copied to clipboard
Guodong Du, Zitao Fang, Jing Li, Junlin Li, Runhua Jiang, Shuyang Yu, Yifei Guo, Yangneng Chen, Sim Kuan Goh, Ho-Kin Tang, Daojing He, Honghai Liu, Min Zhang
| Challenge: | Foundational models and their checkpoints have advanced deep learning, boosting performance across applications. |
| Approach: | They propose a method for pruning fine-tuned models by calculating differences between them and original model. |
| Outcome: | The proposed method can improve performance across vision, NLP, and multi-modal benchmarks. |
Think How to Think: Mitigating Overthinking with Autonomous Difficulty Cognition in Large Reasoning Models (2026.acl-long)
Copied to clipboard
| Challenge: | Recent Large Reasoning Models (LRMs) excel at complex reasoning tasks but often suffer from overthinking. |
| Approach: | They propose a two-stage fine-tuning strategy that progressively inspires LRMs’ difficulty cognition and redundancy cognition of LRM. |
| Outcome: | The proposed model significantly reduces inference costs by over 70% on easy tasks and 40% on complex ones without compromising performance. |
Improving the Sample Efficiency of Prompt Tuning with Domain Adaptation (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Prompt tuning is a technique for adapting large-scale pretrained language models for downstream tasks. |
| Approach: | They propose to condition a frozen pretrained language model with soft prompts from data . they propose to use a domain adaptation technique to regularize the decision boundary . |
| Outcome: | The proposed method outperforms full-model tuning in data-scarce settings by a large margin. |
Reasoning in Flux: Enhancing Large Language Models Reasoning through Uncertainty-aware Adaptive Guidance (2024.acl-long)
Copied to clipboard
Zhangyue Yin, Qiushi Sun, Qipeng Guo, Zhiyuan Zeng, Xiaonan Li, Junqi Dai, Qinyuan Cheng, Xuanjing Huang, Xipeng Qiu
| Challenge: | Extensive experiments across various reasoning tasks demonstrate that UAG not only enhances the reasoning abilities of LLMs but consistently outperforms several strong baselines with minimal computational overhead. |
| Approach: | They propose an approach to guide LLMs onto an accurate and reliable trajectory by identifying and adjusting uncertainty signals within each step of the reasoning chain. |
| Outcome: | The proposed approach outperforms strong baselines and outperformed strong models with minimal computational overhead. |
KnowCoder-X: Boosting Multilingual Information Extraction via Code (2025.findings-acl)
Copied to clipboard
Yuxin Zuo, Wenxuan Jiang, Wenxuan Liu, Zixuan Li, Long Bai, Hanbin Wang, Yutao Zeng, Xiaolong Jin, Jiafeng Guo, Xueqi Cheng
| Challenge: | Empirical evidence indicates that Large Language Models exhibit spontaneous cross-lingual alignment in Information Extraction (IE) however, a significant imbalance across languages persists, highlighting an underlying deficiency. |
| Approach: | They propose a code LLM with advanced cross-lingual and multilingual capabilities for universal IE that standardizes the representation of multilingual schemas using Python classes and conducts IE alignment instruction tuning on translated instance prediction task. |
| Outcome: | The proposed model surpasses ChatGPT and SoTA by 30.17% without training in 29 unseen languages and significantly improves cross-lingual IE transferability. |
SafeMT: Multi-turn Safety for Multimodal Language Models (2026.acl-long)
Copied to clipboard
Han Zhu, Juntao Dai, Jiaming Ji, Haoran Li, Chengkun Cai, Pengcheng Wen, Chi-Min Chan, Boyuan Chen, Yaodong Yang, Sirui Han, Yike Guo
| Challenge: | Multi-turn dialogues pose a greater risk than single prompts, but existing safety benchmarks do not account for this situation. |
| Approach: | They propose a benchmark that features dialogues of varying lengths generated from harmful queries accompanied by images. |
| Outcome: | The proposed model reduces multi-turn Attack Success Rate (ASR) compared to existing guard models. |
DependEval: Benchmarking LLMs for Repository Dependency Understanding (2025.findings-acl)
Copied to clipboard
| Challenge: | a benchmark is designed to evaluate the repository-level dependency understanding of large language models (LLMs) based on 2683 repositories from real-world websites. |
| Approach: | They propose a benchmark to evaluate repository dependency understanding for large language models . DEPENDEVAL evaluates models on three core tasks across 8 programming languages . |
| Outcome: | The benchmark evaluates models on three core tasks across 8 programming languages from real-world repositories. |
Prompt-Guided Retrieval Augmentation for Non-Knowledge-Intensive Tasks (2023.findings-acl)
Copied to clipboard
| Challenge: | Recent studies focus on retrieval to solve knowledge-intensive tasks, but the potential of retrieval for non-knowledge-intensive (NKI) tasks remains under-explored. |
| Approach: | They propose a task-agnostic retrieval framework for NKI tasks that uses a static index and a prompt-guided reranker to re-rank the nearest evidence according to task-specific relevance. |
| Outcome: | The proposed framework outperforms state-of-the-art retrieval-augmented methods on NKI tasks and will be released for further research. |
Selective Temporal Knowledge Graph Reasoning (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing models cannot abstain from uncertain predictions, which will bring risks in real-world applications. |
| Approach: | They propose to abstain from uncertain future facts by using a confidence estimator . they take both the certainty of the current prediction and the accuracy of historical predictions into account . |
| Outcome: | The proposed abstention mechanism helps existing models make selective predictions instead of indiscriminate ones. |
Transformer-GCRF: Recovering Chinese Dropped Pronouns with General Conditional Random Fields (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to recover dropped pronouns ignore the dependencies between pronounes in neighboring utterances. |
| Approach: | They propose a framework that combines Transformer network and General Conditional Random Fields to model the dependencies between pronouns in neighboring utterances. |
| Outcome: | The proposed framework outperforms state-of-the-art models on three Chinese conversation datasets showing that it captures the dependencies between pronouns in neighboring utterances. |
Do Large Language Models have an English Accent? Evaluating and Improving the Naturalness of Multilingual LLMs (2025.acl-long)
Copied to clipboard
| Challenge: | Current Large Language Models (LLMs) are predominantly designed with English as the primary language, but many are still English-dominated. |
| Approach: | They propose to use automatic corpus-level metrics to assess lexical and syntactic naturalness of LLMs in a multilingual context. |
| Outcome: | The proposed method improves naturalness of LLMs in target languages without compromising performance on general-purpose benchmarks. |
Comprehensive Benchmarking of Long-Form Speech Generation in Diverse Scenarios (2026.findings-acl)
Copied to clipboard
Changhao Pan, Rui Yang, Han Wang, Zhuan Zhou, Xuming He, Wenxiang Guo, Ziyue Jiang, Ruiqi Li, Yu Zhang, Chenyuhao Wen, Ke Lei, Xiang Yin, Jingyu Lu, Zhiyuan Zhu, Zhou Zhao
| Challenge: | Existing evaluation benchmarks for long-form speech are limited to limited domains, creating a significant gap with the diverse downstream applications. |
| Approach: | They propose a benchmark that decomposes "long-form speech quality" into specific, disentangled dimensions. |
| Outcome: | The proposed benchmark decomposes “long-form speech quality” into specific, disentangled dimensions. |
INarIG: Iterative Non-autoregressive Instruct Generation Model For Word-Level Auto Completion (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models for word-level autocompletion (WLAC) only use human typed sequences as prefixes in decoding module. |
| Approach: | They propose a novel iterative nonautoregressive instruct generation model for WLAC task . it uses human typed sequences and iterating decoding with subwords to fully utilize input information. |
| Outcome: | The proposed model is more competent in dealing with low-frequency words, and achieves state-of-the-art results on the WMT22 and benchmark datasets. |
DiffZOO: A Purely Query-Based Black-Box Attack for Red-teaming Text-to-Image Generative Model via Zeroth Order Optimization (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing text-to-image (T2I) synthesis diffusion models raise misuse concerns, particularly in creating prohibited or not-safe-for-work (NSFW) images. |
| Approach: | They propose a method which uses zeroth order optimization to procure gradient approximations and harnesses both C-PRV and D-PRv to enhance attack prompts within a discrete prompt space. |
| Outcome: | The proposed method achieves an 8.5% higher average attack success rate than previous works on multiple state-of-the-art safety mechanisms. |
RGL: A Simple yet Effective Relation Graph Augmented Prompt-based Tuning Approach for Few-Shot Learning (2022.findings-naacl)
Copied to clipboard
| Challenge: | Pre-trained language models (PLMs) are a good starting point for downstream applications, but it is difficult to generalize them to new tasks given a few labeled samples. |
| Approach: | They propose to use Relation Graph augmented learning to improve the performance of few-shot natural language understanding tasks by rewriting the input sequence into a cloze question with masks. |
| Outcome: | Extensive experiments show that Relation Graph augmented learning (RGL) improves performance of prompt-based tuning strategies. |
XAL: EXplainable Active Learning Makes Classifiers Better Low-resource Learners (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing methods for active learning rely on model uncertainty or disagreement to pick unlabeled data, leading to over-confidence in superficial patterns and lack of exploration. |
| Approach: | They propose to use a bi-directional encoder and a uni-directional decoder to generate and score an explanation for low-resource text classification. |
| Outcome: | The proposed model improves on 9 strong baselines on six datasets and can generate explanations for its predictions. |
Assist Non-native Viewers: Multimodal Cross-Lingual Summarization for How2 Videos (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing multimodal summarization methods are limited to monolingual videos . a proposed task aims to generate cross-lingual summaries from multimodal inputs . |
| Approach: | They propose a task to generate cross-lingual summaries from multimodal inputs of videos . they propose fusion network that integrates multimodal and cross-linguistic information . |
| Outcome: | The proposed task outperforms existing methods on a reorganized How2 dataset on the reorganized How2 data set. |
MdEval: Massively Multilingual Code Debugging (2026.findings-acl)
Copied to clipboard
Shukai Liu, Linzheng Chai, Jian Yang, Jiajun Shi, He Zhu, Liran Wang, Jin Ke, Wei Zhang, Hualei Zhu, Shuyue Guo, Tao Sun, Jiaheng Liu, Yunlong Duan, Yu Hao, Liqun Yang, Guanglin Niu, Ge Zhang, Zhoujun Li
| Challenge: | Existing benchmarks primarily focus on Python and are limited in terms of language diversity. |
| Approach: | They propose a multilingual debugging benchmark that includes 3.9K test samples of 20 programming languages and introduces the debug instruction corpora MdEval-Instruct by injecting bugs into the correct multilingual queries and solutions. |
| Outcome: | The proposed benchmark includes 3.9K test samples of 20 programming languages and covers the automated program repair task, bug localization task, and bug identification task. |
On the (In-)Security of the Shuffling Defense in the Transformer Secure Inference (2026.acl-long)
Copied to clipboard
| Challenge: | Existing work reveals only randomly permuted activations to the client, allowing adversaries to extract model weights. |
| Approach: | They propose an attack that aligns differently shuffled activations to a common permutation and exploits them to extract model weights. |
| Outcome: | The proposed attack can align shuffled activations to a common permutation and exploit them to extract model weights with a query cost of approximately $1. |
LLMRouterBench: A Massive Benchmark and Unified Framework for LLM Routing (2026.findings-acl)
Copied to clipboard
Hao Li, Yiqun Zhang, Zhaoyan Guo, Chenxu Wang, Shengji Tang, Qiaosheng Zhang, Yang Chen, Biqing Qi, Peng Ye, Lei Bai, Zhen Wang, Shuyue Hu
| Challenge: | Large language model (LLM) routing assigns each query to the best suitable model from an ensemble. |
| Approach: | They introduce a large-scale benchmark and unified framework for LLM routing . they find that many routing methods exhibit similar performance under unified evaluation . |
| Outcome: | The proposed benchmark provides comprehensive metrics for both performance-oriented and performance-cost trade-off routing. |
Benchmarking Long-Context Language Models on Long Code Understanding (2025.acl-long)
Copied to clipboard
Jia Li, Xuyuan Guo, Lei Li, Kechi Zhang, Ge Li, Jia Li, Zhengwei Tao, Fang Liu, Chongyang Tao, Yuqi Zhu, Zhi Jin
| Challenge: | Currently, long-context language models are limited by the lack of a rigorous evaluation framework for long code understanding. |
| Approach: | They propose to use a long code understanding benchmark LongCodeU to evaluate LCLMs' long code comprehension ability for practical applications. |
| Outcome: | The proposed benchmarks show that current LCLMs are limited in their long code understanding ability, particularly when the long code length is greater than 32K, falling far short of their claimed 128K to 1M context windows. |
Measuring Correlation-to-Causation Exaggeration in Press Releases (2020.coling-main)
Copied to clipboard
| Challenge: | Recent studies have found that press releases are a major source of exaggeration in science communication, which is later spread to mainstream media. |
| Approach: | They propose an NLP approach to identify exaggerated causal claims in health press releases that report on observational studies. |
| Outcome: | The proposed approach can identify causal claims in press releases that report on observational studies. |
Unsupervised Text Style Transfer for Controllable Intensity (2026.findings-eacl)
Copied to clipboard
| Challenge: | Unsupervised Text Style Transfer (UTST) aims to transfer the stylistic properties of a given text without parallel text pairs. |
| Approach: | They propose a SFT-then-PPO paradigm to fine-tune an LLM with parallel data and reward functions for distinguishing stylistic intensity in hierarchical levels. |
| Outcome: | The proposed system can transfer stylistic properties without parallel text pairs even for adjacent levels of intensity. |
Memorize Step by Step: Efficient Long-Context Prefilling with Incremental Memory and Decremental Chunk (2024.emnlp-main)
Copied to clipboard
Zhiyuan Zeng, Qipeng Guo, Xiaoran Liu, Zhangyue Yin, Wentao Shu, Mianqiu Huang, Bo Wang, Yunhua Zhou, Linlin Li, Qun Liu, Xipeng Qiu
| Challenge: | Existing methods to optimize LLM for long sequences for long documents are slow and consume memory. |
| Approach: | They propose a method that starts with a small memory size and gradually increases it . they propose Decremental Chunk based on Incremental Memory (IMDC) which reduces chunk size while increasing memory size . |
| Outcome: | The proposed method is faster (1.45x) and reduces GPU memory consumption by 23.3% compared to fixed-size memory. |
R.R.: Unveiling LLM Training Privacy through Recollection and Ranking (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing privacy attacks focus on membership inference or data extraction, but reconstructing specific personally identifiable information (PII) in training data remains challenging. |
| Approach: | They propose a two-step privacy stealing attack that enables attackers to reconstruct PII entities from scrubbed training data where the PI I entities have been masked. |
| Outcome: | The proposed attack can reconstruct PII entities from scrubbed training data where the PI I entities have been masked. |
ZeroAE: Pre-trained Language Model based Autoencoder for Transductive Zero-shot Text Classification (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for text classification use only encoders or decoders that do not allow for the use of labels in unseen domains. |
| Approach: | They propose an autoencoder that encodes text into two disentangled spaces and decodes it to generate text with labels in the unseen domains. |
| Outcome: | The proposed model outperforms the existing methods in label-partially-unseen and label-fully-un-seeen scenarios and even outperfects the SOTA methods. |
PersonaTrace: Synthesizing Realistic Digital Footprints with LLM Agents (2026.eacl-industry)
Copied to clipboard
Minjia Wang, Yunfeng Wang, Xiao Ma, Dexin Lv, Qifan Guo, Lynn Zheng, Benliang Wang, Lei Wang, Jiannan Li, Yongwei Xing, Junzhe Xu, Zheng Sun
| Challenge: | Publicly available corpora cover only slivers of human activity, such as email threads, chat logs, purchase histories, sensor traces, and provide large-scale supervision for data-hungry machine-learning pipelines. |
| Approach: | They propose a method for synthesizing realistic digital footprints using large language model agents from a structured user profile. |
| Outcome: | The proposed method generates diverse sequences of user events, producing corresponding digital artifacts such as emails, messages, calendar entries, reminders, etc. |
MFinMeeting: A Multilingual, Multi-Sector, and Multi-Task Financial Meeting Understanding Evaluation Dataset (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing financial benchmarks rely on news articles, earnings reports, or announcements, making it challenging to capture the real-world dynamics of financial meetings. |
| Approach: | They propose a multilingual, multi-sector, and multi-task dataset called MFinMeeting that supports English, Chinese, and Japanese . |
| Outcome: | The proposed benchmark supports English, Chinese, and Japanese, enhancing comprehension of financial discussions in diverse linguistic contexts. |
HOTVCOM: Generating Buzzworthy Comments for Videos (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing research focuses on generating descriptive comments in English . hot-comments are important for video marketing and branding, authors say . |
| Approach: | They propose a framework to generate hot-comments on a Chinese video dataset . they use a combination of visual, auditory, and textual data to generate them . |
| Outcome: | The proposed framework shows that it generates hot-comments on both the new and existing datasets. |
DAGCN: Distance-based and Aspect-oriented Graph Convolutional Network for Aspect-based Sentiment Analysis (2024.findings-naacl)
Copied to clipboard
| Challenge: | Recent advances in sentiment analysis tend to interference from local factors such as irrelevant words and edges, hindering the precise identification of opinion words. |
| Approach: | They propose a distance-based syntactic weight and Aspect-Fusion Attention to solve this problem. |
| Outcome: | The proposed model outperforms state-of-the-art models on three public datasets and verify its effectiveness. |
2D-DPO: Scaling Direct Preference Optimization with 2-Dimensional Supervision (2025.findings-naacl)
Copied to clipboard
Shilong Li, Yancheng He, Hui Huang, Xingyuan Bu, Jiaheng Liu, Hangyu Guo, Weixun Wang, Jihao Gu, Wenbo Su, Bo Zheng
| Challenge: | Existing methods that optimize for scalar scores or ranking reward ignore multi-dimensional nature of human preferences. |
| Approach: | They propose to extend the preference of Direct Preference Optimization to two dimensions: segments and aspects. |
| Outcome: | The proposed framework decomposes the overall objective into multi-segment and multi-aspect objectives. |
Simple-VGC: Enhancing Visual Grounding in Multimodal Reasoning via Adaptive Tool Composition (2026.acl-long)
Copied to clipboard
| Challenge: | Existing multimodal large language models suffer from systematic failures in basic visual understanding. |
| Approach: | They propose a tool-augmented reasoning framework with three targeted compensation strategies to address these problems. |
| Outcome: | The proposed framework improves visual grounding by re-injecting the original image to mitigate visual forgetting, the authors show . the proposed framework also improves the accuracy of the visual inputs, the researchers show - and the results are promising . |
CriticLean: Critic-Guided Reinforcement Learning for Mathematical Formalization (2026.acl-long)
Copied to clipboard
Zhongyuan Peng, Yifan Yao, Kaijing Ma, Shuyue Guo, Yizhe Li, Yichi Zhang, Chenchen Zhang, Yifan Zhang, Zhouliang Yu, Luming Li, Minghao Liu, Yihang Xia, Jiawei Shen, Yuchen Wu, Yixin Cao, Zhaoxiang Zhang, Wenhao Huang, Jiaheng Liu, Ge Zhang
| Challenge: | Existing approaches to formalizing mathematical statements face limitations in accuracy, especially in the context of complex, highlevel problems that involve sophisticated mathematical reasoning. |
| Approach: | They propose a CriticLean framework that elevates the role of the critic from a passive validator to an active learning component and introduce a benchmark to measure models’ ability to distinguish semantically correct from incorrect formalizations. |
| Outcome: | The proposed framework outperforms open- and closed-source benchmarks and shows that it significantly outperformed existing models. |
Nested Event Extraction upon Pivot Element Recognition (2024.lrec-main)
Copied to clipboard
Weicheng Ren, Zixuan Li, Xiaolong Jin, Long Bai, Miao Su, Yantao Liu, Saiping Guan, Jiafeng Guo, Xueqi Cheng
| Challenge: | Nested Event Extraction (NEE) aims to extract complex event structures where an event contains other events as its arguments recursively. |
| Approach: | They propose a new model that extracts nested events mainly based on recognizing PEs. |
| Outcome: | The proposed model can extract nested events based on recognizing PEs . it incorporates information from both event types and argument roles to improve performance . |
ChatMusician: Understanding and Generating Music Intrinsically with LLM (2024.findings-acl)
Copied to clipboard
Ruibin Yuan, Hanfeng Lin, Yi Wang, Zeyue Tian, Shangda Wu, Tianhao Shen, Ge Zhang, Yuhang Wu, Cong Liu, Ziya Zhou, Liumeng Xue, Ziyang Ma, Qin Liu, Tianyu Zheng, Yizhi Li, Yinghao Ma, Yiming Liang, Xiaowei Chi, Ruibo Liu, Zili Wang, Chenghua Lin, Qifeng Liu, Tao Jiang, Wenhao Huang, Wenhu Chen, Jie Fu, Emmanouil Benetos, Gus Xia, Roger Dannenberg, Wei Xue, Shiyin Kang, Yike Guo
| Challenge: | Despite LLMs' impressive capabilities in musical knowledge, music reasoning remains an unsolved task. |
| Approach: | They propose an open-source large language model (LLM) that integrates intrinsic musical abilities into LLaMA2 and GPT-3.5. |
| Outcome: | The proposed model can understand and generate music with a pure text tokenizer without external multi-modal neural structures or tokenizers. |
Overcoming Catastrophic Forgetting During Domain Adaptation of Seq2seq Language Generation (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing work on lifelong learning requires incremental memory space to learn a model . existing work on experience replay or elastic weighted consolidation requires incremental space . |
| Approach: | They propose a framework that leverages a recall optimization mechanism to memorize parameters of previous tasks via regularization and a domain drift estimation algorithm to compensate the drift between different domains in the embedding space. |
| Outcome: | The proposed framework outperforms SOTA models on paraphrase and dialog response generation tasks. |
Prefix-diffusion: A Lightweight Diffusion Model for Diverse Image Captioning (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing image captioning models require large trainable parameters to bridge visual and textual representations. |
| Approach: | They propose a lightweight image captioning network in combination with continuous diffusion that injects prefix image embeddings into denoising process of diffusion model. |
| Outcome: | The proposed method generates diverse captions with relatively less parameters while maintaining fluency and relevance compared with other models. |
M-Ped: Multi-Prompt Ensemble Decoding for Large Language Models (2025.findings-emnlp)
Copied to clipboard
Jiaxin Guo, Daimeng Wei, Yuanchang Luo, Hengchao Shang, Zongyao Li, Jinlong Yang, Zhanglin Wu, Zhiqiang Rao, Shimin Tao, Hao Yang
| Challenge: | a new ensemble decoding approach enhances the performance of Large Language Models. |
| Approach: | They propose a multi-prompt ensemble decoding approach to enhance LLM performance . they submit n variations of prompts with X to LLMs in batch mode to decode and derive probability distributions . |
| Outcome: | The proposed method improves pass@k rates, LENS metrics and BLEU scores on diverse NLP tasks. |
A Unified Joint Approach with Topological Context Learning and Rule Augmentation for Knowledge Graph Completion (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing knowledge graph completion methods perform simple linear update on relation representation, and only local neighborhood information is aggregated, making it difficult to capture logic semantic between relations and global topological context information. |
| Approach: | They propose a joint approach with Topological Context learning and Rule Augmentation (TCRA) it uses a topological context learning mechanism and a relation rule context learning system . |
| Outcome: | The proposed approach performs better on three benchmark datasets and is widely used in knowledgeintensive applications. |
LICHEE: Improving Language Model Pre-training with Multi-grained Tokenization (2021.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained language models are trained based on single-grained tokenization, making it hard to learn the precise meaning of coarse-grain words and phrases. |
| Approach: | They propose a language model pretraining method that incorporates multi-grained information of input text into pre-trained language models. |
| Outcome: | The proposed method improves performance on CLUE and SuperGLUE in Chinese and English with little extra inference cost. |
Implicit Discourse Relation Recognition using Neural Tensor Network with Interactive Attention and Sparse Learning (C18-1)
Copied to clipboard
| Challenge: | Existing methods for implicit discourse relation recognition ignore bidirectional interactions between two arguments and sparsity of pair patterns. |
| Approach: | They propose a neural Tensor network framework with interactive attention and sparse learning for implicit discourse relation recognition. |
| Outcome: | The proposed framework is effective on PDTB and can be used in text summarization, conversation system and so on. |
FaStFact: Faster, Stronger Long-Form Factuality Evaluations in LLMs (2025.findings-emnlp)
Copied to clipboard
Yingjia Wan, Haochen Tan, Xiao Zhu, Xinyu Zhou, Zhiwei Li, Qingsong Lv, Changxuan Sun, Jiaqi Zeng, Yi Xu, Jianqiao Lu, Yinhong Liu, Zhijiang Guo
| Challenge: | Prior evaluation pipelines fail to evaluate factuality of long-form LLMs due to inefficiency and costly human assessment. |
| Approach: | They propose a fast and strong evaluation pipeline that can evaluate factuality of long-form LLMs . they propose 'faStFact' to reduce cost of web searching and inference calling . |
| Outcome: | The proposed evaluation pipeline achieves highest alignment with human evaluation and efficiency among existing baselines. |
In-Image Neural Machine Translation with Segmented Pixel Sequence-to-Sequence Model (2023.findings-emnlp)
Copied to clipboard
| Challenge: | In-Image Machine Translation (IIMT) aims to convert images containing texts from one language to another. |
| Approach: | They propose an end-to-end model instead of the traditional cascade methods which use optical character recognition followed by neural machine translation and text rendering. |
| Outcome: | The proposed model outperforms both cascade methods and current model in translation quality and robustness across various dimensions. |
Integrating Semantic Scenario and Word Relations for Abstractive Sentence Summarization (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing graph-based methods only consider word relations or structure information, which neglect the correlation between them. |
| Approach: | They propose a Dual Graph network for Abstractive Sentence Summarization that captures word relations and structure information from sentences. |
| Outcome: | The proposed model outperforms state-of-the-art methods on two popular benchmark datasets. |
Multi-stage Distillation Framework for Cross-Lingual Semantic Similarity Matching (2022.findings-naacl)
Copied to clipboard
Kunbo Ding, Weijie Liu, Yuejian Fang, Zhe Zhao, Qi Ju, Xuefeng Yang, Rong Tian, Zhu Tao, Haoyan Liu, Han Guo, Xingyu Bai, Weiquan Mao, Yudong Li, Weigang Guo, Taiqiang Wu, Ningyuan Sun
| Challenge: | Existing studies have shown that cross-lingual knowledge distillation can improve the performance of pre-trained models for cross-linguistic similarity matching tasks. |
| Approach: | They propose a multi-stage distillation framework for constructing a small-size but high-performance cross-lingual model using contrastive learning, bottleneck, and parameter recurrent strategies. |
| Outcome: | The proposed model can compress the size of XLM-R and MiniLM by more than 50% while the performance is only reduced by about 1%. |
FEA-Bench: A Benchmark for Evaluating Repository-Level Code Generation for Feature Implementation (2025.acl-long)
Copied to clipboard
Wei Li, Xin Zhang, Zhongxin Guo, Shaoguang Mao, Wen Luo, Guangyue Peng, Yangyu Huang, Houfeng Wang, Scarlett Li
| Challenge: | Existing benchmarks focus on standalone programming problems, such as HumanEval, MBPP, and LiveCodeBench. |
| Approach: | They propose to use large language models to evaluate their ability to perform incremental development within code repositories by collecting pull requests from 83 GitHub repositorias and using rule-based and intent-based filtering to construct task instances focused on new feature development. |
| Outcome: | The proposed benchmarks show that large language models perform significantly worse in the FEA-Bench, highlighting considerable challenges in repository-level incremental code development. |
VCSearch: Bridging the Gap Between Well-Defined and Ill-Defined Problems in Mathematical Reasoning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies have improved the performance of Large language models on well-defined mathematical benchmarks, but they often overlook ill-defined problems. |
| Approach: | They develop a large-scale benchmark that contains over 5,000 ill-defined mathematical problems. |
| Outcome: | The proposed framework improves the accuracy of identifying unsolvable problems by at least 12% across different LLMs, thus achieving stronger robust mathematical reasoning ability. |
Trigger is Not Sufficient: Exploiting Frame-aware Knowledge for Implicit Event Argument Extraction (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods to extract event arguments focus on learning pair-wise information between arguments and the given trigger. |
| Approach: | They propose a framework to extract event-related arguments from a given event frame-level scope. |
| Outcome: | The proposed method achieves state-of-the-art on the RAMS dataset. |
MM-CRITIC: A Holistic Evaluation of Large Multimodal Models as Multimodal Critique (2025.findings-emnlp)
Copied to clipboard
| Challenge: | e MM-CRITIC is a holistic benchmark for evaluating the critique ability of Large Multimodal Models (LMMs) covering 8 main task types and over 500 tasks, covering 4471 samples. |
| Approach: | They introduce a holistic benchmark for evaluating the critique ability of Large Multimodal Models across multiple dimensions: basic, correction, and comparison. |
| Outcome: | The proposed benchmark covers 8 main task types and over 500 tasks and is composed of 4471 samples. |
An Unsupervised Multiple-Task and Multiple-Teacher Model for Cross-lingual Named Entity Recognition (2022.acl-long)
Copied to clipboard
| Challenge: | Existing models for named entity recognition only consider the potential transferability between two identical tasks across both domains. |
| Approach: | They propose to use a similarity metric model to improve cross-lingual named entity recognition task on target domain. |
| Outcome: | Empirical studies on 7 different languages confirm the effectiveness of the proposed model. |
InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviews (2024.acl-long)
Copied to clipboard
Xintao Wang, Yunze Xiao, Jen-tse Huang, Siyu Yuan, Rui Xu, Haoran Guo, Quan Tu, Yaying Fei, Ziang Leng, Wei Wang, Jiangjie Chen, Cheng Li, Yanghua Xiao
| Challenge: | Existing methods focus on knowledge and linguistic patterns of characters. |
| Approach: | They propose to evaluate character fidelity of role-playing agents with psychological scales . they propose to use psychological scale to measure personality traits of RPAs based on personality traits. |
| Outcome: | The proposed model reproduces character fidelity with psychological scales and shows that it is effective in measuring personality traits. |
Semantic Structure Enhanced Event Causality Identification (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods for Event Causality Identification (ECI) capture implicit associations between events, which are difficult because they lack the ability to understand the associations between two events. |
| Approach: | They propose a model that captures the implicit associations between two events and integrates the event-centric structure information into a GNN-based event aggregator. |
| Outcome: | The proposed model improves on three widely used datasets showing that it integrates event-centric and event-associated semantic elements and captures event associations. |
Dual Slot Selector via Local Reliability Verification for Dialogue State Tracking (2021.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to predict dialogue state from scratch are inefficient and lead to errors . empirical results show that our method achieves 56.93%, 60.73%, and 58.04% joint accuracy on multi-domain conversations . |
| Approach: | They propose a dual-stage dialogue state tracking method that uses a slot selector and a Slot Value generator to predict the current dialogue state. |
| Outcome: | The proposed method achieves 56.93%, 60.73%, and 58.04% joint accuracy on multi-domain conversations. |
Towards Event Extraction with Massive Types: LLM-based Collaborative Annotation and Partitioning Extraction (2025.emnlp-main)
Copied to clipboard
| Challenge: | Event Extraction (EE) is a long-standing target, but lacks an efficient and effective annotation framework to construct the corresponding datasets. |
| Approach: | They propose an LLM-based collaborative annotation framework that refines annotations of triggers from distant supervision and carries out argument annotation. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on the largest EE dataset to date . it achieves the F1 scores of 90% and 85.3% on the human-annotated test set . |
Multi-Scale Spectral Selection and Entropy-Guided Uncertainty Fusion for Multimodal Rumor Detection (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for multimodal content detection fail to capture cross-modal semantic inconsistencies and ignore inherent noise in multimodal features. |
| Approach: | They propose a multimodal rumor detection method based on a frequency domain spectral selection method and entropy-guided uncertainty fusion method to capture cross-modal semantic inconsistencies. |
| Outcome: | The proposed method outperforms state-of-the-art methods in multimodal rumor detection . it shows stronger detection capability and robustness on multiple datasets . |
LVP-M3: Language-aware Visual Prompt for Multilingual Multimodal Machine Translation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances struggle to train a separate model for each language pair, which is costly and unaffordable when the number of languages increases in the real world. |
| Approach: | They propose to train different MMT models to support translations between different languages. |
| Outcome: | The proposed model is able to handle the above issues by providing a shared semantic space for multiple languages. |
VehicleWorld: A Highly Integrated Multi-Device Environment for Intelligent Vehicle Interaction (2025.findings-emnlp)
Copied to clipboard
Jie Yang, Jiajun Chen, Zhangyue Yin, Shuo Chen, Yuxin Wang, Yiran Guo, Yuan Li, Yining Zheng, Xuanjing Huang, Xipeng Qiu
| Challenge: | Traditional Function Calling (FC) approaches operate statelessly, requiring multiple exploratory calls to build environmental awareness before execution, leading to inefficiency and limited error recovery. |
| Approach: | They propose a state-based function call approach that maintains explicit system state awareness and implements direct state transitions to achieve target conditions. |
| Outcome: | The proposed approach outperforms traditional function calling approaches, achieving superior execution accuracy and reduced latency. |
MultiFinBen: Benchmarking Large Language Models for Multilingual and Multimodal Financial Application (2026.acl-long)
Copied to clipboard
Xueqing Peng, Lingfei Qian, Yan Wang, Ruoyu Xiang, Yueru He, Yang Ren, Mingyang Jiang, Vincent Jim Zhang, Yuqing Guo, Jeff Zhao, Huan He, Yi Han, Yun Feng, Yuechen Jiang, Yupeng Cao, Haohang Li, Yangyang Yu, Xiaoyu Wang, Penglei Gao, Shengyuan Lin, Keyi Wang, Shanshan Yang, Yilun Zhao, Zhiwei Liu, Peng Lu, Jerry Huang, Suyuchen Wang, Triantafillos Papadopoulos, Polydoros Giannouris, Efstathia Soufleri, Nuo Chen, Zhiyang Deng, Heming Fu, Yijia Zhao, Mingquan Lin, Meikang Qiu, Kaleb E Smith, Arman Cohan, Xiao-Yang Liu, Jimin Huang, Guojun Xiong, Alejandro Lopez-Lira, Xi Chen, Junichi Tsujii, Jian-Yun Nie, Sophia Ananiadou, Qianqian Xie
| Challenge: | Existing evaluations of LLMs in finance are text-only, monolingual, and largely saturated by current models. |
| Approach: | They propose a multilingual and multimodal benchmark for evaluating LLMs in real financial contexts. |
| Outcome: | The first expert-annotated multilingual and multimodal benchmark is released . it evaluates 21 leading LLMs and shows they perform better in multilingual settings . |
Teaching Neural Module Networks to Do Arithmetic (2022.coling-1)
Copied to clipboard
| Challenge: | Neural Module Networks (NMNs) have limited reasoning abilities and lack numerical reasoning capability. |
| Approach: | They propose to integrate the original question in the interpreter and introduce addition and subtraction modules that perform numerical reasoning over numbers. |
| Outcome: | The proposed methods outperform previous state-of-the-art models on a subset of DROP and achieve competitive reasoning performance. |
CasEE: A Joint Learning Framework with Cascade Decoding for Overlapping Event Extraction (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing methods assume that events appear in sentences without overlaps . overlapping event extraction is a challenging task in natural language understanding . |
| Approach: | They propose a joint learning framework with cascade decoding for overlapping event extraction . they sequentially perform type detection, trigger extraction and argument extraction based on the specific former prediction . |
| Outcome: | The proposed framework improves on a public event extraction benchmark . it sequentially performs type detection, trigger extraction and argument extraction . |
UERLens: Understanding Event Relations in Large Language Models (2026.acl-short)
Copied to clipboard
| Challenge: | Existing studies on event relation extraction (ERE) have focused on improving model performance. |
| Approach: | They propose an interpretability framework for understanding event relations in large language models . they first construct a counterfactual dataset that includes causal, temporal, and sub-event relations . |
| Outcome: | The proposed framework improves event relation extraction by leveraging internal features to train a lightweight classifier. |
CoG: Controllable Graph Reasoning via Relational Blueprints and Failure-Aware Refinement over Knowledge Graphs (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to large language models often exhibit cognitive rigidity, causing reasoning stagnation. |
| Approach: | They propose a training-free framework that mimics the interplay between intuition and deliberation. |
| Outcome: | The proposed framework outperforms state-of-the-art approaches on three benchmarks. |
Graph Neural Network Enhanced Retrieval for Question Answering of Large Language Models (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing retrieval methods divide reference documents into passages, treating them in isolation. Existing methods only use contiguous passages or keywords. |
| Approach: | They propose a retrieval method that leverages graph neural networks to exploit relatedness between passages to enhance retrieval. |
| Outcome: | The proposed method improves retrieval by exploiting the relatedness between passages. |
QiMeng-Attention: SOTA Attention Operator is generated by SOTA Attention Algorithm (2025.findings-acl)
Copied to clipboard
Qirui Zhou, Shaohui Peng, Weiqiang Xiong, Haixin Chen, Yuanbo Wen, Haochen Li, Ling Li, Qi Guo, Yongwei Zhao, Ke Gao, Ruizhi Chen, Yanjun Wu, Zhao Chen, Yunji Chen
| Challenge: | Existing LLMs cannot comprehend the complex data flow and computation process of the attention operator and utilize low-level primitive to exploit GPU performance. |
| Approach: | They propose an LLM-friendly Thinking Language (LLM-TL) that can decouple the generation of high-level optimization logic and low-level implementation on GPU and enhance LLMs’ understanding of attention operator. |
| Outcome: | The proposed method outshines existing LLMs on A100, RTX8000, and T4 GPUs, achieving a speed-up of up to 35.16. |
Recovering dropped pronouns in Chinese conversations via modeling their referents (N19-1)
Copied to clipboard
| Challenge: | Pronouns are often dropped in conversational genres as their referents can be easily understood from context. |
| Approach: | They propose an end-to-end neural network model to recover dropped pronouns in conversational data. |
| Outcome: | The proposed model improves on three different conversational genres. |
Toward Optimal LLM Alignments Using Two-Player Games (2025.findings-emnlp)
Copied to clipboard
Rui Zheng, Hongyi Guo, Zhihan Liu, Xiaoying Zhang, Yuanshun Yao, Xiaojun Xu, Zhaoran Wang, Zhiheng Xi, Tao Gui, Qi Zhang, Xuanjing Huang, Yang Liu, Hang Li
| Challenge: | Alignment of large language models (LLM) is a process that ensures the model’s responses to user prompts align with human intentions and social values. |
| Approach: | They propose an alignment method based on a two-agent game consisting of an adversarial agent and a defensive agent. |
| Outcome: | The proposed method improves on a two-agent game with an adversarial agent and a defensive agent. |
G2S: A General-to-Specific Learning Framework for Temporal Knowledge Graph Forecasting with Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent studies have introduced Large Language Models (LLMs) for this task to enhance the models’ generalization abilities. |
| Approach: | They propose a General-to-Specific learning framework that disentangles the learning processes of two kinds of knowledge in a temporal temporal structure. |
| Outcome: | The proposed framework disentangles the learning processes of the above two kinds of knowledge and improves their generalization abilities. |
Retrieval, Reasoning, Re-ranking: A Context-Enriched Framework for Knowledge Graph Completion (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing embedding-based methods rely on triples in the KG, which is vulnerable to specious relation patterns and long-tail entities. |
| Approach: | They propose a context-enriched framework for KGC that uses a large language model to generate potential answers for each query triple. |
| Outcome: | The proposed framework improves on FB15k237 and WN18RR datasets. |
SAM3-I: Segment Anything with Instructions (2026.acl-long)
Copied to clipboard
Jingjing Li, Yue Feng, Yuchen Guo, Jincai Huang, Wei Ji, Qi Bi, Yongri Piao, Miao Zhang, Xiaoqi Zhao, Qiang Chen, Shihao Zou, Huchuan Lu, Li Cheng
| Challenge: | Existing methods for concept-level grounding and instruction-level reasoning use coarse representations and iterative mask filtering. |
| Approach: | They propose an instruction-following extension of the Segment Anything Model 3 family that unifies concept-level grounding and instruction-level reasoning within a single segmentation framework. |
| Outcome: | Experiments show that SAM3-I achieves appealing performance across referring and reasoning-based segmentation while maintaining its strong concept recall ability. |
Skill Weaving: Efficient LLM Improvement via Modular Skillpacks (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) can specialize under fixed memory and inference budgets, but they struggle to achieve high performance across heterogeneous domains. |
| Approach: | They propose a modular improvement framework that partitions full capabilities of a general-purpose model into domain-specific delta modules that reorganize and refine the model's internal knowledge. |
| Outcome: | The proposed framework outperforms monolithic models on multi-task and agentic benchmarks and achieves up to 4 speedup. |
Lost in Stories: Consistency Bugs in Long Story Generation by LLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing story generation benchmarks focus mainly on plot quality and fluency, leaving consistency errors unexplored. |
| Approach: | They propose a benchmark to evaluate narrative consistency in long-form story generation. |
| Outcome: | Evaluating LLMs, we find consistency errors are common in factual and temporal dimensions . authors say the findings can inform future efforts to improve consistency in long-form narrative generation. |
From Objectives to Questions: A Planning-based Framework for Educational Mathematical Question Generation (2025.acl-long)
Copied to clipboard
| Challenge: | Traditional generation methods focus primarily on textual quality, but they fail to meet complex, multifaceted educational requirements. |
| Approach: | They propose a method for automatic generating high-quality mathematical problems that align with educational objectives using a dataset of 16k mathematical questions with multi-dimensional educational objectives. |
| Outcome: | The proposed method improves generating high-quality mathematical questions that meet multi-dimensional educational objectives. |
F-Eval: Asssessing Fundamental Abilities with Refined Evaluation Methods (2024.acl-long)
Copied to clipboard
Yu Sun, Keyuchen Keyuchen, Shujie Wang, Peiji Li, Qipeng Guo, Hang Yan, Xipeng Qiu, Xuanjing Huang, Dahua Lin
| Challenge: | Large language models (LLMs) have been evaluated for their instruction-following capabilities but lack references to their fundamental abilities. |
| Approach: | They propose a bilingual evaluation benchmark to evaluate the fundamental abilities of large language models including expression, commonsense and logic. |
| Outcome: | The proposed evaluation methods show higher correlation coefficients and larger distinction than other evaluators. |
BERT-ATTACK: Adversarial Attack Against BERT Using BERT (2020.emnlp-main)
Copied to clipboard
| Challenge: | Current approaches to generate adversarial samples for discrete data are heuristic replacement strategies that are difficult to implement in continuous data. |
| Approach: | They propose a method to generate adversarial samples using pre-trained masked language models using BERT. |
| Outcome: | The proposed method outperforms state-of-the-art methods in success rate and perturb percentage while remaining fluent and semantically preserved. |
StableToolBench: Towards Stable Large-Scale Benchmarking on Tool Learning of Large Language Models (2024.findings-acl)
Copied to clipboard
Zhicheng Guo, Sijie Cheng, Hao Wang, Shihao Liang, Yujia Qin, Peng Li, Zhiyuan Liu, Maosong Sun, Yang Liu
| Challenge: | Large Language Models (LLMs) have witnessed remarkable advancements in recent years, prompting the exploration of tool learning. |
| Approach: | They propose a virtual API server and stable evaluation system to assess the stability of large-scale real-time APIs. |
| Outcome: | The proposed benchmarks demonstrate the stability of the proposed system and its caching system. |
LIST: Linearly Incremental SQL Translator for Single-Hop Reasoning, Generation and Verification (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing schema linking methods are not able to handle complex SQL queries. |
| Approach: | They propose a new algorithm that transforms SQL queries into grammatically verifiable sub-queries which are arranged sequentially to reflect single-hop reasoning steps. |
| Outcome: | The proposed algorithm achieves significant performance gains on the BIRD dataset and surpasses schema linking methods at comparable or better cost. |
MUSEG: Reinforcing Video Temporal Understanding via Timestamp-Aware Multi-Segment Grounding (2026.acl-long)
Copied to clipboard
Fuwen Luo, Shengfeng Lou, Chi Chen, Ziyue Wang, Chenliang Li, Weizhou Shen, Jiyue Guo, Peng Li, Ming Yan, Ji Zhang, Fei Huang, Yang Liu
| Challenge: | Existing methods for MLLMs struggle with fine-grained temporal reasoning . despite advances in video understanding, current methods struggle with time-sensitive tasks . |
| Approach: | They propose a time-stamp-aware multi-segment grounding method that enhances temporal understanding by introducing timestamps. |
| Outcome: | The proposed method outperforms existing methods on time-sensitive tasks and generalizes well across diverse temporal understanding scenarios. |
DEIE: Benchmarking Document-level Event Information Extraction with a Large-scale Chinese News Dataset (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing event-based datasets mainly target sentence-level tasks . current models struggle with "document" annotation, a key feature of the current model . |
| Approach: | They propose a large-scale document-level event information extraction dataset with over 56,000+ events and 242,000+ arguments. |
| Outcome: | The proposed dataset has over 56,000+ events and 242,000+ arguments. |
Beyond Dialogue Time: Temporal Semantic Memory for Personalized LLM Agents (2026.findings-acl)
Copied to clipboard
Miao Su, Yucan Guo, Zhongni Hou, Long Bai, Zixuan Li, Yufei Zhang, Guojun Yin, Wei Lin, Xiaolong Jin, Jiafeng Guo, Xueqi Cheng
| Challenge: | Existing methods focus on point-wise memory, losing durative information that captures persistent states and evolving patterns. |
| Approach: | They propose a memory framework that models semantic time for point-wise memory and supports the construction and utilization of durative memory. |
| Outcome: | Experiments on LongMemEval and LoCoMo show that the proposed method outperforms existing methods and achieves up to 12.2% improvement in accuracy. |
Training Verifier to Assessing Complex Real-World Tool-Use Trajectories (2026.findings-acl)
Copied to clipboard
Linzhuang Sun, Mingyang Chen, Hao Liang, Tianpeng Li, Zhou Yijie, Chenzheng Zhu, Tianyu Guo, Huanyao Zhang, Jingxuan Wei, Bihui Yu, Fan Yang, Wentao Zhang
| Challenge: | Existing methods for training effective AI agents often resort to synthetic data generation. |
| Approach: | They propose a plug-and-play framework for data quality control in tool-use scenarios . they construct a tool-verify dataset and release a benchmark to assess its performance . |
| Outcome: | The proposed framework surpasses Qwen2.5-72B-Instruct on Tool-V-Bench and the previous APIGen-MT dataset. |
CoMave: Contrastive Pre-training with Multi-scale Masking for Attribute Value Extraction (2023.findings-acl)
Copied to clipboard
Xinnan Guo, Wentao Deng, Yongrui Chen, Yang Li, Mengdi Zhou, Guilin Qi, Tianxing Wu, Dong Yang, Liubin Wang, Yong Pan
| Challenge: | Existing methods to extract product features from unstructured text still suffer from problems . e-commerce platforms are focusing on multi-scale values, which can be confusing . |
| Approach: | They propose a pre-training technique to automatically obtain attribute value pairs from product descriptions to aid e-commerce. |
| Outcome: | The proposed method improves on the existing token-level masking strategy and achieves state-of-the-art on four benchmarks. |
Integrating Deep Event-Level and Script-Level Information for Script Event Prediction (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies only consider a single event sequence corresponding to one common protagonist. |
| Approach: | They propose a Transformer-based model which integrates deep event-level and script-level information for script event prediction. |
| Outcome: | The proposed model is superior to existing models on the New York Times corpus . it utilizes rich information in the text to obtain more comprehensive representations . |
Powering Verifiable Learning via Automated Evolutionary Data Synthesis (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to building generalizable verifiable data are task-specific and lack a principled, universal evaluator of verifikatability. |
| Approach: | They propose a task-agnostic, strategy-guided, executably-checkable data synthesis framework that synthesizes problems, diverse candidate solutions and verification artifacts from a single source. |
| Outcome: | The proposed framework synthesizes problems, candidates, and verification artifacts from human-annotated and strategy-induced checks and iteratively discovers strategies. |
How Do LLMs and VLMs Understand Viewpoint Rotation Without Vision? An Interpretability Study (2026.acl-long)
Copied to clipboard
Zhen Yang, Ping Jian, Zhongbin Guo, Zuming Zhang, Chengzhi Li, Yonghong Deng, Xinyue Zhang, Wenpeng Lu
| Challenge: | Existing studies on spatial intelligence from the perspective of visual-spatial intelligence have not explored whether visual intelligence alone is sufficient to endow models with spatial intelligence. |
| Approach: | They propose to use a linguistic perspective to investigate spatial intelligence from a theoretical perspective. |
| Outcome: | The proposed model performs poorly on the proposed dataset while human can easily achieve 100% accuracy. |
Text Classification by Contrastive Learning and Cross-lingual Data Augmentation for Alzheimer’s Disease Detection (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for AD detection are too expensive and time-consuming to cover all potential patients. |
| Approach: | They propose a contrastive learning method to obtain effective text representations based on monolingual embeddings of BERT and a cross-lingual data augmentation method by building autoencoders to learn the text representation shared by both languages. |
| Outcome: | The proposed method outperforms other methods on a Mandarin AD corpus and achieves 81.6% detection accuracy. |
Unlocking the Power of Large Language Models for Entity Alignment (2024.acl-long)
Copied to clipboard
Xuhui Jiang, Yinghan Shen, Zhichao Shi, Chengjin Xu, Wei Li, Zixuan Li, Jian Guo, Huawei Shen, Yuanzhuo Wang
| Challenge: | Entity Alignment (EA) is a crucial step in unifying data from heterogeneous sources and plays a critical role in data-driven AI applications. |
| Approach: | They propose a framework that incorporates large language models to improve EA. |
| Outcome: | The proposed framework incorporates large language models (LLMs) to improve EA accuracy while preserving efficiency. |
Analyzing and Internalizing Complex Policy Documents for LLM Agents (2026.acl-long)
Copied to clipboard
Jiateng Liu, Zhenhailong Wang, Xiaojiang Huang, Yingjie Li, Xiang Li, Chenlei Guo, Xing Fan, Ruhi Sarikaya, Heng Ji
| Challenge: | Large language model agents rely on in-context policy documents to act as effective user assistants. |
| Approach: | They propose an agentic benchmark generator with Controllable Complexity in agent policy across four levels to evaluate agents under increasing complexity. |
| Outcome: | The proposed method outperforms the baseline in data-sparse and high-complexity settings. |
Versatile Framework for Song Generation with Prompt-based Control (2025.findings-emnlp)
Copied to clipboard
Yu Zhang, Wenxiang Guo, Changhao Pan, Zhiyuan Zhu, Ruiqi Li, Jingyu Lu, Rongjie Huang, Ruiyuan Zhang, Zhiqing Hong, Ziyue Jiang, Zhou Zhao
| Challenge: | Existing methods for song generation fail to generate vocals with prompt-based control and proper alignment. |
| Approach: | VersBand is a multi-task song generation framework for synthesizing high-quality songs with prompt-based control. |
| Outcome: | Experimental results show that VersBand performs better than baseline models across multiple song generation tasks. |
Text Style Transfer Back-Translation (2023.acl-long)
Copied to clipboard
Daimeng Wei, Zhanglin Wu, Hengchao Shang, Zongyao Li, Minghan Wang, Jiaxin Guo, Xiaoyu Chen, Zhengzhe Yu, Hao Yang
| Challenge: | Current methods require large amount of bilingual training data, which is challenging and sometimes impossible task. |
| Approach: | They propose a method to modify the style of inputs by modifying the source side of BT data. |
| Outcome: | The proposed method significantly improves translation quality against popular BT benchmarks on high-resource and low-resourced language pairs. |
JurisBench: A Deep Benchmark for Assessing Large Language Models in Professional Legal Practice (2026.acl-long)
Copied to clipboard
Ziang Chen, Guannan Li, Fanlin Ji, Yipeng Kang, Jiaqi Li, Muhan Zhang, Yangtao Zhang, Li Tianjiao, Jiannan Wang, Xin Guo, Song-Chun Zhu, Bin Ling
| Challenge: | Existing legal benchmarks evaluate isolated tasks or exam-style questions, failing to capture the procedural interdependencies and adjudicative rigor inherent in professional practice. |
| Approach: | They propose a vertical, depth-oriented, domain-specific benchmark to evaluate Large Language Models (LLMs) in Chinese civil litigation. |
| Outcome: | The proposed benchmarks show that large language models exhibit an "illusion of competence" the results highlight a critical gap between fluent linguistic output and judicial reliability . |
Large Language Model-Based Event Relation Extraction with Rationales (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for ERE rely on large language models, but they face limitations. |
| Approach: | They propose an LLM-based approach with rationales for the ERE task . LLMERE transforms ERE into a question-and-answer task that may have multiple answers . |
| Outcome: | Experimental results show that LLMERE improves over existing methods. |
m3P: Towards Multimodal Multilingual Translation with Multimodal Prompt (2024.lrec-main)
Copied to clipboard
Jian Yang, Hongcheng Guo, Yuwei Yin, Jiaqi Bai, Bing Wang, Jiaheng Liu, Xinnian Liang, LinZheng Chai, Liqun Yang, Zhoujun Li
| Challenge: | Existing multimodal neural machine translation models focus on bilingual translation, but experimental results show that they outperform the text-only baselines and multilingual multimodal methods by a large margin. |
| Approach: | They propose a framework to leverage the multimodal prompt to guide the Multimodal Multilingual Neural Machine Translation (m3P) this framework aligns the representations of different languages with the same meaning and generates the conditional vision-language memory for translation. |
| Outcome: | The proposed framework outperforms previous text-only baselines and multilingual multimodal methods by a large margin. |
Enhancing Multilingual Reasoning via Steerable Model Merging (2026.findings-acl)
Copied to clipboard
Zhuoran Li, Rui Xu, Jian Yang, Junnan Liu, Zhijun Chen, Qianren Mao, Hongcheng Guo, Jiaheng Liu, Likang Xiao, Ming LI, Xiaojie Wang
| Challenge: | Model merging is an effective technique for composing the capabilities of a multilingual model and a reasoning model. |
| Approach: | They propose a model merging framework that modulates the contribution of each source model. |
| Outcome: | Experiments show that the proposed model merging framework outperforms strong baselines on multilingual reasoning benchmarks across 21 different languages. |
A Novel Paradigm Boosting Translation Capabilities of Large Language Models (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing studies on LLMs focused on supervised fine-tuning but their effectiveness has been limited. |
| Approach: | They propose a paradigm consisting of three stages: Secondary Pre-training using extensive monolingual data, Continual Pre- training with interlinear text format documents, and Leveraging source-language consistent instruction for supervised fine-tuning. |
| Outcome: | The proposed approach surpasses previous work and achieves superior performance compared to models such as NLLB-54B(CITATION) and GPT3.5-text-davinci-003. |
To See a World in a Spark of Neuron: Disentangling Multi-Task Interference for Training-Free Model Merging (2025.emnlp-main)
Copied to clipboard
Zitao Fang, Guodong Du, Shuyang Yu, Yifei Guo, Yiwei Zhang, Yiyao Cao, Jing Li, Ho-Kin Tang, Sim Kuan Goh
| Challenge: | Existing approaches to model merging ignore the fundamental roles of neurons, connectivity and activation. |
| Approach: | They propose a framework that relies on neuronal mechanisms to mitigate task interference . they decomposed task-specific representations into two complementary subspaces . their results offer new insights into mitigating task interference and improving knowledge fusion . |
| Outcome: | The proposed framework reduces task interference within neurons and improves knowledge fusion. |
ProxyQA: An Alternative Framework for Evaluating Long-Form Text Generation with Large Language Models (2024.acl-long)
Copied to clipboard
Haochen Tan, Zhijiang Guo, Zhan Shi, Lu Xu, Zhili Liu, Yunlong Feng, Xiaoguang Li, Yasheng Wang, Lifeng Shang, Qun Liu, Linqi Song
| Challenge: | Existing evaluation methods for large language models are labor-intensive and lack efficiency. |
| Approach: | They propose a framework dedicated to assessing long-text generation that includes in-depth human-curated meta-questions spanning various domains . they use a set of proxy-quests with pre-annotated answers to assess the content's quality by incorporating the generated texts as contextual background. |
| Outcome: | The proposed framework assesses the quality of long-text content by matching it with references through human evaluation or automated metrics. |
COIG-P: A High-Quality and Large-Scale Chinese Preference Dataset for Alignment with Human Values (2026.findings-eacl)
Copied to clipboard
Siwei Wu, JinCheng Ren, Xeron Du, Shuyue Guo, Xingwei Qu, Yiming Liang, Jie Liu, Yunwen Li, Tyler Loakman, Tianyu Zheng, Boyu Feng, Huaqing Yuan, Zili Wang, Jiaheng Liu, Wenhao Huang, Chenglin Cai, Haoran Que, Jian Yang, Yuelin Bai, Zekun Moore Wang, Zhouliang Yu, Qunshu Lin, Ding Pan, Yuchen Eleanor Jiang, Tiannan Wang, Wangchunshu Zhou, Shenzhi Wang, Xingyuan Bu, Minghao Liu, Guoyin Wang, Ge Zhang, Chenghua Lin
| Challenge: | Existing Chinese preference datasets suffer from limited scale, restricted domain coverage, and insufficiently rigorous data validation. |
| Approach: | They propose an LLM-based data annotation pipeline with no human intervention to annotate Chinese preference datasets. |
| Outcome: | The proposed pipeline outperforms existing Chinese preference datasets on AlignBench and Chinese Reward Benchmark. |
UniCoder: Scaling Code Large Language Model via Universal Code (2024.acl-long)
Copied to clipboard
Tao Sun, Linzheng Chai, Jian Yang, Yuwei Yin, Hongcheng Guo, Jiaheng Liu, Bing Wang, Liqun Yang, Zhoujun Li
| Challenge: | Experimental results show that UniCoder with the universal code significantly outperforms the previous prompting methods by a large margin. |
| Approach: | They introduce the universal code (UniCode) as the intermediate representation of algorithm steps using conventions of programming languages. |
| Outcome: | The proposed model outperforms previous prompting methods by a large margin . the proposed model is based on a dataset of natural-language questions and code solutions . |
Evaluating Mathematical Reasoning of Large Language Models: A Focus on Error Identification and Correction (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluations focus on problem-solving from examiner perspective, overlooking a dual perspective of examiner regarding error identification and correction. |
| Approach: | They propose to use an annotated dataset to evaluate large language models from the examiner perspective and to use diverse prompts to evaluate eleven representative LLMs. |
| Outcome: | The proposed model outperforms all models while LLaMA-2-7B has comparable abilities to closed-source models GPT-3.5 and Gemini Pro. |
AutoFigure-Edit: Generating Editable Scientific Illustrations via Reference-Guided Styling (2026.acl-demo)
Copied to clipboard
Zhen Lin, Qiujie Xie, Minjun Zhu, Shichen Li, QiYao Sun, Enhao Gu, Yiran Ding, Ke Sun, Fang Guo, Panzhong Lu, Zhiyuan Ning, Yixuan Weng, Yue Zhang
| Challenge: | Existing automated systems for scientific illustrations are limited in editability, stylistic controllability, and efficiency. |
| Approach: | They propose an end-to-end system that generates fully editable scientific illustrations from long-form scientific text while enabling flexible style adaptation through user-provided reference images. |
| Outcome: | The proposed system generates fully editable scientific illustrations from long-form scientific texts while enabling flexible style adaptation through user-provided reference images. |
Medical Dialogue System: A Survey of Categories, Methods, Evaluation and Challenges (2024.findings-acl)
Copied to clipboard
Xiaoming Shi, Zeming Liu, Li Du, Yuxuan Wang, Hongru Wang, Yuhang Guo, Tong Ruan, Jie Xu, Xiaofan Zhang, Shaoting Zhang
| Challenge: | Existing medical dialogue systems have significant potential to simplify diagnostic procedure and reduce the cost of collecting information from patients. |
| Approach: | They analyze 325 papers from well-known computer science, natural language processing conferences and journals to find out the major challenges of medical dialog systems. |
| Outcome: | The proposed systems have been surveyed in the medical community but have not been evaluated from a technical perspective. |
Self-Critique Guided Iterative Reasoning for Multi-hop Question Answering (2025.findings-acl)
Copied to clipboard
Zheng Chu, Huiming Fan, Jingchang Chen, Qianyu Wang, Mingda Yang, Jiafeng Liang, Zhongjie Wang, Hao Li, Guo Tang, Ming Liu, Bing Qin
| Challenge: | Large language models (LLMs) have demonstrated remarkable reasoning capabilities, but they still face challenges in knowledge-intensive multi-hop reasoning. |
| Approach: | They propose a method that uses self-critique feedback to guide iterative reasoning by enabling iteration and self-evaluation of its intermediate reasoning steps. |
| Outcome: | The proposed method surpasses the previous SOTA by 8.6% on three multi-hop reasoning datasets. |
Measure Twice, Click Once: Co-evolving Proposer and Visual Critic via Reinforcement Learning for GUI Grounding (2026.acl-long)
Copied to clipboard
| Challenge: | Graphical User Interface (GUI) grounding requires mapping natural language instructions to precise pixel coordinates due to visually homogeneous elements and dense layouts. |
| Approach: | They propose to replace static consistency strategies with a learnable selection mechanism that selects the optimal target by critiquing its own proposals rendered on the screenshot. |
| Outcome: | The proposed model significantly improves both grounding and critiquing capabilities over 6 benchmarks. |
DVD: Dynamic Contrastive Decoding for Knowledge Amplification in Multi-Document Question Answering (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) generate information with hallucinations due to uneven retrieval quality and irrelevant contents. |
| Approach: | They propose a decoding strategy which dynamically amplifies knowledge from selected documents during the generation phase. |
| Outcome: | The proposed method outperforms other decoding strategies on ALCE-ASQA, NQ, TQA and PopQA benchmarks. |
CAP: Controllable Alignment Prompting for Unlearning in LLMs (2026.acl-long)
Copied to clipboard
Zhaokun Wang, Jinyu Guo, Jingwen Pu, Hongli Pu, Meng Yang, Xunlei Chen, Jie Ou, Wenyi Li, Guangchun Luo, Wenhong Tian
| Challenge: | Existing methods for modifying parameters are unsystematic and rely on empirical experience. |
| Approach: | They propose a controllable alignment prompting for unlearning framework that decouples unlearning into a learnable prompt optimization process via reinforcement learning. |
| Outcome: | The proposed framework achieves precise, controllable unlearning without updating model parameters. |
VisFinEval: A Scenario-Driven Chinese Multimodal Benchmark for Holistic Financial Understanding (2025.emnlp-main)
Copied to clipboard
Zhaowei Liu, Xin Guo, Haotian Xia, Lingfeng Zeng, Fangqi Lou, Jinyi Niu, Mengping Li, Qi Qi, Jiahuan Li, Wei Zhang, Yinglong Wang, Weige Cai, Weining Shen, Liwen Zhang
| Challenge: | Existing benchmarks focus on text comprehension, but MLLMs lack the ability to integrate visual data over financial visuals. |
| Approach: | They evaluate 21 state-of-the-art multimodal large language models in a zero-shot setting . they use an annotated question–answer pair from eight common financial image modalities . |
| Outcome: | The new benchmark outperforms existing models but trailed financial experts by 14 percentage points. |
DSRAG: A Double-Stream Retrieval-Augmented Generation Framework for Countless Intent Detection (2025.naacl-industry)
Copied to clipboard
| Challenge: | Current intent detection work experiments with minor intent categories. |
| Approach: | They propose a retrieval-augmented generation framework that uses query-to-query and query- to-metadata approaches to retrieve intents from metadata. |
| Outcome: | The proposed framework improves on query-to-query (Q2Q) and query- to-metadata (Q 2M) approaches. |
Automate Strategy Finding with LLM in Quant Investment (2025.findings-emnlp)
Copied to clipboard
Zhizhuo Kou, Holam Yu, Junyu Luo, Jingshu Peng, Xujia Li, Chengzhong Liu, Juntao Dai, Lei Chen, Sirui Han, Yike Guo
| Challenge: | Experimental results demonstrate robust performance of the strategy in Chinese & US market regimes compared to established benchmarks. |
| Approach: | They propose a framework leveraging Large Language Models within a risk-aware multi-agent system for automate strategy finding in quantitative finance. |
| Outcome: | The proposed framework outperforms all benchmarks in Chinese & US market regimes with 53.17% cumulative return on SSE50. |
QaRL: Rollout-Aligned Quantization-Aware RL for Fast and Stable Training under Training–Inference Mismatch (2026.findings-acl)
Copied to clipboard
Hao Gu, Hao Wang, Jiacheng Liu, Lujun Li, Qiyuan Zhu, Bei Liu, Binxing Xu, Lei Wang, Xintong Yang, Sida Lin, Sirui Han, Yike Guo
| Challenge: | Recent work has shown that reinforcement learning with simple rule-based reward functions (RLVR) can induce emergent reasoning behaviors and yield gains in challenging domains such as math problem solving. |
| Approach: | They propose a rollout-alignment-quantization-aware RL which aligns training-side forward with the quantized rollout to minimize mismatch. |
| Outcome: | The proposed approach outperforms quantized-rollout training by +5.5 on Qwen3-30B-A3B MoE for math problems while maintaining low-bit throughput. |
Multi-Scale Progressive Attention Network for Video Question Answering (2021.acl-short)
Copied to clipboard
| Challenge: | Experimental evaluations on three benchmarks: TGIF-QA, MSVD-QA and MSRVTT-QA show our method has achieved state-of-the-art performance. |
| Approach: | They propose a multi-scale progressive attention network to fuse visual and text information. |
| Outcome: | The proposed method achieves state-of-the-art on three benchmarks: TGIF-QA, MSVD-QA and MSRVTT-QA. |
Safeguarding LLM Fine-tuning via Push-Pull Distributional Alignment (2026.acl-long)
Copied to clipboard
| Challenge: | Existing safety defenses for large language models fail to explicitly repel harmful patterns . Optimal transport (SOT) allows for safe fine-tuning without sacrificing safety . |
| Approach: | They propose a framework that reframes safe fine-tuning from instance-level filtering challenge to distribution-level alignment task grounded in Optimal Transport. |
| Outcome: | a new framework improves safety of large language models while maintaining competitive performance . the proposed framework reduces the risk of errors and improves model performance compared to baselines . |
LegalReasoner: Step-wised Verification-Correction for Legal Judgment Reasoning (2025.acl-long)
Copied to clipboard
Weijie Shi, Han Zhu, Jiaming Ji, Mengze Li, Jipeng Zhang, Ruiyuan Zhang, Jia Zhu, Jiajie Xu, Sirui Han, Yike Guo
| Challenge: | Existing legal judgment prediction methods struggle with logical errors when conducting complex legal reasoning. |
| Approach: | They propose a method which enhances LJP reliability through step-wise verification and correction of the reasoning process. |
| Outcome: | The proposed model significantly improves concordance with court decisions from 72.37 to 80.27 on LLAMA-3.1-70B. |
Beyond the Safety Tax: Mitigating Unsafe Text-to-Image Generation via External Safety Rectification (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing safety defenses typically intervene internally within the generative model, but suffer from severe concept entanglement, leading to degradation of benign generation quality. |
| Approach: | They propose a structurally isolated safety module that performs external, interpretable rectification without modifying the base model. |
| Outcome: | The proposed module performs external, interpretable rectification without modifying the base model. |
DREAM: Disentangling Risks to Enhance Safety Alignment in Multimodal Large Language Models (2025.naacl-long)
Copied to clipboard
Jianyu Liu, Hangyu Guo, Ranjie Duan, Xingyuan Bu, Yancheng He, Shilong Li, Hui Huang, Jiaheng Liu, Yucheng Wang, Chenchen Jing, Xingwei Qu, Xiao Zhang, Pei Wang, Yanan Wu, Jihao Gu, Yangguang Li, Jianke Zhu
| Challenge: | Multimodal Large Language Models (MLLMs) pose unique safety challenges due to their integration of visual and textual data. |
| Approach: | They propose a method to disentangle risks through step-by-step reasoning within multimodal inputs. |
| Outcome: | The proposed approach improves safety alignment in MLLMs by fine-tuning and iterative Reinforcement Learning from AI feedback. |
Mathematical Proof as a Litmus Test: Revealing Failure Modes of Advanced Large Reasoning Models (2026.acl-long)
Copied to clipboard
| Challenge: | Large reasoning models have demonstrated remarkable mathematical problem-solving abilities, but their true reasoning shortcomings are often hidden. |
| Approach: | They propose to leverage the rigor and methodological complexity of mathematical proofs as a diagnostic tool to expose hidden failures. |
| Outcome: | The proposed model evaluation exploits the rigor and complexity of proof problems to uncover 10 fine-grained errors. |
FAQ: Mitigating Quantization Error via Regenerating Calibration Data with Family-Aware Quantization (2026.findings-acl)
Copied to clipboard
| Challenge: | representativeness and universality of calibration data remain a bottleneck in quantization accuracy. |
| Approach: | They propose a framework that leverages prior knowledge from LLMs to generate calibration samples . their framework reduces accuracy loss by up to 28.5% compared to baseline . |
| Outcome: | Experiments show that family-aware quantization reduces accuracy loss by up to 28.5% compared to baseline data. |
CoRAG: Enhancing Hybrid Retrieval-Augmented Generation through a Cooperative Retriever Architecture (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods only retrieve related documents from local neighbors or subgraphs in the knowledge base, which often miss relevant information located further away from a global view. |
| Approach: | Hybrid-RAG combines textual documents and graph-structured relational information for RAG . existing methods only retrieve related documents from local neighbors or subgraphs in the knowledge base . |
| Outcome: | Hybrid-RAG combines textual documents and graph-structured relational information . existing methods only retrieve related documents from local neighbors or subgraphs in the knowledge base . |
PKU-SafeRLHF: Towards Multi-Level Safety Alignment for LLMs with Human Preference (2025.acl-long)
Copied to clipboard
Jiaming Ji, Donghai Hong, Borong Zhang, Boyuan Chen, Josef Dai, Boren Zheng, Tianyi Alex Qiu, Jiayi Zhou, Kaile Wang, Boxun Li, Sirui Han, Yike Guo, Yaodong Yang
| Challenge: | Using large-scale annotation data, large language models can generate noise, errors and biases, leading to unexpected behaviours. |
| Approach: | They propose a dataset to promote safety alignment in large language models . they separate helpfulness and harmlessness annotations for question-answering pairs . |
| Outcome: | The proposed dataset provides 44.6k prompts and 265k question-answer pairs with safety meta-labels for 19 harm categories and three severity levels, with answers generated by Llama-family models. |
Triggerless Backdoor Attack for NLP Tasks with Clean Labels (2022.naacl-main)
Copied to clipboard
Leilei Gan, Jiwei Li, Tianwei Zhang, Xiaoya Li, Yuxian Meng, Fei Wu, Yi Yang, Shangwei Guo, Chun Fan
| Challenge: | Backdoor attacks are a new threat to neural natural language processing models due to the fragility and lack of interpretability of NLP models. |
| Approach: | They propose a method to perform backdoor attacks without an external trigger . they propose to use clean-labeled examples to generate poisoned clean-labelled examples . |
| Outcome: | The proposed strategy is effective and hard to defend due to its triggerless nature. |
LCMA-SRT: Language-Conditional Mixture-of-Experts Adapters for Joint Multilingual Speech Recognition and Translation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing hierarchical transducers suffer from negative transfer and unstable target-language generation, while training separate models for each direction is computationally prohibitive. |
| Approach: | They propose a hierarchical transducer with language-conditional Mixture-of-Experts adapters to improve multilingual joint automatic speech recognition and speech translation. |
| Outcome: | Experiments on Europarl-ST (9 languages, 72 directions) show that LCMA-SRT improves both ASR and ST within a single joint model, reducing average WER and improving BLEU and COMET over strong hierarchical transducer baselines. |
APLOT: Robust Reward Modeling via Adaptive Preference Learning with Optimal Transport (2025.emnlp-main)
Copied to clipboard
| Challenge: | Experimental results show that RLHF improves performance of Large Language Models . BT-based RMs struggle to distinguish between similar preference responses . |
| Approach: | They propose to enhance BT-based reward models by using an adaptive margin mechanism . they use semantic similarity and reward-predicted reward differences to adjust focus . |
| Outcome: | Experimental results show that the proposed method outperforms existing methods in both in-distribution and OOD settings. |
DeepPlanning: Benchmarking Long-Horizon Agentic Planning with Verifiable Constraints (2026.acl-long)
Copied to clipboard
Yinger Zhang, Shutong Jiang, Renhao Li, Jianhong Tu, Yang Su, Lianghao Deng, Xudong Guo, ChenXu Lv, Junyang Lin
| Challenge: | Existing LLM planning benchmarks emphasize local, step-level reasoning rather than global constrained optimization. |
| Approach: | They propose a benchmark for practical long-horizon agent planning that uses local constrained reasoning and global constrained optimization. |
| Outcome: | The proposed benchmarks show that even frontier agentic LLMs struggle with these problems. |
Enhancing Large Language Models for Document-Level Translation Post-Editing Using Monolingual Data (2025.coling-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have excellent performance in many tasks, but they still face challenges in document translation. |
| Approach: | They propose a method that leverages the capabilities of Large Language Models to optimize document translation using only monolingual data. |
| Outcome: | The proposed method improves translation quality and improves contextual consistency in document translation using only monolingual data. |
Event Causality Extraction via Implicit Cause-Effect Interactions (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies have not exploited the interactions between the cause and effect event that could provide crucial clues for causality reasoning. |
| Approach: | They propose an Implicit Cause-Effect interaction framework which captures the implicit intra- and inter-event interactions by incorporating the privileged information for reasoning. |
| Outcome: | The proposed framework captures the implicit intra- and inter-event interactions by incorporating the privileged information (ground truth event types and arguments) for reasoning. |
Transkimmer: Transformer Learns to Layer-wise Skim (2022.acl-long)
Copied to clipboard
| Challenge: | Prior work has proposed to augment Transformer model with the capability of skimming tokens to improve its computational efficiency. |
| Approach: | They propose to add a parameterized predictor before each layer that learns to make the skimming decision. |
| Outcome: | The proposed model achieves 10.97x speedup on GLUE benchmark compared with BERT-base baseline with less than 1% accuracy degradation. |
Beyond the Granularity: Multi-Perspective Dialogue Collaborative Selection for Dialogue State Tracking (2022.acl-long)
Copied to clipboard
| Challenge: | Experimental results show that task-oriented dialogue systems have attracted growing attention and achieved substantial progress. |
| Approach: | They propose a method that dynamically selects relevant dialogue contents for each slot . they retrieve turn-level utterances and evaluate their relevance to the slot from three perspectives . |
| Outcome: | The proposed method achieves state-of-the-art performance on MultiWOZ 2.1 and MultiWOz 2.2 and superior performance on multiple mainstream benchmark datasets. |
Adaptive Feature Discrimination and Denoising for Asymmetric Text Matching (2022.coling-1)
Copied to clipboard
| Challenge: | Existing models focus on asymmetric text matching but rarely perform feature denoising . existing models focus only on recognizing discriminative features and filtering out irrelevant features . |
| Approach: | They propose a novel adaptive feature discrimination and denoising model for asymmetric text matching . it explicitly distinguishes discriminative features and filters out irrelevant features in context . |
| Outcome: | The proposed model achieves significant performance gains over current state-of-the-art models on four real-world datasets. |
EchoMLLM: Incentivizing Echocardiographic Video Understanding with Keyframe Grounding and Report Generation (2026.findings-acl)
Copied to clipboard
Heyu Huang, Wanran Sun, Chi Chen, Bo Chen, Zonghao Guo, Yuhua Li, Ruixuan Li, Kunlun He, Maosong Sun
| Challenge: | Echocardiography analysis requires a dual capability: rigorous quantitative keyframe localization and comprehensive qualitative synthesis. |
| Approach: | They propose a unified framework designed for real-world echocardiography video understanding. |
| Outcome: | a new framework is designed to support real-world echocardiography video understanding . it reduces temporal grounding errors by up to 76% and improves report generation quality by 65% . |
Document-level Relation Extraction with Dual-tier Heterogeneous Graph (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods focus on extracting relations from single sentence . document-level relation extraction requires a comprehension of the whole document . |
| Approach: | They propose a graph-based model with Dual-tier Heterogeneous Graph (DHG) for document-level relation extraction. |
| Outcome: | The proposed model achieves state-of-the-art performance on two widely used datasets. |
DPEPO: Diverse Parallel Exploration Policy Optimization for LLM-based Agents (2026.acl-long)
Copied to clipboard
JunShuo Zhang, Chengrui Huang, Feng Guo, Zihan Li, Ke Shi, Menghua Jiang, Jiguo Yu, Shuo Shang, Shen Gao
| Challenge: | Existing approaches to large language model (LLM) agents that follow the sequential "reason-then-act" paradigm suffer from limited exploration and incomplete environmental understanding as they interact with only a single environment per step. |
| Approach: | They propose a paradigm that enables an agent to interact with multiple environments simultaneously and share cross-trajectory experiences. |
| Outcome: | The proposed paradigm achieves state-of-the-art (SOTA) success rates while maintaining comparable efficiency to strong sequential baselines. |
GPT-NER: Named Entity Recognition via Large Language Models (2025.findings-naacl)
Copied to clipboard
Shuhe Wang, Xiaofei Sun, Xiaoya Li, Rongbin Ouyang, Fei Wu, Tianwei Zhang, Jiwei Li, Guoyin Wang, Chen Guo
| Challenge: | Large-scale language models (LLMs) have shown impressive ability for in-context learning with limited training data. |
| Approach: | They propose a novel sequence labeling task that transforms a sequence labeled as a text-generation task into a self-verification task that LLMs can adapt to. |
| Outcome: | The proposed model performs better on NER than supervised models on a variety of tasks . the proposed model can be easily adapted by LLMs to generate a text sequence . |
Towards Multi-System Log Anomaly Detection (2025.acl-industry)
Copied to clipboard
| Challenge: | Existing models require dataset-specific training, causing costly procedures and performance bottlenecks. |
| Approach: | They propose a log anomaly detection model with semantic relational reasoning that extracts cross-system semantic patterns and encodes them as high-dimensional learnable vectors. |
| Outcome: | The proposed model extracts cross-system semantic patterns and encodes them as high-dimensional learnable vectors. |
Understanding Unnatural Questions Improves Reasoning over Text (2020.coling-main)
Copied to clipboard
| Challenge: | Complex question answering (CQA) requires large amounts of human-annotated data . learning effective CQA requires large amount of human annotated . |
| Approach: | They propose to map human-generated questions into unnatural machine-generated ones . they generate synthetic pairs and train a parser that associates synthetic questions with their corresponding action sequences. |
| Outcome: | The proposed model outperforms the state-of-the-art model trained on human-labeled data. |
Text-centric Alignment for Bridging Test-time Unseen Modality (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a text-centric alignment method is used to handle unseen modalities and dynamic modality combinations at test time. |
| Approach: | They propose a text-centric alignment method that unifies different input modalities into a single semantic text representation by leveraging in-context learning with Large Language Models and uni-modal foundation models. |
| Outcome: | The proposed method unifies input modalities into a single semantic representation . it significantly improves the ability to manage unseen, diverse, and unpredictable modality combinations . |
Fusion Makes Perfection: An Efficient Multi-Grained Matching Approach for Zero-Shot Relation Extraction (2024.naacl-short)
Copied to clipboard
| Challenge: | Existing methods to extract unseen relations require laborious manual annotation . a new approach uses fine-grained matching to reduce manual annotation cost . |
| Approach: | They propose an efficient multi-grained matching approach that uses virtual entity matching to reduce manual annotation cost. |
| Outcome: | The proposed approach outperforms the state-of-the-art methods and achieves inference efficiency and accuracy in zero-shot relation extraction tasks. |
Evaluating Robustness of Generative Search Engine on Adversarial Factoid Questions (2024.findings-acl)
Copied to clipboard
Xuming Hu, Xiaochuan Li, Junzhe Chen, Yinghui Li, Yangning Li, Xiaoguang Li, Yasheng Wang, Qun Liu, Lijie Wen, Philip Yu, Zhijiang Guo
| Challenge: | Existing large language models (LLMs)-backed generative search engines may not always be accurate. |
| Approach: | They propose to evaluate the robustness of retrieval-augmented generation in a realistic and high-risk setting where adversaries have only black-box system access. |
| Outcome: | The proposed model exhibits higher susceptibility to factual errors compared to LLMs without retrieval. |
A Survey of Inductive Reasoning for Large Language Models (2026.acl-long)
Copied to clipboard
Kedi Chen, Dezhao Ruan, Yuhao Dan, Yaoting Wang, Siyu Yan, Xuecheng Wu, Yinqi Zhang, Qin Chen, Jie Zhou, Liang He, Biqing Qi, Linyang Li, Qipeng Guo, Xiaoming Shi, Wei Zhang
| Challenge: | Inductive reasoning is an important task for large language models (LLMs). |
| Approach: | They propose a survey of inductive reasoning for large language models . they categorize methods into three main areas: post-training enhancement, test-time exploration, and data augmentation. |
| Outcome: | The proposed method improves inductive reasoning in large language models. |
PAR2-RAG: Planned Active Retrieval and Reasoning for Multi-Hop Question Answering (2026.acl-industry)
Copied to clipboard
| Challenge: | Multi-hop question answering is a practical bottleneck in industry applications . large language models (LLMs) fail frequently when evidence coverage is incomplete or reasoning trajectories drift . |
| Approach: | They propose a training-free two-stage framework that separates coverage from commitment . it performs breadth-first anchoring to build a high-recall evidence frontier . compared with IRCoT, it achieves 23.5% higher answer accuracy . |
| Outcome: | The proposed framework outperforms strong baselines in MHQA benchmarks and achieves 23.5% higher answer accuracy and 10.5% NDCG gains in retrieval quality. |
ABC-Bench: Benchmarking Agentic Backend Coding in Real-World Development (2026.findings-acl)
Copied to clipboard
Jie Yang, Honglin Guo, Li Ji, Jiazheng Zhou, Rui Zheng, Zhikai Lei, Shuo Zhang, Zhiheng Xi, Shichun Liu, Yuxin Wang, Bo Wang, Yining Zheng, Tao Gui, Xipeng Qiu
| Challenge: | Large Language Models (LLMs) have redefined the role of AI in software engineering . current benchmarks focus on localized code generation, but neglect dynamic, full-process requirements of real-world engineering. |
| Approach: | They propose a benchmark to evaluate agentic backend coding within a realistic, executable workflow. |
| Outcome: | The ABC-Bench benchmark evaluates agentic backend coding within a realistic, executable workflow. |
Mitigating Shortcut Learning via Smart Data Augmentation based on Large Language Model (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods to improve shortcut learning performance are limited by manual definition of shortcuts and inherent confirmation bias during model training. |
| Approach: | They propose a method of Smart Data Augmentation based on Large Language Models to identify shortcuts and generate their anti-shortcut counterparts. |
| Outcome: | The proposed method shows an improvement of 5.61% across various natural language processing tasks. |
Aligning Agents via Planning: A Benchmark for Trajectory-Level Reward Modeling (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) evolve into agentic systems capable of autonomous tool invocation and complex reasoning. |
| Approach: | They propose a trajectory-level preference benchmark to evaluate judges' ability to distinguish preferred versus distractor agent trajectories in tool-integrated environments. |
| Outcome: | The proposed benchmark evaluates how well judges distinguish preferred versus distractor agent trajectories in complex tool-using scenarios. |
When Slower Isn’t Truer: Inverse Scaling Law of Truthfulness in Multimodal Reasoning (2026.findings-acl)
Copied to clipboard
Sitong Fang, Wenjing Cao, Jiahao Li, Xuyao Wang, Chi-Min Chan, Sirui Han, Juntao Dai, Yike Guo, Yaodong Yang, Jiaming Ji
| Challenge: | a study of slow reasoning models for multimodal reasoning finds that they are more prone to fabricating plausible yet false details when confronted with incomplete or misleading visual inputs. |
| Approach: | They conduct the first systematic study of the inverse scaling law in slow-thinking paradigms for multimodal reasoning. |
| Outcome: | The findings suggest that slower reasoning models are more prone to fabricating false details . the study analyzed 5,000-sample hierarchical prompt dataset by 50 participants . |
Improving Chinese Spelling Check by Character Pronunciation Prediction: The Effects of Adaptivity and Granularity (2022.emnlp-main)
Copied to clipboard
| Challenge: | Chinese spelling check (CSC) is a fundamental NLP task that detects and corrects spelling errors in Chinese texts. |
| Approach: | They propose an auxiliary task of Chinese pronunciation prediction to improve CSC . they propose adaptive weighting schemes and a delicate correction strategy . |
| Outcome: | The proposed auxiliary task improves Chinese pronunciation prediction on three benchmarks. |
Beyond End-to-End: Dynamic Chain Optimization for Private LLM Adaptation on the Edge (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are revolutionizing mobile intelligence, but their implementation on mobile devices is severely bottlenecked by the prohibitive resource demands of LLMs. |
| Approach: | They propose a paradigm that forgoes end-to-end updates in favor of a sequential, layer-by-layer manner. |
| Outcome: | Extensive experiments on multiple benchmarks demonstrate the superiority of ChainFed over existing methods, boosting average accuracy by up to 46.46%. |
Combining the Best of Both Worlds: A Method for Hybrid NMT and LLM Translation (2025.findings-acl)
Copied to clipboard
Zhanglin Wu, Daimeng Wei, Xiaoyu Chen, Hengchao Shang, Jiaxin Guo, Zongyao Li, Yuanchang Luo, Jinlong Yang, Zhiqiang Rao, Hao Yang
| Challenge: | Large language models have advantages over neural machine translation systems, but they suffer from high computational costs and significant latency. |
| Approach: | They propose a scheduling policy that optimizes translation result while ensuring fast speed and as little LLM usage as possible. |
| Outcome: | The proposed model achieves optimal translation performance with less LLM usage on multilingual test sets. |
Chinese SimpleQA: A Chinese Factuality Evaluation for Large Language Models (2025.acl-long)
Copied to clipboard
Yancheng He, Shilong Li, Jiaheng Liu, Yingshui Tan, Weixun Wang, Hui Huang, Xingyuan Bu, Hangyu Guo, Chengwei Hu, Boren Zheng, Zhuoran Lin, Dekai Sun, Zhicheng Zheng, Wenbo Su, Bo Zheng
| Challenge: | Current frontier models sometimes generate false outputs or answers that are not substantiated by evidence. |
| Approach: | They propose Chinese SimpleQA, a Chinese benchmark to evaluate LLMs' factuality . they focus on Chinese language over 6 major topics with 99 diverse subtopics . |
| Outcome: | The Chinese SimpleQA benchmark evaluates the factuality ability of LLMs . the questions and answers are short and easy-to-evaluate . |
mABC: Multi-Agent Blockchain-inspired Collaboration for Root Cause Analysis in Micro-Services Architecture (2024.findings-emnlp)
Copied to clipboard
Wei Zhang, Hongcheng Guo, Jian Yang, Zhoujin Tian, Yi Zhang, Yan Chaoran, Zhoujun Li, Tongliang Li, Xu Shi, Liangfan Zheng, Bo Zhang
| Challenge: | Root cause analysis (RCA) in Micro-services architectures with escalating complexity is challenging due to fault propagation and circular dependencies among nodes. |
| Approach: | They propose a framework where multiple agents follow Agent Workflow and collaborate in blockchain-inspired voting to ensure the reliability of root cause analysis. |
| Outcome: | The proposed framework reduces the number of steps and standardizes task processing through Agent Workflow. |
Migician: Revealing the Magic of Free-Form Multi-Image Grounding in Multimodal Large Language Models (2025.findings-acl)
Copied to clipboard
You Li, Heyu Huang, Chi Chen, Kaiyu Huang, Chao Huang, Zonghao Guo, Zhiyuan Liu, Jinan Xu, Yuhua Li, Ruixuan Li, Maosong Sun
| Challenge: | Existing MLLMs still struggle to achieve precise grounding in multi-image scenarios. |
| Approach: | They propose a Chain-of-Thought framework that integrates single-image grounding with multi-image comprehension to address this challenge. |
| Outcome: | The proposed model outperforms existing models in multi-image grounding tasks by 24.94% and surpasses larger 70B models. |
ViPE: Visual Perception in Parameter Space for Efficient Video-Language Understanding (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing video-language models rely on concatenating visual tokens with textual inputs for joint modeling, but this method suffers from significant inefficiency when scaling to long videos with dense visual inputs. |
| Approach: | They propose a video-to-parameter efficiency paradigm called ViPE that transforms video content into visual perceptual weights, which are directly injected into the LLM’s parameters. |
| Outcome: | The proposed model reduces FLOPs by 85% and inference time by up to 65% while reducing FLOP and FLOP inference times by up-to-65%. |
Jiuge: A Human-Machine Collaborative Chinese Classical Poetry Generation System (P19-3)
Copied to clipboard
Guo Zhipeng, Xiaoyuan Yi, Maosong Sun, Wenhao Li, Cheng Yang, Jiannan Liang, Huimin Chen, Yuhui Zhang, Ruoyu Li
| Challenge: | Existing systems for automatic poetry generation are model-oriented, resulting in poor user participation. |
| Approach: | They propose a human-machine collaborative Chinese classical poetry generation system called Jiuge . Jiuge allows users to revise unsatisfied parts of a generated poem draft repeatedly . |
| Outcome: | The proposed system allows users to revise unsatisfied parts of a generated poem draft repeatedly. |
Semantic-Eval : A Semantic Comprehension Evaluation Framework for Large Language Models Generation without Training (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have emerged as key drivers of progress in the field of natural language processing. |
| Approach: | They propose a framework that assesses LLM-generated text based on semantic understanding. |
| Outcome: | The proposed framework surpasses traditional evaluation metrics and lags behind GPT-4. |
LLMBox: A Comprehensive Library for Large Language Models (2024.acl-demos)
Copied to clipboard
Tianyi Tang, Hu Yiwen, Bingqian Li, Wenyang Luo, ZiJing Qin, Haoxiang Sun, Jiapeng Wang, Shiyi Xu, Xiaoxue Cheng, Geyang Guo, Han Peng, Bowen Zheng, Yiru Tang, Yingqian Min, Yushuo Chen, Jie Chen, Ranchi Zhao, Luran Ding, Yuhao Wang, Zican Dong, Xia Chunxuan, Junyi Li, Kun Zhou, Xin Zhao, Ji-Rong Wen
| Challenge: | a library to facilitate the development, use, and evaluation of large language models (LLMs) is presented. |
| Approach: | They propose a unified library to facilitate the development, use and evaluation of large language models (LLMs). |
| Outcome: | The proposed library is based on extensive experiments in a variety of evaluation settings. |
Soft-Labeled Contrastive Pre-Training for Function-Level Code Representation (2022.findings-emnlp)
Copied to clipboard
Xiaonan Li, Daya Guo, Yeyun Gong, Yun Lin, Yelong Shen, Xipeng Qiu, Daxin Jiang, Weizhu Chen, Nan Duan
| Challenge: | Existing methods for contrastive pre-training ignore the relevance between codes in large code corpus. |
| Approach: | They propose a Soft-labeled contrastive pre-training framework with positive sample construction methods to learn functional-level code representation. |
| Outcome: | The proposed framework can obtain fine-grained soft-labels through an iterative adversarial manner and use them to learn better code representation. |
ProMedTS: A Self-Supervised, Prompt-Guided Multimodal Approach for Integrating Medical Text and Time Series (2025.findings-acl)
Copied to clipboard
Shuai Niu, Jing Ma, Hongzhan Lin, Liang Bai, Zhihua Wang, V. W., Richard Yi Da Xu, Guo Li, Xian Yang
| Challenge: | Large language models excel at processing unstructured data, but integrating time series data with text remains a challenge. |
| Approach: | They propose a self-supervised multimodal framework that uses prompt-guided learning to unify heterogeneous data types. |
| Outcome: | The proposed framework outperforms state-of-the-art approaches on disease diagnosis tasks using real-world datasets. |
"I Don’t Know What to Say": A Fact-Filling Questionnaire Method to Help Non-Experts Talk to LegalAI Assistant (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have greatly expanded the scope of legal AI. |
| Approach: | They propose a method that generates questionnaires to help users refine queries . they leverage an iterative training process that collects valuable questionnaires . |
| Outcome: | The proposed method improves the completeness of queries and ensures the performance of domain-specific models in downstream legal tasks. |
Self-Supervised Detection of Contextual Synonyms in a Multi-Class Setting: Phenotype Annotation Use Case (2021.emnlp-main)
Copied to clipboard
Jingqing Zhang, Luis Bolanos Trujillo, Tong Li, Ashwani Tanwar, Guilherme Freire, Xian Yang, Julia Ive, Vibhor Gupta, Yike Guo
| Challenge: | Contextualised word embeddings are powerful tool to detect contextual synonyms, but most of the current SOTA methods are supervised and underexploit the potential of the context. |
| Approach: | They propose a self-supervised approach which detects contextual synonyms of concepts being trained on the data created by shallow matching. |
| Outcome: | The proposed approach outperforms the previous SOTA with gains of up to 4.5 and 4.0 absolute points after fine-tuning with as little as 20% of the labelled data. |
JudgeAgent: Beyond Static Benchmarks for Knowledge-Driven and Dynamic LLM Evaluation (2026.findings-acl)
Copied to clipboard
Zhichao Shi, Xuhui Jiang, Chengjin Xu, Cangli Yao, Shengjie Ma, Yinghan Shen, Zixuan Li, Jian Guo, Yuanzhuo Wang
| Challenge: | Current evaluation methods for large language models rely on static benchmarks . limited knowledge coverage and fixed difficulties hinder the targeted optimizations resulting in superficial evaluations of LLMs - a problem that has been addressed by JudgeAgent . |
| Approach: | They propose a knowledge-driven and dynamic evaluation framework for large language models . judgeAgent leverages LLM agents equipped with context graphs to traverse knowledge structures . |
| Outcome: | The proposed framework can achieve comprehensive evaluations and facilitate effective model iterations. |
The GaoYao Benchmark: A Comprehensive Framework for Evaluating Multilingual and Multicultural Abilities of Large Language Models (2026.acl-long)
Copied to clipboard
Yilun Liu, Chunguang Zhao, Mengyao Piao, Lingqi Miao, Shimin Tao, Minggui HE, Chenxin Liu, Zhang Li, null Mahongxia, Jiaxin Guo, Chen Liu, Liqun Deng, Jiansheng Wei, Xiaojun Meng, Fanyi Du, Daimeng Wei, Yanghua Xiao
| Challenge: | Existing multilingual evaluation benchmarks neglect cultural nuances and lack language coverage in subjective tasks. |
| Approach: | They propose a framework that categorizes evaluation tasks into three cultural layers and nine cognitive sub-layers. |
| Outcome: | The proposed framework surpasses prior coverage by up to 111% on 20+ LLMs. |
Slot Dependency Modeling for Zero-Shot Cross-Domain Dialogue State Tracking (2022.coling-1)
Copied to clipboard
| Challenge: | Existing zero-shot learning methods ignore slot dependencies in a multidomain dialogue . experimental results show the effectiveness of our proposed method over existing state-of-art generation methods . |
| Approach: | They propose to use slot prompts combination, slot values demonstration and slot constraint object to model slot-slot dependency, slot-value dependency and slot-context dependency respectively. |
| Outcome: | The proposed method outperforms state-of-the-art methods under zero-shot/few-shot settings. |
BayesKD: Bayesian Knowledge Distillation for Compact LLMs in Constrained Fine-tuning Scenarios (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have revolutionized various domains with their remarkable capabilities, but their massive parameter sizes pose significant challenges for fine-tuning and inference. |
| Approach: | They propose a Bayesian Knowledge Distillation framework for compact Large Language Models in resource-constrained fine-tuning scenarios that employs Logits Dual-Scaling, Knowledge Alignment Module, and Bayes Distillations Optimization. |
| Outcome: | The proposed framework outperforms baseline methods on various state-of-the-art LLMs, including LLaMA, Qwen2, Bloom, and Vicuna. |
Outcome-Grounded Advantage Reshaping for Fine-Grained Credit Assignment in Mathematical Reasoning (2026.acl-long)
Copied to clipboard
Ziheng Li, Liu Kang, Feng Xiao, Luxi Xing, Qingyi Si, Zhuoran Li, Weikang Gong, Deqing Yang, Yanghua Xiao, Hongcheng Guo
| Challenge: | Group Relative Policy Optimization (GRPO) uses a coarse-grained credit assignment mechanism that propagates group-level rewards uniformly to to every token in a sequence, neglecting the varying contribution of individual reasoning steps. |
| Approach: | They introduce Outcome-grounded Advantage Reshaping (OAR) which redistributes advantages based on how much each token influences the model’s final answer. |
| Outcome: | Empirical results show that OAR-G outperforms GRPO on a high-fidelity attribution signal and suppresses low-impact tokens while preserving the advantage mass. |
Beyond the Crowd: LLM-Augmented Community Notes for Governing Health Misinformation (2026.acl-long)
Copied to clipboard
| Challenge: | X (formerly Twitter) users can flag misleading posts, attach contextual notes, and rate the notes’ helpfulness, but there is a significant latency in Community Notes, which is unable to provide accurate notes. |
| Approach: | They propose a framework that augments Community Notes for faster and more reliable health misinformation governance. |
| Outcome: | The proposed framework outperforms human contributors in correctness, helpfulness, and evidence utility in health misinformation surges. |
Knowledge Fusion By Evolving Weights of Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Experimental results on mainstream language models show that Evolver outperforms previous state-of-the-art models by large margins due to the high training costs of large language models. |
| Approach: | They propose a method to integrate multiple models from diverse training scenarios into a unified model. |
| Outcome: | The proposed method outperforms state-of-the-art models on mainstream language models by large margins. |
HyperMem: Hypergraph Memory for Long-Term Conversations (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to long-term memory management rely on pairwise relations, causing fragmented retrieval. |
| Approach: | They propose a hypergraph-based hierarchical memory architecture that explicitly models high-order associations using hyperedges. |
| Outcome: | Experiments show that HyperMem achieves state-of-the-art performance with 92.73% accuracy for long-term conversations. |
Multi-view Classification Model for Knowledge Graph Completion (2020.aacl-main)
Copied to clipboard
| Challenge: | Existing knowledge graph completion models only evaluated candidate triples from content information. |
| Approach: | They propose a multi-view classification model where multiple views are performed based on both content and context information for candidate triple evaluation. |
| Outcome: | The proposed model improves on two representative datasets and improves performance. |
DynamicKV: Task-Aware Adaptive KV Cache Compression for Long Context LLMs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing KV cache compression methods enforce a fixed pattern, neglecting task-specific characteristics, which hampers the effective retention of essential information while discarding less important tokens. |
| Approach: | They propose a Task-Aware KV cache mechanism that dynamically adjusts the KV caching size across different layers based on the characteristics of the tasks. |
| Outcome: | The proposed method surpasses state-of-the-art methods by 11% on the LongBench dataset even under extreme compression (0.9%) |
Text Classification via Large Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large-scale Language Models (LLMs) have shown the ability for in-context learning. |
| Approach: | They propose a progressive reasoning strategy tailored to addressing complex linguistic phenomena such as intensification, contrast, irony and limited number of tokens allowed in in-context learning. |
| Outcome: | The proposed model performs better on 4 out of 5 widely-used text-classification benchmarks, while demonstrating comparable performance to SOTA on MR. |
PerSphere: A Comprehensive Framework for Multi-Faceted Perspective Retrieval and Summarization (2025.acl-long)
Copied to clipboard
| Challenge: | Experimental results show that the main challenge lies in long context and perspective extraction. |
| Approach: | They propose a benchmark to facilitate multi-faceted perspective retrieval and summarization . they propose measurable metrics to evaluate the comprehensiveness of the retrieval pipeline . |
| Outcome: | The proposed system breaks free from information silos by combining two opposing claims . it can be used to extract multiple perspectives and improve performance on the platform . |
BackdoorAgent: A Unified Framework for Backdoor Attacks on LLM-based Agents (2026.findings-acl)
Copied to clipboard
Yunhao Feng, Yige Li, Yutao Wu, Yingshui Tan, Yanming Guo, Yifan Ding, Kun Zhai, Xingjun Ma, Yu-Gang Jiang
| Challenge: | Large language model (LLM) agents execute tasks through multi-step workflows that combine planning, memory, and tool use. |
| Approach: | They propose a modular framework that provides a unified view of backdoor threats in LLM agents. |
| Outcome: | The proposed framework provides a unified, agent-centric view of backdoor threats in LLM agents. |
Contrastive Learning on LLM Back Generation Treebank for Cross-domain Constituency Parsing (2025.acl-long)
Copied to clipboard
| Challenge: | Existing constituency treebanks are limited in out-of-domain settings, therefore constituency parsing is still a challenge. |
| Approach: | They propose a novel method for constituency parsing using large language models . they use a cross-domain constituency treebank to fill missing words with the incomplete one . |
| Outcome: | The proposed method achieves state-of-the-art performance on average compared with baselines on five target domains of MCTB. |
Isotropy-Enhanced Conditional Masked Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing non-autoregressive models with auto-regressing decoding paradigms have been used for various text generation tasks to accelerate inference but at the cost of generation quality to some extent. |
| Approach: | They propose to use Look Neighbors strategy to enhance learning of target token representations during training to achieve a good balance between inference speedup and generation quality. |
| Outcome: | The proposed models outperform current models on 4 WMT datasets and outperformed the current SoTA results. |
C3LRSO: A Chinese Corpus for Complex Logical Reasoning in Sentence Ordering (2025.coling-main)
Copied to clipboard
| Challenge: | Existing sentence ordering datasets for non-English languages are unavailable. |
| Approach: | They propose a parameter-free sentence ordering dataset that provides genuinely unordered sentences without artificial segmentation cues. |
| Outcome: | The proposed method outperforms existing methods on the sentence ordering task. |
Spotlight and Shadow: Attention-Guided Dual-Anchor Introspective Decoding for MLLM Hallucination Mitigation (2026.findings-acl)
Copied to clipboard
| Challenge: | Multimodal Large Language Models (MLLMs) excel in tasks ranging from image captioning to complex reasoning. |
| Approach: | They propose a contrastive decoding framework that dynamically calibrates each token generation by mining the model’s internal perceptual discrepancies. |
| Outcome: | The proposed framework mitigates hallucination while enhancing general reasoning capabilities. |
A Dual-Channel Framework for Sarcasm Recognition by Detecting Sentiment Conflict (2022.findings-naacl)
Copied to clipboard
| Challenge: | Sarcasm employs ambivalence, where one says something positive but actually means negative . linguistically, it is difficult to recognize such sentiment conflict because the sentiments are mixed or even implicit . |
| Approach: | They propose a Dual-Channel Framework to model literal and implied sentiments separately . they propose sarcastic networks that can detect sarcasm sentiments in political debates . |
| Outcome: | The proposed framework achieves state-of-the-art on political debates and Twitter datasets. |
MemPO: Self-Memory Policy Optimization for Long-Horizon Agents (2026.findings-acl)
Copied to clipboard
Ruoran Li, Xinghua Zhang, Haiyang Yu, Shitong Duan, Xiang Li, Wenxin Xiang, Chonghua Liao, Xudong Guo, Yongbin Li, Jinli Suo
| Challenge: | Existing methods for long-horizon agents introduce the external memory module and look up the relevant information from the stored memory, which prevents the model from proactively managing its memory content and aligning with the agent’s overarching task objectives. |
| Approach: | They propose an algorithm which enables agents to autonomously manage their memory during interaction with environment and selectively retain crucial information. |
| Outcome: | Extensive experiments show that the proposed algorithm achieves absolute F1 score gains of 25.98 over the base model and 7.1 over the previous SOTA baseline while preserving task performance. |
Distill-C: Enhanced NL2SQL via Distilled Customization with LLMs (2025.naacl-industry)
Copied to clipboard
Cong Duy Vu Hoang, Gioacchino Tangari, Clemence Lanfranchi, Dalu Guo, Paul Cayet, Steve Siu, Don Dharmasiri, Yuan-Fang Li, Long Duong, Damien Hilloulin, Rhicheek Patra, Sungpack Hong, Hassan Chafi
| Challenge: | Domain- and customer-specific requirements complicate the problem of NL2SQL customization. |
| Approach: | They propose a distilled customization framework tailored for NL2SQL tasks. |
| Outcome: | The proposed framework outperforms teacher models on three benchmarks and achieves an average improvement of 36% in execution accuracy. |
Multi-step Jailbreaking Privacy Attacks on ChatGPT (2023.findings-emnlp)
Copied to clipboard
| Challenge: | With the rapid evolution of large language models (LLMs), many downstream NLP tasks can be well solved given appropriate prompts. |
| Approach: | They propose to integrate ChatGPT and Bing GPT3 into their applications to create a set of LLMs that can be used to generate NLP tasks with appropriate prompts. |
| Outcome: | The proposed models can be zero-shot or few-shot learners to solve specified tasks and can even be zero or few shot learners. |
No Free Lunch: Retrieval-Augmented Generation Undermines Fairness in LLMs, Even for Vigilant Users (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Retrieval-augmented generation is widely adopted for its effectiveness and cost-efficiency in mitigating hallucinations. |
| Approach: | They propose a practical three-level threat model from the perspective of user fairness awareness. |
| Outcome: | The proposed model shows that RAG can undermine fairness alignment without fine-tuning or retraining. |
CFinBench: A Comprehensive Chinese Financial Benchmark for Large Language Models (2025.naacl-long)
Copied to clipboard
Ying Nie, Binwei Yan, Tianyu Guo, Hao Liu, Haoyu Wang, Wei He, Binfan Zheng, Weihao Wang, Qiang Li, Weijian Sun, Yunhe Wang, Dacheng Tao
| Challenge: | Large language models (LLMs) have achieved remarkable performance on various NLP tasks, yet their potential in more challenging task like finance, has not been fully explored. |
| Approach: | They propose a benchmark to assess the financial knowledge of large language models (LLMs) in China. |
| Outcome: | The proposed benchmark is the most comprehensive evaluation benchmark to date for LLMs in finance. |
GraphReader: Building Graph-based Agent to Enhance Long-Context Abilities of Large Language Models (2024.findings-emnlp)
Copied to clipboard
Shilong Li, Yancheng He, Hangyu Guo, Xingyuan Bu, Ge Bai, Jie Liu, Jiaheng Liu, Xingwei Qu, Yangguang Li, Wanli Ouyang, Wenbo Su, Bo Zheng
| Challenge: | Existing models for long contexts struggle to handle long inputs due to limited context window and memory usage. |
| Approach: | They propose a graph-based agent system that analyzes long texts into a graphical graph . GraphReader consistently outperforms GPT-4-128k across context lengths from 16k to 256k . |
| Outcome: | The proposed model outperforms existing models on four challenging benchmarks. |
MM-ChatAlign: A Novel Multimodal Reasoning Framework based on Large Language Models for Entity Alignment (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing MMEA methods rely on knowledge representation learning (KRL) to measure the similarity of entity embeddings. |
| Approach: | They propose a framework that utilizes the visual reasoning abilities of MLLMs for multimodal entity alignment. |
| Outcome: | The proposed framework integrates the visual reasoning abilities of MLLMs for multimodal entity alignment. |
Golden Touchstone: A Comprehensive Bilingual Benchmark for Evaluating Financial Large Language Models (2025.findings-emnlp)
Copied to clipboard
Xiaojun Wu, Junxi Liu, Huan-Yi Su, Zhouchi Lin, Yiyan Qi, Chengjin Xu, Jiajun Su, Jiajie Zhong, Fuwei Wang, Saizhuo Wang, Fengrui Hua, Jia Li, Jian Guo
| Challenge: | Existing financial benchmarks suffer from limited language and task coverage, low-quality datasets, and inadequate adaptability for LLM evaluation. |
| Approach: | They propose a bilingual benchmark for financial LLMs that assesses models’ language understanding and generation capabilities. |
| Outcome: | The proposed bilingual benchmark assesses models’ language understanding and generation capabilities. |
A Survey of Link Prediction in N-ary Knowledge Graphs (2025.emnlp-main)
Copied to clipboard
Jiyao Wei, Saiping Guan, Da Li, Zhongni Hou, Miao Su, Yucan Guo, Xiaolong Jin, Jiafeng Guo, Xueqi Cheng
| Challenge: | N-ary Knowledge Graphs (NKGs) capture n-ary facts containing more than two entities. |
| Approach: | They present the first comprehensive survey of link prediction in NKGs . they provide an overview of the field and analyze their performance and application scenarios . |
| Outcome: | The proposed methods provide an overview of the field and analyze performance and application scenarios. |
Frame Semantic-Enhanced Sentence Modeling for Sentence-level Extractive Text Summarization (2021.emnlp-main)
Copied to clipboard
| Challenge: | Sentence-level extractive text summarization is difficult to model the importance of sentences. |
| Approach: | They propose a Frame Semantic-Enhanced Sentence Modeling for Extractive Summarization that leverages Frame semantics to model sentences from both intra-sentence level and inter-sentent level. |
| Outcome: | The proposed model outperforms six state-of-the-art methods on two benchmark corpus datasets. |
LIME: Less Is More for MLLM Evaluation (2025.findings-acl)
Copied to clipboard
King Zhu, Qianbo Zang, Shian Jia, Siwei Wu, Feiteng Fang, Yizhi Li, Shuyue Guo, Tianyu Zheng, Jiawei Guo, Bo Li, Haoning Wu, Xingwei Qu, Jian Yang, Ruibo Liu, Xiang Yue, Jiaheng Liu, Chenghua Lin, Hamid Alinejad-Rokny, Min Yang, Shiwen Ni, Wenhao Huang, Ge Zhang
| Challenge: | Existing MLLM benchmarks and unified evaluation frameworks cannot accurately and efficiently reflect the ability of MLMLs. |
| Approach: | They propose a semi-automated benchmark curated using a pipeline that filters out uninformative samples and eliminates answer leakage by focusing on tasks that require image-based understanding. |
| Outcome: | The proposed benchmark reduces the number of samples by 76% and evaluation time by 77% while it can more effectively distinguish different models’ abilities. |
PrivLM-Bench: A Multi-level Privacy Evaluation Benchmark for Language Models (2024.acl-long)
Copied to clipboard
Haoran Li, Dadi Guo, Donghao Li, Wei Fan, Qi Hu, Xin Liu, Chunkit Chan, Duanyi Yao, Yuan Yao, Yangqiu Song
| Challenge: | generative large language models (LLMs) exhibit surprising capability and integrate previous tasks into a unified text generation formulation. |
| Approach: | They propose a privacy evaluation benchmark to quantify the privacy leakage of language models. |
| Outcome: | The proposed benchmark compares PPLMs with different privacy implementations to find out how privacy leakage is handled. |
CodeEvo: Interaction-Driven Synthesis of Code-centric Data through Hybrid and Iterative Feedback (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for generating instruction-code pairs rely on rigid heuristics and are labor-intensive. |
| Approach: | They propose a dual-agent architecture that integrates a Coder and a Reviewer to orchestrate the generation trajectory. |
| Outcome: | The proposed architecture outperforms baselines on a large-scale dataset of instruction-code pairs with stepped difficulty levels. |
Deep Research with Open-Domain Evaluation and Multi-Stage Guardrails for Safety (2026.acl-long)
Copied to clipboard
Wei-Chieh Huang, Henry Peng Zou, Yaozu Wu, Dongyuan Li, Yankai Chen, Weizhi Zhang, Yangning Li, Angelo Zangari, Jizhou Guo, Chunyu Miao, Liancheng Fang, Langzhou He, Yinghui Li, Renhe Jiang, Philip S. Yu
| Challenge: | Existing deep research frameworks lack adequate evaluation procedures and stage-specific protections. |
| Approach: | They propose a framework with open-domain evaluation and a stage-wise safety benchmark to address this oversight. |
| Outcome: | The proposed framework improves defense success rates by 16.53% while reducing over-refusal rates to approximately 6%. |
NutFrame: Frame-based Conceptual Structure Induction with LLMs (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies focus on syntactic knowledge and world knowledge, but conceptual structure is not well-understood. |
| Approach: | They propose a benchmark for coNceptual structure induction based on FrameNet . they use prompts to induce conceptual structure of Framenet with LLMs . |
| Outcome: | The proposed model is able to induce conceptual structure of FrameNet with LLMs. |
On-Policy Self-Distillation for Efficient Diffusion Language Models with Early-Stage Calibration (2026.findings-acl)
Copied to clipboard
Huaisheng Zhu, MingYu Liu, Junze Liu, Zhen Ge, Tian Wang, Jiri Gesi, Dakuo Wang, Weiqi Zhang, Houyu Zhang, Yufan Guo, Xian Li, Bing Yin, Sujay Sanghavi
| Challenge: | Recent studies have demonstrated that masked diffusion models (MDMs) can surpass autoregressive models (ARMs) in various tasks. |
| Approach: | They propose a method to calibrate early token predictions without demonstration data by distilling an unnormalized target distribution into the original model. |
| Outcome: | Experiments on math, planning, and RLHF tasks show that COPSD improves both effectiveness and efficiency, and further enhances performance when combined with supervised fine-tuning. |
How Far Does BERT Look At: Distance-based Clustering and Analysis of BERT’s Attention (2020.coling-main)
Copied to clipboard
| Challenge: | Recent work on multi-head attention mechanism shows heuristics and clues in analyzing various aspects of the mechanism. |
| Approach: | They propose to cluster attention heatmaps into significantly different patterns through unsupervised clustering on top of a set of proposed features. |
| Outcome: | The proposed features can explain and calibrate different attention heads in Transformer models. |
DataArc-SynData-Toolkit: A Unified Closed-Loop Framework for Multi-Path, Multimodal, and Multilingual Data Synthesis (2026.acl-demo)
Copied to clipboard
Zhichao Shi, Cehao Yang, Hao Zhou, Xiaojun Wu, Huajie Li, Xuhui Jiang, Chengjin Xu, Yuanzhuo Wang, Jian Guo
| Challenge: | Existing synthetic data tools are limited by convoluted workflows, fragmented data standards, and limited scalability across modalities. |
| Approach: | They develop an open-source framework that aims to reduce the technical barrier to synthetic data generation and subsequent model training. |
| Outcome: | The proposed framework achieves an optimal balance between generation efficiency and data quality. |
A.S.E: A Repository-Level Benchmark for Evaluating Security in AI-Generated Code (2026.findings-acl)
Copied to clipboard
Keke Lian, Wang Bin, Lei Zhang, Libo Chen, Junjie Wang, Ziming Zhao, Yujiu Yang, Miaoqian Lin, Haotong Duan, Haoran Zhao, Shuang Liao, Mingda Guo, Quan Jiazheng, Yilu Zhong, Chenhao He, Chen Zichuan, Jie Wu, Haoling Li, Zhaoxuan Li, Jiongchi Yu, Hui LI, Dong Zhang
| Challenge: | Existing security evaluation benchmarks lack relevance to real-world AI programming tasks . current LLMs struggle with secure coding, research shows . |
| Approach: | They propose a repository-level evaluation benchmark to assess security of AI-generated code. |
| Outcome: | The proposed framework mirrors real-world AI programming tasks and offers valuable insights into the state of AI code generation. |
Can LLMs See Without Pixels? Benchmarking Spatial Intelligence from Textual Descriptions (2026.findings-acl)
Copied to clipboard
Zhongbin Guo, Zhen Yang, Yushan Li, Xinyue Zhang, Wenyu Gao, Jiacheng Wang, Chengzhi Li, Xiangrui Liu, Ping Jian
| Challenge: | Existing advances in Spatial Intelligence rely on vision-Language Models . however, a critical question remains: does spatial understanding originate from visual encoders? |
| Approach: | They propose to evaluate the SI performance of Large Language Models without pixel-level input. |
| Outcome: | The proposed benchmark challenges large language models to perform symbolic reasoning rather than visual pattern matching. |
HumanLLM: Benchmarking and Improving LLM Anthropomorphism via Human Cognitive Patterns (2026.acl-long)
Copied to clipboard
Xintao Wang, Jian Yang, Weiyuan Li, Rui Xie, Jen-tse Huang, Jun Gao, Shuai Huang, Yueping Kang, Yuanli Guo, Hongwei Feng, Yanghua Xiao
| Challenge: | Large Language Models (LLMs) have demonstrated remarkable capabilities in reasoning and generation, serving as the foundation for advanced persona simulation and Role-Playing Language Agents (RPLAs). |
| Approach: | They propose a framework that treats psychological patterns as interacting causal forces and synthesizes 113 scenarios where 2-5 patterns reinforce, conflict, or modulate each other. |
| Outcome: | The proposed framework outperforms Qwen3-32B on multi-pattern dynamics despite 4 fewer parameters. |
E3-TIR: Enhanced Experience Exploitation for Tool-Integrated Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing training paradigms for Large Language Models (LLMs) suffer from inefficient exploration and mode degradation due to a lack of prior guidance, while SFT-then-RL is limited by high data costs and capability plateaus caused by low-entropy collapse. |
| Approach: | They propose an Enhanced Experience Exploitation paradigm that integrates expert prefixes, expert guided, and self-exploration to improve agent training. |
| Outcome: | The proposed model achieves a 6% performance improvement over traditional paradigms on tool-use tasks while requiring less than 10% of the synthetic data. |
Aggregation of Reasoning: A Hierarchical Framework for Enhancing Answer Selection in Large Language Models (2024.lrec-main)
Copied to clipboard
Zhangyue Yin, Qiushi Sun, Qipeng Guo, Zhiyuan Zeng, Xiaonan Li, Tianxiang Sun, Cheng Chang, Qinyuan Cheng, Ding Wang, Xiaofeng Mou, Xipeng Qiu, Xuanjing Huang
| Challenge: | Recent advances in Chain-of-Thought prompting have facilitated significant breakthroughs for Large Language Models (LLMs) in complex reasoning tasks. |
| Approach: | They propose a hierarchical reasoning aggregation framework to address this problem . they propose dynamic sampling to adjust the number of reasoning chains . |
| Outcome: | The proposed framework outperforms existing ensemble methods on complex reasoning tasks. |
Psyche-R1: Towards Reliable Psychological LLMs through Unified Empathy, Expertise, and Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Recent reasoning-augmented LLMs have demonstrated impressive capabilities across a wide range of domains owing to their exceptional text understanding capabilities. |
| Approach: | They propose a Chinese psychological LLM that integrates empathy, psychological expertise, and reasoning. |
| Outcome: | The proposed model produces over 75k high-quality psychological questions paired with detailed rationales, generated through and iterative prompt-rationale optimization procedure, along with 73k empathetic dialogues. |
Guidelines as Environments: A World Model Approach to Rule Following (2026.acl-long)
Copied to clipboard
| Challenge: | Existing models for guideline-following are a poor fit for ambiguous, text-defined constraints. |
| Approach: | They propose a Rule-Grounded Causal World Model that builds an explicit state space from guideline text itself. |
| Outcome: | Experiments show that the proposed model can be used to model rule execution with an explicit state space from the guideline text itself. |
Case2Code: Scalable Synthetic Data for Code Generation (2025.coling-main)
Copied to clipboard
Yunfan Shao, Linyang Li, Yichuan Ma, Peiji Li, Demin Song, Qinyuan Cheng, Shimin Li, Xiaonan Li, Pengyu Wang, Qipeng Guo, Hang Yan, Xipeng Qiu, Xuanjing Huang, Dahua Lin
| Challenge: | Large Language Models (LLMs) have shown outstanding breakthroughs in code generation. |
| Approach: | They propose a case-to-code induction task that exploits the expressiveness and correctness of programs by incorporating LLMs into their training. |
| Outcome: | The proposed task improves distribution case-to-code induction and various coding generation tasks. |
From Experience to Skill: Multi-Agent Generative Engine Optimization via Reusable Strategy Learning (2026.findings-acl)
Copied to clipboard
Beining Wu, Fuyou Mao, Jiong Lin, Cheng Yang, Jiaxuan Lu, Yifu Guo, Siyu Zhang, Yifan Wu, Ying Huang, Fu Li
| Challenge: | Generative engines (GEs) are replacing ranked links with citation-grounded answers . current methods are unable to accumulate or transfer effective strategies across tasks and engines . |
| Approach: | They propose a multi-agent framework where planning, editing, and fidelity-aware evaluation serve as the execution layer. |
| Outcome: | The proposed framework outperforms heuristic baselines in visibility and citation fidelity on three mainstream engines. |
CORBA: Contagious Recursive Blocking Attacks on Multi-Agent Systems Based on Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing security models rely on open-ended communication, but the collaborative process itself can be exploited and disrupted. |
| Approach: | They propose a new threat class, called Denial-of-Collaboration, which corrupts collaborative structure and transforms communication topology into self-sabotage. |
| Outcome: | The proposed attacks bypass conventional safety alignments that are not designed to detect behavioral or systemic attacks. |
An Empirical Analysis on Spatial Reasoning Capabilities of Large Multimodal Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large Multimodal Models (LMMs) have shown impressive generalization ability on vision and language tasks, but their spatial understanding is under-explored. |
| Approach: | They construct a VQA dataset to analyze LMMs' spatial reasoning capabilities. |
| Outcome: | The proposed model is stronger at basic object detection than complex spatial reasoning. |
LLM-enhanced Self-training for Cross-domain Constituency Parsing (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to self-training rely on limited and potentially low-quality raw corpora. |
| Approach: | They propose to enhance self-training with the large language model to generate domain-specific raw corpora iteratively and introduce grammar rules that guide the LLM in generating raw corporeals and establish criteria for selecting pseudo instances. |
| Outcome: | The proposed method outperforms traditional methods regardless of the large language model's performance. |
An Open-Source Data Contamination Report for Large Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing contamination analysis is conducted internally by large language model developers and lacks transparency and completeness. |
| Approach: | They present a data contamination report for 15 popular large language models . they propose an open-source pipeline to perform contamination analysis on customised data . |
| Outcome: | The proposed pipeline enables the community to perform contamination analysis on customised data and models. |
CodeIF: Benchmarking the Instruction-Following Capabilities of Large Language Models for Code Generation (2025.acl-industry)
Copied to clipboard
| Challenge: | CodeIF assesses the ability of large language models to adhere to task-oriented instructions in code generation tasks. |
| Approach: | They introduce a benchmark designed to assess LLMs' ability to adhere to task-oriented instructions within diverse code generation scenarios. |
| Outcome: | The proposed benchmark assesses LLMs' ability to adhere to task-oriented instructions in code generation tasks across a wide range of complexity levels and programming domains. |
Benchmarking Meaning Representations in Neural Semantic Parsing (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing work on meaning representations is not comprehensively evaluated due to the lack of readily-available execution engines. |
| Approach: | They propose a unified benchmark on meaning representations by integrating existing semantic parsing datasets, completing the missing logical forms, and implementing the missing execution engines. |
| Outcome: | The proposed benchmark combines existing parsing datasets, completes missing logical forms, and implements missing execution engines. |