Papers by Chen Zhao
FinLFQA: Evaluating Attributed Text Generation of LLMs in Financial Long-Form Question Answering (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing benchmarks focus on simple attribution that retrieves textual evidence as references. |
| Approach: | They propose a benchmark to evaluate the ability of large language models to generate reliable attributions. |
| Outcome: | The proposed benchmark evaluates the ability of LLMs to generate long-form answers with reliable and nuanced attributions. |
Set Generation Networks for End-to-End Knowledge Base Population (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing knowledge base population systems require a machine translation task to generate multiple facts, but the fact order is not considered. |
| Approach: | They propose a knowledge base population task that aims to discover facts about entities from texts and expand a KB with these facts. |
| Outcome: | The proposed networks achieve state-of-the-art (SoTA) performance on two benchmark datasets. |
The Self-Improvement Paradox: Can Language Models Bootstrap Reasoning Capabilities without External Scaffolding? (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to self-improvement rely on external supervision signals in the form of seed data and/or assistance from third-party models. |
| Approach: | They propose a framework for generating high-quality synthetic question-answer data in a fully autonomous manner. |
| Outcome: | The proposed framework generates high-quality synthetic question-answer data in a fully autonomous manner. |
Distantly-Supervised Dense Retrieval Enables Open-Domain Question Answering without Evidence Annotation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Open-domain question answering uses evidence retrieved from large corpus to answer questions . state-of-the-art approaches require intermediate evidence annotations for training . however, such intermediate annotations are expensive and methods that rely on them cannot transfer to the more common setting . |
| Approach: | They propose an open-domain question answering approach that alternately finds evidence from an up-to-date model and encourages the model to learn the most likely evidence. |
| Outcome: | The proposed approach improves over weak retrievers on multi-hop and single-hop benchmarks without using evidence labels. |
Towards Explainable Computerized Adaptive Testing with Large Language Model (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods focus on minimizing the number of questions required to assess ability, lacking clear and reliable explanations for the question selection process. |
| Approach: | They propose to use large language models to enhance computer adaptive testing (CAT) by providing human-like interpretability and explanations. |
| Outcome: | The proposed agent-based CAT performs comparably or superior to traditional CAT methods in accuracy and significantly improves student trust and satisfaction. |
Agent-RewardBench: Towards a Unified Benchmark for Reward Modeling across Perception, Planning, and Safety in Real-World Multimodal Agents (2025.acl-long)
Copied to clipboard
| Challenge: | Multimodal Large Language Models (MLLMs) are developing but lack external feedback . there is no clear on how to select reward models for agents . |
| Approach: | They propose a benchmark to evaluate agent reward modeling ability in MLLMs . they use multiple dimensions and real-world agent scenarios evaluation . |
| Outcome: | The proposed benchmark evaluates agent performance in multimodal large language models . it covers perception, planning, and safety with 7 scenarios and is highly difficult and high-quality . |
Data Manipulation: Towards Effective Instance Learning for Neural Dialogue Generation via Learning to Augment and Reweight (2020.acl-main)
Copied to clipboard
| Challenge: | Current state-of-the-art neural dialogue models learn from human conversations . however, due to the open-ended nature of human conversations, the quality of training data varies . |
| Approach: | They propose a data manipulation framework to augment and highlight effective training samples . they also propose to increase its manipulation skills through gradient descent with validation samples a reshaping framework to proactively restructure the data distribution towards reliable samples is also proposed . |
| Outcome: | The proposed framework improves the performance of open-domain neural dialogue models with respect to evaluation metrics and human judgments. |
Reinforced Question Rewriting for Conversational Question Answering (2022.emnlp-industry)
Copied to clipboard
| Challenge: | Existing approaches to CQA involve training new models from scratch . existing approaches are expensive and often not feasible . |
| Approach: | They propose to use QA feedback to supervise the rewriting model with reinforcement learning. |
| Outcome: | The proposed model can improve QA performance over baselines for extractive and retrieval QA. |
Boosting Cross-Lingual Transfer via Self-Learning with Uncertainty Estimation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent pre-trained language models have achieved remarkable zero-shot performance . we propose a self-learning framework that utilizes unlabeled data of target languages . |
| Approach: | They propose a self-learning framework that utilizes unlabeled data of target languages to select silver labels for cross-lingual transfer tasks. |
| Outcome: | The proposed framework outperforms baseline models on two cross-lingual tasks by 10 F1 on average and 2.5 accuracy on natural language inference (NLI). |
SP3: Enhancing Structured Pruning via PCA Projection (2024.findings-acl)
Copied to clipboard
| Challenge: | Structured pruning is a widely used technique for reducing the size of pre-trained language models, but current methods overlook the potential of compressing the hidden dimension d in PLMs. |
| Approach: | They propose a structured pruning approach that projectes features into a space defined by principal components before masking the hidden dimension d in pre-trained language models. |
| Outcome: | Experiments on benchmarks show that SP3 can reduce d by 70%, compress 94% of the BERTbase model, and maintain over 96% accuracy. |
Make Your Decision Convincing! A Unified Two-Stage Framework: Self-Attribution and Decision-Making (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing frameworks for explaining black-box model behavior are unreliable . large-scale pre-trained models often rely on superficial clues for predictions . |
| Approach: | They propose a unified two-stage framework that uses subsequences from the input text as a rationale to generate model decision. |
| Outcome: | The proposed framework achieves competitive results on five reasoning datasets and in semi-supervised scenarios. |
Learning to Imagine: Visually-Augmented Natural Language Generation (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods for natural language generation are pre-trained on text-only corpora, resulting in visual commonsense. |
| Approach: | They propose a method that makes pre-trained language models learn to imagine for visually-augmented natural language generation. |
| Outcome: | The proposed method is compatible with Transformer-based architecture. |
Graph-GRPO: Stabilizing Multi-Agent Topology Learning via Group Relative Policy Optimization (2026.findings-acl)
Copied to clipboard
Yueyang Cang, Xiaoteng Zhang, Erlu Zhao, Zehua Ji, Yuhang Liu, Yuchen He, Zhiyuan Ning, Chen Yijun, Wenge Que, Li Shi
| Challenge: | Recent approaches to optimize communication topology rely on single-sample policy gradients with absolute rewards. |
| Approach: | They propose a topology optimization framework that integrates Group Relative Policy Optimization. |
| Outcome: | The proposed topology optimization framework outperforms state-of-the-art methods on reasoning and code generation benchmarks. |
Lattice-Based Transformer Encoder for Neural Machine Translation (P19-1)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) takes deterministic sequences for source representations. However, word-level or subword-level segmentation has multiple choices to split a source sequence with different word segmentors or different subword vocabulary sizes. |
| Approach: | They propose lattice-based encoders to explore effective word or subword representations in an automatic way during training. |
| Outcome: | The proposed encoders can explore effective word or subword representation in an automatic way during training. |
DentalGPT: Incentivizing Multimodal Reasoning in Dentistry (2026.findings-acl)
Copied to clipboard
Zhenyang Cai, Jiaming Zhang, Junjie Zhao, Ziyi Zeng, Yanchao Li, Liang Jingyi, Junying Chen, Yunjin Yang, Jiajun You, Shuzhi Deng, null Xieruiqiii, Yuanting Chen, Xiangyi Feng, Jianquan Li, Liangyi Chen, Junwen Wang, Shan Jiang, Benyou Wang
| Challenge: | Current multimodal large language models (MLLMs) show limited understanding of dental images. |
| Approach: | They propose a dental-specialized multimodal large language model trained via staged multimodal alignment and reinforcement learning. |
| Outcome: | The proposed model outperforms state-of-the-art models on disease classification and dental VQA tasks. |
TC–RAG: Turing–Complete RAG’s Case study on Medical LLM Systems (2025.acl-long)
Copied to clipboard
Xinke Jiang, Yue Fang, Rihong Qiu, Haoyu Zhang, Yongxin Xu, Hao Chen, Wentao Zhang, Ruizhe Zhang, Yuchen Fang, Xinyu Ma, Xu Chu, Junfeng Zhao, Yasha Wang
| Challenge: | Existing approaches to RAG neglect system state variables, resulting in poor performance and erroneous knowledge accumulation. |
| Approach: | They propose a framework that incorporates a Turing Complete System to manage state variables and manage retrieval halting. |
| Outcome: | The proposed framework improves on seven real-world healthcare datasets and shows that it is more accurate than existing methods. |
Dual-Axis Generative Reward Model Toward Semantic and Turn-taking Robustness in Interactive Spoken Dialogue Models (2026.acl-long)
Copied to clipboard
Yifu Chen, Shengpeng Ji, Zhengqing Liu, Qian Chen, Wen Wang, Ziqing Wang, Yangzhuo Li, Tianle Liang, Zhou Zhao
| Challenge: | Reinforcement learning (RL) has improved text- and vision-language models, but its application in SDMs is hindered. |
| Approach: | They propose a dual-axis Generative Reward Model that provides semantic quality and interaction timing for SDMs. |
| Outcome: | The proposed model achieves state-of-the-art performance on interaction-quality assessment across a wide spectrum of datasets. |
Dialog-Post: Multi-Level Self-Supervised Objectives and Hierarchical Model for Dialogue Post-Training (2023.acl-long)
Copied to clipboard
| Challenge: | a new method for dialogue representation and understanding is proposed . pre-trained language models (PLMs) are inappropriate for dialogue understanding tasks . |
| Approach: | They propose a method that trains pre-trained language models to fit dialogues . they use a hierarchical segment-wise self-attention network to model dialogues more comprehensively . |
| Outcome: | The proposed method outperforms existing models and achieves a 3.3% improvement on average. |
Autoregressive Speech Synthesis without Vector Quantization (2025.acl-long)
Copied to clipboard
Lingwei Meng, Long Zhou, Shujie Liu, Sanyuan Chen, Bing Han, Shujie Hu, Yanqing Liu, Jinyu Li, Sheng Zhao, Xixin Wu, Helen M. Meng, Furu Wei
| Challenge: | MELLE is a novel language modeling approach for text-to-speech synthesis that generates continuous tokens from text . authors demonstrate that it reduces the need for vector quantization and improves model robustness . |
| Approach: | They propose to autoregressively generate continuous mel-spectrogram frames directly from text condition, bypassing vector quantization. |
| Outcome: | The proposed model achieves superior performance across multiple metrics and is more streamlined. |
Low-Resource Comparative Opinion Quintuple Extraction by Data Augmentation with Prompting (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Comparative Opinion Quintuple Extraction (COQE) aims to predict comparative opinion quintuples from comparative sentences. |
| Approach: | They propose a low-resource approach to extract comparative opinion quintuples from comparative sentences . they propose augmentation using ChatGPT and a data-centric approach . |
| Outcome: | The proposed approach improves the existing pipeline-based method and achieves state-of-the-art results. |
Event Ontology Completion with Hierarchical Structure Evolution Networks (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for event detection require predefined schemas, but manual defining is expensive and labor-intensive. |
| Approach: | They propose a task to achieve event clustering, hierarchy expansion and type naming . they propose 'neighbor Contrastive Clustering' module and a Hierarchy-Aware Linking module . |
| Outcome: | The proposed method outperforms baseline methods on three datasets. |
LLM-based Translation Inference with Iterative Bilingual Understanding (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing studies show that the ability of large language models to generate contextual understanding of the sentence can degrade translation quality. |
| Approach: | They propose a method that generates contextual understanding for both source and target languages separately. |
| Outcome: | The proposed method outperforms strong comparison methods in multiple domains. |
The Elephant in the Room: Exploring the Role of Neutral Words in Language Model Group-Agnostic Debiasing (2025.findings-acl)
Copied to clipboard
Xinwei Guo, Jiashi Gao, Junlei Zhou, Jiaxin Zhang, Guanhua Chen, Xiangyu Zhao, Quanying Liu, Haiyan Wu, Xin Yao, Xuetao Wei
| Challenge: | Large Language Models (LLMs) are increasingly integrated into our daily lives, raising ethical concerns, especially about perpetuating stereotypes. |
| Approach: | They propose a method that incorporates a neutral word semantics-based loss function to alleviate the deterioration of the LMS during debiasing. |
| Outcome: | The proposed method alleviates the deterioration of the Language Modeling Score (LMS) by incorporating a neutral word semantics-based loss function. |
Label Anchored Contrastive Learning for Language Understanding (2022.naacl-main)
Copied to clipboard
| Challenge: | a novel approach to contrastive learning for language understanding is not fully explored . contrastive training has been widely applied to self-supervised representation learning . |
| Approach: | They propose a label anchored contrastive learning approach for language understanding using a class label. |
| Outcome: | The proposed approach improves on GLUE and CLUE benchmarks by 4.1% compared to the state-of-the-art approaches . the proposed approach also improves under the few-shot and data imbalance settings . |
Decouple knowledge from paramters for plug-and-play language modeling (2023.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained language models (PLMs) have made impressive results in a wide range of NLP tasks. |
| Approach: | They propose a pre-training model with editable and scalable key-value memory and leverage knowledge in an explainable manner by knowledge retrieval in the pasted macro ‘MEMORY’. |
| Outcome: | The proposed model decouples the knowledge storage from model parameters with an editable and scalable key-value memory and leverages knowledge in an explainable manner by knowledge retrieval in the pasted macro ‘MEMORY’. |
LLMs Assist NLP Researchers: Critique Paper (Meta-)Reviewing (2024.emnlp-main)
Copied to clipboard
Jiangshu Du, Yibo Wang, Wenting Zhao, Zhongfen Deng, Shuaiqi Liu, Renze Lou, Henry Zou, Pranav Narayanan Venkit, Nan Zhang, Mukund Srinath, Haoran Zhang, Vipul Gupta, Yinghui Li, Tao Li, Fei Wang, Qin Liu, Tianlin Liu, Pengzhi Gao, Congying Xia, Chen Xing, Cheng Jiayang, Zhaowei Wang, Ying Su, Raj Shah, Ruohao Guo, Jing Gu, Haoran Li, Kangda Wei, Zihao Wang, Lu Cheng, Surangika Ranathunga, Meng Fang, Jie Fu, Fei Liu, Ruihong Huang, Eduardo Blanco, Yixin Cao, Rui Zhang, Philip Yu, Wenpeng Yin
| Challenge: | a comparative analysis of paper (meta-)reviews by large language models (LLMs) aims to identify and distinguish LLMs from human activities . |
| Approach: | They present a comparative analysis to identify and distinguish LLM activities from human activities. |
| Outcome: | The proposed analysis aims to improve recognition of instances when someone implicitly uses LLMs for reviewing activities. |
CodeScope: An Execution-based Multilingual Multitask Multidimensional Benchmark for Evaluating LLMs on Code Understanding and Generation (2024.acl-long)
Copied to clipboard
Weixiang Yan, Haitian Liu, Yunkun Wang, Yunzhe Li, Qian Chen, Wen Wang, Tingyu Lin, Weishan Zhao, Li Zhu, Hari Sundaram, Shuiguang Deng
| Challenge: | Existing benchmarks for evaluating the code understanding and generation capacities of Large Language Models are insufficient . existing benchmarks focus on a narrow range of popular programming languages and specific tasks . |
| Approach: | They propose an execution-based, multilingual, multitask evaluation benchmark for LLMs . they evaluate coding performance from three dimensions: length, difficulty, efficiency . |
| Outcome: | The proposed benchmark covers 43 programming languages and eight coding tasks. |
Reinforced Efficient Reasoning via Semantically Diverse Exploration (2026.acl-long)
Copied to clipboard
Ziqi Zhao, Zhaochun Ren, Jiahong Zou, Liu Yang, Zhiwei Xu, Xuri Ge, Zhumin Chen, Xinyu Ma, Daiting Shi, Shuaiqiang Wang, Dawei Yin, Xin Xin
| Challenge: | Existing methods for reinforcement learning with verifiable rewards suffer from limited exploration diversity and inefficient reasoning. |
| Approach: | They propose a method that rewards concise and correct reasoning while penalizing unnecessarily long reasoning chains. |
| Outcome: | Extensive experiments on Qwen and Llama models validate the effectiveness and efficiency of ROSE. |
Continual Few-shot Event Detection via Hierarchical Augmentation Networks (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for continual few-shot event detection use labeled data, but in real-world applications, new event types emerge continually. |
| Approach: | They propose a memory-based framework for continual few-shot event detection . they incorporate prototypical augmentation into the memory set to memorize previous event types . |
| Outcome: | The proposed method outperforms existing methods in multiple continual few-shot event detection tasks. |
CRITICTOOL: Evaluating Self-Critique Capabilities of Large Language Models in Tool-Calling Error Scenarios (2025.emnlp-main)
Copied to clipboard
| Challenge: | a number of tools are used to perform complex tasks, but the tool utilization process can cause errors. |
| Approach: | They propose a critique evaluation benchmark for tool learning that analyzes function-calling errors on tool evaluation benchmarks. |
| Outcome: | The proposed critique evaluation benchmark holds diverse tool-use errors with varying complexities, which better reflects real-world scenarios. |
Document-Level Event Argument Extraction With a Chain Reasoning Paradigm (2023.acl-long)
Copied to clipboard
| Challenge: | Document-level event argument extraction aims to identify event arguments beyond sentence level, where a significant challenge is to model long-range dependencies. |
| Approach: | They propose a chain reasoning paradigm which captures long-range interdependence due to the chains’ compositional nature and generates decomposable first-order logic rules for reasoning. |
| Outcome: | The proposed method outperforms previous methods on two benchmarks and is robust enough to defend against adversarial attacks. |
CroAno : A Crowd Annotation Platform for Improving Label Consistency of Chinese NER Dataset (2021.emnlp-demo)
Copied to clipboard
Baoli Zhang, Zhucong Li, Zhen Gan, Yubo Chen, Jing Wan, Kang Liu, Jun Zhao, Shengping Liu, Yafei Shi
| Challenge: | Existing crowd annotation tools for named entity recognition (NER) focus on efficiency and don't consider consistency of datasets. |
| Approach: | They propose a crowd annotation platform for Chinese named entity recognition (NER) CroAno provides a systematic solution for improving label consistency of Chinese NER datasets. |
| Outcome: | The proposed platform improves label consistency of Chinese NER datasets. |
Hierarchical Acoustic-Semantic Modeling: Modality Separation and Semantic Coherence for Full-Duplex SLMs (2026.acl-long)
Copied to clipboard
Zhenyu Liu, Xuanyu Zhang, Yunxin li, Qixun Teng, Shenyuan Jiang, Haolan Chen, Mingjun Zhao, Fanbo Meng, Yu Xu, Yancheng He, Baotian Hu, Haizhou Li, Min Zhang
| Challenge: | despite significant progress, full-duplex SLMs are constrained by severe modality interference, authors say . modality interferes with acoustic and semantic modeling, making them unintelligent and unnatural . authors propose a hierarchical parameter separation strategy that decouples conflicting modalities in deep layers . |
| Approach: | They propose a hierarchical parameter separation strategy that decouples conflicting modalities in deep layers while preserving cross-modality coherence via a dedicated semantic alignment channel. |
| Outcome: | The proposed method significantly advances the state of the art on full-duplex benchmarks . it decouples conflicting modalities in deep layers while preserving cross-modality coherence . |
Your Co-Workers Matter: Evaluating Collaborative Capabilities of Language Models in Blocks World (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on how large language model agents collaborate with humans in equal roles emphasize the importance of coordination and communication. |
| Approach: | They propose to use chain-of-thought prompts to evaluate different collaboration perspectives, from independent to more complex, dependent tasks. |
| Outcome: | The proposed model significantly improves the evaluation metric. |
OMS: On-the-fly, Multi-Objective, Self-Reflective Ad Keyword Generation via LLM Agent (2025.emnlp-main)
Copied to clipboard
| Challenge: | Keyword decision in Sponsored Search Advertising is critical to the success of ad campaigns. |
| Approach: | They propose a keyword generation framework that is On-the-fly and Multi-objective to automate keyword generation. |
| Outcome: | Experiments show that OMS outperforms existing methods in keyword generation . relying on large-scale query-keyword data is a major limitation, authors say . |
LEGO: A Multi-agent Collaborative Framework with Role-playing and Iterative Feedback for Causality Explanation Generation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Causality explanation generation is a generative task that aims to explain why a given cause-effect pair is true using natural language. |
| Approach: | They propose a multi-agent framework with role-playing and iterative feedback for causality explanation generation. |
| Outcome: | The proposed framework is superior to existing frameworks on WIKIWHY and e-CARE datasets. |
Robust Machine Reading Comprehension by Learning Soft labels (2020.coling-main)
Copied to clipboard
| Challenge: | Neural models have achieved great success on the task of machine reading comprehension, which are typically trained on hard labels. |
| Approach: | They propose a robust training method for machine reading comprehension models to address label sparseness problem by using three strategies to train models on soft labels. |
| Outcome: | The proposed method improves the baseline model performance and achieves state-of-the-art performance on NewsQA and QUOREF. |
WavRAG: Audio-Integrated Retrieval Augmented Generation for Spoken Dialogue Models (2025.acl-long)
Copied to clipboard
| Challenge: | Existing RAG frameworks rely on Automatic Speech Recognition to process speech input, which discards crucial audio information and increases computational overhead. |
| Approach: | They propose a retrieval augmented generation framework with native, end-to-end audio support that integrates audio and text into a unified knowledge representation. |
| Outcome: | The proposed framework can perform 10x faster than current pipelines while delivering 10x acceleration. |
AS-ES Learning: Towards efficient CoT learning in small models (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to induce Chain-of-Thought (CoT) in LLMs are limited and do not consider the importance of efficiently utilizing existing CoT data. |
| Approach: | They propose a new training paradigm which exploits the inherent information in CoT for iterative generation. |
| Outcome: | The proposed training paradigm surpasses direct seq2seq training on CoT-extensive tasks without data augmentation or altering the model itself. |
Cross-Lingual Question Answering over Knowledge Base as Reading Comprehension (2023.findings-eacl)
Copied to clipboard
| Challenge: | Existing high-quality xMRC datasets can be further utilized to fine-tune our model. |
| Approach: | They propose a cross-lingual question answering over knowledge base approach that converts KB subgraphs into passages to narrow the gap between KB schemas and questions. |
| Outcome: | The proposed approach outperforms baselines and achieves strong few-shot and zero-shot performance on two xKBQA datasets in 12 languages. |
TableVista: Benchmarking Multimodal Table Reasoning under Visual and Structural Complexity (2026.findings-acl)
Copied to clipboard
Zheyuan Yang, Liqiang Shang, Junjie Chen, Xun Yang, Chenglong Xu, Bo Yuan, Chenyuan Jiao, Yaoru Sun, Yilun Zhao
| Challenge: | TableVista evaluates multimodal table reasoning under visual and structural complexity . current models struggle to maintain reasoning consistency when structural complexity combined with visually integrated presentations. |
| Approach: | They propose a benchmark for evaluating multimodal table reasoning under visual and structural complexity. |
| Outcome: | The proposed model performs poorly on visual and structural complexity. |
STARS: A Unified Framework for Singing Transcription, Alignment, and Refined Style Annotation (2025.findings-acl)
Copied to clipboard
Wenxiang Guo, Yu Zhang, Changhao Pan, Zhiyuan Zhu, Ruiqi Li, ZheTao Chen, Wenhao Xu, Fei Wu, Zhou Zhao
| Challenge: | Existing automated singing annotation (ASA) methods tackle isolated aspects of the annotation pipeline. |
| Approach: | They propose a framework that addresses transcription, alignment, and refined style annotations. |
| Outcome: | The proposed framework delivers comprehensive multi-level annotations encompassing: (1) precise phoneme-audio alignment, (2) robust note transcription and temporal localization, (3) expressive vocal technique identification, and (4) global stylistic characterization including emotion and pace. |
HalluAudio: A Comprehensive Benchmark for Hallucination Detection in Large Audio-Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing studies on hallucination focus on text or vision, while few audio-oriented studies are limited in scale, modality coverage, and diagnostic depth. |
| Approach: | They propose a large-scale benchmark for evaluating hallucinations across speech, sound, and music. |
| Outcome: | The proposed model improves hallucination rate, yes/no bias, error-type analysis, and refusal rate. |
A Goal Without a Plan Is Just a Wish: Efficient and Effective Global Planner Training for Long-Horizon Agent Tasks (2026.acl-long)
Copied to clipboard
Shuzheng Si, Haozhe Zhao, Kangyang Luo, Gang Chen, Fanchao Qi, Minjia Zhang, Baobao Chang, Maosong Sun
| Challenge: | Recent advances in large language models (LLMs) have leapt from static chatbots to versatile agents that tackle complex tasks such as science experiments. |
| Approach: | They propose a plan-and-execute framework and propose 'EAGLET' to enhance the executor agent's planning abilities without human effort. |
| Outcome: | The proposed method outperforms existing methods on three long-horizon tasks and reduces training costs by 8 compared to baselines. |
Learning Geometry-Aware Representations for New Intent Discovery (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods for intent classification fail to distinguish new intents due to intertwined centers . a novel framework that learns geometry-aware representations to maximally separate all intents is proposed . |
| Approach: | They propose a new intent discovery framework that learns geometry-aware representations to maximally separate all intents. |
| Outcome: | The proposed framework achieves a new state-of-the-art performance on three benchmarking datasets. |
ChemVLR: Prioritizing Reasoning in Perception for Chemical Vision-Language Understanding (2026.findings-acl)
Copied to clipboard
| Challenge: | Currently, vision-Language Models are optimized for direct visual question-answering tasks. |
| Approach: | They propose a visual-language-based VLM that prioritizes reasoning within the perception process. |
| Outcome: | The proposed model outperforms existing models and domain-specific open-source models in the chemical domain. |
Manifold Learning-based Word Representation Refinement Incorporating Global and Local Information (2020.coling-main)
Copied to clipboard
| Challenge: | Recent studies show word embedding models underestimate similarities between similar words and overestimate similarities between distant words. |
| Approach: | They propose two new word embedding methods that align original and re-fined embeddable spaces to a new refined semantic space. |
| Outcome: | The proposed methods outperform state-of-the-art methods for word representation refinement. |
Look Light, Think Heavy: What Multimodal Chain-of-Thought Reasoning Can and Cannot Do (2026.acl-long)
Copied to clipboard
| Challenge: | Existing open-source models often yield only marginal overall improvements, possibly due to an overemphasis on mathematical reasoning at the expense of broader capabilities. |
| Approach: | They evaluate 12 multimodal tasks using 14 non-reasoning models and 8 reasoning models. |
| Outcome: | The proposed method is effective in multimodal reasoning tasks, the authors show . they show that it lacks the ability to maintain deep visual introspection throughout the reasoning process. |
Taming "Zombie" Agents: A Markov State-Aware Framework for Resilient Multi-Agent Evolution (2026.acl-long)
Copied to clipboard
Taolin Zhang, Pukun Zhao, Qizhou Chen, Jiuheng Wan, Chen Chen, Xiaofeng He, Chengyu Wang, Richang Hong
| Challenge: | Existing approaches to improve efficiency of multi-agent systems rely on aggressive graph topology evolution . however, such hard pruning overlooks the potential for "zombie" agents to recover and contribute in subsequent discussion rounds. |
| Approach: | They propose a Markov state-aware framework for resilient multi-agent evolution that manages agent collaboration through soft state transitions. |
| Outcome: | The proposed framework outperforms baselines and significantly reduces token consumption through state-aware agent scheduling. |
Generate-on-Graph: Treat LLM as both Agent and KG for Incomplete Knowledge Graph Question Answering (2024.emnlp-main)
Copied to clipboard
Yao Xu, Shizhu He, Jiabei Chen, Zihao Wang, Yangqiu Song, Hanghang Tong, Guang Liu, Jun Zhao, Kang Liu
| Challenge: | Existing methods to integrate LLMs with Knowledge Graphs (KGs) however, these methods are often incomplete to cover all the knowledge required to answer questions. |
| Approach: | They propose to integrate LLMs with Knowledge Graphs (KGs) to address insufficient knowledge and hallucination issues in Large Language Models. |
| Outcome: | The proposed method outperforms existing methods on two datasets. |
Named Entity Recognition via Noise Aware Training Mechanism with Data Filter (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for named entity recognition (NER) do not distinguish noisy from hard samples. |
| Approach: | They propose a noise-aware-with-filter method to help model identify noisy samples . they propose 'incomplete trust' loss function which boosts L CRF with a robust term . |
| Outcome: | The proposed method outperforms the existing methods on six real-world Chinese and English NER datasets. |
EPO: Hierarchical LLM Agents with Environment Preference Optimization (2024.emnlp-main)
Copied to clipboard
| Challenge: | Long-horizon decision-making tasks require extensive planning over multiple steps, maintaining coherence and goal orientation, which is difficult for LLMs that are typically designed for more immediate and localized predictions. |
| Approach: | They propose a hierarchical framework that decomposes complex tasks into manageable subgoals, utilizing separate LLMs for subgoal prediction and low-level action generation. |
| Outcome: | The proposed framework achieves first place on the ALFRED public leaderboard and demonstrates its potential to improve long-horizon decision-making in diverse environments. |
Enhancing LLM Knowledge Learning through Generalization (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Continued pre-training on paraphrased data has shown empirical promise for enhancing knowledge acquisition, but this approach is costly and unreliable as it relies on external models or manual effort for rewriting. |
| Approach: | They propose formatting-based data augmentation which diversifies documents conveying the same knowledge by altering document formats rather than their content. |
| Outcome: | The proposed methods improve generalization to diverse paraphrased contexts and enhance pre-training and instruction tuning. |
WilKE: Wise-Layer Knowledge Editor for Lifelong Knowledge Editing (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing knowledge editing methods focus on single editing, failing to meet the requirements for lifelong editing. |
| Approach: | They propose an approach that selects editing layer based on the pattern matching degree of editing knowledge across different layers in language models. |
| Outcome: | The proposed method improves on GPT2-XL and GPT-J in lifelong editing compared to state-of-the-art methods . |
Inter-Passage Verification for Multi-evidence Multi-answer QA (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing multi-answer question answering systems struggle to retrieve and synthesize a large number of evidence passages. |
| Approach: | They propose a multi-answer question answering framework that generates a large set of passages and then processes each passage individually to generate an initial high-recall but noisy answer set. |
| Outcome: | The proposed framework outperforms baselines on the QAMPARI and RoMQA datasets, achieving an average F1 score improvement of 11.17%. |
Unsupervised Dual Paraphrasing for Two-stage Semantic Parsing (2020.acl-main)
Copied to clipboard
| Challenge: | Existing semantic parsing frameworks rely on nontrivial human labor to generate canonical utterances. |
| Approach: | They propose a framework that uses an unsupervised paraphrase model to parse canonical utterances. |
| Outcome: | The proposed framework is effective and compatible with supervised training. |
Tug-of-War between Knowledge: Exploring and Resolving Knowledge Conflicts in Retrieval-Augmented Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing knowledge conflicts in RALMs can ensnare them in a tug-of-war between knowledge and evidence, limiting their practical applicability. |
| Approach: | They propose a method called Conflict-Disentangle Contrastive Decoding (CD2) to better calibrate the model’s confidence. |
| Outcome: | The proposed method can resolve knowledge conflicts in large language models with the help of conflict-disentangle contrast decoding (CD2) . |
SimulSpeech: End-to-End Simultaneous Speech to Text Translation (2020.acl-main)
Copied to clipboard
| Challenge: | SimulSpeech is an end-to-end simultaneous speech to text translation system . conventional approaches to simultaneous speech translation divide the translation process into two stages . |
| Approach: | They develop an end-to-end simultaneous speech to text translation system which translates speech in source language to text in target language concurrently. |
| Outcome: | The proposed system achieves reasonable BLEU scores and lower delay compared to full-sentence translation model. |
Fact-and-Reflection (FaR) Improves Confidence Calibration of Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on the confidence calibration of LLMs have not explored the effects of different prompting strategies on LLM performance. |
| Approach: | They propose Fact-and-Reflection prompting which improves LLM confidence calibration . they propose to use human cognition to elicit known "facts" and ask model to "reflect" over them . |
| Outcome: | The proposed method lowers the expected calibration error by 23.5% on multi-purpose QA tasks. |
Explainable Hallucination through Natural Language Inference Mapping (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) often generate hallucinated content, making it crucial to identify and quantify inconsistencies in their outputs. |
| Approach: | They propose a framework that maps entailment and contradiction relations between inputs and outputs using a natural language inference model. |
| Outcome: | The proposed framework outperforms state-of-the-art methods by five percentage points while providing clear, interpretable explanations. |
Uncertain Local-to-Global Networks for Document-Level Event Factuality Identification (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on identifying event factuality at sentence level, which leads to conflicts between different mentions of the same event. |
| Approach: | They propose a document-level event factuality identification model that uses local uncertainty and global structure to model event factuality. |
| Outcome: | The proposed method outperforms existing models on two widely used datasets. |
Uncovering Scaling Laws for Large Language Models via Inverse Problems (2025.findings-emnlp)
Copied to clipboard
Arun Verma, Zhaoxuan Wu, Zijian Zhou, Xiaoqiang Lin, Zhiliang Chen, Rachael Hwee Ling Sim, Rui Qiao, Jingtan Wang, Nhung Bui, Xinyuan Niu, Wenyang Hu, Gregory Kang Ruey Lau, Zi-Yu Khoo, Zitong Zhao, Xinyi Xu, Apivich Hemachandra, See-Kiong Ng, Bryan Kian Hsiang Low
| Challenge: | Large Language Models (LLMs) have achieved remarkable success across diverse domains. |
| Approach: | inverse problems can efficiently uncover scaling laws that guide the building of LLMs, authors argue . authors propose brute-force approaches to improve LLM training costs due to high costs . |
| Outcome: | This paper advocates that inverse problems can efficiently uncover scaling laws that guide the building of LLMs to achieve the desirable performance with significantly better cost-effectiveness. |
Code Representation Pre-training with Complements from Program Executions (2024.emnlp-industry)
Copied to clipboard
| Challenge: | Existing languages have syntactic representations of code to improve code intelligence, but they are difficult to learn from code. |
| Approach: | They propose to embed dynamic information of programs revealed by their test cases into feature representations of code as complements. |
| Outcome: | The proposed method yields 6%/19% mAP improvements over its masked language modeling counterparts. |
Rethinking Sentiment Style Transfer (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing evaluation methods for text style transfer are unsatisfactory. |
| Approach: | They propose to use a graph-based method to extract attribute content from sentences . they propose an efficient regularization to leverage attribute-dependent content as guiding signals. |
| Outcome: | The proposed method is based on a YELP and IMDB dataset and it is able to detect errors in the human evaluation. |
Capturing Relations between Scientific Papers: An Abstractive Model for Related Work Section Generation (2021.acl-long)
Copied to clipboard
| Challenge: | Existing related work generation models are inflexible and extract sentences from multiple papers to form a related work discussion. |
| Approach: | They propose a Relation-aware Related work generator which generates an abstractive related work from the given multiple scientific papers in the same research area. |
| Outcome: | The proposed model improves over existing models and can be used to familiarize researchers with the state of the art in the field. |
SLARD: A Chinese Superior Legal Article Retrieval Dataset (2025.coling-main)
Copied to clipboard
| Challenge: | Existing retrieval methods struggle to achieve ideal results, a study finds . existing large language models lack prior knowledge of the content of superior legal articles . |
| Approach: | They propose to use a Chinese superior legal article retrieval dataset to find relevant articles with higher legal effectiveness. |
| Outcome: | The proposed dataset shows that existing retrieval methods struggle to achieve ideal results. |
Relation-Aware Question Answering for Heterogeneous Knowledge Graphs (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing retrieval-based approaches to solve multihop Knowledge Base Question Answering (KBQA) fail to utilize information from head-tail entities and the semantic connection between relations to enhance the information capturing of relations in KGs. |
| Approach: | They propose to use a dual relation graph to find the answer entity in a knowledge graph . they use primal entity graph reasoning, dual relation grafitment and interaction . |
| Outcome: | The proposed approach achieves significant performance gain over the prior state-of-the-art on two public datasets, WebQSP and CWQ. |
SDiaReward: Modeling and Benchmarking Spoken Dialogue Rewards with Modality and Colloquialness (2026.acl-long)
Copied to clipboard
Jingyu Lu, Yuhan Wang, Fan Zhuo, Xize Cheng, Changhao Pan, Xueyi Pu, Yifu Chen, Chenyuhao Wen, Tianle Liang, Zhou Zhao
| Challenge: | SDiaReward is an end-to-end spoken dialogue system that integrates paralinguistic nuances and spontaneous nature of human conversation. |
| Approach: | They propose an end-to-end multi-turn reward model trained on SDiaReward-Dataset . it is a collection of episode-level preference pairs targeting modality and colloquiality gaps . |
| Outcome: | The proposed model outperforms general-purpose audio LLMs in episode-level evaluation. |
Modeling Hierarchical Reasoning Chains by Linking Discourse Units and Key Phrases for Reading Comprehension (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods of logical reasoning focus on entity-aware information but ignore hierarchical relations that may even have mutual effects. |
| Approach: | They propose a holistic graph network that deals with context at both discourse-level and word-level as the basis for logical reasoning. |
| Outcome: | The proposed method improves on logical reasoning QA datasets and natural language inference datasets. |
CNSL-bench: Benchmarking the Sign Language Understanding Capabilities of MLLMs on Chinese National Sign Language (2026.acl-long)
Copied to clipboard
| Challenge: | CNSL-bench is the first comprehensive Chinese National Sign Language benchmark . current MLLMs are inferior to human performance, despite advances in multimodal modeling . |
| Approach: | They propose a Chinese National Sign Language benchmark to evaluate multimodal large language models in sign language understanding. |
| Outcome: | The proposed benchmark evaluates 21 open-source and proprietary MLLMs . results show that current models are inferior to human performance . |
Make Imagination Clearer! Stable Diffusion-based Visual Imagination for Multimodal Machine Translation (2025.acl-long)
Copied to clipboard
Andong Chen, Yuchen Song, Kehai Chen, Xuefeng Bai, Muyun Yang, Liqiang Nie, Jie Liu, Tiejun Zhao, Min Zhang
| Challenge: | Experimental results show that our model significantly outperforms existing multimodal MT and text-only MT. |
| Approach: | They propose a stable diffusion-based imagination network into a multimodal large language model to generate an image for each source sentence. |
| Outcome: | The proposed model outperforms existing multimodal and text-only MT and achieves an average improvement of 14 BLEU points on Multi30K and MSCOCO multimodal MT benchmarks. |
TexSmart: A System for Enhanced Natural Language Understanding (2021.acl-demo)
Copied to clipboard
Lemao Liu, Haisong Zhang, Haiyun Jiang, Yangming Li, Enbo Zhao, Kun Xu, Linfeng Song, Suncong Zheng, Botong Zhou, Dick Zhu, Xiao Feng, Tao Chen, Tao Yang, Dong Yu, Feng Zhang, ZhanHui Kang, Shuming Shi
| Challenge: | TexSmart supports fine-grained named entity recognition (NER) Large-scale fine-granular entity types are expected to provide richer semantic information for downstream NLP applications. |
| Approach: | They introduce TexSmart, a text understanding system that supports fine-grained named entity recognition (NER) and enhanced semantic analysis functionalities. |
| Outcome: | The proposed system supports fine-grained named entity recognition (NER) and enhanced semantic analysis functions. |
Effective Distillation of Table-based Reasoning Ability from LLMs (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing work on table-based reasoning distillation has focused on smaller models with limited performance. |
| Approach: | They propose a table-based reasoning distillation approach to distill LLMs into smaller models . their results show that a 220 million parameter model fine-tuned using distilled data improves performance . |
| Outcome: | The proposed model improves on a scientific table-to-text generation dataset and surpasses specific LLMs. |
OpenPrompt: An Open-source Framework for Prompt-learning (2022.acl-demo)
Copied to clipboard
| Challenge: | Prompt-learning is a new paradigm in natural language processing, adapting pre-trained language models to cloze-style prediction, autoregressive modeling, or sequence to sequence generation. |
| Approach: | They propose a framework for prompt-learning that integrates pre-trained language models with a unified framework. |
| Outcome: | The proposed framework is easy to use and flexible enough to integrate with other frameworks. |
CogKTR: A Knowledge-Enhanced Text Representation Toolkit for Natural Language Understanding (2022.emnlp-demos)
Copied to clipboard
Zhuoran Jin, Tianyi Men, Hongbang Yuan, Yuyang Zhou, Pengfei Cao, Yubo Chen, Zhipeng Xue, Kang Liu, Jun Zhao
| Challenge: | Existing knowledge-enhanced methods are limited to knowledge-intensive tasks. |
| Approach: | They propose a knowledge-enhanced text representation toolkit for natural language understanding . it combines knowledge acquisition, knowledge representation, knowledge injection and knowledge application . |
| Outcome: | The proposed toolkit supports knowledge acquisition, knowledge representation, knowledge injection, and knowledge application. |
Unsupervised Multi-scale Expressive Speaking Style Modeling with Hierarchical Context Information for Audiobook Speech Synthesis (2022.coling-1)
Copied to clipboard
| Challenge: | a recent study has shown that expressiveness of audiobooks is limited by the averaged global-scale speaking style representation. |
| Approach: | They propose an unsupervised multi-scale context-sensitive text-to-speech model for audiobooks . they use hierarchical context encoder to predict global-scale contextual style embeddings . |
| Outcome: | The proposed model outperforms existing models on a real-world Mandarin audio dataset. |
Refusal-Aware Red Teaming: Exposing Inconsistency in Safety Evaluations (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) require rigorous safety evaluations to be effective. |
| Approach: | They propose a red teaming framework that detects internal model refusals and contrasts them with judgments from an external safety evaluator to generate test cases that expose such discrepancies. |
| Outcome: | The proposed framework outperforms existing reinforcement learning-based approaches in generating diverse test cases and achieves a substantially higher discovery rate of refusal gaps. |
LiveCANNBench: Benchmark SWE AI Coding for Ascend CANN (2026.findings-acl)
Copied to clipboard
Sijie Wang, Kai Zhao, Wee Peng Tay, Shuo Zhang, Chengwen Liu, Quanjiang Guo, Ren Junhao, Xin Li, Heng Lian, Jingdi Lei, Rui She, Huacan Wang, Ronghao Chen
| Challenge: | Recent advances in agents have enabled multi-file, multi-language, and dependency-aware AI coding. |
| Approach: | They propose an SWE-level benchmark for AI coding in the Huawei Ascend CANN software stack. |
| Outcome: | The proposed benchmark is constructed from real-world CANN repositories and consists of over 400 task instances spanning multiple file, multi-language, and execution-aware coding challenges. |
Probing Multimodal Large Language Models for Global and Local Semantic Representations (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies have focused on the ability of MLLMs to generate single tokens one by one, while lacking studies about how their representation vectors can encode global multimodal information. |
| Approach: | They propose to use image-caption corpus to train Multimodal Large Language Models (MLLMs) . they find that the topmost layers encode more global semantic information . |
| Outcome: | The proposed models can encode more global semantic information, rather than the topmost layers, and perform better on visual-language entailment tasks. |
Forging Multiple Training Objectives for Pre-trained Language Models via Meta-Learning (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Empirical studies show that learning multiple training objectives in a single model makes the learned language representation barely converge to the desired optimum. |
| Approach: | They propose a meta-learning-based adaptive sampler which learns latent sampling pattern on arbitrary pre-training objectives. |
| Outcome: | Empirical studies show that learning multiple objectives in a single model makes it difficult to achieve the desired optimum. |
A Troublemaker with Contagious Jailbreak Makes Chaos in Honest Towns (2025.acl-long)
Copied to clipboard
| Challenge: | Existing research focuses on single-agent attacks and shared memory attacks, but real-world scenarios often involve independent memory. |
| Approach: | They propose a large-scale, multi-agent, multitopology attack evaluation framework that exploits the memory of an agent to make it more vulnerable to jailbreak attacks. |
| Outcome: | The proposed framework improves on the troublemaker makes chaos in Honest Town task with 23.51%, 18.95%, and 52.93% improvements in line, star topologies, and 100-agent settings. |
Optimizing User Profiles via Contextual Bandits for Retrieval-Augmented LLM Personalization (2026.acl-long)
Copied to clipboard
Linfeng Du, Ye Yuan, Zichen Zhao, Fuyuan Lyu, Emiliano Penaloza, Xiuying Chen, Zipeng Sun, Jikun Kang, Laurent Charlin, Xue Liu, Haolun Wu
| Challenge: | Existing approaches for personalizing large language models require modifying parameters. |
| Approach: | They propose a lightweight approach to personalizing large language models via retrieval augmentation . relevance serves as an unreliable proxy for utility, they argue . |
| Outcome: | The proposed framework outperforms strong heuristic and retrieval-augmented baselines on nine personalization tasks. |
Iterative Document Representation Learning Towards Summarization with Polishing (D18-1)
Copied to clipboard
| Challenge: | Existing summarization methods read through document only once to generate a document representation, resulting in a sub-optimal representation. |
| Approach: | They propose an iterative model for supervised extractive text summarization which polishes the document representation on many passes through the document. |
| Outcome: | The proposed model outperforms state-of-the-art extractive systems on CNN/DailyMail and DUC2002 datasets. |
BlendFilter: Advancing Retrieval-Augmented Large Language Models via Query Generation Blending and Knowledge Filtering (2024.emnlp-main)
Copied to clipboard
Haoyu Wang, Ruirui Li, Haoming Jiang, Jinjin Tian, Zhengyang Wang, Chen Luo, Xianfeng Tang, Monica Cheng, Tuo Zhao, Jing Gao
| Challenge: | Retrieval-augmented Large Language Models struggle with complex inputs and noisy knowledge retrieval hindering model effectiveness. |
| Approach: | They propose a query generation method that integrates query generation blending with knowledge filtering to enhance retrieval-augmented LLMs. |
| Outcome: | The proposed approach surpasses state-of-the-art benchmarks on open-domain question answering benchmarks. |
A Survey on LLM-based Conversational User Simulation (2026.eacl-long)
Copied to clipboard
Bo Ni, Yu Wang, Leyao Wang, Branislav Kveton, Franck Dernoncourt, Yu Xia, Hongjie Chen, Reuben Luera, Samyadeep Basu, Subhojyoti Mukherjee, Puneet Mathur, Nesreen K. Ahmed, Junda Wu, Li Li, Huixin Zhang, Ruiyi Zhang, Tong Yu, Sungchul Kim, Jiuxiang Gu, Zhengzhong Tu, Alexa Siu, Zichao Wang, Seunghyun Yoon, Nedim Lipka, Namyong Park, Zihao Lin, Trung Bui, Yue Zhao, Tyler Derr, Ryan A. Rossi
| Challenge: | Recent advances in large language models (LLMs) have enabled high-fidelity generation of synthetic user conversation. |
| Approach: | They propose a taxonomy covering user granularity and simulation objectives . they analyze core techniques and evaluation methodologies to help them understand the latest developments . |
| Outcome: | The proposed model enables high-fidelity generation of synthetic user conversation. |
RAG-Star: Enhancing Deliberative Reasoning with Retrieval Augmented Verification and Refinement (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing large language models (LLMs) show exceptional problem-solving capabilities but struggle with complex reasoning tasks. |
| Approach: | They propose a novel RAG approach that integrates retrieved information to guide tree-based reasoning process based on LLMs. |
| Outcome: | The proposed approach outperforms existing methods in large language models . iteratively plans intermediate sub-queries and answers based on the LLM itself . |
Bit-Flip Error Resilience in LLMs: A Comprehensive Analysis and Defense Framework (2025.emnlp-main)
Copied to clipboard
Yuhang Chen, Zhen Tan, Ajay Kumar Jaiswal, Huaizhi Qu, Xinyu Zhao, Qi Lin, Yu Cheng, Andrew Kwong, Zhichao Cao, Tianlong Chen
| Challenge: | Bit-flip errors (BFEs) are hardware faults where individual bits in memory or processing units are unintentionally flipped. |
| Approach: | They propose a novel defense strategy to mitigate bit-flip errors (BFEs) they propose bfe protection and a self-correction mechanism to minimize performance degradation . |
| Outcome: | The proposed defense strategy minimizes performance degradation while significantly improving robustness against BFEs. |
FaithLens: Detecting and Explaining Faithfulness Hallucination (2026.findings-acl)
Copied to clipboard
Shuzheng Si, Qingyi Wang, Haozhe Zhao, Yuzhuo Bai, Guanqiao Chen, Kangyang Luo, Gang Chen, Fanchao Qi, Minjia Zhang, Baobao Chang, Maosong Sun
| Challenge: | Recent progress in large language models (LLMs) has revolutionized text generation. |
| Approach: | They propose a faithfulness hallucination detection model that can provide binary predictions and corresponding explanations to improve trustworthiness. |
| Outcome: | The proposed model outperforms advanced models on 12 diverse tasks. |
Factorized Learning Assisted with Large Language Model for Gloss-free Sign Language Translation (2024.lrec-main)
Copied to clipboard
| Challenge: | Previous Sign Language Translation methods have relied on gloss annotations to improve performance, but labeling high-quality glosses is labor-intensive and inefficient. |
| Approach: | They propose to integrate Large Language Model (LLM) into SLT by factorizing learning into two stages to improve the learning curve. |
| Outcome: | The proposed approach improves on three SLT datasets conducted under the gloss-free setting. |
RedCoder: Automated Multi-Turn Red Teaming for Code LLMs (2026.acl-long)
Copied to clipboard
Wenjie Jacky Mo, Qin Liu, Xiaofei Wen, Dongwon Jung, Hadi Askari, Wenxuan Zhou, Zhe Zhao, Muhao Chen
| Challenge: | Existing red-teaming approaches for code generation rely on extensive human effort and are prone to generating malicious code under adversarial environments. |
| Approach: | They propose a red-teaming agent that engages victim models in multi-turn conversations to elicit vulnerable code. |
| Outcome: | Experiments show that RedCoder outperforms red-teaming methods in inducing vulnerabilities in code generation. |
Cutting Off the Head Ends the Conflict: A Mechanism for Interpreting and Mitigating Knowledge Conflicts in Language Models (2024.findings-acl)
Copied to clipboard
Zhuoran Jin, Pengfei Cao, Hongbang Yuan, Yubo Chen, Jiexin Xu, Huaijun Li, Xiaojian Jiang, Kang Liu, Jun Zhao
| Challenge: | Existing methods to expand internal memory boundaries of language models by providing external context can often conflict, leading to knowledge conflicts. |
| Approach: | They propose a method that prunes conflicting attention heads without updating model parameters. |
| Outcome: | The proposed method can flexibly control eight LMs to use internal memory or external context without updating model parameters. |
EventOA: An Event Ontology Alignment Benchmark Based on FrameNet and Wikidata (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on event ontologies focus on entity-based OA, and neglect event-based one . however, independent development of event ontoologies often results in heterogeneous representations that raise the need for establishing alignments between semantically related events. |
| Approach: | They propose a multi-view event ontology alignment method that utilizes description information and neighbor information to obtain richer representations of the event ontoologies. |
| Outcome: | The proposed method outperforms existing entity-based methods and can serve as a strong baseline for future research. |
Modeling Multi-Dimensional Cognitive States in Large Language Models under Cognitive Crowding (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing Large Language Models (LLMs) mainly address isolated tasks such as emotion analysis or stance detection. |
| Approach: | They propose a large-scale model that combines large-level annotations with hyperbolic space to model human cognitive states. |
| Outcome: | The proposed model outperforms baseline models on cognitive dimensions on single dimension tasks while retaining strong hierarchical structure. |
Adversarial Regularization as Stackelberg Game: An Unrolled Optimization Approach (2021.emnlp-main)
Copied to clipboard
Simiao Zuo, Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Jianfeng Gao, Weizhu Chen, Tuo Zhao
| Challenge: | Existing approaches to adversarial regularization treat adversarials and defending players equally, which is undesirable because only the defending player contributes to the generalization performance. |
| Approach: | They propose a method which formulates adversarial regularization as a Stackelberg game and induces a competition between a leader and a follower. |
| Outcome: | The proposed method outperforms existing adversarial regularization baselines on a set of machine translation and natural language understanding tasks. |
Unlocking the Potential of Model Merging for Low-Resource Languages (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Adapting large language models (LLMs) to new languages requires continual pre-training followed by supervised fine-tuning. |
| Approach: | They propose a model merging solution that integrates LLMs with distinct capabilities into a single model without additional training. |
| Outcome: | The proposed model merging outperforms CT-then-SFT in low-resource languages with scarce data. |
Retrieving Multimodal Information for Augmented Generation: A Survey (2023.findings-emnlp)
Copied to clipboard
Ruochen Zhao, Hailin Chen, Weishi Wang, Fangkai Jiao, Xuan Long Do, Chengwei Qin, Bosheng Ding, Xiaobao Guo, Minzhi Li, Xingxuan Li, Shafiq Joty
| Challenge: | Large Language Models (LLMs) are increasingly using multimodality to augment their generation ability, but there is no unified perception of at which stage and how to incorporate different modalities. |
| Approach: | They propose to use multimodality to augment Large Language Models (LLMs) this will provide scholars with a deeper understanding of the methods' applications and encourage them to adapt existing techniques to the fast-growing field of LLMs. |
| Outcome: | The proposed methods improve factuality, reasoning, interpretability, and robustness of the generated content. |
Beyond Noise: Characterizing Creative Potential in Unverifiable LLM Hallucinations (2026.acl-long)
Copied to clipboard
Yu Yan, Chunhong Zhang, Haiyu Zhao, Ziyang Zeng, Zihao Liu, Yongkang Wu, Jianzhou Diao, YiJie Chen, Shujie Wang, Zheng Hu
| Challenge: | Large Language Models generate outputs that extend beyond established knowledge . prior work does not characterize the unverifiable space as a whole . |
| Approach: | They propose a novelty-verifiability characterization that distinguishes Creative Synthesis from Groundless Fabrication by a conceptual creation task. |
| Outcome: | The proposed model distinguishes Creative Synthesis (Region A) from Groundless Fabrication (Regium B) it shows that Region A is non-negligible and robust, persisting across generation strategies, models, domains, and embedding choices. |
RARR: Researching and Revising What Language Models Say, Using Language Models (2023.acl-long)
Copied to clipboard
Luyu Gao, Zhuyun Dai, Panupong Pasupat, Anthony Chen, Arun Tejasvi Chaganty, Yicheng Fan, Vincent Zhao, Ni Lao, Hongrae Lee, Da-Cheng Juan, Kelvin Guu
| Challenge: | Language models (LMs) excel at many tasks but often produce unsupported or misleading content. |
| Approach: | They propose a system that finds attribution for any text generation model and post-edits it to fix unsupported content. |
| Outcome: | The proposed system improves attribution while preserving the original output. |
LLMs Trust Humans More, That’s a Problem! Unveiling and Mitigating the Authority Bias in Retrieval-Augmented Generation (2025.acl-long)
Copied to clipboard
Yuxuan Li, Xinwei Guo, Jiashi Gao, Guanhua Chen, Xiangyu Zhao, Jiaxin Zhang, Quanying Liu, Haiyan Wu, Xin Yao, Xuetao Wei
| Challenge: | Large language models (LLMs) generate outputs that stray from user input or contravene established knowledge. |
| Approach: | They propose a new phenomenon, Authority Bias, where LLMs favor one knowledge source over the other . they propose atomic information that generates conflicts and a Conflict Detection Enhanced Query framework . |
| Outcome: | The proposed framework reduces Authority bias in large language models . it detects conflicts, performs credibility assessment on conflicting paragraphs, and detects perturbed text . |
RubricHub: A Comprehensive and Highly Discriminative Rubric Dataset via Automated Coarse-to-Fine Generation (2026.acl-long)
Copied to clipboard
Sunzhu Li, Jiale Zhao, Huimin Ren, Zhenlin Wei, Yang Zhou, Jingwen Yang, Shunyu Liu, Kaike Zhang, Chen Wei
| Challenge: | Existing methods for generating open-ended rubrics suffer from scalability bottlenecks and coarse criteria resulting in a supervision ceiling effect. |
| Approach: | They propose a framework for automated Coarse-to-Fine Rubric Generation . their framework uses principle-guided synthesis, multi-model aggregation, difficulty evolution . |
| Outcome: | The proposed framework produces comprehensive and highly discriminative criteria capable of capturing the subtle nuances. |
Debiasing the Fine-Grained Classification Task in LLMs with Bias-Aware PEFT (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods to mitigate label biases such as retraining, post-hoc adjustment, and parameter-efficient fine-tuning fail to address prediction propensity and discriminative ability biase. |
| Approach: | They propose a bias-aware optimization framework that incorporates two distinct label balance constraints with a PEFT strategy targeting an intermediate layer to mitigate this issue. |
| Outcome: | The proposed approach outperforms or matches the performance of full-parameter fine-tuning and LoRA, achieving superior results with lower perplexity. |
Group-wise Contrastive Learning for Neural Dialogue Generation (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to training dialogue models have low diversity in open-domain contexts . prior art suggests that naive MLE objective is not effective enough . |
| Approach: | They propose to incorporate contrastive learning into dialogue generation by using a pretrained baseline model as a reference. |
| Outcome: | The proposed framework is suited for training a wide range of dialogue generation models with favorable performance over baseline training approaches. |
Language Models can be Deductive Solvers (2024.findings-naacl)
Copied to clipboard
| Challenge: | Recent advances have enabled Large Language Models (LLMs) to potentially exhibit reasoning capabilities, but complex logical reasoning remains a challenge. |
| Approach: | They propose a novel language model that internalizes and emulates the reasoning processes of logical solvers and avoids parsing errors by learning strict adherence to solver syntax and grammar. |
| Outcome: | The proposed model outperforms state-of-the-art solver-augmented language models and few-shot prompting methods on public deductive reasoning benchmarks. |
Analyzing Chain-of-thought Prompting in Black-Box Large Language Models via Estimated V-information (2024.lrec-main)
Copied to clipboard
| Challenge: | Chain-of-Thought (CoT) prompting and large language models (LLMs) have shown great potential in improving performance on challenging reasoning tasks. |
| Approach: | They propose a new metric which extends the concept of pointwise V-information to black-box models and quantifies label-relevant new information introduced by CoT prompting. |
| Outcome: | The proposed metric extends the concept of pointwise V-information to black-box models, quantifying label-relevant new information introduced by CoT prompting beyond pre-existing label information. |
UQ-Merge: Uncertainty Guided Multimodal Large Language Model Merging (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing models merging methods often lead to suboptimal performance due to harmful models . et al., 2018; 59: 59-64. |
| Approach: | They propose an uncertainty-guided MLLM merging algorithm that integrates models into a single MLML. |
| Outcome: | The proposed algorithm improves on held-in and held-out vision-language benchmarks. |
Focus on Your Question! Interpreting and Mitigating Toxic CoT Problems in Commonsense Reasoning (2024.acl-long)
Copied to clipboard
| Challenge: | Large language models exhibit high-level commonsense reasoning abilities, especially with enhancement methods like Chain-of-Thought (CoT). |
| Approach: | They propose a chain-of-thought-like method to elicit models' potential abilities to generate rationales and answers that are based on attribution tracing and causal tracers to probe the internal working mechanism of the LLM. |
| Outcome: | The proposed method eliminates Toxic CoT problems and improves the model’s overall commonsense reasoning performance by 5.5%. |
CityEQA: A Hierarchical LLM Agent on Embodied Question Answering Benchmark in City Space (2025.emnlp-main)
Copied to clipboard
Yong Zhao, Kai Xu, Zhengqiu Zhu, Yue Hu, Zhiheng Zheng, Yingfeng Chen, Yatai Ji, Chen Gao, Yong Li, Jincai Huang
| Challenge: | Embodied Question Answering (EQA) tasks are primarily focused on indoor environments, leaving the complexities of urban settings unexplored. |
| Approach: | They propose a task where an embodied agent answers open-vocabulary questions in dynamic city spaces. |
| Outcome: | The proposed agent achieves 60.7% of human-level answering accuracy compared to baselines . the proposed agent outperforms existing agents in open-ended city spaces . |
SCALE: Towards Collaborative Content Analysis in Social Science with Large Language Model Agents and Human Intervention (2025.acl-long)
Copied to clipboard
| Challenge: | Content analysis is labor-intensive and time-consuming process that requires multiple rounds of manual annotation, domain expert discussion, and rule-based refinement. |
| Approach: | They propose a multi-agent framework that effectively Simulates Content Analysis via Large language model (LLM) ag Ents. |
| Outcome: | The proposed framework achieves human-approximated performance across various content analysis tasks. |
LGESQL: Line Graph Enhanced Text-to-SQL Model with Mixed Local and Non-Local Relations (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods to encode text-to-SQL data are node-centric and ignore semantics embedded in the topological structure of edges. |
| Approach: | They propose a Line Graph Enhanced Text-to-SQL model to mine relational features without constructing meta-paths. |
| Outcome: | The proposed model achieves state-of-the-art on the cross-domain text-to-SQL benchmark Spider at the time of writing. |
IntrAgent: An LLM Agent for Content-Grounded Information Retrieval through Literature Review (2026.acl-long)
Copied to clipboard
| Challenge: | Scientific research relies on accurate information retrieval from literature to support analytical decisions. |
| Approach: | They propose a task that automates fine-grained information retrieval *faithfully* grounded in the provided content in response to research-driven queries. |
| Outcome: | The proposed agent achieves 13.2% higher cross-domain accuracy than state-of-the-art RAG and research-agent baselines across seven backbone LLMs. |
MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsing (2026.acl-industry)
Copied to clipboard
Junbo Niu, Zheng Liu, Zhuangcheng Gu, Bin Wang, Linke Ouyang, Zhiyuan Zhao, Tao Chu, Tianyao He, Fan Wu, Qintong Zhang, Zhenjiang Jin, Guang Liang, Rui Zhang, Wenzheng Zhang, Yuan Qu, Zhifei Ren, Yuefeng Sun, Zirui Tang, Boyu Niu, Yuanhong Zheng, Dongsheng Ma, Ziyang Miao, Hejun Dong, Siyi Qian, Junyuan Zhang, Fangdong Wang, Jingzhou Chen, Xiaomeng Zhao, Liqun Wei, Wei Li, Shasha Wang, RuiLiang Xu, Yuanyuan Cao, Lu Chen, Qianqian Wu, Huaiyu Gu, Lindong Lu, Dechen Lin, null Shenguanlin, Xuanhe Zhou, Linfeng Zhang, Yuhang Zang, Xiaoyi Dong, Jiaqi Wang, Bo Zhang, Lei Bai, Pei Chu, Weijia Li, Jiang Wu, Lijun Wu, Zhenxiang Li, Guangyu Wang, Zhongying Tu, Chao Xu, Kai Chen, Bowen Zhou, Dahua Lin, Wentao Zhang, Conghui He
| Challenge: | Document images are characterized by higher resolutions, denser content, and more complex structural layouts. |
| Approach: | They propose a 1.2B-parameter document parsing vision-language model that decouples layout analysis from local content recognition. |
| Outcome: | The proposed model surpasses general-purpose and domain-specific models on multiple benchmarks while maintaining significantly lower computational overhead. |
PairCoder: Pair Programming-Inspired Two-Agent Collaboration for Code Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing multi agent frameworks for large language models are brittle on code generation tasks. |
| Approach: | They propose a framework that brings pair programming to autonomous LLM collaboration. |
| Outcome: | Using PairCoder, large language models achieve better results on code generation tasks and reduce token usage by 40% to 70% on eight representative backbones. |
Uncertainty-Aware Test-Time Search for Optimization Problem Solving (2026.acl-long)
Copied to clipboard
Linlin Yu, Xujiang Zhao, Dong Li, Yanchi Liu, Wei Cheng, Zhengzhang Chen, Chen Zhao, Feng Chen, Haifeng Chen
| Challenge: | Language model hallucinations and limited availability of labeled datasets often result in misaligned formulations, code errors and feasibility failures. |
| Approach: | They propose a Monte Carlo Tree Search framework that automates optimization problems from natural language descriptions with efficiency and reliability. |
| Outcome: | The proposed framework achieves state-of-the-art solution accuracy and reduces token usage. |
Emphasising Structured Information: Integrating Abstract Meaning Representation into LLMs for Enhanced Open-Domain Dialogue Evaluation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing evaluation metrics struggle to evaluate adversarial negative examples . existing metrics struggle in handling adversarials, resulting in low correlations with human judgments. |
| Approach: | They propose a framework that integrates AMR and domain-specific language models for automatic open-domain dialogue evaluation. |
| Outcome: | The proposed evaluation framework achieves strong correlations with human judgments across multiple datasets. |
Rethinking Multi-Modal Alignment in Multi-Choice VideoQA from Feature and Sample Perspectives (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to VideoQA focus on utilizing frame- or object-level visual representations, but they neglect visual-language interactions. |
| Approach: | They propose to break down video into trajectories and first leverage trajectory feature in VideoQA to enhance alignment between two modalities. |
| Outcome: | The proposed method outperforms all the state-of-the-art models on the NExT-QA benchmark. |
Sentence-Level Agreement for Neural Machine Translation (P19-1)
Copied to clipboard
| Challenge: | Empirical results show that a sentence-level agreement module can significantly improve the performance of neural machine translation (NMT) |
| Approach: | They propose a sentence-level agreement module to minimize the difference between the representation of source and target sentences. |
| Outcome: | Empirical results show the proposed agreement module significantly improves translation performance. |
Let The Jury Decide: Fair Demonstration Selection for In-Context Learning through Incremental Greedy Evaluation (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing demonstration selection strategies focus on optimizing performance metrics such as accuracy. |
| Approach: | They propose a framework for selecting fair and representative demonstrations that improve group fairness in In-Context Learning. |
| Outcome: | The proposed framework improves fairness metrics without compromising accuracy. |
CogToM: A Comprehensive Theory of Mind Benchmark inspired by Human Cognition for Large Language Models (2026.acl-long)
Copied to clipboard
Haibo Tong, Zeyang Yue, Feifei Zhao, Erliang Lin, Lu Jia, Ruolin Chen, Yinqian Sun, Qian Zhang, Yi Zeng
| Challenge: | Existing benchmarks for Large Language Models (LLMs) are limited to false belief tasks, highlighting bottlenecks in specific dimensions. |
| Approach: | They propose a benchmark to evaluate Large Language Models' Theory of Mind capabilities . they evaluate 8000 bilingual instances across 46 paradigms and validated by 49 human annotators . |
| Outcome: | The proposed benchmark reveals performance heterogeneities and bottlenecks in 22 representative models. |
Enhancing Speech Large Language Models with Prompt-Aware Mixture of Audio Encoders (2025.emnlp-main)
Copied to clipboard
Weiqiao Shan, Yuang Li, Yuhao Zhang, Yingfeng Luo, Chen Xu, Xiaofeng Zhao, Long Meng, Yunfei Lu, Min Zhang, Hao Yang, Tong Xiao, JingBo Zhu
| Challenge: | Existing work on integrating audio encoders with large language models (LLMs) has focused on semantic understanding tasks, but different tasks may require distinct features that emphasize either semantic or acoustic aspects. |
| Approach: | They propose to use a prompt-aware mixture to enhance the Speech LLM that uses multiple audio encoders to extract different features based on the prompt. |
| Outcome: | The proposed approach outperforms all single-encoder Speech LLMs on ASR, speaker number verification, and AC tasks. |
Document-Level Relation Extraction with Sentences Importance Estimation and Focusing (2022.naacl-main)
Copied to clipboard
| Challenge: | Document-level relation extraction models are not robust and exhibit bizarre behaviors when non-evidence sentences are removed. |
| Approach: | They propose a document-level relation extraction framework that uses a sentence importance score and a focusing loss to encourage DocRE models to focus on evidence sentences. |
| Outcome: | The proposed framework improves overall performance and makes DocRE models more robust. |
InstructCoder: Instruction Tuning Large Language Models for Code Editing (2024.acl-srw)
Copied to clipboard
| Challenge: | InstructCoder is the first instruction-tuning dataset designed to adapt LLMs for general-purpose code editing. |
| Approach: | They propose to use Large Language Models to edit code based on user instructions . they use a dataset to adapt LLMs to general-purpose code editing . |
| Outcome: | The proposed model can significantly improve code editing performance compared to proprietary models . the proposed model is based on a human-written execution-based benchmark . |
MiLoRA: Efficient Mixture of Low-Rank Adaptation for Large Language Models Fine-tuning (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Low-rank adaptation and its mixture-of-experts (MOE) methods are highly effective but introduce significant latency in multi-tenant settings due to the LoRA modules and MOE routers added to multiple linear modules. |
| Approach: | They propose a low-rank adaptation variant that considers each LoRA module as an expert and employs a prompt-aware routing mechanism. |
| Outcome: | Extensive analysis on commonsense reasoning tasks and math reasoning tasks show that MiLoRA outperforms strong PEFT baselines with comparable tunable parameter budgets. |
A Computational Method for Measuring Open Codes in Qualitative Analysis (2026.findings-acl)
Copied to clipboard
John Chen, Alexandros Nikolaos Lotsos, Sihan Cheng, Lexie Zhao, Yanjia Zhang, Jessica Hullman, Bruce Sherin, Uri Wilensky, Michael Horn
| Challenge: | Qualitative analysis is widely adopted across many social science disciplines. |
| Approach: | They propose a theory-informed computational method for measuring inductive coding results from humans and GAI. |
| Outcome: | The proposed method captures breadth, consensus, unique contribution, and systematic deviation without assuming ground truth. |
Unveiling the Flaws: Exploring Imperfections in Synthetic Data and Mitigation Strategies for Large Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | acquiring large amounts of high-quality data can be challenging due to data scarcity, privacy concerns, and high costs. |
| Approach: | They propose a method which reverses instruction-following issues caused by uniform format of synthetic data and proposes unlearning techniques to mitigate these flaws. |
| Outcome: | The proposed method reverses instruction-following issues caused by pattern overfitting without compromising performance on benchmarks at relatively low cost. |
Dynamic Feature Fusion for Sign Language Translation Using HyperNetworks (2025.findings-naacl)
Copied to clipboard
| Challenge: | Using RGB and keypoint streams, sign language translation is highly dependent on the brain's ability to process color, shape, and motion simultaneously. |
| Approach: | They propose a hypernetwork-based fusion method that extracts salient features from RGB and keypoint streams and introduces self-distillation and SST contrastive learning to maintain feature advantages while aligning the global semantic space. |
| Outcome: | The proposed method achieves state-of-the-art performance on two public sign language datasets, reducing model parameters by about two-thirds. |
Neural Machine Translation for Agglutinative Languages via Data Rejuvenation (2025.acl-srw)
Copied to clipboard
| Challenge: | Recent years, advances in Neural Machine Translation (NMT) heavily rely on large-scale parallel corpora. |
| Approach: | They propose to combine fine-grained inactive sample identification with target-side rejuvenation to improve translation quality from agglutinative languages. |
| Outcome: | The proposed framework improves on four low-resource agglutinative language tasks. |
SciAssess: Benchmarking LLM Proficiency in Scientific Literature Analysis (2025.findings-naacl)
Copied to clipboard
Hengxing Cai, Xiaochen Cai, Junhan Chang, Sihang Li, Lin Yao, Wang Changxin, Zhifeng Gao, Hongshuai Wang, Li Yongge, Mujie Lin, Shuwen Yang, Jiankun Wang, Mingjun Xu, Jin Huang, Xi Fang, Jiaxi Zhuang, Yuqi Yin, Yaqi Li, Changhong Chen, Zheng Cheng, Zifeng Zhao, Linfeng Zhang, Guolin Ke
| Challenge: | Existing benchmarks fail to adequately evaluate the proficiency of Large Language Models (LLMs) Existing standards do not cover the skills needed to evaluate LLMs in scientific literature analysis. |
| Approach: | They propose a benchmark to evaluate the proficiency of large language models in scientific literature analysis. |
| Outcome: | SciAssess evaluates 11 LLMs on multiple tasks across scientific fields. |
KnowDis: Knowledge Enhanced Data Augmentation for Event Causality Detection via Distant Supervision (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods of event causality detection use hand-labeled training data. |
| Approach: | They propose a framework for event causality detection that augments training data via distant supervision. |
| Outcome: | The proposed framework outperforms existing methods on two benchmark datasets . it outperformed previous methods by a large margin assisted with automatically labeled training data. |
CortexDebate: Debating Sparsely and Equally for Multi-Agent Debate (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to improve the reasoning performance of LLMs suffer from two major shortcomings: too lengthy input contexts and overconfidence dilemma. |
| Approach: | They propose a method to debating among LLM agents using a sparse debator graph . they use a module called McKinsey-based Debate Matter to optimize the debators . |
| Outcome: | The proposed method has been well demonstrated across eight datasets from four task types. |
FinDVer: Explainable Claim Verification over Long and Hybrid-content Financial Documents (2024.emnlp-main)
Copied to clipboard
Yilun Zhao, Yitao Long, Tintin Jiang, Chengye Wang, Weiyuan Chen, Hongjun Liu, Xiangru Tang, Yiming Zhang, Chen Zhao, Arman Cohan
| Challenge: | FinDVer is a benchmark to evaluate the explainable claim verification capabilities of LLMs . financial documents are typically long, intricate and dense, and they include both quantita and numerical reasoning. |
| Approach: | They propose a benchmark to evaluate the explainable claim verification capabilities of LLMs . they assess 25 LLM systems under long-context and RAG settings . |
| Outcome: | The proposed benchmark can be used to evaluate the explainable claim verification capabilities of LLMs in financial documents. |
CondenseFlow: Scalable Latent Space Collaboration via Semantic Compression for Multi-Agent Systems (2026.findings-acl)
Copied to clipboard
| Challenge: | Full-state latent communication in LLMs suffers from memory overhead scaling linearly with collaboration rounds. |
| Approach: | They propose a lightweight module that uses learnable semantic probes to compress KV caches into fixed-size representations. |
| Outcome: | The proposed module reduces KV cache memory by over 99% and inference latency by approximately 20% on seven benchmarks spanning six models . it outperforms text-based methods by 1.7 percentage points on average across all configurations while outperforming existing methods by 1.7%. |
How Many Answers Should I Give? An Empirical Study of Multi-Answer Reading Comprehension (2023.findings-acl)
Copied to clipboard
| Challenge: | Despite recent progress in multi-answer MRC, there is no systematic analysis of how this phenomenon arises and how to better address it. |
| Approach: | They develop a taxonomy to categorize commonly-seen multi-answer MRC instances and examine how well different paradigms deal with different types of multi-announced questions. |
| Outcome: | The proposed taxonomy categorizes commonly-seen multi-answer instances and analyzes how well different paradigms deal with different types of multi-announced instances. |
Selection and Generation: Learning towards Multi-Product Advertisement Post Generation (2020.emnlp-main)
Copied to clipboard
| Challenge: | E-commerce websites have billions of products, so it is impossible to write all copywriting manually. |
| Approach: | They propose a model to generate an AD post using a select network and a MGenNet network to generate a post including selected products. |
| Outcome: | The proposed model achieves impressive performance on a large-scale real-world AD post dataset. |
Multi-Turn Response Selection for Chatbots with Deep Attention Matching Network (P18-1)
Copied to clipboard
| Challenge: | Existing models for matching dialogue responses rely on semantic and functional dependencies . a recent study only uses the last utterance in context for matching a reply . |
| Approach: | They propose a model that matches a response with its multi-turn context using attention. |
| Outcome: | The proposed model outperforms the state-of-the-art models on two large-scale multi-turn response selection tasks. |
An Iterative Emotion Interaction Network for Emotion Recognition in Conversations (2020.coling-main)
Copied to clipboard
| Challenge: | Emotion recognition in conversations (ERC) is a task that aims to recognize the emotion of each utterance in conversations. |
| Approach: | They propose an iterative emotion interaction network which uses iterativly predicted emotion labels instead of gold emotion labels to explicitly model the emotion interaction. |
| Outcome: | The proposed method retains state-of-the-art performance on two datasets and achieves high accuracy. |
Less is More: Knowledge-Aware Compression for Long Legal Judgment Prediction (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent advances leverage large language models (LLMs) for legal reasoning, but they face high computational costs and information degradation when handling long cases. |
| Approach: | They propose a framework that selectively retains legally relevant information while reducing redundant or less informative content, enabling efficient and accurate long-context reasoning. |
| Outcome: | The proposed framework outperforms existing methods on four real-world datasets spanning multiple jurisdictions and languages. |
KPatch: Knowledge Patch to Pre-trained Language Model for Zero-Shot Stance Detection on Social Media (2024.lrec-main)
Copied to clipboard
Shuohao Lin, Wei Chen, Yunpeng Gao, Zhishu Jiang, Mengqi Liao, Zhiyu Zhang, Shuyuan Zhao, Huaiyu Wan
| Challenge: | Existing knowledge injection methods fail to understand the semantics of tweets . |
| Approach: | They propose a method to flexibly inject knowledge into a pre-trained language model and adaptively expand tweets context. |
| Outcome: | The proposed method is based on two training stages to flexibly inject knowledge into the pre-trained language model and adaptively expand tweets context. |
TokenPenalty: Alleviating Attention Sinks and Positional Decay in LVLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Multimodal large language models (MLLMs) often hallucinate due to two relevant phenomena: massive activation phenomenon and positional information decay. |
| Approach: | They propose a token-level intervention strategy that dynamically suppresses irrelevant visual tokens while preserving key contextual signals. |
| Outcome: | Experiments show that TokenTruth significantly improves factual consistency across MLLMs on standard image understanding benchmarks. |
FinTrust: A Comprehensive Benchmark of Trustworthiness Evaluation in Finance Domain (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent LLMs have demonstrated promising ability in solving finance related problems, but applying them in real-world finance applications remains challenging due to its high risk and high stakes property. |
| Approach: | They propose a benchmark specifically designed for evaluating the trustworthiness of LLMs in finance applications. |
| Outcome: | The proposed benchmark outperforms proprietary models in most tasks while open-source models have advantage in specific areas like industry-level fairness. |
Harmonizing the Past, Present, and Future: A Null-Space Constrained Region-Specific Method for Continual Learning in LLMs (2026.acl-long)
Copied to clipboard
Jinhui Chen, Shizhu He, Xingchang Yang, Huanxuan Liao, Yequan Wang, Xiangwen Liao, Wenhao Teng, Kang Liu, Jun Zhao
| Challenge: | Existing continual learning paradigms prioritize instant performance through dense updates, leading to catastrophic forgetting and rapid exhaustion of model capacity. |
| Approach: | They propose a method that preserves previously acquired knowledge and acquires new task-specific skills while preserving sufficient parameter capacity for subsequent adaptation. |
| Outcome: | The proposed method is based on the brain's functional partitioning and can be used to map tasks between specialized and generalist neurons. |
DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models (2024.acl-long)
Copied to clipboard
Damai Dai, Chengqi Deng, Chenggang Zhao, R.x. Xu, Huazuo Gao, Deli Chen, Jiashi Li, Wangding Zeng, Xingkai Yu, Y. Wu, Zhenda Xie, Y.k. Li, Panpan Huang, Fuli Luo, Chong Ruan, Zhifang Sui, Wenfeng Liang
| Challenge: | Mixture-of-Experts (MoE) architectures face challenges in ensuring expert specialization . despite the promising performance, scaling language models to an extremely large scale is associated with exceedingly high computational costs. |
| Approach: | They propose an architecture that allows for ultimate expert specialization by segmenting experts into mN ones and activating mK from them. |
| Outcome: | The proposed architecture achieves comparable performance with GShard with 2B parameters and computation. |
OpenT2T: An Open-Source Toolkit for Table-to-Text Generation (2024.emnlp-demo)
Copied to clipboard
Haowei Zhang, Shengyun Si, Yilun Zhao, Lujing Xie, Zhijian Xu, Lyuhao Chen, Linyong Nan, Pengcheng Wang, Xiangru Tang, Arman Cohan
| Challenge: | Existing methods for table-to-text generation are limited and benchmarked on a limited number of datasets. |
| Approach: | They propose to use open-source tools to reproduce existing large language models for performance comparison and expedite the development of new models. |
| Outcome: | The proposed toolkit compares existing large language models on 9 table-to-text generation datasets and maintains a leaderboard to provide insights for future work. |
Transparentize the Internal and External Knowledge Utilization in LLMs with Trustworthy Citation (2025.findings-acl)
Copied to clipboard
| Challenge: | citation generation and retrieval-augmented generation are still lacking in large language models due to hallucinations. |
| Approach: | They propose a retrieval-augmented citation generation task that requires models to generate citations considering both external and internal knowledge while providing trustworthy references. |
| Outcome: | The proposed method achieves better performance across scenarios compared to baselines . retrieval quality, question types, and model knowledge influence trustworthiness . |
Interpreting Sentiment Composition with Latent Semantic Tree (2023.findings-acl)
Copied to clipboard
| Challenge: | Current researches on sentiment classification are shifting from improving model performance to interpretability. |
| Approach: | They propose a new tree form capable of interpreting sentiment composition in a principled way. |
| Outcome: | The proposed tree can explain sentiment composition in a principled way. |
ChartCoder: Advancing Multimodal Large Language Model for Chart-to-Code Generation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing open-source MLLMs fail to fully capture dense information embedded in charts . current models still face significant challenges in understanding and analyzing visual tasks such as captioning and question answering. |
| Approach: | They propose a chart-to-code MLLM which leverages Code LLMs as the language backbone to enhance the executability of the generated code. |
| Outcome: | The proposed model surpasses existing open-source models on chart-to-code benchmarks with only 7B parameters and provides lossless representations that contain all critical details. |
Forget the Unneeded: Backdooring Large Language Models via Contrastive-enhanced Machine Unlearning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for prompt tuning for Large Language Models find backdoor attacks to be significant in data-rich scenarios. |
| Approach: | They propose a backdoor attacks through contrastive-enhanced machine unlearning in data-limited scenarios . they use a machine un learning method to capture precise backdoor patterns . |
| Outcome: | The proposed method captures precise backdoor patterns without association between triggers and backdoors, reducing side effects. |
MULFE: A Multi-Level Benchmark for Free Text Model Editing (2024.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have impressive capabilities in comprehending human language and vast parametric knowledge obtained from large corpora. |
| Approach: | They propose a multi-level benchmark for free text model editing to bridge the gap . they categorize probe queries into three levels of generalization . |
| Outcome: | The proposed method improves the generalization performance of large langugae models. |
Looking Beyond Text: Reducing Language Bias in Large Vision-Language Models via Multimodal Dual-Attention and Soft-Image Guidance (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large vision-language models (LVLMs) have been criticized for their language bias. |
| Approach: | They propose to use a dual-attention mechanism to construct separate attention for visual and text inputs to enhance integration of visual inputs across models. |
| Outcome: | Experiments show that the proposed model debiases LVLMs from their language bias, enhancing visual comprehension and reducing hallucinations without additional resources. |
Are Multimodal LLMs Robust Against Adversarial Perturbations? RoMMath: A Systematic Evaluation on Multimodal Math Reasoning (2025.naacl-long)
Copied to clipboard
| Challenge: | Recent-released MLLMs have shown remarkable performance on various multimodal math reasoning benchmarks. |
| Approach: | They introduce RoMMath, the first benchmark designed to evaluate the capabilities and robustness of multimodal large language models in handling multimodal math reasoning. |
| Outcome: | The proposed model performs well on a broad spectrum of 17 MLLMs and demonstrates that they are robust to adversarial perturbations. |
TIE: Topological Information Enhanced Structural Reading Comprehension on Web Pages (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing models for structural reading comprehension (SRC) only focus on comprehension of plain text, tables, tables or knowledge bases. |
| Approach: | They propose a topological information enhanced model which transforms a token-level task into a tag-level one by introducing a two-stage process. |
| Outcome: | The proposed model outperforms baselines and achieves state-of-the-art performance on the web-based SRC benchmark WebSRC at the time of writing. |
Mutual-Learning Improves End-to-End Speech Translation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to end-to-end speech translation (E2E) models only allow one way knowledge transfer, which is limited by the performance of the teacher model. |
| Approach: | They propose a one-way knowledge transfer paradigm where the MT and ST models are collaboratively trained and considered as peers rather than teacher/student. |
| Outcome: | The proposed model improves the performance of end-to-end speech translation (ST) task by combining knowledge from two models with peer models. |
Learning from Adjective-Noun Pairs: A Knowledge-enhanced Framework for Target-Oriented Multimodal Sentiment Classification (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods to determine sentiment polarity of opinion target are inconsistent and lack visual attention. |
| Approach: | They propose a framework which can exploit adjective-noun pairs extracted from images to improve visual attention and sentiment prediction capability of the TMSC task. |
| Outcome: | The proposed framework outperforms state-of-the-art on two public datasets. |
SciSketch: An Open-source Framework for Automated Schematic Diagram Generation in Scientific Papers (2025.emnlp-demos)
Copied to clipboard
| Challenge: | SCISKETCH is an open-source framework that supports two automated workflows for schematic diagram generation using foundation models. |
| Approach: | They propose an open-source framework that supports two automated workflows for schematic diagram generation using foundation models. |
| Outcome: | The open-source framework outperforms several state-of-the-art foundation models in generating schematic diagrams for scientific papers. |
Token-wise Curriculum Learning for Neural Machine Translation (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing curriculum learning approaches to Neural Machine Translation (NMT) require sampling sufficient amounts of “easy” samples from training data at the early stage of training. |
| Approach: | They propose a token-wise curriculum learning approach that creates sufficient amounts of easy samples from training data. |
| Outcome: | The proposed approach outperforms baselines on five language pairs on low-resource languages. |
ShadowGNN: Graph Projection Neural Network for Text-to-SQL Parser (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing semantic parsing models struggle to adapt to unseen database schemas . a new architecture, ShadowGNN, processes schemas at abstract and semantic levels . |
| Approach: | They propose a new architecture which processes schemas at abstract and semantic levels. |
| Outcome: | The proposed architecture outperforms state-of-the-art models on a text-to-sql benchmark . it uses domain-independent representations to extract logical linking between question and schema . |
KG-Agent: An Efficient Autonomous Agent Framework for Complex Reasoning over Knowledge Graph (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods to design the interaction strategy between large language models and knowledge graphs (KGs) are not effective for large language model (LLM)s to solve complex tasks due to the large volume and structured format of KG data. |
| Approach: | They propose an LLM-based agent framework that enables small LLMs to actively make decisions over knowledge graphs. |
| Outcome: | The proposed framework outperforms existing methods on in-domain and out-domain datasets using 10K samples. |
Rethinking the Role of Entropy in Optimizing Tool-Use Behaviors for Large Language Model Agents (2026.acl-long)
Copied to clipboard
Zeping Li, Hongru Wang, Yiwen Zhao, Guanhua Chen, Yixia Li, Keyang Chen, Yixin Cao, Guangnan Ye, Hongfeng Chai, Zhenfei Yin
| Challenge: | Large language models excel in mathematical reasoning and multi-hop question answering tasks, but in long trajectories, agents often invoke tools excessively or inappropriately, increasing computation cost and derailing the reasoning process. |
| Approach: | They propose to use entropy reduction as a supervisory signal to reduce tool calls . they propose to design two reward strategies to address the needs of optimizing tool-use behavior. |
| Outcome: | The proposed reward strategies reduce tool calls by 72.07% and improve performance by 22.27%. |
Metacognitive Self-Correction for Multi-Agent System via Prototype-Guided Next-Execution Reconstruction (2026.findings-acl)
Copied to clipboard
Xu Shen, Qi Zhang, Song Wang, Zhen Tan, Xinyu Zhao, Laura Yao, Vaishnav Tadiparthi, Hossein Nourkhiz Mahjoub, Ehsan Moradi Pari, Kwonjoon Lee, Tianlong Chen
| Challenge: | Large Language Model based multi-agent systems (MAS) excel at collaborative problem solving but remain brittle to cascading errors. |
| Approach: | They propose a metacognitive framework that enables step-level error detection and self-correction in Large Language Model based multi-agent systems (MAS) . |
| Outcome: | The proposed framework outperforms baselines on the Who When benchmark and delivers consistent gains on AgentErrorBench. |
OctoBench: Benchmarking Scaffold-Aware Instruction Following in Repository-Grounded Agentic Coding (2026.acl-long)
Copied to clipboard
Deming Ding, Shichun Liu, Enhui Yang, Jiahang Lin, Ziying Chen, Shihan Dou, Honglin Guo, Weiyu Cheng, Pengyu Zhao, Chengjun Xiao, Qunhong Zeng, Qi Zhang, Xuanjing Huang, Qidi Xu, Tao Gui
| Challenge: | coding scaffolds that follow heterogeneous instructions remain under-examined in software engineering . coding models are capable software agents, but their ability to follow constraints remains under-explored . |
| Approach: | They introduce OctoBench, which benchmarks scaffold-aware instruction following in agentic coding. |
| Outcome: | The proposed benchmark aims to accelerate the development of more scaffold-aware agents. |
CogKGE: A Knowledge Graph Embedding Toolkit and Benchmark for Representing Multi-source and Heterogeneous Knowledge (2022.acl-demo)
Copied to clipboard
Zhuoran Jin, Tianyi Men, Hongbang Yuan, Zhitao He, Dianbo Sui, Chenhao Wang, Zhipeng Xue, Yubo Chen, Jun Zhao
| Challenge: | Existing methods focus on entity-centric knowledge, but CogKGE supports heterogeneous knowledge. |
| Approach: | They propose a knowledge graph embedding toolkit to represent multi-source and heterogeneous knowledge. |
| Outcome: | The proposed toolkit provides a unified programming framework for KGE tasks and a series of knowledge representations for downstream tasks. |
FedGUI: Benchmarking Federated GUI Agents across Heterogeneous Platforms, Devices, and Operating Systems (2026.findings-acl)
Copied to clipboard
WenHao Wang, Haoting Shi, Mengying Yuan, Yiquan Lin, Panrong Tong, Hanzhang Zhou, Guangyi Liu, Pengxiang Zhao, Yue Wang, Siheng Chen
| Challenge: | a lack of benchmarks capture real-world, cross-platform heterogeneity in GUI training . traditional methods to train GUI agents rely on centralized data collection and manual labeling . |
| Approach: | They propose a benchmark for developing and evaluating federated GUI agents across mobile, web and desktop platforms. |
| Outcome: | The proposed benchmarks show that cross-platform collaboration improves performance and identify platform and OS as the most influential factors. |
Mitigating Hallucinations of Large Language Models in Medical Information Extraction via Contrastive Decoding (2024.findings-emnlp)
Copied to clipboard
Derong Xu, Ziheng Zhang, Zhihong Zhu, Zhenxi Lin, Qidong Liu, Xian Wu, Tong Xu, Xiangyu Zhao, Yefeng Zheng, Enhong Chen
| Challenge: | Medical Information Extraction (MIE) tasks are a fundamental component of medical NLP. |
| Approach: | They propose an alternative adaptive constraint strategy to adjust the scale and scope of contrastive tokens. |
| Outcome: | The proposed approach selectively enhances the identification and classification capabilities while minimizing the influence of other inherent abilities in LLMs. |
Super Tickets in Pre-Trained Language Models: From Model Compression to Improving Generalization (2021.acl-long)
Copied to clipboard
Chen Liang, Simiao Zuo, Minshuo Chen, Haoming Jiang, Xiaodong Liu, Pengcheng He, Tuo Zhao, Weizhu Chen
| Challenge: | 'lottery tickets' can be trained to match the performance of a full model . subnetwork training can also outperform random sampled subnetworks of the same size . |
| Approach: | They propose to train a subnetwork of 'lottery tickets' to match the full model's performance. |
| Outcome: | The proposed model outperforms subnetworks of the same size in a phase transition phenomenon . the proposed model improves single task fine-tuning by 0.9 points on BERT-base and 1.0 points on GLUE large . |
STK-Adapter: Incorporating Evolving Graph and Event Chain for Temporal Knowledge Graph Extrapolation (2026.acl-long)
Copied to clipboard
Shuyuan Zhao, Wei Chen, Weijie Zhang, Xinrui Hou, Junfeng Shen, Boyan Shi, Shengnan Guo, Youfang Lin, Huaiyu Wan
| Challenge: | Temporal Knowledge Graphs (TKGs) store dynamic facts in the real world. |
| Approach: | They propose a Spatial-Temporal Knowledge Adapter which integrates the evolving graph encoder and the LLM to facilitate TKG reasoning. |
| Outcome: | The proposed method outperforms state-of-the-art methods on benchmark datasets and exhibits strong generalization capabilities in cross-dataset task. |
FedED: Federated Learning via Ensemble Distillation for Medical Relation Extraction (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing relation extraction methods require centralizing training data from different medical platforms while holding the privacy-sensitive data puts patients' privacy at risk. |
| Approach: | They propose a federated relation extraction model that trains a central model without sharing or exchange of private local data. |
| Outcome: | The proposed model trains a central model without uploading local parameters, and it performs well on three publicly available datasets. |
DIDS: Domain Impact-aware Data Sampling for Large Language Model Training (2025.emnlp-main)
Copied to clipboard
Weijie Shi, Jipeng Zhang, Yaguang Wu, Jingzhi Fang, Shibo Zhang, Yao Zhao, Hao Chen, Ruiyuan Zhang, Yue Cui, Jia Zhu, Sirui Han, Jiajie Xu, Xiaofang Zhou
| Challenge: | Existing approaches for optimizing domain-level sampling strategies struggle with maintaining intra-domain consistency and accurately measuring domain impact. |
| Approach: | They propose to use a Fisher-Information Matrix-guided metric to measure domain impact to ensure intra-domain consistency and accuracy. |
| Outcome: | The proposed model achieves 3.4% higher average performance while maintaining comparable training efficiency. |
Integrating Semantics and Neighborhood Information with Graph-Driven Generative Models for Document Retrieval (2021.acl-long)
Copied to clipboard
Zijing Ou, Qinliang Su, Jianxing Yu, Bang Liu, Jingwen Wang, Ruihui Zhao, Changyou Chen, Yefeng Zheng
| Challenge: | Existing methods for document hashing combine only one of semantics and neighborhood information, lacking a theoretical principle to guide the integration process. |
| Approach: | They propose to encode neighborhood information with a graph-induced Gaussian distribution and integrate it with generative models. |
| Outcome: | The proposed model can be trained as efficiently as state-of-the-art methods on benchmark datasets. |
Document-Level Relation Extraction via Pair-Aware and Entity-Enhanced Representation Learning (2022.coling-1)
Copied to clipboard
| Challenge: | Existing document-level relation extraction methods are sparse in relational entity pairs and the representation of entity pairs is insufficient. |
| Approach: | They propose a Pair-Aware and Entity-Enhanced(PAEE) model to solve two challenges . they propose predicting potential relational entity pairs and assembling directional entity pairs . |
| Outcome: | The proposed model can obtain state-of-the-art performance on four benchmark datasets . it can predict potential relational entity pairs and assemble directional entity pairs . |
From Selection to Generation: A Survey of LLM-based Active Learning (2025.acl-long)
Copied to clipboard
Yu Xia, Subhojyoti Mukherjee, Zhouhang Xie, Junda Wu, Xintong Li, Ryan Aponte, Hanjia Lyu, Joe Barrow, Hongjie Chen, Franck Dernoncourt, Branislav Kveton, Tong Yu, Ruiyi Zhang, Jiuxiang Gu, Nesreen K. Ahmed, Yu Wang, Xiang Chen, Hanieh Deilamsalehy, Sungchul Kim, Zhengmian Hu, Yue Zhao, Nedim Lipka, Seunghyun Yoon, Ting-Hao Kenneth Huang, Zichao Wang, Puneet Mathur, Soumyabrata Pal, Koyel Mukherjee, Zhehao Zhang, Namyong Park, Thien Huu Nguyen, Jiebo Luo, Ryan A. Rossi, Julian McAuley
| Challenge: | Large Language Models (LLMs) have been used for selection and training of data for active learning. |
| Approach: | They propose an intuitive taxonomy that categorizes LLM-based active learning techniques and discuss the transformative roles they can play in the active learning loop. |
| Outcome: | The proposed model can generate entirely new data instances and provide more cost-effective annotations with fewer labeled data instances. |
A Survey of RAG-Reasoning Systems in Large Language Models (2025.findings-emnlp)
Copied to clipboard
Yangning Li, Weizhi Zhang, Yuyao Yang, Wei-Chieh Huang, Yaozu Wu, Junyu Luo, Yuanchen Bei, Henry Peng Zou, Xiao Luo, Yusheng Zhao, Chunkit Chan, Yankai Chen, Zhongfen Deng, Yinghui Li, Hai-Tao Zheng, Dongyuan Li, Renhe Jiang, Ming Zhang, Yangqiu Song, Philip S. Yu
| Challenge: | a survey of RAG-based reasoning-based approaches shows that it is not effective for multi-step inferences. |
| Approach: | They map how advanced reasoning optimizes each stage of RAG . they show how retrieved knowledge supply missing premises and expand context for complex inference . |
| Outcome: | The proposed frameworks achieve state-of-the-art across knowledge-intensive benchmarks. |
Circuit Complexity Bounds for RoPE-based Transformer Architecture (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies provide the circuit complexity bounds to Transformer-like architectures. position embedding has emerged as a crucial technique in modern large language models. |
| Approach: | They propose to use position embedding to improve Transformer-like architectures by analyzing their circuits and analyzing the results. |
| Outcome: | The proposed model is able to solve canonical tasks without embedding positional information. |
To Copy Rather Than Memorize: A Vertical Learning Paradigm for Knowledge Graph Completion (2023.acl-long)
Copied to clipboard
Rui Li, Xu Chen, Chaozhuo Li, Yanming Shen, Jianan Zhao, Yujing Wang, Weihao Han, Hao Sun, Weiwei Deng, Qi Zhang, Xing Xie
| Challenge: | Existing methods for embedding knowledge graphs implicitly memorize relation rules to infer missing links, but they are difficult to memorize due to the inherent deficiencies of such implicit memorization strategy. |
| Approach: | They propose a vertical learning paradigm that allows to explicitly copy target information from related factual triples for more accurate prediction. |
| Outcome: | The proposed model improves generalization ability and makes distant link prediction significantly easier. |
RepoGenesis: Benchmarking End-to-End Microservice Generation from Readme to Repository (2026.acl-long)
Copied to clipboard
Zhiyuan Peng, Xin Yin, Pu Zhao, Fangkai Yang, Lu Wang, Ran Jia, Xu Chen, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang
| Challenge: | Existing benchmarks focus on isolated function/class-level generation, neglecting complete microservice repository generation. |
| Approach: | They propose a multilingual benchmark for repository-level end-to-end web microservice generation that reflects real-world development workflows. |
| Outcome: | The benchmark compared 106 repositories across 18 domains and 11 frameworks and 1,258 API endpoints and 2,335 test cases. |
DUAL RM: Beyond Rule-based Preference Reward Modeling via Meta-Reward (2026.acl-long)
Copied to clipboard
Xiaobo Liang, Wanfu Wang, Qipeng Huang, Yuyang Ding, Zecheng Tang, Yixin Ji, Qianben Chen, Zhe Zhao, Kehai Chen, Juntao Li, Min Zhang
| Challenge: | Existing preference-based reward modeling methods face a recursive dependency where each verifier requires a meta-verifier, leading to continuous and costly dependence on human annotation. |
| Approach: | They propose a dual RM that couples discriminative and generative reward models under a non-parametric meta-reward. |
| Outcome: | The proposed model achieves strong performance across major preference benchmarks and even when trained exclusively on language modality, it exhibits robust cross-modal transfer on Omni-RewardBench. |
CN-AutoMIC: Distilling Chinese Commonsense Knowledge from Pretrained Language Models (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing commonsense knowledge graphs are limited to English, hindering research in non-English languages. |
| Approach: | They propose a Chinese CKG generated from multilingual PLMs that is translated into Chinese . they propose 'generate-by-category' strategy to reduce invalid generation . |
| Outcome: | The proposed CKG has high quality and diversity, surpassing the direct translation version of similar English CKGs. |
Derailer-Rerailer: Adaptive Verification for Efficient and Reliable Language Model Reasoning (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing prompting methods struggle with complex tasks and reasoning stability, limiting their practical deployment. |
| Approach: | They propose a framework that adaptively balances reasoning accuracy and computational efficiency by employing a lightweight Derailer mechanism to assess reasoning stability and selectively triggers an advanced Rerailer verification process only when necessary. |
| Outcome: | The proposed framework achieves significant accuracy improvements (8-11%) while maintaining 2-3 times better efficiency than existing verification methods. |
CHBias: Bias Evaluation and Mitigation of Chinese Conversational Language Models (2023.acl-long)
Copied to clipboard
| Challenge: | Existing studies on social biases in language models have focused on only English. |
| Approach: | They propose to use a Chinese dataset for bias evaluation and mitigation of Chinese conversational language models. |
| Outcome: | The proposed dataset includes under-explored bias categories, such as ageism and appearance biases, which received less attention in previous studies. |
ShopSimulator: Evaluating and Exploring RL-Driven LLM Agent for Shopping Assistants (2026.acl-long)
Copied to clipboard
Pei Wang, Yanan Wu, Xiaoshuai Song, Weixun Wang, Gengru Chen, Zhongwen Li, Kezhong Yan, Qi Liu, Ken Deng, Shuaibing Zhao, Shaopan Xiong, Xuepeng Liu, Xuefeng Chen, Wanxi Deng, Wenbo Su, Bo Zheng
| Challenge: | Existing studies on large language model-based agents focus on evaluation benchmarks without training support. |
| Approach: | They propose a large-scale Chinese shopping simulation environment that uses large language models to train agents. |
| Outcome: | The proposed model performs poorly in a large-scale and challenging shopping environment in China. |
HyperCore: Hyperbolic and Co-graph Representation for Automatic ICD Coding (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for ICD coding ignore Code Hierarchy and Code Co-occurrence . cost of manual coding estimated to be $25 billion per year in the US . |
| Approach: | They propose a hyperbolic representation method to leverage the code hierarchy and a graph convolutional network to utilize the code co-occurrence. |
| Outcome: | The proposed model outperforms state-of-the-art methods on two widely used datasets. |
Faster In-Context Learning for LLMs via N-Gram Trie Speculative Decoding (2025.emnlp-main)
Copied to clipboard
| Challenge: | In-Context Learning (ICL) is a key method in prompt engineering, but its long retrieved contexts and limited token throughput will slow reasoning speeds. |
| Approach: | They propose a method that leverages the overlap between context and model output to generate drafts from the context. |
| Outcome: | The proposed method achieves the highest mean speedup on Vicuna-7B, Llama2-7B-Chat, and Llma3-8B-Instruct tasks. |
BioGen: Generating Biography Summary under Table Guidance on Wikipedia (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for summarizing text have not captured the salient information from an article. |
| Approach: | They propose a table-guided abstractive biography summarization that utilizes factual tables to capture important information and generate a summary of a biography. |
| Outcome: | The proposed method is the first large-scale biography summarization dataset with tables. |
ZoomRAG: Hierarchical Random-walk Zooming across Multi-scale Information Graphs for Fast and Accurate RAG (2026.findings-acl)
Copied to clipboard
Xianming Hu, Jingyang Chen, Bin Tang, Yihe Liu, Yihong Huang, Hongbo Zhao, Nuoyi Chen, Jie Zhang, Ping Li, Kai Zhang
| Challenge: | retrieval-augmented generation (RAG) is a powerful tool for NLP applications . but it is challenging to encode large knowledge bases as compact offline structures . |
| Approach: | They propose a coarse-to-fine hierarchical graph inference method that uses random walks to retrieve information from a corpus of documents. |
| Outcome: | The proposed method reduces offline indexing costs and accelerates retrieval. |
MotivGraph-SoIQ: Integrating Motivational Knowledge Graphs and Socratic Dialogue for Enhanced LLM Ideation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have limitations in grounding ideas and mitigating confirmation bias during refinement. |
| Approach: | They propose a framework that integrates a Motivational Knowledge Graph with a Q-Driven Socratic Ideator to enhance LLM ideation. |
| Outcome: | The proposed framework enhances LLM ideation by integrating a Motivational Knowledge Graph with a Q-Driven Socratic Ideator. |
MultiFileTest: A Multi-File-Level LLM Unit Test Generation Benchmark and Impact of Error Fixing Mechanisms (2026.findings-acl)
Copied to clipboard
Yibo Wang, Congying Xia, Wenting Zhao, Jiangshu Du, Chunyu Miao, Zhongfen Deng, Philip S. Yu, Chen Xing
| Challenge: | Existing evaluation benchmarks for LLM unit test generation focus on function-level code rather than on more practical, challenging multi-file codebases. |
| Approach: | They propose a multi-file-level benchmark for unit test generation covering Python, Java, and JavaScript. |
| Outcome: | The proposed benchmarks show that most LLMs exhibit moderate performance on MultiFileTest, highlighting the benchmark’s inherent difficulty. |
From Hypothesis to Publication: A Comprehensive Survey of AI-Driven Research Support Systems (2025.findings-emnlp)
Copied to clipboard
Zekun Zhou, Xiaocheng Feng, Lei Huang, Xiachong Feng, Ziyun Song, Ruihan Chen, Liang Zhao, Weitao Ma, Yuxuan Gu, Baoxin Wang, Dayong Wu, Guoping Hu, Ting Liu, Bing Qin
| Challenge: | rapid development of artificial intelligence (AI) technologies has inspired researchers to explore how AI can accelerate and enhance research. |
| Approach: | They organize the relevant studies into three main categories: hypothesis formulation, hypothesis validation, and manuscript publication. |
| Outcome: | The authors summarize the current state of research in three main areas: hypothesis formulation, hypothesis validation, and manuscript publication. |
Take Off the Training Wheels! Progressive In-Context Learning for Effective Alignment (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have explored the working mechanisms of In-Context Learning (ICL) however, they mainly focus on classification and simple generation tasks, limiting their broader application to more complex generation tasks in practice. |
| Approach: | They propose an efficient Progressive In-Context Alignment method that embeds the task function learned from demonstrations into the separator token representation. |
| Outcome: | The proposed method surpasses vanilla ICL and achieves comparable performance to other alignment tuning methods. |
Collective Event Detection via a Hierarchical and Bias Tagging Networks with Gated Multi-level Attention Mechanisms (D18-1)
Copied to clipboard
| Challenge: | Existing approaches to ACE event detection treat multiple events in one sentence as independent ones and recognize them separately. |
| Approach: | They propose a hierarchical and bias tagging network framework to detect multiple events in one sentence collectively and a gated multi-level attention mechanism to automatically extract and fuse the sentence-level and document-level information. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on a 2005 ACE dataset. |
Distantly Supervised Relation Extraction in Federated Settings (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to label training datasets using distant supervision are expensive and cannot cover all walks of life. |
| Approach: | They propose a federated denoising framework to suppress label noise in federation . they propose to use a multiple instance learning based denoisation method to select reliable sentences . |
| Outcome: | The proposed method can select reliable sentences via cross-platform collaboration. |
RPC-Bench: A Fine-grained Benchmark for Research Paper Comprehension (2026.acl-long)
Copied to clipboard
Yelin Chen, Fanjin Zhang, Suping Sun, Yunhe Pang, Yuanchun Wang, Jian Song, XiaoYan Li, Lei Hou, Shu Zhao, Jie Tang, Juanzi Li
| Challenge: | Existing benchmarks for understanding research papers offer limited fine-grained evaluation at scale. |
| Approach: | They propose a large-scale question-answering benchmark built from review–rebuttal exchanges of high-quality computer science papers. |
| Outcome: | The proposed model is based on human-verified QA pairs and contains 15K questions. |
MED-COPILOT: A Medical Assistant Powered by GraphRAG and Similar Patient Case Retrieval (2026.acl-demo)
Copied to clipboard
| Challenge: | MED-COPILOT is an interactive research prototype for evidence-aware clinical reasoning . large language models (LLMs) are prone to hallucinations and lack verifiable evidence grounding . |
| Approach: | They propose a system that integrates GraphRAG and semantic-keyword similar-patient retrieval to support transparent clinical reasoning. |
| Outcome: | The proposed system outperforms baseline and standard RAGs on clinical note completion and medical question answering. |
Multi-Step Reasoning Over Unstructured Text with Beam Dense Retrieval (2021.naacl-main)
Copied to clipboard
| Challenge: | Current methods for complex question answering use structured knowledge and unstructured text. |
| Approach: | They propose a multi-step retrieval approach that iteratively forms an evidence chain through beam search in dense representations. |
| Outcome: | The proposed method is competitive to state-of-the-art systems without using semi-structured information. |
TencentPretrain: A Scalable and Flexible Toolkit for Pre-training Models of Different Modalities (2023.acl-demo)
Copied to clipboard
Zhe Zhao, Yudong Li, Cheng Hou, Jing Zhao, Rong Tian, Weijie Liu, Yiren Chen, Ningyuan Sun, Haoyan Liu, Weiquan Mao, Han Guo, Weigang Gou, Taiqiang Wu, Tao Zhu, Wenhang Shi, Chen Chen, Shan Huang, Sihong Chen, Liqun Liu, Feifei Li, Xiaoshuai Chen, Xingwu Sun, Zhanhui Kang, Xiaoyong Du, Linlin Shen, Kimmo Yan
| Challenge: | Several pre-training models of different modalities are showing a rising trend of homogeneity in their model structures. |
| Approach: | They propose a toolkit that supports pre-training models of different modalities. |
| Outcome: | The proposed toolkit can match the performance of the original implementations on text, vision, and audio benchmarks. |
Multi-Granularity Information Interaction Framework for Incomplete Utterance Rewriting (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Recent approaches in Incomplete Utterance Rewriting (IUR) fail to capture the source of important words, introducing words from irrelevant utterances. |
| Approach: | They propose a framework to capture the multi-granularity of semantic information and fetch the relevant utterance. |
| Outcome: | The proposed framework outperforms state-of-the-art models on two benchmark datasets . it can capture the source of important words and fetch the relevant utterance . |
MENTOR: Efficient Autoregressive Image Generation with Balanced Multimodal Control (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent text-to-image models achieve impressive visual quality but still face challenges in precise controllability, balancing multimodal inputs, and high training cost for multimodal image generation. |
| Approach: | They propose an autoregressive framework with a two-stage training paradigm for controllable multimodal image generation. |
| Outcome: | Extensive experiments on DreamBench++ and DreamBech show that the proposed framework achieves a strong balance between textual and visual guidance for controllable image generation. |
AbGen: Evaluating Large Language Models in Ablation Study Design and Evaluation for Scientific Research (2025.acl-long)
Copied to clipboard
Yilun Zhao, Weiyuan Chen, Zhijian Xu, Manasi Patwardhan, Chengye Wang, Yixin Liu, Lovekesh Vig, Arman Cohan
| Challenge: | a benchmark designed to evaluate the capabilities of LLMs in designing ablation studies for scientific research is available online. |
| Approach: | They propose to use a benchmark to evaluate LLMs' ability to design ablation studies . they investigate whether current automated evaluation methods are not reliable . |
| Outcome: | The benchmark compared leading LLMs with human experts on generating detailed ablation study designs . the results show that current evaluation methods are not reliable for the task . |
EVIT: Event-Oriented Instruction Tuning for Event Reasoning (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have made significant advances in event reasoning . however, smaller instruction-tuned models do not consistently demonstrate exceptional proficiency . |
| Approach: | They propose an event-oriented instruction tuning technique to train a large language model . they propose a structure named event quadruple which contains the structure and semantics of events . |
| Outcome: | The proposed model achieves competitive performances on event reasoning tasks. |
EFUF: Efficient Fine-Grained Unlearning Framework for Mitigating Hallucinations in Multimodal Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to eliminate hallucinations require expensive human annotation . hallucination in multimodal large language models poses unique challenges for current research . |
| Approach: | They propose a fine-grained unlearning framework that performs gradient ascent to eliminate hallucinations without paired data. |
| Outcome: | The proposed method reduces hallucinations while preserving quality with modest computational overhead. |
Table-R1: Inference-Time Scaling for Table Reasoning Tasks (2025.emnlp-main)
Copied to clipboard
| Challenge: | In this study, we explore inference-time scaling on table reasoning tasks. |
| Approach: | They propose a large-scale dataset of reasoning traces and a reinforcement learning with verifiable rewards approach to enable inference-time scaling on table reasoning tasks. |
| Outcome: | The proposed model matches or exceeds GPT-4.1 and DeepSeek-R1 models on diverse table reasoning tasks. |
Whispers that Shake Foundations: Analyzing and Mitigating False Premise Hallucinations in Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models generate hallucinated text when confronted with false premise questions . authors propose a method to mitigate false premises hallucinosity . |
| Approach: | They propose a method to constrain false premise attention heads during the model inference process. |
| Outcome: | The proposed method improves performance by constraining false premise attention heads . it yields a notable increase of nearly 20% of model performance . |
STAD: Self-Training with Ambiguous Data for Low-Resource Relation Extraction (2022.coling-1)
Copied to clipboard
| Challenge: | Existing approaches for low-resource relation extraction use only confident instances and uncertain instances. |
| Approach: | They propose a self-training approach for low-resource relation extraction using auto-annotated instances. |
| Outcome: | The proposed method improves on two widely used datasets with low-resource settings. |
Generating Temporally-ordered Event Sequences via Event Optimal Transport (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for temporal event ordering and event infilling ignore the global semantics of events, and the model adopts a word-level objective to model events in texts. |
| Approach: | They propose a temporal event ordering and event infilling task using a model that uses maximum likelihood estimation to model events in texts. |
| Outcome: | The proposed model outperforms existing models on all evaluation datasets. |
LINKED: Eliciting, Filtering and Integrating Knowledge in Large Language Model for Commonsense Reasoning (2024.findings-emnlp)
Copied to clipboard
Jiachun Li, Pengfei Cao, Chenhao Wang, Zhuoran Jin, Yubo Chen, Kang Liu, Xiaojian Jiang, Jiexin Xu, Jun Zhao
| Challenge: | Large language models (LLMs) often exhibit poor performance on knowledge-intensive tasks, such as commonsense reasoning. |
| Approach: | They propose a method to elicit, filter and integrate knowledge in large language models (LINKED) they propose 'reward model' to filter out noisy knowledge and 'take marginal consistent reasoning module' |
| Outcome: | The proposed method outperforms SOTA baselines on two commonsense reasoning tasks. |
Imperfect also Deserves Reward: Multi-Level and Sequential Reward Modeling for Better Dialog Management (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing research on taskoriented dialog systems mainly includes pipeline and end-to-end methods due to its non-differentiable nature. |
| Approach: | They propose a multi-level reward modeling approach that factorizes a reward into a three-level hierarchy: domain, act, and slot. |
| Outcome: | The proposed approach significantly improves performance and speed of training in a wide range of dialog systems. |
LongLeader: A Comprehensive Leaderboard for Large Language Models in Long-context Scenarios (2025.naacl-long)
Copied to clipboard
Pei Chen, Hongye Jin, Cheng-Che Lee, Rulin Shao, Jingfeng Yang, Mingyu Zhao, Zhaoyu Zhang, Qin Lu, Kaiwen Men, Ning Xie, Huasheng Li, Bing Yin, Han Li, Lingyun Wang
| Challenge: | LongLeader aims to assess different LLMs' long-context comprehension abilities . long-constext comprehension is a key bottleneck for many use cases . |
| Approach: | They propose a leaderboard to assess different LLMs' long-context comprehension abilities . they offer open-source access to the benchmarks and maintain a dedicated website . |
| Outcome: | The proposed model assesses different LLMs on selected benchmarks and provides open-source access to the benchmarks. |
DyLex: Incorporating Dynamic Lexicons into BERT for Sequence Labeling (2021.emnlp-main)
Copied to clipboard
Baojun Wang, Zhao Zhang, Kun Xu, Guang-Yuan Hao, Yuyang Zhang, Lifeng Shang, Linlin Li, Xiao Chen, Xin Jiang, Qun Liu
| Challenge: | Existing approaches to integrate lexical knowledge into deep learning models are limited by large-scale dynamic lexicons. |
| Approach: | They propose a plug-in lexicon incorporation approach for BERT based sequence labeling tasks . they adopt word-agnostic tag embeddings to avoid re-training the representation . |
| Outcome: | The proposed framework achieves new SOTA even with large scale lexicons, the authors show . they adopt word-agnostic tag embeddings to avoid re-training the representation . |
Ruleformer: Context-aware Rule Mining over Knowledge Graph (2022.coling-1)
Copied to clipboard
| Challenge: | Existing work on rule mining focuses on mining rules, but how to select appropriate rules for completion of different triplets has not been discussed. |
| Approach: | They propose to take context information into consideration when selecting suitable rules . they devise a transformer-based rule mining approach, Ruleformer . |
| Outcome: | The proposed model takes context information into consideration, which helps select suitable rules for inference tasks. |
Read As Human: Compressing Context via Parallelizable Close Reading and Skimming (2026.acl-long)
Copied to clipboard
Jiwei Tang, Shilei Liu, Zhicheng Zhang, Qingsong Lv, Runsong Zhao, Tingwei Lu, Langming Liu, Haibin Chen, Yujin Yuan, Hai-Tao Zheng, Wenbo Su, Bo Zheng
| Challenge: | Existing task-aware methods require loading the entire input sequence at once for compression, which suffer from computational inefficiency. |
| Approach: | They propose a framework that adopts an adaptive hybrid reading strategy to reduce computational inefficiency and redundant information in long-context scenarios. |
| Outcome: | Experiments show that RAM outperforms baselines on multiple question answering and summarization benchmarks while delivering up to a 12x speedup on long inputs. |
Hallucinations as Orthogonal Noise: Inference-Time Manifold Alignment via Dynamic Contextual Orthogonalization (2026.findings-acl)
Copied to clipboard
Mingkuan Zhao, Wentao Hu, Tianchen Huang, Yuheng Min, Suquan Chen, Yide Gao, Yanbo Zhai, Shuangyong Song, Xuelong Li
| Challenge: | Hallucinations in Large Language Models persist in critical domains where generated content diverges from contextual facts or logical constraints. |
| Approach: | They propose to generate hallucinations as orthogonal noise relative to the semantic manifold of the residual stream. |
| Outcome: | The proposed method achieves superior contextual faithfulness compared to state-of-the-art methods. |
Challenging the Boundaries of Reasoning: An Olympiad-Level Math Benchmark for Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing evaluation frameworks for large reasoning models are saturated by a lack of reliable and verifiable benchmarks. |
| Approach: | They propose a rigorously curated, Olympiad-level math benchmark comprising 350 problems, each with parallel English and Chinese versions. |
| Outcome: | The proposed benchmark unifies two evaluation paradigms and offers 150 problems formalized in Lean 4 for rigorous process-level evaluation. |
Beyond Query Memorization: Large Language Model Routing with Query Decomposition and Historical Matching (2026.acl-long)
Copied to clipboard
Bo Lv, Jingbo Sun, Jianwei Lv, Chen Tang, Shaojie Zhang, Nayu Liu, Guoxin Yu, Zihao Li, Qichao Zhang, Dongbin Zhao, Ping Luo, Yue Yu
| Challenge: | Existing routing methods rely on direct mapping from queries to models based on surface-level features, leading to poor generalizability on out-of-distribution data. |
| Approach: | They propose a new routing framework that recasts the routing task as a matching process of sifting similar queries from historical logs. |
| Outcome: | The proposed framework improves matching accuracy while lowering inference costs . it decouples linguistic surface forms from task-intrinsic requirements . |
CERES: Pretraining of Graph-Conditioned Transformer for Semi-Structured Session Data (2022.naacl-main)
Copied to clipboard
| Challenge: | Despite advances in self-supervised learning, there is a lack of models that can effectively capture both intra- and intra-item semantics for semi-structured session data. |
| Approach: | They propose a graph-based transformer model for semi-structured session data that captures both intra- and intra-item semantics. |
| Outcome: | The proposed model outperforms baselines in three session search and entity linking tasks by up to 9%. |
DCFEE: A Document-level Chinese Financial Event Extraction System based on Automatically Labeled Training Data (P18-4)
Copied to clipboard
| Challenge: | Existing methods to extract events from documents are limited due to the high cost of labeling . Experimental results demonstrate the effectiveness of a document-level Chinese financial event extraction system. |
| Approach: | They propose a document-level Chinese financial event extraction framework which detects event mentions and extracts events from financial news. |
| Outcome: | The proposed system detects event mentions and extracts events from financial news . it can generate large scale labeled data and extract events from entire document . |
See the World, Discover Knowledge: A Chinese Factuality Evaluation for Large Vision Language Models (2025.findings-acl)
Copied to clipboard
Jihao Gu, Yingyao Wang, Pi Bu, Chen Wang, Ziming Wang, Tengtao Song, Donglai Wei, Jiale Yuan, Yingxiu Zhao, Yancheng He, Shilong Li, Jiaheng Liu, Meng Cao, Jun Song, Yingshui Tan, Xiang Li, Wenbo Su, Xiaoyong Zhu, Bo Zheng
| Challenge: | Existing models for large vision language models do not fully reflect their knowledge capacity and reliability, resulting in erroneous outputs that do not align with the image content or provide answers lacking knowledge evidence. |
| Approach: | They propose a Chinese-based benchmark for visual factuality across 8 major topics and 56 subtopics and a multi-hop question construction. |
| Outcome: | The proposed model decouples visual factuality into two parts: seeing the world and discovering knowledge. |
Line Graph Enhanced AMR-to-Text Generation with Mix-Order Graph Attention Networks (2020.acl-main)
Copied to clipboard
| Challenge: | Existing graph-to-sequence approaches use graph neural networks as encoders, but they lack the structure information needed to translate AMR into the graph-based data. |
| Approach: | They propose a graph-to-sequence task which aims to recover natural language from Abstract Meaning Representations (AMR) they adopt graph attention networks with higher-order neighborhood information to explore the edge relations in AMR graphs. |
| Outcome: | The proposed framework achieves state-of-the-art performance on English AMR benchmark datasets and is able to translate the AMR semantics into the natural language. |
Towards Interpretable Tabular Reasoning: Enhancing LLM Reasoning on Tabular Data with Pre-Constructed Logic Graph (2026.acl-long)
Copied to clipboard
Lirong Gao, Zewei Yu, Zhongrui Yin, Qi Zhang, Yuke Zhu, Bo Zheng, Haobo Wang, Junbo Zhao, Gang Chen, Sheng Guo
| Challenge: | Tabular data is used in fields such as finance and healthcare due to its heterogeneity and complexity. |
| Approach: | They propose a Logic-Graph-Enhanced LLM Reasoning framework that integrates the strengths of tree-based models and LLMs to improve their interpretability. |
| Outcome: | The proposed framework outperforms tree-based models and state-of-the-art LLMs on tabular prediction tasks, achieving superior accuracy and interpretability. |
I²B-LPO: Latent Policy Optimization via Iterative Information Bottleneck (2026.acl-long)
Copied to clipboard
Huilin Deng, Hongchen Luo, Yue Zhu, Long Li, Zhuoyue Chen, Xinghao Zhao, Ming LI, Chuyang Zhao, Jihai Zhang, MengChang Wang, Yang Cao, Yu Kang
| Challenge: | Existing methods for large language model reasoning suffer from exploration collapse due to the semantic homogeneity of random rollouts. |
| Approach: | They propose to use latent policy optimization via iterative information bottleneck to optimize reasoning trajectories by diversifying reasoning . |
| Outcome: | Empirical results show that the proposed method achieves state-of-the-art performance with margins of up to 5.3% in accuracy and 7.4% in diversity metrics. |
RPDR: A Round-trip Prediction-Based Data Augmentation Framework for Long-Tail Question Answering (2025.emnlp-main)
Copied to clipboard
| Challenge: | Long-tail question answering presents significant challenges for large language models due to limited ability to acquire and accurately recall less common knowledge. |
| Approach: | They propose a data augmentation framework that selects high-quality easy-to-learn training data to enhance dense retrieval models. |
| Outcome: | The proposed framework improves on two long-tail retrieval benchmarks, PopQA and EntityQuestion, and shows that it outperforms existing retrievers on extremely long-tailed questions. |
Multilingual Generation in Abstractive Summarization: A Comparative Study (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing models for multilingual generation lack thorough analysis due to extensive linguistic diversity. |
| Approach: | They propose to classify multilingual generation methodologies into three categories based on their underlying modeling principles . they introduce an automatic metric to mitigate spurious correlations associated with language mixing . |
| Outcome: | The proposed model improves in high-resource, low-resourced, and zero-shot scenarios. |
On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A Survey (2024.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) provide a data-centric solution to alleviate limitations of real-world data with synthetic data generation. |
| Approach: | They propose a generic workflow for LLM-driven synthetic data generation. |
| Outcome: | The proposed workflows highlight gaps in existing research and outline avenues for future studies. |
Summarizing Procedural Text: Data and Approach (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Procedural text summarization task is a popular task in the NLP field because of its long length and complexity. |
| Approach: | They propose a procedural text summarization task with two granularity . they propose an Entity-State Graph-based Summarizer (ESGS) which aggregates contextual information for each procedure. |
| Outcome: | The proposed model can summarize the entire procedural text or give an overview for each step or both . Experiments on two datasets confirm the proposed model's effectiveness. |
PSSAT: A Perturbed Semantic Structure Awareness Transferring Method for Perturbation-Robust Slot Filling (2022.coling-1)
Copied to clipboard
Guanting Dong, Daichi Guo, Liwen Wang, Xuefeng Li, Zechen Wang, Chen Zeng, Keqing He, Jinzheng Zhao, Hao Lei, Xinyue Cui, Yi Huang, Junlan Feng, Weiran Xu
| Challenge: | Existing slot filling models memorize inherent patterns of entities and contexts from training data. |
| Approach: | They propose a perturbed semantic structure awareness transferring method for slot filling models . they use two MLM-based training strategies to learn contextual semantic structure and word distribution . |
| Outcome: | The proposed method outperforms existing methods and gains strong generalization while preventing model from memorizing inherent patterns of entities and contexts. |
LLaSA: Large Language and Structured Data Assistant (2025.naacl-long)
Copied to clipboard
Yao Xu, Shizhu He, Jiabei Chen, ZengXiangrong ZengXiangrong, Bingning Wang, Guang Liu, Jun Zhao, Kang Liu
| Challenge: | Structured knowledge grounding (SKG) tasks are a key part of many NLP applications. |
| Approach: | They propose a framework for enhancing LLMs' ability to handle structured data . they represent various types of structured data in a unified hypergraph format . |
| Outcome: | The proposed framework outperforms existing methods on SKG tasks using LoRA finetuning. |
Task Knowledge Injection via Interpolations and Reinstatement for Large Language Model Generalization (2025.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained large language models have been widely adopted to elicit their superior performance on downstream tasks, but instruction tuning may overfit them to specific task formats, compromising their generalization on unseen tasks. |
| Approach: | They propose to inject latent task adaptation and knowledge reinstatement into large language models to mitigate spurious correlations between inputs and targets. |
| Outcome: | The proposed method improves generalization on in-domain and out-of-domain unseen tasks. |
A Simple and Effective Method to Improve Zero-Shot Cross-Lingual Transfer Learning (2022.coling-1)
Copied to clipboard
Kunbo Ding, Weijie Liu, Yuejian Fang, Weiquan Mao, Zhe Zhao, Tao Zhu, Haoyan Liu, Rong Tian, Yiren Chen
| Challenge: | Existing zero-shot cross-lingual transfer methods rely on parallel corpora or bilingual dictionaries . however, its effect is limited by the gap between embedding clusters of different languages . |
| Approach: | They propose Embedding-Push, Attention-Pull, and Robust targets to transfer English embeddings to virtual multilingual embedders without semantic loss. |
| Outcome: | Experimental results show that the proposed method outperforms existing methods on cross-lingual tasks and can achieve a better multilingual alignment. |
LSDC: An Efficient and Effective Large-Scale Data Compression Method for Supervised Fine-tuning of Large Language Models (2025.findings-naacl)
Copied to clipboard
Zhaoguang Long, Yuhao Zhou, Shangqing Zhao, Yupei Ren, Li Cai, Chenghao Jia, Zhe Chen, Zhe Fang, Yuxiang Song, Man Lan
| Challenge: | Large Language Models (LLMs) are expanding in scale and size, increasing computational costs . large-scale data compression techniques can reduce the size of training datasets while maintaining data integrity. |
| Approach: | They propose a large-scale data compression method to reduce the size of training data . they use a bifurcated quantization strategy to maximize the diversity of samples . |
| Outcome: | The proposed method significantly reduces the size of training data while maximizing the submodular gain. |
PresentAgent: Multimodal Agent for Presentation Video Generation (2025.emnlp-demos)
Copied to clipboard
| Challenge: | Existing methods for generating static slides or text summaries are limited to producing narrated presentations. |
| Approach: | They propose a multimodal agent that transforms long-form documents into narrated presentations. |
| Outcome: | The present agent produces fully synchronized visual and spoken content that closely mimics human-style presentations. |
Representation Purification for End-to-End Speech Translation (2025.coling-main)
Copied to clipboard
| Challenge: | Existing approaches to enhance speech translation focus on enhancing knowledge transfer . factors in speech that are not relevant to translation content, such as timbre and rhythm, often limit the efficiency of knowledge transfer. |
| Approach: | They propose a framework that excludes content-agnostic perturbations from speech representations to mitigate their negative impact on ST. |
| Outcome: | The proposed framework significantly improves translation performance across all translation directions in three settings and achieves preeminent performance under a *transcript-free* setting. |
Convert Language Model into a Value-based Strategic Planner (2025.acl-industry)
Copied to clipboard
| Challenge: | Emotional support conversation (ESC) aims to alleviate the emotional distress of individuals through effective conversations. |
| Approach: | They propose a framework that bootstraps the planning during ESC and determines the optimal strategy based on long-term returns. |
| Outcome: | The proposed framework outperforms baseline models on ESC datasets and can be used to guide the LLM to response. |
ZhuJiu: A Multi-dimensional, Multi-faceted Chinese Benchmark for Large Language Models (2023.emnlp-demo)
Copied to clipboard
Baoli Zhang, Haining Xie, Pengfan Du, Junhao Chen, Pengfei Cao, Yubo Chen, Shengping Liu, Kang Liu, Jun Zhao
| Challenge: | Various types of LLMs have recently been rapidly developing, such as Llama2 and ChatGLM2 . |
| Approach: | They propose a benchmark that comprehensively evaluates LLMs across 7 ability dimensions covering 51 tasks. |
| Outcome: | The proposed benchmarks are comprehensive and systematic, with a high level of accuracy and authority. |
Tree-KG: An Expandable Knowledge Graph Construction Framework for Knowledge-intensive Domains (2025.acl-long)
Copied to clipboard
| Challenge: | Knowledge graphs are a useful tool for organizing complex data in knowledge-intensive domains. |
| Approach: | They propose an expandable framework that combines structured domain texts with advanced semantic techniques to create a tree-like graph from textbooks. |
| Outcome: | The proposed framework surpasses competing methods in the text-Annotated dataset with high scores on the Text-Annalytated data. |
SAMoRA: Semantic-Aware Mixture of LoRA Experts for Task-Adaptive Learning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for multitask learning fail to match input semantics with expert capabilities, leading to weak expert specialization. |
| Approach: | They propose a parameter-efficient mixture-of-experts framework for task-adaptive learning that aligns textual semantics with the most suitable experts for precise routing. |
| Outcome: | The proposed framework outperforms the state-of-the-art methods and holds excellent task generalization capabilities. |
KnowledgeFMath: A Knowledge-Intensive Math Reasoning Dataset in Finance Domains (2024.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks for large language models (LLMs) are only 56.6% accurate, leaving room for improvement. |
| Approach: | They propose a benchmark to evaluate LLMs' capabilities in solving knowledge-intensive math reasoning problems using a finance-domain knowledge bank and expert-annotated solution references. |
| Outcome: | The proposed system achieves only 56.6% accuracy, leaving room for improvement. |
Fusing Highly Specialized Language Models for Comprehensive Expertise (2025.acl-long)
Copied to clipboard
Ning Ding, Yulin Chen, Ganqu Cui, Xingtai Lv, Weilin Zhao, Kaiyan Zhang, Ruobing Xie, Bowen Zhou, Zhiyuan Liu, Maosong Sun
| Challenge: | Existing models that focus on language, programming code, and mathematical symbols are not able to achieve mastery of all three domains simultaneously. |
| Approach: | They propose to fuse highly-specialized models that are already sufficiently trained on different domains to achieve a highly-specific model. |
| Outcome: | The proposed model could achieve mastery of the three crucial domains simultaneously. |
Combining Curriculum Learning and Knowledge Distillation for Dialogue Generation (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies have shown that curriculum learning facilitates dialogue generation tasks while knowledge distillation can yield significant performance boosts for student models. |
| Approach: | They propose a combination of curriculum learning and knowledge distillation for dialogue generation models . they cluster training cases according to their complexity and employ an adversarial training strategy . |
| Outcome: | The proposed model improves compared with baselines. |
PLAWBENCH: A Rubric-Based Benchmark for Evaluating LLMs in Real-World Legal Practice (2026.acl-long)
Copied to clipboard
Yuzhen Shi, Huanghai Liu, Yiran HU, Song Gaojie, Xu Xinran, Yubo Ma, Tianyi Tang, Li Zhang, Qingjing Chen, Feng Di, Wenbo Lv, Weiheng Wu, Kexin Yang, Sen Yang, Wei Wang, Rongyao Shi, Qiu Yuanyang, Yuemeng Qi, Zhang Jingwen, Sui Xiaoyu, Yifan Chen, Zhang Yi, An Yang, Bowen Yu, Dayiheng Liu, Junyang Lin, Weixing Shen, Bing Zhao, Charles L. A. Clarke, HU Wei
| Challenge: | Existing benchmarks for large language models (LLMs) are coarse, single-dimensional metrics and do not explicitly assess fine-grained legal reasoning. |
| Approach: | They propose a Practical Law Benchmark to evaluate large language models in real-world legal practice scenarios. |
| Outcome: | The proposed model is based on 850 questions and 13 scenarios with expert-designed evaluation rubrics. |
Fine-Grained Data Ordering Improves Fine-Tuning for Large Language Models (2026.findings-acl)
Copied to clipboard
Xiaomeng Hu, Yixuan Tang, Haoze Li, Hao Chen, Qi Zhang, Zhanming Shen, Yiming Zhang, Haobo Wang, Junbo Zhao
| Challenge: | Prior work focused on data preprocessing, focusing on filtering and cleaning data . a study aimed to improve fine-grained scheduling of data order in epochs . |
| Approach: | They propose a fine-grained scheduling method of data order in epochs to fill this gap . they define data difficulty based on relevance between data and model . |
| Outcome: | The proposed method improves on pre-training and small-scale fine-tuning experiments 2.4% over baselines. |
Tandem: Riding Together with Large and Small Language Models for Efficient Reasoning (2026.findings-acl)
Copied to clipboard
Zichuan Fu, Xian Wu, Guojing Li, Yejing Wang, Yijun Chen, Zhao Zihao, Luo Yixuan, Hanyu Yan, Yefeng Zheng, Xiangyu Zhao
| Challenge: | Recent advances in large language models (LLMs) have catalyzed the rise of reasoningintensive inference paradigms, where models perform explicit step-by-step reasoning before generating final answers. |
| Approach: | They propose a large-small LLM collaboration framework that synergizes large and small language models to achieve high-quality reasoning with significantly reduced computational cost. |
| Outcome: | The proposed framework outperforms the mentor LLM while preserving the benefits of the thinking paradigm of LLMs. |
Mind the Gap in Cultural Alignment: Task-Aware Culture Management for Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing cultural alignment approaches fail to align LLMs’ broad cultural values with the specific goals of downstream tasks and suffer from cross-cultural interference. |
| Approach: | They propose a novel pipeline for task-specific cultural alignment that synthesizes task-aware cultural data in line with target task formats. |
| Outcome: | Experiments across five national cultures and ten culture-sensitive tasks show consistent improvements over prompt-based and fine-tuning baselines. |
Learning How and What to Memorize: Cognition-Inspired Two-Stage Optimization for Evolving Memory (2026.acl-long)
Copied to clipboard
Derong Xu, Shuochen Liu, Pengfei Luo, Pengyue Jia, Yingyi Zhang, Yi Wen, Yimin Deng, Wenlin Zhang, Enhong Chen, Xiangyu Zhao, Tong Xu
| Challenge: | Existing memory systems rely on static, hand-crafted update rules for personalization, but sparse outcome rewards provide weak supervision, resulting in unstable long-horizon optimization. |
| Approach: | They propose a memory guideline optimization framework that learns how memory should be organized and what information to update. |
| Outcome: | The proposed framework learns how memory should be organized and what information to update. |
LLMsPark: A Benchmark for Evaluating Large Language Models in Strategic Gaming Contexts (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) are increasingly important for their intelligence evaluation. |
| Approach: | They propose a game theory-based evaluation platform that measures LLMs’ decision-making strategies and social behaviors in classic game-theoretic settings. |
| Outcome: | The proposed system cross-evaluates 15 leading LLMs using leaderboard rankings and scoring mechanisms. |
Beyond Quantity: Trajectory Diversity Scaling for Code Agents (2026.findings-acl)
Copied to clipboard
Guhong Chen, Chenghao Sun, Cheng Fu, Qiyao Wang, Zhihong Huang, ChaoPeng Wei, Guangxu Chen, Feiteng Fang, Ahmadreza Argha, Bing Zhao, Xander Xu, Qi Han, Hamid Alinejad-Rokny, Qiang Qu, Binhua Li, Shiwen Ni, Min Yang, HU Wei, Yongbin Li
| Challenge: | Code large language models (LLMs) are becoming tool-interactive agents . quantity-centric scaling exhibits an early bottleneck that underutilizes trajectory data . et al.: a new approach to scale trajectory diversity improves tool-use generalization . |
| Approach: | They propose a Trajectory Diversity Scaling-based data synthesis framework for code agents that scales performance through diversity rather than raw volume. |
| Outcome: | Experiments on general tool-use benchmarks and code agent tasks show that TDScaling improves tool-user generalization and inherent coding proficiency. |
MODDP: A Multi-modal Open-domain Chinese Dataset for Dialogue Discourse Parsing (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmark datasets for discourse parsing are domain-specific and contain only textual modality . this makes it difficult to accurately understand the dialogue without multi-modal clues . |
| Approach: | They propose a multi-modal Chinese discourse parsing dataset based on open-domain dialogues . they propose to integrate multi-modality into the original textual unimodal DDP model . |
| Outcome: | The proposed dataset improves on the existing unimodal model by adding multimodalities to the model. |
SciMDR: Advancing Scientific Multimodal Document Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Current models struggle to provide reliable assistance in real-world scientific workflows because evidence is distributed across long, multimodal documents. |
| Approach: | They propose a framework for QA Synthesis and document-scale regrounding that generates faithful, isolated QA pairs and reasoning on focused segments. |
| Outcome: | The proposed framework achieves significant improvements across multiple QA benchmarks, particularly in tasks requiring complex document-level reasoning. |
Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimation (2024.emnlp-main)
Copied to clipboard
Yuan Ge, Yilun Liu, Chi Hu, Weibin Meng, Shimin Tao, Xiaofeng Zhao, Mahong Xia, Zhang Li, Boxing Chen, Hao Yang, Bei Li, Tong Xiao, JingBo Zhu
| Challenge: | Existing methods for instruction data selection have limitations such as relying on fragile external APIs, being affected by biases in GPT models, or reducing the diversity of the selected instruction dataset. |
| Approach: | They propose an industrial-friendly, expert-aligned and diversity-preserved instruction data selection method: Clustering and Ranking (CaR). |
| Outcome: | The proposed method outperforms Alpaca's existing methods by 32.1% in GPT-4 evaluations. |
Enhancing Neural Topic Model with Multi-Level Supervisions from Seed Words (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing topic seed words are difficult to incorporate into topic models due to the semantic diversity of natural language. |
| Approach: | They propose a neural topic model enhanced with supervisions from seed words on word and document levels. |
| Outcome: | The proposed model outperforms the state-of-the-art seeded topic models in terms of topic quality and classification accuracy. |
Continual Learning for Natural Language Generation in Task-oriented Dialog Systems (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing neural approaches for natural language generation are typically developed offline for specific domains. |
| Approach: | They propose a method to expand NLG knowledge incrementally to new domains . major challenge is catastrophic forgetting, meaning a model forgets the knowledge it has learned before . |
| Outcome: | The proposed method outperforms other methods by effectively mitigating catastrophic forgetting issue. |
ICLEval: Evaluating In-Context Learning Ability of Large Language Models (2025.coling-main)
Copied to clipboard
| Challenge: | Existing evaluation frameworks focus on language abilities and knowledge, often overlooking the assessment of ICL ability. |
| Approach: | They propose to evaluate the ICL ability of Large Language Models (LLMs) using the ICLEval benchmark. |
| Outcome: | The proposed benchmark demonstrates that ICL ability is universally present in different LLMs and model size is not the sole determinant of ICL efficacy. |
VisCGEC: Benchmarking the Visual Chinese Grammatical Error Correction (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing studies on Chinese grammatical error correction ignore multi-modality and faked errors, which pushes techniques far away from real-world scenarios. |
| Approach: | They propose to benchmark Chinese grammatical error correction for Chinese as a foreign language learner (CFL) using a dataset, they propose to use two CGEC frameworks to conduct experiments . |
| Outcome: | The proposed approach achieves an F 0.5 score of only 28.9%. |
Both Matter: Enhancing the Emotional Intelligence of Large Language Models without Compromising the General Intelligence (2024.findings-acl)
Copied to clipboard
| Challenge: | Emotional Intelligence (EI) is a key concept in the field of human intelligence. |
| Approach: | They propose a method to enhance EI of large language models by naive fine-tuning on EI-related tasks. |
| Outcome: | The proposed method improves EI of two LLM-based assistants without compromising GI. |
Sentiment Word Aware Multimodal Refinement for Multimodal Sentiment Analysis with ASR Errors (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing models for multimodal sentiment analysis are limited in their capacity to be deployed in the real world. |
| Approach: | They propose a model that can dynamically refine erroneous sentiment words by leveraging multimodal sentiment clues. |
| Outcome: | The proposed model surpasses the state-of-the-art models on three datasets. |
ReLearn: Unlearning via Learning for Large Language Models (2025.acl-long)
Copied to clipboard
Haoming Xu, Ningyuan Zhao, Liming Yang, Sendong Zhao, Shumin Deng, Mengru Wang, Bryan Hooi, Nay Oo, Huajun Chen, Ningyu Zhang
| Challenge: | Existing methods for unlearning large language models often rely on reverse optimization to reduce target token probabilities. |
| Approach: | They propose a data augmentation and fine-tuning pipeline for effective unlearning . they propose augmentation, evaluation frameworks to measure contextual forgetting . |
| Outcome: | The proposed framework achieves targeted forgetting while preserving high-quality outputs. |
Can LLMs Hear the Dogwhistle? (2026.findings-acl)
Copied to clipboard
Yifan Liu, Yi Lin, Xinwei Guo, Ziwei Wang, Jiaxin Zhang, Guanhua Chen, Haiyan Wu, Xiangyu Zhao, Xin Yao, Xuetao Wei
| Challenge: | Existing safety benchmarks focus on explicitly harmful content, but ignore context-dependent expressions such as dogwhistles. |
| Approach: | They propose a benchmark for evaluating LLM safety under dogwhistle-driven prompts . their findings expose a blind spot in current safety evaluation practices . |
| Outcome: | The proposed benchmark compared safety performance with toxic terms using dogwhistle-driven prompts. |
MLDebugging: Towards Benchmarking Code Debugging Across Multi-Library Scenarios (2025.findings-acl)
Copied to clipboard
JinYang Huang, Xiachong Feng, Qiguang Chen, Hanjie Zhao, Zihui Cheng, Jiesong Bai, Jingxuan Zhou, Min Li, Libo Qin
| Challenge: | MLDebugging is a benchmark designed to assess debugging challenges within multi-library Python code. |
| Approach: | They propose to introduce a benchmark to assess debugging challenges within multi-library Python code using 126 Python libraries. |
| Outcome: | The proposed benchmark covers 126 Python libraries and a wide range of multi-library code issues. |
ARCH: Efficient Adversarial Regularized Training with Caching (2021.findings-emnlp)
Copied to clipboard
Simiao Zuo, Chen Liang, Haoming Jiang, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao
| Challenge: | Existing approaches to regularize models require generating a perturbation for each sample in each epoch. |
| Approach: | They propose an adversarial regularization method where perturbations are generated and cached once every several epochs. |
| Outcome: | The proposed method significantly eases the computational burden (saves up to 70% of computational time) it produces a notably better (in most of the tasks) or comparable model generalization. |
CiteLab: Developing and Diagnosing LLM Citation Generation Workflows via the Human-LLM Interaction (2025.acl-demo)
Copied to clipboard
| Challenge: | Existing frameworks for enabling Large Language Models to generate citations are lacking . however, they can still produce hallucinated responses that are non-factual or irrelevant to the input. |
| Approach: | They propose an open-source and modular framework for enabling LLMs to generate citations in Question-Answering tasks. |
| Outcome: | The proposed framework is extensible and paired with a visual interface, Citefix, facilitating case study and modification of existing citation generation methods. |
SLIDE: A Framework Integrating Small and Large Language Models for Open-Domain Dialogues Evaluation (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to evaluate open domain dialogues have a one-to-many problem . existing approaches lack commonsense reasoning biases and perform poorly in domain-specific scenarios. |
| Approach: | They propose a framework that leverages both a small, specialised model and LLMs for the evaluation of open-domain dialogues. |
| Outcome: | The proposed framework achieves state-of-the-art performance in both classification and evaluation tasks and exhibits better correlation with human judgements. |
PsychEval: A Multi-Session and Multi-Therapy Benchmark for High-Realism AI Psychological Counselor (2026.findings-acl)
Copied to clipboard
Qianjun Pan, Junyi Wang, Jie Zhou, Yutao Yang, Junsong Li, Kaiyin Xu, Yougen Zhou, Yihan Li, JingYuan Zhao, Qin Chen, Ningning Zhou, Kai Chen, Liang He
| Challenge: | Existing models focus on a single therapy, but complex cases require flexible strategies among various therapies. |
| Approach: | They propose a multi-session, multi-therapy, and highly realistic benchmark . it is designed to address three key challenges: 1) can we train a highly realistic AI counselor? 2) How to systematically evaluate an AI counselor?" |
| Outcome: | The proposed benchmark is annotated with extensive professional skills and includes over 677 meta-skills and 4577 atomic skills. |
Revisiting Automated Evaluation for Long-form Table Question Answering (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing automated metrics for long-form table question answering (LFTQA) are poorly correlated with human judgments and fail to distinguish between factually accurate responses and those that are factual incorrect. |
| Approach: | They propose to use a meta-evaluation dataset to assess the effectiveness of LLM-based LFTQA systems. |
| Outcome: | The proposed meta-evaluation dataset includes 2,988 human-annotated examples. |
Finding the Dominant Winning Ticket in Pre-Trained Language Models (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on pre-trained language models show that they can fine-tune parameters but achieve good downstream performance. |
| Approach: | They find that a dominant winning ticket takes up 0.05% of the parameters and is transferable across different tasks. |
| Outcome: | The proposed model can achieve comparable performance with the full-parameter model, the authors show . the dominant winning ticket takes up 0.05% of the parameters, and the model is transferable across tasks, they show - the authors conclude . |
OVEL: Online Video Entity Linking (2025.coling-main)
Copied to clipboard
| Challenge: | Existing studies on Multi-modal Entity Linking focus on linking textual and visual mentions or offline videos’ mentions to entities in multi-modal knowledge bases. |
| Approach: | They propose a task called Online Video Entity Linking to establish connections between online videos and a knowledge base with high accuracy and timeliness. |
| Outcome: | The proposed method can establish connections between mentions in online videos and a knowledge base with high accuracy and timeliness. |
Prompt Optimization via Adversarial In-Context Learning (2024.acl-long)
Copied to clipboard
Do Long, Yiran Zhao, Hannah Brown, Yuxi Xie, James Zhao, Nancy Chen, Kenji Kawaguchi, Michael Shieh, Junxian He
| Challenge: | Existing methods to optimize prompts for in-context learning are based on adversarial learning and are computationally efficient and extensible to other LLMs and tasks. |
| Approach: | They propose a method to optimize prompts for in-context learning by a generator and a discriminator. |
| Outcome: | The proposed method improves state-of-the-art prompt optimization techniques on 13 generation and classification tasks including summarization, arithmetic reasoning, machine translation, data-to-text generation, and the MMLU and big-bench hard benchmarks. |
Structure-Discourse Hierarchical Graph for Conditional Question Answering on Long Documents (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to conditional question answering on long documents ignore document structure and discourse relations between sentences in document sections. |
| Approach: | They construct a Structure-Discourse Hierarchical Graph and conduct bottom-up information propagation to address this issue. |
| Outcome: | The proposed approach outperforms the existing methods on the conditional question answering on long documents by 3.0 EM score and 2.4 F1 score on answer measuring, and 2.2 EM and 1.9 F1 scores on jointly answer and condition measuring. |
Language Resource Efficient Learning for Captioning (2021.findings-emnlp)
Copied to clipboard
| Challenge: | XE loss and SC loss are both considered to be performance degradations for captioning tasks. |
| Approach: | They propose to generalize the single pairwise comparison in SC loss and use multiple generalized pairwise compares to reduce noise in baseline. |
| Outcome: | The proposed method outperforms state-of-the-art models on a video caption dataset using only half of the language resources. |
Augmentation, Retrieval, Generation: Event Sequence Prediction with a Three-Stage Sequence-to-Sequence Approach (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods to predict event sequences are complex and ignore the knowledge of external events. |
| Approach: | They propose a statistical induction problem to generate a sequence of events by exploring the similarity between the given goal and known sequences of events. |
| Outcome: | The proposed model outperforms existing methods on an event sequence prediction task. |
Rethinking Document-level Neural Machine Translation (2022.findings-acl)
Copied to clipboard
| Challenge: | Neural machine translation models are weak enough for document-level translation . current models only translate sentences individually, resulting in poor document coherence . |
| Approach: | They propose to use the original Transformer model to test document-level neural machine translation . they find that the original transformer models can achieve strong results for document translation if trained properly . |
| Outcome: | The proposed model outperforms sentence-level models on nine datasets and two sentence- level datasets across six languages. |
Decoding Time Series with LLMs: A Multi-Agent Framework for Cross-Domain Annotation (2026.findings-eacl)
Copied to clipboard
Minhua Lin, Zhengzhang Chen, Yanchi Liu, Xujiang Zhao, Zongyu Wu, Junxiang Wang, Xiang Zhang, Suhang Wang, Haifeng Chen
| Challenge: | Time series data is ubiquitous across various domains, including manufacturing, finance, and healthcare. |
| Approach: | They propose a multi-agent system to generate general and domain-specific annotations for time series data. |
| Outcome: | The proposed system outperforms existing methods on synthetic and real-world datasets. |
DeepNote: Note-Centric Deep Retrieval-Augmented Generation (2025.findings-emnlp)
Copied to clipboard
Ruobing Wang, Qingfei Zhao, Yukun Yan, Daren Zha, Yuxuan Chen, Shi Yu, Zhenghao Liu, Yixuan Wang, Shuo Wang, Xu Han, Zhiyuan Liu, Maosong Sun
| Challenge: | . - (EN) |
| Approach: | . - (EN) |
| Outcome: | . - (EN) |
CLEAR: Can Language Models Really Understand Causal Graphs? (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing language models lack a conceptual framework for understanding causal graphs, but there is still potential for improvement. |
| Approach: | They develop a framework to define causal graph understanding by assessing language models’ behaviors through four practical criteria derived from diverse disciplines. |
| Outcome: | The proposed framework defines three complexity levels and encompasses 20 causal graph-based tasks across 20 different levels. |
Ensembling Prompting Strategies for Zero-Shot Hierarchical Text Classification with Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Hierarchical text classification is a challenging task in natural language processing. |
| Approach: | They propose a method which integrates the results of diverse prompting strategies to promote LLMs’ reliability. |
| Outcome: | The proposed method boosts the performance of single prompting strategies and achieves SOTA results on three benchmark datasets. |
BCL: Bayesian In-Context Learning Framework for Information Extraction (2026.findings-acl)
Copied to clipboard
Haoliang Liu, Chengkun Cai, Xu Zhao, Han Zhu, Shizhou Huang, Xinglin Zhang, Tao Chen, Jenq-Neng Hwang, Zhang Huaping, Lei Li
| Challenge: | Existing information extraction (IE) tasks rely on in-context learning with large language models. |
| Approach: | They propose a Bayesian-based in-context learning framework that refines label representations across IE tasks using particle filtering and Bayes updates. |
| Outcome: | The proposed framework improves performance over existing methods (up to 30%) it underperforms one-shot prompting by a substantial margin on NER tasks and CodeIE fails on RE tasks with near-zero micro-F1. |
A Fully Generative Motivational Interviewing Counsellor Chatbot for Moving Smokers Towards the Decision to Quit (2025.findings-acl)
Copied to clipboard
Zafarullah Mahmood, Soliman Ali, Jiading Zhu, Mohamed Abdelwahab, Michelle Yu Collins, Sihan Chen, Yi Cheng Zhao, Jodi Wolff, Osnat C. Melamed, Nadia Minian, Marta Maslej, Carolynne Cooper, Matt Ratto, Peter Selby, Jonathan Rose
| Challenge: | Large language models (LLMs) are being used to provide automated talk therapy . however, it is crucial to know if they would be effective and adhere to known standards. |
| Approach: | They propose to use large language models to automate talk therapy with a focus on tobacco addiction. |
| Outcome: | The proposed chatbot showed adherence to MI standards in 98% of utterances, higher than human counsellors. |
Localized Low-Rank Adaptation within Clustered Parameter Subspaces (2026.acl-long)
Copied to clipboard
| Challenge: | Low-Rank Adaptation (LoRA) for large language models has been successful in various domains. |
| Approach: | They propose to perform low-rank updates within clustered parameter subspaces . they group rows/columns of update matrix into locally coherent, uncorrelated subspace blocks . |
| Outcome: | Empirical results show that low-rank Adaptation (LoRA) is better than global adaptations in various domains. |
Beyond Accuracy: Unveiling Inefficiency Patterns in Tool-Integrated Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Tool-Integrated Reasoning (TIR) is a tool that can be used to solve complex tasks. |
| Approach: | They propose a hardware-aware TIR-efficiency metric that unifies internal reasoning and external tool-use costs while explicitly accounting for non-reusable KV-Cache and long-tool-response scenarios. |
| Outcome: | The proposed metric explains wall-clock latency significantly better than token-count metric in a simulated high-concurrency industrial setting. |
ELAD: Explanation-Guided Large Language Models Active Distillation (2024.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are hindered by their memory inefficiency, computational demands, and the high costs of API inferences. |
| Approach: | They propose an Explanation-Guided LLMs Active Distillation framework that employs an active learning strategy to optimize the balance between annotation costs and model performance. |
| Outcome: | The proposed framework significantly improves the efficiency of LLMs knowledge distillation. |
Improving Low-resource Question Answering by Augmenting Question Information (2023.findings-emnlp)
Copied to clipboard
Andong Chen, Yuan Sun, Xiaobing Zhao, Rosella Galindo Esparza, Kehai Chen, Yang Xiang, Tiejun Zhao, Min Zhang
| Challenge: | Low-resource questions pose a significant challenge within the field of Question-Answering (QA) tasks. |
| Approach: | They propose a method that leverages large models' internal knowledge to enhance the quality of augmented data by Prompt Answer, Question Generation, and Question Filter. |
| Outcome: | The proposed method outperforms existing augmentation strategies on high-resource QA tasks like SQUAD1.1 and TriviaQA. |
Memory-Efficient Differentiable Transformer Architecture Search (2021.findings-acl)
Copied to clipboard
| Challenge: | Current neural architecture search methods suffer from huge computational cost. |
| Approach: | They propose a reversible recursive backpropagation algorithm that uses the last layer to store the outputs of the network. |
| Outcome: | The proposed algorithm outperforms standard Transformers on three sequence-to-sequence datasets. |
GCPG: A General Framework for Controllable Paraphrase Generation (2022.findings-acl)
Copied to clipboard
Kexin Yang, Dayiheng Liu, Wenqiang Lei, Baosong Yang, Haibo Zhang, Xue Zhao, Wenqing Yao, Boxing Chen
| Challenge: | Existing studies highlight a special condition under two indispensable aspects of controllable paraphrase generation (CPG) individually, lacking a unified circumstance to explore and analyze their effectiveness. |
| Approach: | They propose a general controllable paraphrase generation framework that integrates lexical and syntactical conditions into a text sequence and uniformly processes them in an encoder-decoder paradigm. |
| Outcome: | The proposed framework can combine lexical and syntactical conditions and improve paraphrase generation. |
Better Red Teaming via Searching with Large Language Model (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for evaluating large language models face challenges in managing semantic intricacies and optimizing the efficiency of the search process. |
| Approach: | They propose a framework that reconceptualizes test case generation as a strategic planning problem, leveraging Monte Carlo Tree Search. |
| Outcome: | Experiments on a range of LLM architectures show that the proposed framework achieves state-of-the-art attack success rates without sacrificing computational efficiency. |
Dialogue Summarization with Static-Dynamic Structure Fusion Graph (2023.acl-long)
Copied to clipboard
| Challenge: | Dialogue summarization is a challenging task since it has dynamic interaction nature and inconsistent information flow among various speakers. |
| Approach: | They propose a Static-Dynamic graph-based Dialogue Summarization model which fuses prior knowledge from human expertise and adaptively learns the graph structure in an end-to-end learning fashion. |
| Outcome: | The proposed model can help people capture the highlights of a semi-structured and multi-participant dialogue without reviewing the complex dialogue context. |
Task-Aware Resolution Optimization for Visual Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing visual large language models pre-assume a fixed resolution for downstream tasks, leading to sub-optimal performance. |
| Approach: | They propose a formula to determine the optimal resolution for a given vision-language task . they then propose 'parameter-efficient' fine-tuning technique to extend the visual input resolution . |
| Outcome: | The proposed method is based on rigorous experiments on vision-language tasks. |
Is the Attention Matrix Really the Key to Self-Attention in Multivariate Long-Term Time Series Forecasting? (2026.acl-long)
Copied to clipboard
| Challenge: | In multivariate long-term time series forecasting, it is widely believed that the effectiveness of self-attention arises from its attention matrix. |
| Approach: | They propose a multi-branch MLP that isolates the ‘multi-brain mapping with element-wise operation’ structure from the Transformer and shows that it achieves competitive performance. |
| Outcome: | The proposed model outperforms three classic and three latest Transformer models and shows that it achieves competitive performance. |
A Hybrid Approach to Scalable and Robust Spoken Language Understanding in Enterprise Virtual Agents (2021.naacl-industry)
Copied to clipboard
Ryan Price, Mahnoosh Mehrabani, Narendra Gupta, Yeon-Jun Kim, Shahab Jalalvand, Minhua Chen, Yanjie Zhao, Srinivas Bangalore
| Challenge: | Spoken language understanding (SLU) extracts the intended mean- ing from a user's utterance. |
| Approach: | They propose a framework for intent and entity extraction utilizing a hybrid of statistical and rule-based approaches. |
| Outcome: | The proposed framework can be deployed quickly for a large class of EVA applications with little need for human intervention. |
Mitigating Hallucinations in Multi-modal Large Language Models via Image Token Attention-Guided Decoding (2025.naacl-long)
Copied to clipboard
| Challenge: | Multi-modal large language models (MLLMs) generate plausible but incorrect content, resulting in hallucinations . recent advances in MLLM technology have demonstrated their outstanding performance in a variety of visual tasks, such as object detection. |
| Approach: | They propose a plug-and-play method which leverages MLLMs’ internal representations to mitigate hallucinations by analyzing input and output tokens. |
| Outcome: | The proposed method exploits MLLMs’ internal representations to mitigate hallucinations. |
PAPERMIND: Benchmarking Agentic Reasoning and Critique over Scientific Papers in Multimodal LLMs (2026.findings-acl)
Copied to clipboard
Yanjun Zhao, Tianxin Wei, Jiaru Zou, Xuying Ning, Yuanchen Bei, Lingjie Chen, Simmi Rana, Wendy H. Yang, Hanghang Tong, Jingrui He
| Challenge: | Existing benchmarks assess integrated and agent-oriented scientific reasoning in isolation . Existing systems assess integrated reasoning in isolated tasks . |
| Approach: | They propose a benchmark to evaluate integrated and agent-oriented scientific reasoning over research papers. |
| Outcome: | The proposed benchmark evaluates integrated and agent-oriented scientific reasoning over scientific papers. |
Adaptive Parameterization for Neural Dialogue Generation (D19-1)
Copied to clipboard
| Challenge: | Existing models of open-domain dialogue generate responses based on sequence-to-sequence paradigms. |
| Approach: | They propose an Adaptive Neural Dialogue generation model which manages various conversations with conversation-specific parameterization. |
| Outcome: | The proposed model performs better on a large-scale conversational dataset. |
T2A-Feedback: Improving Basic Capabilities of Text-to-Audio Generation via Fine-grained AI Feedback (2025.acl-long)
Copied to clipboard
Zehan Wang, Ke Lei, Chen Zhu, Jiawei Huang, Sashuai Zhou, Luping Liu, Xize Cheng, Shengpeng Ji, Zhenhui Ye, Tao Jin, Zhou Zhao
| Challenge: | Text-to-audio (T2A) models still struggle to satisfy human preferences for prompt-following and acoustic quality when generating complex multi-event audio. |
| Approach: | They propose to use AI feedback learning to enhance basic capabilities of text-to-audio models . they use a large audio preference dataset to evaluate the model's capabilities . |
| Outcome: | The proposed model improves in simple and complex scenarios with AI feedback learning. |
Representation Interventions Enable Lifelong Knowledge Memory Control in LLMs (2026.acl-long)
Copied to clipboard
Xuyuan Liu, Shengyu Chen, Xinshuai Dong, Yanchi Liu, Xujiang Zhao, Haoyu Wang, Yujun Yan, Haifeng Chen, Zhengzhang Chen
| Challenge: | Large language models (LLMs) produce outdated or inaccurate content. Updating their knowledge efficiently and accurately without costly retraining is a major challenge. |
| Approach: | They propose a robust and scalable method that treats knowledge control as interventions within the model’s representation space. |
| Outcome: | The proposed method achieves fine-grained control over complex, unstructured knowledge while maintaining general utility with frozen base weights. |
Idea23D: Collaborative LMM Agents Enable 3D Model Generation from Interleaved Multimodal Inputs (2025.coling-main)
Copied to clipboard
| Challenge: | Existing 3D AIGC methods don’t fully unleash human creativity. |
| Approach: | They propose a framework that generates 3D content from multimodal inputs . they propose 198 multimodal text inputs for 3D generation tasks . |
| Outcome: | The proposed framework generates 3D content from multimodal inputs without human intervention. |
Pruning via Merging: Compressing LLMs via Manifold Alignment Based Layer Merging (2024.emnlp-main)
Copied to clipboard
Deyuan Liu, Zhanyue Qin, Hairu Wang, Zhao Yang, Zecheng Wang, Fangying Rong, Qingbin Liu, Yanchao Hao, Bo Li, Xi Chen, Cunhang Fan, Zhao Lv, Dianhui Chu, Zhiying Tu, Dianbo Sui
| Challenge: | Existing methods for parameter pruning fail to utilize the knowledge from pruned parameters. |
| Approach: | They propose a method that uses manifold learning and the Information Bottleneck measure to merge similar layers to preserve model performance. |
| Outcome: | The proposed method outperforms pruning methods on multiple datasets and LLMs with quantization and achieves substantial compression ratios. |
AutoPRM: Automating Procedural Supervision for Multi-Step Reasoning via Controllable Question Decomposition (2024.naacl-long)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have shown promise in multi-step reasoning tasks, yet relying on extensive manual labeling to provide procedural feedback remains a significant impediment. |
| Approach: | They propose a self-supervised framework that decomposes complex problems into manageable subquestions with a controllable granularity switch and sequentially applies reinforcement learning to iteratively improve the subquest solver. |
| Outcome: | The proposed framework improves performance on mathematical and commonsense reasoning tasks over SOTA. |
LongReD: Mitigating Short-Text Degradation of Long-Context Large Language Models via Restoration Distillation (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have extended context windows through scaling positional encodings and lightweight continual pre-training, but performance degradation is still not fully explored. |
| Approach: | They propose a novel approach to reduce short-text performance degradation by minimizing distribution drift in hidden states and attention scores. |
| Outcome: | The proposed approach minimizes the distribution discrepancy between the extended and original models while maintaining or even enhancing the model's long-context abilities. |
Introducing Compiler Semantics into Large Language Models as Programming Language Translators: A Case Study of C to x86 Assembly (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) can be used to translate high-level programming languages to machine instructions. |
| Approach: | They propose two methods to solve a problem known as neural compilation by using a 13B model with a behavioral accuracy of over 91%. |
| Outcome: | The proposed approach outperforms the larger model by over 50% and achieves a behavioral accuracy of over 91% while outperforming the GPT-4 Turbo model. |
Landmark Embedding: A Chunking-Free Embedding Method For Retrieval Augmented Long-Context Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods for retrieval augmentation work with chunked contexts, which leads to poor quality of semantic representation and incomplete retrieval of useful information. |
| Approach: | They propose a method for retrieval augmentation of long-context language modeling using landmark embedding. |
| Outcome: | The proposed method outperforms existing retrieval methods with a notable advantage. |
Data Augmentation using LLMs: Data Perspectives, Learning Paradigms and Challenges (2024.findings-acl)
Copied to clipboard
Bosheng Ding, Chengwei Qin, Ruochen Zhao, Tianze Luo, Xinze Li, Guizhen Chen, Wenhan Xia, Junjie Hu, Anh Tuan Luu, Shafiq Joty
| Challenge: | Data augmentation (DA) is a key technique for enhancing model performance by diversifying training examples without the need for additional data collection. |
| Approach: | They examine various strategies that utilize LLMs for data augmentation, including a novel exploration of learning paradigms where LLM-generated data is used for diverse forms of further training. |
| Outcome: | The proposed approach addresses the primary open challenges faced by LLMs in the field of large language models and aims to serve as a comprehensive guide for researchers and practitioners. |
Diagnosing and Remedying Representation Deficiencies for Deterministic Reasoning in KGQA (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to solve non-deterministic reasoning problems in large language models are limited by their complexity and lack of a clear understanding of the problem. |
| Approach: | They propose a method to diagnose and correct non-deterministic reasoning behaviors in large language models. |
| Outcome: | The proposed method outperforms baselines and WebQSP benchmarks on the widely used WebQ SP and CWQ benchmarks. |
The Magic of IF: Investigating Causal Reasoning Abilities in Large Language Models of Code (2023.findings-acl)
Copied to clipboard
| Challenge: | entailment a) |
| Approach: | entailment : We want to explore whether Code-LLMs with code prompts are better . encoding a code prompt is better than text-only LLMs, they say . |
| Outcome: | entailment : Our results show that Code-LLMs with code prompts are better compared to text-only LLMs. |
From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judge (2025.emnlp-main)
Copied to clipboard
Dawei Li, Bohan Jiang, Liangjie Huang, Alimohammad Beigi, Chengshuai Zhao, Zhen Tan, Amrita Bhattacharjee, Yuxuan Jiang, Canyu Chen, Tianhao Wu, Kai Shu, Lu Cheng, Huan Liu
| Challenge: | Recent advances in Large Language Models (LLMs) inspire the "LLM-as-a-judge" paradigm . traditional methods of assessment and evaluation fail in dynamic and open-ended scenarios . |
| Approach: | They propose a paradigm where LLMs are leveraged to perform scoring, ranking, or selection for machine learning evaluation scenarios. |
| Outcome: | The proposed model-based judgment and evaluation paradigms are based on large language models and are compared to the current model-driven evaluation paradigm. |
Stylized Dialogue Generation with Feature-Guided Knowledge Augmentation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods synthesize pseudo data through back translation but lack guidance on target style features. |
| Approach: | They propose a knowledge-augmented stylized dialogue generation model with a feature-guided style knowledge selection module that utilizes context and response features. |
| Outcome: | The proposed model produces a satisfactory performance on two public benchmarks on both semantic and stylized levels. |
ZhuJiu-Knowledge: A Fairer Platform for Evaluating Multiple Knowledge Types in Large Language Models (2024.naacl-demo)
Copied to clipboard
| Challenge: | evaluating the knowledge of large language models (LLMs) is crucial, and rapid advancement in large language modeling has heightened the importance of model evaluations. |
| Approach: | They propose a fairer benchmark for evaluating multiple knowledge types of LLMs by focusing on commonsense knowledge, world knowledge, and language knowledge. |
| Outcome: | The proposed framework evaluates 14 current mainstream LLMs and provides a detailed discussion and analysis of their results. |
G-HiRel: Enhancing the Adaption to Knowledge Updating for Large Language Model Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have good performance in multiple reasoning tasks, but are limited to adapt the rapid knowledge updates in the real-world scenario. |
| Approach: | They propose an LLM reasoning framework with hierarchical relational retrieval for large-scale knowledge updating, named G-HiRel. |
| Outcome: | The proposed framework achieves superiority in terms of accuracy and interpretability on three benchmarks. |
Dream to Chat: Model-based Reinforcement Learning on Dialogues with User Belief Modeling (2025.findings-emnlp)
Copied to clipboard
Yue Zhao, Xiaoyu Wang, Dan Wang, Zhonglin Jiang, Qingqing Gu, Teng Chen, Ningyuan Xi, Jinxian Qu, Yong Chen, Luo Ji
| Challenge: | a framework for constructing dialogue world models for natural language tasks is currently lacking. |
| Approach: | They propose a framework that can be used to train a dialogue world model. |
| Outcome: | The proposed framework can predict future utterances and user beliefs . it can achieve state-of-the-art performance on emotion classification and sentiment identification . |
Rethinking Data Mixing from the Perspective of Large Language Models (2026.acl-short)
Copied to clipboard
Yuanjian Xu, Tianze Sun, Changwei Xu, XinLong Zhao, Jianing Hao, Ran Chen, Yang Liu, Ruijie Xu, Stephen Chen, Guang Zhang
| Challenge: | Existing methods to mix data with LLMs have relied on domain definitions derived from intuition. |
| Approach: | They propose a reweighting framework that restructures data scheduling as a graph-constrained optimization problem. |
| Outcome: | The proposed framework achieves competitive performance on GPT-2 models. |
A Large-Scale Chinese Multimodal NER Dataset with Speech Clues (2021.acl-long)
Copied to clipboard
| Challenge: | Using a large-scale dataset, we explore Chinese named entity recognition (NER) with both textual and acoustic contents. |
| Approach: | They propose a Chinese multimodal named entity recognition dataset . their corpus contains 42,987 annotated sentences and 71 hours of speech data . |
| Outcome: | The proposed model yields state-of-the-art (SoTA) results on Chinese multimodal named entity recognition (NER) based on 42,987 annotated sentences and 71 hours of speech data. |
ALPS: Attention Localization and Pruning Strategy for Efficient Adaptation of Large Language Models (2025.findings-acl)
Copied to clipboard
Hao Chen, Haoze Li, Zhiqing Xiao, Lirong Gao, Qi Zhang, Xiaomeng Hu, Ningtao Wang, Xing Fu, Junbo Zhao
| Challenge: | Prior research has focused on optimizing general-purpose large language models to downstream tasks . however, these approaches inherently introduce data dependency, which hinders generalization and reusability. |
| Approach: | They propose an algorithm that localizes the most task-sensitive attention heads and prunes by restricting attention training updates to these heads, thereby reducing alignment costs. |
| Outcome: | The proposed algorithm achieves 2% performance improvement over baselines on three tasks while localizing the most task-sensitive attention heads. |
Mosaic-IT: Cost-Free Compositional Data Synthesis for Instruction Tuning (2025.findings-acl)
Copied to clipboard
| Challenge: | Current instruction tuning relies on teacher models or human intervention to generate and refine the instructions and responses for training, which are costly, non-sustainable, and may lack diversity. |
| Approach: | They propose a human/model-free compositional data synthesis method that can create rich and diverse augmentations from existing instruction tuning data to enhance large language models. |
| Outcome: | The proposed method improves performance over benchmarks and reduces training costs by 80% compared with original instruction tuning. |
Extracting and Combining Abilities For Building Multi-lingual Ability-enhanced Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing work relies on training with multi-lingual ability-related data, which may not be available for low-resource languages. |
| Approach: | They propose a multi-lingual ability-enhanced LLM that extracts language-agnostic ability-related weights from LLMs and combine them across different languages by simple addition and subtraction operations without training. |
| Outcome: | The proposed approach extracts language-agnostic ability-related weights from LLMs and combine them across different languages without training. |
LearnAct: Few-Shot Mobile GUI Agent with a Unified Demonstration Benchmark (2026.findings-acl)
Copied to clipboard
Guangyi Liu, Pengxiang Zhao, Liang Liu, Zhiming Chen, Yuxiang Chai, Yaozhen Liang, WenHao Wang, Siheng Chen, Zhengxi Lu, Shuai Ren, Hao Wang, Shibo He, Yong Liu, Wenchao Meng
| Challenge: | Mobile GUI agents show promise in automating tasks but face significant generalization challenges in long-tail scenarios. |
| Approach: | They propose a benchmark framework for mobile GUI agents that measures the performance of GUI agents by analyzing their performance. |
| Outcome: | The LearnGUI benchmark outperforms existing methods in offline and online evaluations and demonstrates consistent gains across model architectures. |
Beyond Detection: Evaluating Fallacy Awareness of LLMs in Interactive Scenarios (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models fail to recognize fallacious reasoning in real-world interactions despite strong performance on static fallacy detection tasks. |
| Approach: | They propose a Chinese benchmark to assess fallacy awareness without explicit cues . they propose 'fate' evaluation framework that assesses fallacy without explicit . |
| Outcome: | The proposed framework assesses fallacy awareness without explicit cues, combining natural dialogue responses and reasoning-based decisions. |
YuLan-Mini: Pushing the Limits of Open Data-efficient Language Model (2025.acl-long)
Copied to clipboard
Hu Yiwen, Huatong Song, Jie Chen, Jia Deng, Jiapeng Wang, Kun Zhou, Yutao Zhu, Jinhao Jiang, Zican Dong, Yang Lu, Xu Miao, Xin Zhao, Ji-Rong Wen
| Challenge: | prevailing pre-training approaches for large language models involve several complexities. |
| Approach: | They propose a low-cost training recipe and a robust optimization approach to mitigate training instability . they also propose synthesis, curriculum, and data selection pipelines to integrate data . |
| Outcome: | The proposed model achieves top-tier performance among models with similar parameter scale . it is comparable to industry-leading models that require significantly more data . |
Pruning as a Domain-specific LLM Extractor (2024.findings-naacl)
Copied to clipboard
Nan Zhang, Yanchi Liu, Xujiang Zhao, Wei Cheng, Runxue Bao, Rui Zhang, Prasenjit Mitra, Haifeng Chen
| Challenge: | Large Language Models (LLMs) have exhibited remarkable proficiency across a wide array of NLP tasks. |
| Approach: | They propose a method for pruning large language models using general or task-specific weights to extract a compressed, task-agnostic LLM. |
| Outcome: | The proposed method extracts a compressed, domain-specific, and task- agnostic LLM by identifying LLM weights that are pivotal for general capabilities, like linguistic capability and multi-task solving, and domain- specific knowledge. |
DeMAC: Enhancing Multi-Agent Coordination with Dynamic DAG and Manager-Player Feedback (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Multi-agent systems (MAS) powered by large language models struggle to adapt to evolving task dependencies and to handle uncertainties. |
| Approach: | They propose a Dynamic Environment-Aware Manager-Player Agents Coordination framework that enhances multi-agent coordination through long-term strategic planning. |
| Outcome: | The proposed framework outperforms traditional reinforcement learning and human-agent collaboration in the Overcooked simulation. |
Can Large Language Models Understand You Better? An MBTI Personality Detection Dataset Aligned with Population Traits (2025.coling-main)
Copied to clipboard
Bohan Li, Jiannan Guan, Longxu Dou, Yunlong Feng, Dingzirui Wang, Yang Xu, Enbo Wang, Qiguang Chen, Bichen Wang, Xiao Xu, Yimeng Zhang, Libo Qin, Yanyan Zhao, Qingfu Zhu, Wanxiang Che
| Challenge: | Existing data on MBTI personality detection are based on self-reported labels and fail to capture the full range of population personality traits. |
| Approach: | They construct a manually annotated MBTI personality detection dataset with soft labels under the guidance of psychologists and use them to identify the task. |
| Outcome: | The MBTIBench is the first manually annotated MBti personality detection dataset with soft labels under the guidance of psychologists. |
AMoPO: Adaptive Multi-objective Preference Optimization without Reward Models and Reference Models (2025.findings-acl)
Copied to clipboard
Qi Liu, Jingqing Ruan, Hao Li, Haodong Zhao, Desheng Wang, Jiansong Chen, Wan Guanglu, Xunliang Cai, Zhi Zheng, Tong Xu
| Challenge: | Existing multi-objective preference alignment methods for large language models face limitations such as auxiliary reward/reference models and computational complexity. |
| Approach: | They propose a framework that achieves dynamic balance across preference dimensions by using dimension-aware generation metrics as implicit rewards. |
| Outcome: | Empirical results show that AMoPO outperforms state-of-the-art methods by 28.5% . |
SEER: Self-Aligned Evidence Extraction for Retrieval-Augmented Generation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for enhancing RAG performance rely on heuristic-based augmentation . Existing approaches rely heavily on a heuriistic-driven approach, resulting in poor generalization and skews in the evidence length. |
| Approach: | They propose a model-based evidence extraction learning framework that optimizes a vanilla model as an evidence extractor with desired properties through self-aligned learning. |
| Outcome: | The proposed method reduces the evidence length by 9.25 times and improves reliability and reliability. |
Neural Graph Matching Networks for Chinese Short Text Matching (2020.acl-main)
Copied to clipboard
| Challenge: | Chinese word segmentation can be erroneous, ambiguous or inconsistent, causing performance problems. |
| Approach: | They propose a sentence matching framework that uses paired word lattices as input instead of a character sequence. |
| Outcome: | The proposed framework outperforms the state-of-the-art short text matching models on two Chinese datasets. |
Generating Classical Chinese Poems via Conditional Variational Autoencoder and Adversarial Training (D18-1)
Copied to clipboard
| Challenge: | Existing models for automatic poetry generation lack term novelty and thematic consistency. |
| Approach: | They propose a conditional variational autoencoder with adversarial training for classical Chinese poem generation. |
| Outcome: | The proposed model outperforms existing models on a large poetry corpus on 'classical Chinese' . it generates poems with novel terms and learns their thematic consistency with their titles. |
TPTU-v2: Boosting Task Planning and Tool Usage of Large Language Model-based Agents in Real-world Industry Systems (2024.emnlp-industry)
Copied to clipboard
Yilun Kong, Jingqing Ruan, YiHong Chen, Bin Zhang, Tianpeng Bao, Shi Shiwei, Du Qing, Xiaoru Hu, Hangyu Mao, Ziyue Li, Xingyu Zeng, Rui Zhao, Xueqian Wang
| Challenge: | Large language models have demonstrated proficiency in addressing tasks that necessitate a combination of task planning and the usage of external tools. |
| Approach: | They propose a framework to enhance the task planning and tool usage abilities of LLMs in industrial systems. |
| Outcome: | The proposed framework enhances the task planning and tool usage abilities of LLM-based agents in industrial systems. |
Scaling Laws or Threshold Effects: Exploring the Optimal Vocabulary Size for Balancing Performance and Efficiency in Low-Resource Languages (2026.findings-acl)
Copied to clipboard
| Challenge: | vocab expansion scaling laws are well-established for high-resource languages, but they remain unverified in low-resourced settings. |
| Approach: | They propose to scale trilingual vocabulary for languages with 140 to 195,000 tokens . they find that BBPE follows a "decline-then-rise" pattern, whereas BPE improves monotonically . |
| Outcome: | The proposed configuration reduces pre-training duration by over 71% across 1.5B to 8B models while improving downstream performance. |
kNN-BOX: A Unified Framework for Nearest Neighbor Generation (2024.eacl-demo)
Copied to clipboard
| Challenge: | kNN-BOX enables quick development and visualization for novel generation paradigm . Currently, knn-BOx has provided implementation of seven popular kN-MT variants . |
| Approach: | They propose a framework which decomposes the datastore-augmentation approach into three modules . they apply kNN-BOX to machine translation and three other tasks . |
| Outcome: | The proposed framework decomposes the datastore-augmentation approach into three modules . it provides implementation of seven popular kNN-MT variants, covering research from performance enhancement to efficiency optimization. |
Detection, Diagnosis, and Explanation: A Benchmark for Chinese Medial Hallucination Evaluation (2024.lrec-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have made significant progress in recent years, but their practical use is hindered by their tendency to generate hallucinations. |
| Approach: | They propose to use ICD-10 and MeSH to evaluate LLMs' ability to detect medical hallucinations and make accurate diagnoses in noisy environments. |
| Outcome: | The proposed benchmark can be used to evaluate LLMs’ ability to detect medical hallucinations, make accurate diagnoses in noisy conditions, and provide plausible explanations. |
VaseVQA: Multimodal Agent and Benchmark for Ancient Greek Pottery (2026.findings-eacl)
Copied to clipboard
Jinchao Ge, Tengfei Cheng, Biao Wu, Zeyu Zhang, Shiya Huang, Judith Bishop, Gillian Shepherd, Meng Fang, Ling Chen, Yang Zhao
| Challenge: | MLLMs that use domain-specific data are limited in understanding cultural heritage artifacts such as ancient Greek pottery . supervised fine-tuning improves adaptation to domain knowledge, but it struggles with deeper reasoning tasks. |
| Approach: | They propose a visual question-answer tool that augments SFT with reinforcement learning using verifiable rewards. |
| Outcome: | The proposed model outperforms baseline models on reasoning-intensive questions on ancient Greek pottery. |
EduMARS: Can Vision-Language Models Grade Like Teachers? Benchmarking Multimodal, Rubric-Based Assessment on Chinese K-12 Answers (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks for automated grading of student work fail to evaluate real student responses . existing models fail to assess real student work, especially on cognitively demanding tasks . |
| Approach: | They propose a multimodal benchmark for rubric-aligned evaluation of real Chinese K-12 student answers. |
| Outcome: | The proposed model improves performance and interpretability of existing models on EduMARS . existing models fail to perform on real-world, cognitively demanding tasks, authors say . |
Crossroads of Optimization under Uncertainty: How to Choose the Optimal Model (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to Optimization under Uncertainty (OuU) have inherent limitations and advantages. |
| Approach: | They propose a framework that automates the modeling and solving of six types of uncertainty models and generates mapping pairs to explore the potential relationship between optimization problems and optimal models. |
| Outcome: | The proposed framework achieves superior performance even on specific model types, with correlation analysis showing that data scale and specific scenario significantly influence model selection. |
Data Contamination Calibration for Black-box LLMs (2024.findings-acl)
Copied to clipboard
| Challenge: | Despite the rapid advancements of Large Language Models, the unchecked ultra-large-scale training sets introduce a series of potential risks like data contamination. |
| Approach: | They propose a method to detect contaminated training data and diminish the contamination effect by using a to-be-released dataset. |
| Outcome: | The proposed method outperforms existing methods by at least 4.5% on more 4 dataset formats, with more than 10 base LLMs. |
Double-Checker: Large Language Model as a Checker for Few-shot Named Entity Recognition (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies have demonstrated remarkable performance on few-shot Named Entity Recognition tasks due to the high cost of obtaining high-quality labeled data. |
| Approach: | They propose to decompose the task into entity span detection and entity type classification using a type-independent entity span detector and then classify the detected spans based on their types. |
| Outcome: | The proposed method consistently yields improvements over two baseline approaches. |
Open Set Relation Extraction via Unknown-Aware Training (2023.acl-long)
Copied to clipboard
Jun Zhao, Xin Zhao, WenYu Zhan, Qi Zhang, Tao Gui, Zhongyu Wei, Yun Wen Chen, Xiang Gao, Xuanjing Huang
| Challenge: | Existing supervised relation extraction methods can still misclassify unknown relations into known relations due to the lack of supervision signals. |
| Approach: | They propose a method that regularizes the model by dynamically synthesizing negative instances that can provide the missing supervision signals. |
| Outcome: | The proposed method achieves SOTA unknown relation detection without compromising the classification of known relations. |
FinReporting: An Agentic Workflow for Localized Reporting of Cross-Jurisdiction Financial Disclosure (2026.acl-demo)
Copied to clipboard
Fan Zhang, Mingzi Song, Rania Elbadry, Yankai Chen, Shaobo Wang, Yixi Zhou, Xunwen Zheng, Yueru He, Yuyang Dai, Georgi Nenkov Georgiev, Ayesha Gull, Muhammad Usman Safder, Fan Wu, Liyuan Meng, Fengxian Ji, Junning Zhao, Xueqing Peng, Jimin Huang, YU Chen, Xue Liu, Preslav Nakov, Zhuohan Xie
| Challenge: | FinReporting is an agentic workflow for localized cross-jurisdiction financial reporting . existing approaches assume a single-market setting and overlook structural differences across jurisdictions . |
| Approach: | They propose a workflow that decomposes financial reporting into auditable stages . they use Large Language Models to extract and summarize corporate disclosures . |
| Outcome: | The proposed system decomposes reporting into auditable stages . it improves consistency and reliability under heterogeneous reporting regimes. |
Measuring Social Bias in Vision-Language Models with Face-Only Counterfactuals from Real Photos (2026.acl-long)
Copied to clipboard
| Challenge: | Vision-Language Models (VLMs) are increasingly deployed in socially consequential settings . attribution under visual confounding is a central challenge in measuring social bias . |
| Approach: | They propose a face-only counterfactual evaluation paradigm that isolates demographic effects while preserving real-image realism. |
| Outcome: | The proposed paradigm isolates demographic effects while preserving real-image realism. |
FCM: A Fine-grained Comparison Model for Multi-turn Dialogue Reasoning (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing neural dialogue models only capture syntactic and semantic information, but fail to model the logical consistency between the dialogue history and the generated response. |
| Approach: | They propose a fine-grained comparison model to capture syntactic and semantic information and then compare each candidate's representation with the whole history to obtain a history consistency representation. |
| Outcome: | The proposed model obtains higher ranking scores than baseline models on two public dialogue datasets. |
Learning Flexible Large Multimodal Models with Arbitrary Modality Combinations (2026.findings-acl)
Copied to clipboard
| Challenge: | Multimodal Large Language Models (MLLMs) have potential for cross-modal understanding . but extending MLLM to handle diverse modalities introduces two challenges . |
| Approach: | They propose a dual-stage compression mechanism to reduce the number of modality tokens per modality and condense it into a single, compact token sequence. |
| Outcome: | Experiments show that Flex-M3 outperforms its counterpart trained on only full-modality data. |
Keywords and Instances: A Hierarchical Contrastive Learning Framework Unifying Hybrid Granularities for Text Generation (2022.acl-long)
Copied to clipboard
Mingzhe Li, XieXiong Lin, Xiuying Chen, Jinxiong Chang, Qishen Zhang, Feng Wang, Taifeng Wang, Zhongyi Liu, Wei Chu, Dongyan Zhao, Rui Yan
| Challenge: | Existing studies focus on contrastive learning on the instance level without discriminating the contribution of each word. |
| Approach: | They propose a hierarchical contrastive learning mechanism which can unify semantic meaning in the input text. |
| Outcome: | The proposed model outperforms baselines on storytelling, paraphrasing, dialogue generation, and storytelling tasks. |
The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | a growing number of researchers are studying the hallucination issue in large language models. |
| Approach: | They propose a hallucination detection benchmark and a method to detect hallucines in LLMs. |
| Outcome: | The proposed method detects hallucinations and mitigates them using different training stages. |
AntCritic: Argument Mining for Free-Form and Visually-Rich Financial Comments (2024.lrec-main)
Copied to clipboard
| Challenge: | Argument mining is a thriving task in natural language processing, but its generalization is limited by existing datasets. |
| Approach: | They propose to use a dataset to help model argument mining . the dataset AntCritic supports both argument component detection and argument relation prediction tasks. |
| Outcome: | The proposed model can detect arguments and identify their relationships automatically. |
A Query-Response Framework for Whole-Page Complex-Layout Document Image Translation with Relevant Regional Concentration (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for document image translation rely on the vanilla encoder-decoder paradigm . a novel dynamic aggregation mechanism is designed to enhance the text semantics in query features toward translation. |
| Approach: | They propose a Query-Response DIT framework that reformulates the DIT task into a parallel response/translation process of multiple queries. |
| Outcome: | The proposed framework improves translation quality on four translation directions on three benchmarks. |
Sticker-TTS: Learn to Utilize Historical Experience with a Sticker-driven Test-Time Scaling Framework (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large reasoning models have exhibited strong performance on complex reasoning tasks, but current test-time scaling methods rely on redundant sampling and ignore historical experience utilization. |
| Approach: | They propose a test-time scaling framework that coordinates three collaborative LRMs to iteratively explore and refine solutions guided by historical attempts. |
| Outcome: | The proposed framework surpasses strong baselines on three mathematical reasoning benchmarks, including AIME-24, AIME-25, and OlymMATH. |
Measuring Your ASTE Models in The Wild: A Diversified Multi-domain Dataset For Aspect Sentiment Triplet Extraction (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing ASTE datasets are limited in their ability to represent real-world scenarios, hindering progress in this area. |
| Approach: | They propose a new ASTE dataset that is manually annotated to better fit real-world scenarios by providing more diverse and realistic reviews. |
| Outcome: | The proposed dataset is manually annotated to better fit real-world scenarios. |
Token-Budget-Aware LLM Reasoning (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to enhance reasoning capabilities of large language models incur significant overhead in token usage, leading to increased costs. |
| Approach: | They propose a token-budget-aware LLM reasoning framework that adjusts the number of reasoning tokens based on the reasoning complexity of each problem. |
| Outcome: | The proposed method reduces token costs in CoT reasoning with only a slight performance reduction. |
DUET: Joint Exploration of User–Item Profiles in Recommendation System (2026.findings-acl)
Copied to clipboard
Yue Chen, Yifei Sun, Lu Wang, Fangkai Yang, Pu Zhao, Minjie Hong, Yifei Dong, Minghua He, Nan Hu, Jianjin Zhang, Zhiwei Dai, Yuefeng Zhan, Weihao Han, Hao Sun, Qingwei Lin, Weiwei Deng, Feng Sun, Qi Zhang, Saravan Rajmohan, Dongmei Zhang
| Challenge: | Existing LLMs are opaque and difficult to interpret, resulting in limited interpretability. |
| Approach: | They propose an interaction-aware profile generator that jointly produces user and item profiles conditioned on both user history and item evidence. |
| Outcome: | The proposed model outperforms baselines on three real-world datasets. |
Exploring Label Hierarchy in a Generative Way for Hierarchical Text Classification (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for hierarchical text classification are lacking in the field of natural language processing. |
| Approach: | They propose a hierarchy-aware T5 model with path-adaptive attention mechanism to exploit hierarchical dependency across different levels. |
| Outcome: | The proposed model outperforms state-of-the-art models especially in Macro-F1 and low Macro. |
Dialogue is Better Than Monologue: Instructing Meidcal LLMs via Strategic Conversations (2026.findings-eacl)
Copied to clipboard
Zijie Liu, Xinyu Zhao, Jie Peng, Jinhao Duan, Zhuangdi Zhu, Qingyu Chen, Kaidi Xu, Xia Hu, Tianlong Chen
| Challenge: | Existing tuning methods for medical AI models are monologue-based . existing benchmarks are based on licensing exams or research articles . |
| Approach: | They propose a benchmark to expose limitations of monologue-based tuning for medical AI models . they use a large dialogue dataset to capture stepwise diagnostic reasoning . |
| Outcome: | The proposed model outperforms monologue-tuned models on a medical question answering task and improves accuracy on standard medical QA benchmarks. |
LearnDA: Learnable Knowledge-Guided Data Augmentation for Event Causality Identification (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for event causality identification (ECI) rely on annotated training data. |
| Approach: | They propose a method to augment training data for event causality identification by iteratively generating new examples and classifying event causalities in a dual learning framework. |
| Outcome: | The proposed method outperforms existing methods on EventStoryLine and Causal-TimeBank. |
Not All Directions Matter: Towards Structured and Task-Aware Low-Rank Model Adaptation (2026.acl-long)
Copied to clipboard
Xi Xiao, Chenrui Ma, Yunbei Zhang, Chen Liu, Zhuxuanzi Wang, Yanshu Li, Lin Zhao, Guosheng Hu, Tianyang Wang, Hao Xu
| Challenge: | Low-Rank Adaptation (LoRA) is a key parameter-efficient fine-tuning method . however, its effectiveness is hampered by semantic drift and structural incoherence . |
| Approach: | They propose a low-rank Adaptation framework that tackles semantic drift and structural incoherence by pruning task-irrelevant directions. |
| Outcome: | Experiments on large language models, vision models, and vision models show that the proposed framework outperforms LoRA and advanced dynamic rank allocation and sparsity-based methods. |
Rhythm Controllable and Efficient Zero-Shot Voice Conversion via Shortcut Flow Matching (2025.acl-long)
Copied to clipboard
Jialong Zuo, Shengpeng Ji, Minghui Fang, Mingze Li, Ziyue Jiang, Xize Cheng, Xiaoda Yang, Chen Feiyang, Xinyu Duan, Zhou Zhao
| Challenge: | Existing methods focus on disentangling speakers and content, while others focus on preserving the source's prosody. |
| Approach: | They propose a rhythm-controllable and efficient zero-shot voice conversion model that transforms the source speaker’s timbre into an unseen one while retaining speech content. |
| Outcome: | The proposed model adapts the linguistic content duration to the desired speaking style, facilitating the transfer of the target speaker’s rhythm. |
LoRE: Enhancing Search Relevance with Progressive Chain-of-Thought and Preference Alignment (2026.findings-acl)
Copied to clipboard
Chenji Lu, Zhuo Chen, Hui Zhao, Zhiyuan Zeng, Gang Zhao, Junjie Ren, null Lihaoran, Songyan Liu, Pengjie Wang, Chuan Yu, Jian Xu, Bo Zheng
| Challenge: | E-commerce search relevance is a critical component of retrieval systems. |
| Approach: | They propose a large-generative model for search relevance that trains reasoning knowledge, multi-modal understanding and rule awareness into three core competencies. |
| Outcome: | The proposed model outperforms GPT-5 in Macro-F1 and achieves 27% online gain. |
Diffusion vs. Autoregressive Language Models: A Text Embedding Perspective (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language model (LLM)-based embedding models surpass BERT and T5 on general-purpose text embeddable tasks. |
| Approach: | They propose to adopt diffusion language models for text embeddings to overcome limitations in unidirectional attention used during autoregressive pre-training. |
| Outcome: | The proposed model outperforms the existing LLM-based embedding model on reasoning tasks by 20% and 2% on traditional embeddable benchmarks. |
Domain-Lifelong Learning for Dialogue State Tracking via Knowledge Preservation Networks (2021.emnlp-main)
Copied to clipboard
Qingbin Liu, Pengfei Cao, Cao Liu, Jiansong Chen, Xunliang Cai, Fan Yang, Shizhu He, Kang Liu, Jun Zhao
| Challenge: | Existing offline DST models require a fixed dataset to train . Existing domain-lifelong learning methods are impractical in real-world applications . |
| Approach: | They propose a domain-lifelong learning method to continuously train a DST model on new data to learn incessantly emerging new domains while avoiding catastrophically forgetting old learned domains. |
| Outcome: | The proposed method outperforms state-of-the-art lifelong learning methods by 4.25% and 8.27% on the MultiWOZ and the SGD benchmarks. |
Adaptive Zooming via Relevance-Informed Positional Resource Allocation for Training-free LLM Context Extension (2026.findings-acl)
Copied to clipboard
Hongbo Zhao, Huibin Wang, Bin Tang, Xianming Hu, Yihong Huang, Yijun Shen, Nuoyi Chen, Ping Li, Kai Zhang
| Challenge: | Existing training-free methods for extrapolating beyond training context lengths are semantics-agnostic . Existing methods that focus on relative token distances can indiscriminately blur semantically relevant and irrelevant tokens . |
| Approach: | They propose an adaptive positional zooming method that uses semantic relevance to extrapolate beyond training context lengths. |
| Outcome: | Experiments show that RiPRA outperforms existing training-free extrapolation methods . relevant tokens get higher positional resolution, while irrelevant tokens are compressed . |
ChartEdit: How Far Are MLLMs From Automating Chart Analysis? Evaluating MLLMs’ Capability via Chart Editing (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluations of multimodal large language models rely on limited case studies . however, they lack the ability to generate accurate edits according to the instructions . |
| Approach: | They propose a benchmark for chart editing that includes 1,405 edit instructions applied to 233 real-world charts. |
| Outcome: | The proposed benchmark includes 1,405 diverse editing instructions applied to 233 real-world charts. |
Progressive LoRA for Multimodal Continual Instruction Tuning (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to MCIT address Catastrophic Forgetting and Knowledge Transfer (KT) but using a fixed number of shared LoRA blocks across tasks can lead to knowledge interference. |
| Approach: | They propose a framework that uses a fixed number of shared LoRA blocks to reduce knowledge interference. |
| Outcome: | The proposed framework outperforms existing approaches on the latest MCIT benchmark. |
CoTD-PO: Chain-of-Thought Distillation with Preference Optimization (2025.findings-emnlp)
Copied to clipboard
Lujie Niu, Haochen Sun, Fangkun Zhao, Sheng Chen, Zimeng Bai, Jiawei Zhang, Caixia Yuan, Xiaojie Wang
| Challenge: | Existing methods for chain-of-thought distillation suffer from a distribution mismatch between teacher-generated training trajectories and the student model's own generative distribution. |
| Approach: | They propose a framework that shifts the training paradigm from passive imitation to active trajectory exploration by allowing students to sample their own answer paths. |
| Outcome: | The proposed method outperforms standard CoT distillation baselines while mitigating mode collapse and preserving semantic diversity. |
Revisit Self-Debugging with Self-Generated Tests for Code Generation (2025.acl-long)
Copied to clipboard
Xiancai Chen, Zhengwei Tao, Kechi Zhang, Changzhi Zhou, Xinyu Zhang, Wanli Gu, Yuanpeng He, Mengdi Zhang, Xunliang Cai, Haiyan Zhao, Zhi Jin
| Challenge: | Large language models (LLMs) have made significant advances in code generation, but they still face challenges when tackling complex programming tasks beyond their basic capabilities. |
| Approach: | They propose to integrate self-generated tests into the code generation process . they propose to use post-execution and in-exection self-debugging to mitigate test bias . |
| Outcome: | The proposed method improves the performance of large language models in code generation tasks by leveraging execution feedback from tests. |
Why Machine Reading Comprehension Models Learn Shortcuts? (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing studies show that many MRC models learn shortcuts to outwit benchmarks, but the performance is unsatisfactory in real-world applications. |
| Approach: | They propose to use shortcut questions to analyze learning difficulty of MRC models . they propose to analyze the learning difficulty regarding shortcut and challenging questions . |
| Outcome: | The proposed methods show that a large proportion of shortcut questions in training data make models rely on shortcut tricks excessively. |
KG-RAG: Enhancing GUI Agent Decision-Making via Knowledge Graph-Driven Retrieval-Augmented Generation (2025.emnlp-main)
Copied to clipboard
Ziyi Guan, Jason Chun Lok Li, Zhijian Hou, Pingping Zhang, Donglai Xu, Yuzhi Zhao, Mengyang Wu, Jinpeng Chen, Thanh-Toan Nguyen, Pengfei Xian, Wenao Ma, Shengchao Qin, Graziano Chesi, Ngai Wong
| Challenge: | Recent advances in GUI agents have limited app-specific knowledge of complex mobile tasks. |
| Approach: | They propose a Knowledge Graph-driven Retrieval-Augmented Generation framework that transforms fragmented UTGs into structured vector databases for efficient real-time retrieval. |
| Outcome: | The proposed framework outperforms existing methods in a 75.8% success rate and 84.6% decision accuracy test across mobile apps. |
RobuT: A Systematic Study of Table QA Robustness Against Human-Annotated Adversarial Perturbations (2023.acl-long)
Copied to clipboard
Yilun Zhao, Chen Zhao, Linyong Nan, Zhenting Qi, Wenlin Zhang, Xiangru Tang, Boyu Mi, Dragomir Radev
| Challenge: | Existing Table QA models are vulnerable to task-specific perturbations, such as replacing key question entities or shuffling table columns. |
| Approach: | They propose to use large language models to generate adversarial examples to enhance training, which significantly improves the robustness of Table QA models. |
| Outcome: | The proposed model significantly improves on existing Table QA models against human-annotated adversarial perturbations. |
Smart-Searcher: Incentivizing the Dynamic Knowledge Acquisition of LLMs via Reinforcement Learning (2025.findings-emnlp)
Copied to clipboard
Huatong Song, Jinhao Jiang, Wenqing Tian, Zhipeng Chen, Yuhuan Wu, Jiahao Zhao, Yingqian Min, Xin Zhao, Lei Fang, Ji-Rong Wen
| Challenge: | Large Language Models (LLMs) are powerful but prone to hallucinations due to static knowledge. Retrieval-augmented generation (RAG) helps by injecting external information, but current methods are costly, generalize poorly, or ignore the model’s internal knowledge. |
| Approach: | They propose a framework to train large language models to leverage both internal and external knowledge sources. |
| Outcome: | The proposed framework outperforms existing methods and achieves efficient retrieval-augmented reasoning. |
PromptRank: Unsupervised Keyphrase Extraction Using Prompt (2023.acl-long)
Copied to clipboard
| Challenge: | Existing keyphrase extraction methods struggle with document and candidate length discrepancies or fail to fully utilize the pre-trained language model without further fine-tuning. |
| Approach: | They propose an unsupervised keyphrase extraction approach that uses a pre-trained language model to rank candidates based on document embeddings. |
| Outcome: | The proposed approach outperforms the existing keyphrase extraction approach on six benchmarks. |
UniMoE-Audio: Unified Speech and Music Generation with Dynamic-Capacity Mixture-of-Experts (2026.acl-long)
Copied to clipboard
Zhenyu Liu, Yunxin li, Xuanyu Zhang, Qixun Teng, Shenyuan Jiang, Xinyu Chen, Haoyuan Shi, Haolan Chen, Fanbo Meng, Mingjun Zhao, Yu Xu, Yancheng He, Baotian Hu, Haizhou Li, Min Zhang
| Challenge: | Recent advances in unified multimodal models indicate a clear trend towards comprehensive content generation. |
| Approach: | They propose a unified speech and music generation model built upon a novel framework . they propose specialized MoE architectures and curated training strategies to tackle data imbalances . |
| Outcome: | The proposed model achieves state-of-the-art performance on major speech and music generation benchmarks. |
SMASH: Improving SMAll Language Models’ Few-SHot Ability with Prompt-Based Distillation (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Large-scale language models with prompts have shown remarkable performance on few-shot learning. |
| Approach: | They propose an approach to improve SMAll language models’ few-SHot ability by training on intermediate tasks before prompt-based fine-tuning on downstream tasks. |
| Outcome: | The proposed model improves on sentence-pair and sentiment classification tasks by training on intermediate tasks before fine-tuning on downstream tasks. |
Investigating Ensemble Methods for Model Robustness Improvement of Text Classifiers (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to reduce model's reliance on bias features ignore the learnability of these features. |
| Approach: | They propose to reduce models' reliance on bias features by first training models with fixed low-capacity models which ignore the learnability of the bias features. |
| Outcome: | The proposed models can perform better on out-of-distribution datasets than baseline models with a more sophisticated model design. |
Representation-Guided Parameter-Efficient LLM Unlearning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to unlearning large language models often memorize sensitive or harmful information, but they struggle with the forget-retain trade-off due to the polysemantic nature of LLMs parameters. |
| Approach: | They propose a representation-guided low-rank unlearning approach that leverages the geometric properties of representation spaces to achieve robust and precise unlearning. |
| Outcome: | The proposed approach outperforms state-of-the-art models on TOFU and WMDP benchmarks while maintaining higher model utility. |
An Efficient Context-Dependent Memory Framework for LLM-Centric Agents (2025.naacl-industry)
Copied to clipboard
| Challenge: | a recent study has demonstrated that context-dependent memory encoding can help to retrieve key memory cues essential for problem-solving. |
| Approach: | They propose an efficient architecture miming human memory processes through multistage encoding, context-aware storage, and retrieval strategies for LLM-centric agents. |
| Outcome: | The proposed architecture surpasses state-of-the-art online LLM-centric approaches on two interactive decision-making benchmarks in the navigation and manipulation domain. |
Dynamic Planning for LLM-based Graphical User Interface Automation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to planning for GUI tasks are limited due to long historical dialogues. |
| Approach: | They propose a novel approach to dynamic planning based on environmental feedback and execution history to guide action prediction in GUI tasks. |
| Outcome: | The proposed approach surpasses the strong GPT-4V baseline by +12.7% in accuracy. |
A Federated Framework for LLM-based Recommendation (2025.findings-naacl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated potential in building generative recommendation systems through fine-tuning user behavior data. |
| Approach: | They propose a federated framework for LLM-based recommendation that combines dynamic parameter aggregation and learning speed for different clients. |
| Outcome: | The proposed framework achieves a more balanced client performance and improved overall performance in a computational and storage-efficient way while safeguarding user privacy well. |
MultiFinBen: Benchmarking Large Language Models for Multilingual and Multimodal Financial Application (2026.acl-long)
Copied to clipboard
Xueqing Peng, Lingfei Qian, Yan Wang, Ruoyu Xiang, Yueru He, Yang Ren, Mingyang Jiang, Vincent Jim Zhang, Yuqing Guo, Jeff Zhao, Huan He, Yi Han, Yun Feng, Yuechen Jiang, Yupeng Cao, Haohang Li, Yangyang Yu, Xiaoyu Wang, Penglei Gao, Shengyuan Lin, Keyi Wang, Shanshan Yang, Yilun Zhao, Zhiwei Liu, Peng Lu, Jerry Huang, Suyuchen Wang, Triantafillos Papadopoulos, Polydoros Giannouris, Efstathia Soufleri, Nuo Chen, Zhiyang Deng, Heming Fu, Yijia Zhao, Mingquan Lin, Meikang Qiu, Kaleb E Smith, Arman Cohan, Xiao-Yang Liu, Jimin Huang, Guojun Xiong, Alejandro Lopez-Lira, Xi Chen, Junichi Tsujii, Jian-Yun Nie, Sophia Ananiadou, Qianqian Xie
| Challenge: | Existing evaluations of LLMs in finance are text-only, monolingual, and largely saturated by current models. |
| Approach: | They propose a multilingual and multimodal benchmark for evaluating LLMs in real financial contexts. |
| Outcome: | The first expert-annotated multilingual and multimodal benchmark is released . it evaluates 21 leading LLMs and shows they perform better in multilingual settings . |
Distinguish Confusing Law Articles for Legal Judgment Prediction (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods to assist legal judgment are limited and can't solve confusing charges issue. |
| Approach: | They propose an end-to-end model to predict a legal judgment based on a textual description of the case and a graph neural network to learn subtle differences between confusing law articles. |
| Outcome: | The proposed model can learn subtle differences between confusing law articles and extract effective discriminative features from fact descriptions. |
Learning to Maximize Mutual Information for Chain-of-Thought Distillation (2024.findings-acl)
Copied to clipboard
| Challenge: | Knowledge distillation is a technique of transferring knowledge from large, complex models to smaller ones. |
| Approach: | They propose a method utilizing chain-of-thought distillation to transfer knowledge from large, complex models to smaller ones by maximizing mutual information of the representation features of the two tasks. |
| Outcome: | The proposed method outperforms the state-of-the-art knowledge distillation method on four datasets. |
CogMG: Collaborative Augmentation Between Large Language Model and Knowledge Graph (2024.acl-demos)
Copied to clipboard
| Challenge: | Large language models (LLMs) are susceptible to generating hallucinated content and often encompass factually inaccurate information. |
| Approach: | They propose a framework that leverages knowledge graphs to address the limitations of Large Language Models (LLMs) they identify and decompose required knowledge triples that are not present in the KG, enriching them and aligning updates with real-world demands. |
| Outcome: | The proposed framework reduces hallucinations and increases factual accuracy in QA scenarios while retaining the same quality of knowledge. |
CoV: Chain-of-View Prompting for Spatial Reasoning (2026.findings-acl)
Copied to clipboard
Haoyu Zhao, Akide Liu, Zeyu Zhang, Weijie Wang, Feng Chen, Ruihan Zhu, Gholamreza Haffari, Bohan Zhuang
| Challenge: | Embodied question answering requires collecting context that is distributed across multiple viewpoints . most recent vision–language models (VLMs) are constrained to a fixed and finite set of input views . |
| Approach: | They propose a training-free, test-time reasoning framework that transforms a VLM into an active viewpoint reasoner through a coarse-to-fine exploration process. |
| Outcome: | The proposed framework improves LLM-Match performance by 11.98% on four mainstream VLMs. |
A dataset and baselines for sequential open-domain question answering (D18-1)
Copied to clipboard
| Challenge: | Existing question-answering systems focus on answering individual questions, assuming they are devoid of context. |
| Approach: | They propose to ask multiple related questions in a dataset that includes human-authored questions. |
| Outcome: | The proposed system can answer human-authored questions better than existing systems. |
Physics: Benchmarking Foundation Models on University-Level Physics Problem Solving (2025.findings-acl)
Copied to clipboard
| Challenge: | a benchmark for university-level physics problem solving contains 1,297 expert-annotated problems . a proprietary model, o3-mini, achieves only 59.9% accuracy, highlighting fundamental weaknesses in scientific reasoning, conceptual understanding, and mathematical precision. |
| Approach: | They introduce Physics, a benchmark for university-level physics problem solving. |
| Outcome: | The proposed model achieves only 59.9% accuracy on the most advanced model, o3-mini . the proposed model is a powerful tool for evaluating models on advanced problems . |
BMCook: A Task-agnostic Compression Toolkit for Big Models (2022.emnlp-demos)
Copied to clipboard
Zhengyan Zhang, Baitao Gong, Yingfa Chen, Xu Han, Guoyang Zeng, Weilin Zhao, Yanxu Chen, Zhiyuan Liu, Maosong Sun
| Challenge: | Existing efforts to compress medium-sized models for specific tasks have limited results. |
| Approach: | They propose a task-agnostic compression toolkit for big models that implements quantization, pruning, distillation and MoEfication methods. |
| Outcome: | The proposed tool improves performance on a model with 3 billion parameters by 12x . it also outperforms the original model on three typical NLP benchmarks. |
DUAL-REFLECT: Enhancing Large Language Models for Reflective Translation through Dual Learning Feedback Mechanisms (2024.acl-short)
Copied to clipboard
| Challenge: | Existing self-reflection methods lack effective feedback information, limiting the translation performance of large language models (LLMs). |
| Approach: | They propose a framework that leverages the dual learning of translation tasks to provide effective feedback, thereby enhancing the models’ self-reflective abilities and improving translation performance. |
| Outcome: | The proposed framework improves the models’ self-reflective abilities and improves translation accuracy and eliminating ambiguities across translation tasks. |
Glue pizza and eat rocks - Exploiting Vulnerabilities in Retrieval-Augmented Generative Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Retrieval-Augmented Generative (RAG) models enhance Large Language Models (LLMs) by integrating external knowledge bases. |
| Approach: | They propose to exploit openness of RAG models by injecting deceptive content into the retrieval database, intentionally changing the model’s behavior. |
| Outcome: | The proposed model can be exploited through crafted content uploads with access to the retriever. |
QiMeng-Attention: SOTA Attention Operator is generated by SOTA Attention Algorithm (2025.findings-acl)
Copied to clipboard
Qirui Zhou, Shaohui Peng, Weiqiang Xiong, Haixin Chen, Yuanbo Wen, Haochen Li, Ling Li, Qi Guo, Yongwei Zhao, Ke Gao, Ruizhi Chen, Yanjun Wu, Zhao Chen, Yunji Chen
| Challenge: | Existing LLMs cannot comprehend the complex data flow and computation process of the attention operator and utilize low-level primitive to exploit GPU performance. |
| Approach: | They propose an LLM-friendly Thinking Language (LLM-TL) that can decouple the generation of high-level optimization logic and low-level implementation on GPU and enhance LLMs’ understanding of attention operator. |
| Outcome: | The proposed method outshines existing LLMs on A100, RTX8000, and T4 GPUs, achieving a speed-up of up to 35.16. |
ThinkPilot: Steering Reasoning Models via Automated Think-prefixes Optimization (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large Reasoning Models (LRMs) are powerful but still suffer from inefficient and off-target reasoning. |
| Approach: | They propose a training-free framework that automatically optimizes Large Reasoning Models' reasoning by generating think-prefixes that evolve driven by a taxonomy of reasoning behaviors. |
| Outcome: | The proposed framework significantly improves accuracy-length trade-off for efficient reasoning, drastically improves safety and improves instruction following. |
Illusions of Confidence? Diagnosing LLM Truthfulness via Neighborhood Consistency (2026.acl-long)
Copied to clipboard
Haoming Xu, Ningyuan Zhao, Yunzhi Yao, Weihong Xu, Hongru Wang, Xinle Deng, Shumin Deng, Jeff Z. Pan, Huajun Chen, Ningyu Zhang
| Challenge: | Existing evaluations rely on point-wise confidence, which can mask brittle belief. |
| Approach: | They propose a measure of belief robustness that evaluates coherence across a conceptual neighborhood. |
| Outcome: | The proposed model is more resistant to interference than existing models. |
TransFace: Unit-Based Audio-Visual Speech Synthesizer for Talking Head Translation (2024.findings-acl)
Copied to clipboard
Xize Cheng, Rongjie Huang, Linjun Li, Zehan Wang, Tao Jin, Aoxiong Yin, Chen Feiyang, Xinyu Duan, Baoxing Huai, Zhou Zhao
| Challenge: | Existing methods for talking head translation rely on cascading, resulting in delays and cascadic errors. |
| Approach: | They propose a model for talking head translation, TransFace, which can translate audio-visual speech into audio-visual speech in other languages. |
| Outcome: | The proposed model can translate audio-visual speech into audio-visual speech in other languages. |
Modeling Personalization in Continuous Space for Response Generation via Augmented Wasserstein Autoencoders (D19-1)
Copied to clipboard
| Challenge: | Existing work on variableal autoencoders and waterstein autoencoding models has shown significant progress in open-domain response generation. |
| Approach: | They propose to embed user-level and utterance-level information into two multimodal distributions and combine them into a mixed distribution. |
| Outcome: | The proposed model outperforms state-of-the-art models on a large-scale real-world dataset. |
SAM3-I: Segment Anything with Instructions (2026.acl-long)
Copied to clipboard
Jingjing Li, Yue Feng, Yuchen Guo, Jincai Huang, Wei Ji, Qi Bi, Yongri Piao, Miao Zhang, Xiaoqi Zhao, Qiang Chen, Shihao Zou, Huchuan Lu, Li Cheng
| Challenge: | Existing methods for concept-level grounding and instruction-level reasoning use coarse representations and iterative mask filtering. |
| Approach: | They propose an instruction-following extension of the Segment Anything Model 3 family that unifies concept-level grounding and instruction-level reasoning within a single segmentation framework. |
| Outcome: | Experiments show that SAM3-I achieves appealing performance across referring and reasoning-based segmentation while maintaining its strong concept recall ability. |
Robust Unsupervised Neural Machine Translation with Adversarial Denoising Training (2020.coling-main)
Copied to clipboard
| Challenge: | Unsupervised neural machine translation (UNMT) has attracted great interest in the machine translation community. |
| Approach: | They propose to explicitly take noisy data into consideration to improve the robustness of UNMT based systems. |
| Outcome: | The proposed methods significantly improved the robustness of the conventional UNMT systems in noisy scenarios. |
AJ-Bench: Benchmarking Agent-as-a-Judge for Environment-Aware Evaluation (2026.findings-acl)
Copied to clipboard
Wentao Shi, Yu Wang, Yuyang Zhao, Yuxin Chen, Fuli Feng, Xueyuan Hao, Xi Su, Qi GU, Hui Su, Xunliang Cai, Xiangnan He
| Challenge: | Existing approaches to verify agent behaviors in complex environments rely on rule-based verifiers or LLM-as-a-Judge models. |
| Approach: | They propose a benchmark to evaluate Agent-as-a-Judge across three domains . the benchmark covers search, data systems, and graphical user interfaces - with 155 tasks and 516 trajectories . |
| Outcome: | The proposed benchmark outperforms existing benchmarks in search, data systems, and GUI domains while revealing open challenges in agent-based verification. |
Cross-lingual Multimodal Sentiment Analysis for Low-Resource Languages via Language Family Disentanglement and Rethinking Transfer (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing multimodal sentiment analysis methods are limited to textual data and cannot handle multimodal scenarios. |
| Approach: | They propose a transfer learning framework that allows cross-lingual and cross-modal alignments and a language family disentanglement module that enhances the sharing of language universals within families. |
| Outcome: | The proposed method is superior to existing methods and can handle low-resource languages. |
Reconstructing Event Regions for Event Extraction via Graph Attention Networks (2020.aacl-main)
Copied to clipboard
| Challenge: | Existing approaches for event extraction focus on sentence-level event extraction, but they lack a broader view of the document context. |
| Approach: | They build graphs with candidate event filler extractions enriched by sentential embeddings as nodes and use graph attention networks to identify event regions in a document and aggregate event information. |
| Outcome: | The proposed method performs well on two languages and shows that it is faster than previous methods. |
Learning-by-Narrating: Narrative Pre-Training for Zero-Shot Dialogue Comprehension (2022.acl-short)
Copied to clipboard
| Challenge: | Existing models for dialogue comprehension are not available for the pre-training of such a model. |
| Approach: | They propose a narrative-guided pre-training strategy that learns by narrating key information from a dialogue input. |
| Outcome: | The proposed model performs better on four dialogue-based tasks and is comparable to existing models. |
Towards Effective and Efficient Continual Pre-training of Large Language Models (2025.acl-long)
Copied to clipboard
Jie Chen, Zhipeng Chen, Jiapeng Wang, Kun Zhou, Yutao Zhu, Jinhao Jiang, Yingqian Min, Xin Zhao, Zhicheng Dou, Jiaxin Mao, Yankai Lin, Ruihua Song, Jun Xu, Xu Chen, Rui Yan, Zhewei Wei, Di Hu, Wenbing Huang, Ji-Rong Wen
| Challenge: | Continual pre-training (CPT) has been an important approach for adapting language models to specific domains or tasks. |
| Approach: | They propose a Continual pre-training method that can greatly improve Chinese language ability and scientific reasoning ability of LLMs. |
| Outcome: | The proposed method can greatly improve Chinese language ability and scientific reasoning ability of LLMs. |
TaPERA: Enhancing Faithfulness and Interpretability in Long-Form Table QA by Content Planning and Execution-based Reasoning (2024.acl-long)
Copied to clipboard
| Challenge: | Long-form table question answering often generates paragraph long and complex answers . a prevalent and concerning issue is hallucination, where models generate answers that are coherent yet factually incorrect or irrelevant to the input context. |
| Approach: | They propose a modular framework that decomposes the whole process into three sub-modules . framework produces a QA-based plan first, followed by generating an answer conditioned on this plan . human evaluation results indicate the framework improves strong baselines on accuracy and truthfulness . |
| Outcome: | The proposed framework improves accuracy and truthfulness on the FeTaQA and QTSumm datasets. |
Class Lifelong Learning for Intent Detection via Structure Consolidation Networks (2023.findings-acl)
Copied to clipboard
Qingbin Liu, Yanchao Hao, Xiaolong Liu, Bo Li, Dianbo Sui, Shizhu He, Kang Liu, Jun Zhao, Xi Chen, Ningyu Zhang, Jiaoyan Chen
| Challenge: | Existing intent detection models can only handle predefined intent classes in the offline environment. |
| Approach: | They propose a method that continually learns new intent classes from new data . structure-based retrospection and contrastive knowledge distillation are used to solve these problems . |
| Outcome: | The proposed method outperforms existing models on three benchmarks. |
Enhancing Large Vision-Language Models with Ultra-Detailed Image Caption Generation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing pipelines for generating high-quality, ultra-detailed image captions are limited by the scarcity of image caption data. |
| Approach: | They propose a pipeline for generating high-quality, ultra-detailed image captions that integrates both pre-processing and post-processor stages. |
| Outcome: | The proposed pipeline improves LVLMs' perception and cognitive abilities across multiple vision-language benchmarks. |
MixGR: Enhancing Retriever Generalization for Scientific Domain through Complementary Granularity (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies show the importance of document retrieval in the scientific domain. |
| Approach: | They propose a zero-shot approach to measure query-document similarity using atomic components in queries and documents to combine them into a united score. |
| Outcome: | The proposed approach outperforms previous document retrieval methods by 24.7%, 9.8%, and 6.9% on nDCG@5 with unsupervised, supervised, and LLM-based retrievers. |
ViDoRAG: Visual Document Retrieval-Augmented Generation via Dynamic Iterative Reasoning Agents (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing benchmarks focus on image-based question answering (QA) but ignore the fundamental challenges of efficient retrieval, comprehension, and reasoning within dense visual documents. |
| Approach: | They propose a novel multi-agent RAG framework tailored for complex reasoning across visual documents that employs a Gaussian Mixture Model (GMM)-based hybrid strategy to handle multi-modal retrieval. |
| Outcome: | The proposed framework outperforms existing methods by over 10% on the competitive ViDoSeek benchmark. |
Extract, Integrate, Compete: Towards Verification Style Reading Comprehension (2021.findings-emnlp)
Copied to clipboard
| Challenge: | VGaokao is a verification style reading comprehension dataset for Chinese language tests requiring advanced language understanding skills. |
| Approach: | They propose a new extract-integration-compete approach to extract complementary evidence from Chinese Language tests of Gaokao and a pairwise competition to push models to learn the subtle difference between similar text pieces. |
| Outcome: | The proposed approach outperforms baselines on VGaokao with retrieved complementary evidence while having the merits of efficiency and explainability. |
Question-guided Knowledge Graph Re-scoring and Injection for Knowledge Graph Question Answering (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Knowledge graph question answering (KGQA) aims to provide factual answers to natural language questions by leveraging structured information stored in a knowledge graph. |
| Approach: | They propose a Question-guided Knowledge Graph Re-scoring method to eliminate noisy pathways for the input question, thereby focusing specifically on pertinent factual knowledge. |
| Outcome: | The proposed method eliminates noisy pathways for the input question, thereby focusing specifically on pertinent factual knowledge. |
Novel Slot Detection With an Incremental Setting (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Current dialogue systems face diverse user requests and rapid change domains, making quickly adapt to scenarios with previous unseen slot types becomes a major challenge. |
| Approach: | They propose an incremental novel slot detection task which separates the dialogue system to deal with novel types as two major phrases: 1) model discovers unknown slots; 2) training model to possess the capability to handle new classes. |
| Outcome: | The proposed approach overcomes catastrophic forgetting during the process of INSD and is highly effective. |
ReAgent: Reversible Multi-Agent Reasoning for Knowledge-Enhanced Multi-Hop QA (2025.emnlp-main)
Copied to clipboard
Zhao Xinjie, Fan Gao, Xingyu Song, Yingjian Chen, Rui Yang, Yanran Fu, Yuyang Wang, Yusuke Iwasawa, Yutaka Matsuo, Irene Li
| Challenge: | Multi-hop question answering (QA) is a central challenge in natural language processing . early mistakes can cause errors and undermine the final result, authors say . |
| Approach: | They propose a reversible multi-agent reasoning framework that backtracks to earlier valid states when conflicts arise. |
| Outcome: | Empirical evaluation shows that the framework improves on forward-only benchmarks by 6% . the approach enables agents to backtrack to valid states when conflicts arise . |
Unlocking the Future: Exploring Look-Ahead Planning Mechanistic Interpretability in Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have shown that large language models may possess preliminary planning capabilities. |
| Approach: | They examine the look-ahead planning mechanism in large language models from the perspectives of information flow and internal representations. |
| Outcome: | The proposed model can decode the decision from the output of MHSA in the middle layers at the last token. |
GUICourse: From General Vision Language Model to Versatile GUI Agent (2025.acl-long)
Copied to clipboard
Wentong Chen, Junbo Cui, Jinyi Hu, Yujia Qin, Junjie Fang, Yue Zhao, Chongyi Wang, Jun Liu, Guirong Chen, Yupeng Huo, Yuan Yao, Yankai Lin, Zhiyuan Liu, Maosong Sun
| Challenge: | Graphical User Interfaces (GUIs) are a pivotal medium for human-computer interaction. |
| Approach: | They propose a series of datasets for training visual-based GUI agents using general VLMs. |
| Outcome: | The proposed GUICourse datasets show that even a small-sized GUI agent performs better on GUI tasks. |
Think before Go: Hierarchical Reasoning for Image-goal Navigation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for image-goal navigation fail to extract informative visual cues, leading agents to wander around. |
| Approach: | They propose a framework that decomposes image-goal navigation into high-level planning and low-level execution. |
| Outcome: | The proposed method is superior to existing methods in both simulation and real-world environments. |
Incorporating Dynamic Semantics into Pre-Trained Language Model for Aspect-based Sentiment Analysis (2022.findings-acl)
Copied to clipboard
| Challenge: | Aspect-based sentiment analysis (ABSA) predicts sentiment polarity towards a specific aspect in a sentence. |
| Approach: | They propose to use a dynamic aspect-oriented semantics-based method to learn ABSA. |
| Outcome: | The proposed method can learn dynamic aspect-oriented semantics for ABSA on three benchmark datasets. |
TextHide: Tackling Data Privacy in Language Understanding Tasks (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Unsolved privacy challenges in distributed or federated learning are a challenge for many domains including Natural Language Processing. |
| Approach: | They propose a federated learning framework that adds an encryption step to prevent an eavesdropping attacker from recovering private text data. |
| Outcome: | The proposed model can effectively defend against attacks on shared gradients or representations and the averaged accuracy reduction is only 1.9%. |
Position Really Matters: Towards a Holistic Approach for Prompt Tuning (2025.findings-naacl)
Copied to clipboard
| Challenge: | Prompt tuning is effective in extracting knowledge from foundation models, but its effectiveness is uncertain. |
| Approach: | They propose a parametric prompt tuning strategy that dynamically determines different factors of prompts based on specific tasks or instances. |
| Outcome: | The proposed approach improves performance across a wide range of tasks including NLP, vision recognition, and vision-language tasks. |
Parameter-efficient Continual Learning Framework in Industrial Real-time Text Classification System (2022.naacl-industry)
Copied to clipboard
Tao Zhu, Zhe Zhao, Weijie Liu, Jiachi Liu, Yiren Chen, Weiquan Mao, Haoyan Liu, Kunbo Ding, Yudong Li, Xuefeng Yang
| Challenge: | Existing continual learning methods use data replay, parameter isolation and regularization to mitigate catastrophic forgetting. |
| Approach: | They propose a parameter-efficient continual learning framework that updates parameters offline and then trains using an online regularization method. |
| Outcome: | The proposed framework reduces catastrophic forgetting and saves the model with the changed parameters instead of all parameters. |
Improving Translation Quality Estimation with Bias Mitigation (2023.acl-long)
Copied to clipboard
| Challenge: | State-of-the-art translation Quality Estimation models are biased, relying on monolingual features while ignoring the bilingual semantic alignment. |
| Approach: | They propose a method to mitigate the bias of translation quality estimation models by contrastive learning between clean and noisy sentence pairs. |
| Outcome: | The proposed method improves the estimation performance while mitigating the bias. |
ExeCoder: Empowering Large Language Models with Executability Representation for Code Translation (2025.emnlp-main)
Copied to clipboard
Minghua He, Yue Chen, Fangkai Yang, Pu Zhao, Wenjie Yin, Yu Kang, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang
| Challenge: | Existing code translation models only learn the contextual semantics of code during pre-training, neglecting executability information closely related to the execution state of the code. |
| Approach: | They propose an LLM specifically designed for code translation called ExeCoder . it uses executability representations such as functional semantics and syntax structures to enhance LLMs' capabilities. |
| Outcome: | The proposed model outperforms existing open-source code translation models on two metrics. |
What’s in a Name? Answer Equivalence For Open-Domain Question Answering (2021.emnlp-main)
Copied to clipboard
| Challenge: | A flaw in QA evaluation is that annotations often only provide one answer . therefore, model predictions semantically equivalent to the answer but superficially different are considered incorrect. |
| Approach: | They explore using alias entities from knowledge bases to extract additional answers . they incorporate additional answers for evaluation and model training with equivalent answers based on the results . |
| Outcome: | The proposed solution improves the accuracy of evaluation with additional answers and improves model training with equivalent answers. |
Open-ended Commonsense Reasoning with Unrestricted Answer Candidates (2023.findings-emnlp)
Copied to clipboard
Chen Ling, Xuchao Zhang, Xujiang Zhao, Yanchi Liu, Wei Cheng, Mika Oishi, Takao Osaki, Katsushi Matsuda, Haifeng Chen, Liang Zhao
| Challenge: | Current approaches to commonsense reasoning are limited due to limited answer scope. |
| Approach: | They propose to solve a commonsense question without a pre-defined answer scope . they leverage pre-trained language models to iteratively retrieve reasoning paths on the external knowledge base . |
| Outcome: | The proposed method achieves better performance on two commonsense benchmark datasets. |
When to Continue Thinking: Adaptive Thinking Mode Switching for Efficient Reasoning (2025.findings-emnlp)
Copied to clipboard
Xiaoyun Zhang, Jingqing Ruan, Xing Ma, Yawen Zhu, Haodong Zhao, Hao Li, Jiansong Chen, Ke Zeng, Xunliang Cai
| Challenge: | Large reasoning models (LRMs) incur excessive computational overhead due to redundant reasoning, especially on simple tasks. |
| Approach: | They propose an Adaptive Self-Recovery Reasoning framework that suppresses unnecessary reasoning and enables implicit recovery. |
| Outcome: | The proposed framework suppresses unnecessary reasoning and enables implicit recovery. |
RankCSE: Unsupervised Sentence Representations Learning via Learning to Rank (2023.acl-long)
Copied to clipboard
Jiduan Liu, Jiahao Liu, Qifan Wang, Jingang Wang, Wei Wu, Yunsen Xian, Dongyan Zhao, Kai Chen, Rui Yan
| Challenge: | Unsupervised sentence representation learning is one of the fundamental problems in natural language processing . contrastive learning methods fail to capture fine-grained ranking information among the sentences . |
| Approach: | They propose a novel approach for unsupervised sentence representation learning that integrates ranking consistency and ranking distillation with contrastive learning into a unified framework. |
| Outcome: | The proposed approach performs better over state-of-the-art models on STS and TR tasks. |
UER: An Open-Source Toolkit for Pre-training Models (D19-3)
Copied to clipboard
Zhe Zhao, Hui Chen, Jinbin Zhang, Xin Zhao, Tao Liu, Wei Lu, Xi Chen, Haotang Deng, Qi Ju, Xiaoyong Du
| Challenge: | Existing work on pre-training models have shown that it is important to use a framework to deploy various pre- training models efficiently. |
| Approach: | They propose an assemble-on-demand pre-training toolkit that assembles pre-trained models on demand and encapsulates them with rich modules. |
| Outcome: | The proposed framework can reproduce state-of-the-art models or develop models that remain unexplored. |
Keyphrase Generation with Correlation Constraints (D18-1)
Copied to clipboard
| Challenge: | Existing methods for keyphrase generation ignore correlation among keyphrases, resulting in duplication and coverage issues. |
| Approach: | They propose a new sequence-to-sequence architecture for keyphrase generation that captures correlation among keyphrases by preceding phrases to eliminate duplicate phrases and improve result coherence. |
| Outcome: | The proposed model outperforms the state-of-the-art method on benchmark datasets in terms of accuracy and diversity. |
SELF-GUARD: Empower the LLM to Safeguard Itself (2024.naacl-long)
Copied to clipboard
| Challenge: | Recent studies have investigated methods to improve the safety of large language models (LLMs) safety training involves fine-tuning the LLM with adversarial samples, which activate the LRM’s capabilities against jailbreak. |
| Approach: | They propose a safety training approach that integrates safety training and safeguards to train the LLM to perform harmfulness detection on its own outputs. |
| Outcome: | The proposed method reduces harmful output and adds a [harmful] or [harmless] tag to the end of the LLM's response. |
Probing into the Root: A Dataset for Reason Extraction of Structural Events from Financial Documents (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing methods for event reason extraction are far from resolving this problem. |
| Approach: | They propose a task to extract causal explanations from document-level texts . they use a dataset FinReason for evaluation to provide Reasons annotation for financial events . |
| Outcome: | The proposed task performs better than existing methods on a dataset of 8,794 documents, 12,861 financial events and 11,006 reason spans. |
Concept-Based Label Embedding via Dynamic Routing for Hierarchical Text Classification (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for hierarchical text classification focus on modeling the text, but the concept of sharing among classes has been ignored in previous work. |
| Approach: | They propose a concept-based method that explicitly represents the concept and model the sharing mechanism among classes for the hierarchical text classification. |
| Outcome: | The proposed method outperforms state-of-the-art methods on two widely used datasets. |
Large Dual Encoders Are Generalizable Retrievers (2022.emnlp-main)
Copied to clipboard
Jianmo Ni, Chen Qu, Jing Lu, Zhuyun Dai, Gustavo Hernandez Abrego, Ji Ma, Vincent Zhao, Yi Luan, Keith Hall, Ming-Wei Chang, Yinfei Yang
| Challenge: | Experimental results show that dual encoders outperform sparse and dense retrievers on the BEIR dataset significantly. |
| Approach: | They challenge belief that bottleneck layer is too limited for out-of-domain generalization . they scale up the model while keeping bottleneck as a single dot-product with a fixed size . |
| Outcome: | The proposed model outperforms sparse and dense retrievers on the BEIR dataset significantly. |
Clinical-Coder: Assigning Interpretable ICD-10 Codes to Chinese Clinical Notes (2020.acl-demos)
Copied to clipboard
| Challenge: | Existing methods of automatic coding prediction have been successful, but the interpretability of predicted codes is a challenge. |
| Approach: | They propose an online system that can predict ICD codes for Chinese clinical notes by using a Dilated Convolutional Attention network with N-gram Matching mechanism. |
| Outcome: | The proposed system is able to provide supporting information in clinical decision making. |
AgentReview: Exploring Peer Review Dynamics with LLM Agents (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods of peer review analysis do not address multivariate nature of the process, account for latent variables, and are constrained by privacy concerns due to the sensitive nature of data. |
| Approach: | They propose a large language model based peer review simulation framework which effectively disentangles the impacts of multiple latent factors and addresses the privacy issue. |
| Outcome: | The proposed framework disentangles the impacts of multiple latent factors and addresses privacy concerns. |
ItD: Large Language Models Can Teach Themselves Induction through Deduction (2024.acl-long)
Copied to clipboard
| Challenge: | Recent studies have shown that Large Language Models (LLMs) have limited ability to conduct induction. |
| Approach: | They propose a framework to enable LLMs to teach themselves induction through deduction. |
| Outcome: | The proposed framework improves performance on two induction benchmarks and shows that it can be used to teach induction through deduction. |
Leverage Lexical Knowledge for Chinese Named Entity Recognition via Collaborative Graph Network (D19-1)
Copied to clipboard
| Challenge: | Existing models for named entity recognition (NER) lack word boundaries information, which is a major barrier to developing a high performance named entity system. |
| Approach: | They propose a Chinese named entity recognition system with word boundaries information . they use word-level representations and character-level models to integrate lexical knowledge into Chinese NER . |
| Outcome: | The proposed model outperforms the state-of-the-art model and achieves a speed of up to 15 times faster than the SOTA model. |
Modeling Layout Reading Order as Ordering Relations for Visually-rich Document Understanding (2024.emnlp-main)
Copied to clipboard
Chong Zhang, Yi Tu, Yixi Zhao, Chenshu Yuan, Huan Chen, Yue Zhang, Mingxu Chai, Ya Guo, Huijia Zhu, Qi Zhang, Tao Gui
| Challenge: | Existing models of layout reading order do not convey the complete reading order information in the layout. |
| Approach: | They propose to model layout reading order as ordering relations over layout elements . they propose a reading-order-relation-enhancing pipeline to improve model performance . |
| Outcome: | The proposed model outperforms existing models on a visual-rich document dataset and on eight cross-domain VrD-IE/QA tasks without targeted optimization. |
Addressing NER Annotation Noises with Uncertainty-Guided Tree-Structured CRFs (2023.emnlp-main)
Copied to clipboard
| Challenge: | Named entity recognition datasets are notorious for their noisy nature due to annotation errors, inconsistencies, and subjective interpretations. |
| Approach: | They propose a method that considers NER as a constituency tree parsing problem and uses a tree-structured Conditional Random Fields with uncertainty evaluation for integration. |
| Outcome: | The proposed model exhibits superb performance even in extreme scenarios with 90% annotation noise. |
Enhancing Scalability of Pre-trained Language Models via Efficient Parameter Sharing (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to scale pre-trained language models to a deeper model depth share all parameters or use extra blocks. |
| Approach: | They propose a parameter-efficient approach to scaling pre-trained language models to a deeper model depth using matrix product operator. |
| Outcome: | The proposed model scales pre-trained language models to a deeper model depth by 4x and achieves 0.1 points higher than BERT-large for GLUE score. |
Implicit Relation Linking for Question Answering over Knowledge Graph (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing methods rely on textual similarities between NL and KG to build relation links. |
| Approach: | They propose an implicit relation linking method called ImRL which links relation phrases in NL to relation paths in KG. |
| Outcome: | The proposed method significantly outperforms state-of-the-art methods on two benchmarks and a newly-created datasets. |
FineReason: Evaluating and Improving LLMs’ Deliberate Reasoning through Reflective Puzzle Solving (2025.acl-long)
Copied to clipboard
Guizhen Chen, Weiwen Xu, Hao Zhang, Hou Pong Chan, Chaoqun Liu, Lidong Bing, Deli Zhao, Anh Tuan Luu, Yu Rong
| Challenge: | Recent advances in large language models (LLMs) highlight an important shift from the “System 1” way of quick reactions to the “system 2” style of reflection-and-correction problem solving. |
| Approach: | They propose a logic-puzzle benchmark for systematic evaluation of large language models' reasoning capabilities that decomposes each puzzle into atomic steps. |
| Outcome: | The proposed model improves on state checking and state transition tasks and demonstrates gains in reasoning by up to 5.1%. |
VoxMind: An End-to-End Agentic Spoken Dialogue System (2026.acl-long)
Copied to clipboard
Tianle Liang, Yifu Chen, Shengpeng Ji, Yijun Chen, Zhiyang Jia, Jingyu Lu, Fan Zhuo, Xueyi Pu, Yangzhuo Li, Zhou Zhao
| Challenge: | Existing research on end-to-end spoken dialogue models has focused on core perception and generation, with limited exploration of tool-augmented extensions. |
| Approach: | They propose a framework to equip end-to-end spoken dialogue models with comprehensive agentic abilities by leveraging a 470-hour AgentChat dataset. |
| Outcome: | The proposed framework outperforms Gemini-2.5-Pro on spoken agent tasks while maintaining general conversational quality. |
A Layer-wise Analysis of Supervised Fine-Tuning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for fine-tuning ignore depth-dependent heterogeneity of instruction-following . a critical gap remains in understanding where these changes occur across the model's depth and which layers are essential for instruction- following. |
| Approach: | They propose a method which selectively updates critical intermediate layers . they show that effective alignment is architecturally localized rather than distributed . |
| Outcome: | The proposed method outperforms standard LoRA up to 10.2% on GSM8K with reduced parameter overhead. |
From the One, Judge of the Whole: Typed Entailment Graph Construction with Predicate Generation (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods to construct entailment graphs suffer from severe sparsity issues due to limited corpora and the long-tail phenomenon of predicate distributions. |
| Approach: | They propose a multi-stage method to generate entailment graphs by generating new predicates and detecting enanglement relations among seed predicats. |
| Outcome: | The proposed method can generate high-quality graphs with high precision over state-of-the-art methods and boost the performance of down-stream inference tasks. |
Don’t Be Misled by Style: A Style-Adaptive Reranker for Capturing Effective Knowledge in Retrieval-Augmented Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing rerankers are mainly trained on well-edited texts, but stylistic features can be misled by reranked models. |
| Approach: | They propose a style-augmented multi-task framework that prioritizes effective knowledge over stylistic perturbations by using an LLM to derive passage-level supervision on whether a passage helps or harms answer correctness. |
| Outcome: | Extensive experiments show that SARK improves generation performance across multiple LLMs under mixed-style conditions. |
Rethinking Reasoning-Intensive Retrieval: Evaluating and Advancing Retrievers in Agentic Search Systems (2026.acl-long)
Copied to clipboard
| Challenge: | Existing evaluation benchmarks for retrievers are narrow and evaluate them in isolation . existing evaluation benchmarking frameworks focus on evaluating retrievers in isolation, obscuring their value in real-world applications. |
| Approach: | They propose an evaluation framework that evaluates retrievers in agentic search systems . they provide expert-annotated reasoning aspects, positive documents, a reference response and evaluation rubrics . |
| Outcome: | The proposed framework assesses retrievers in agentic search systems. |
GRAG: Graph Retrieval-Augmented Generation (2025.findings-naacl)
Copied to clipboard
| Challenge: | Naive Retrieval-Augmented Generation (RAG) focuses on individual documents during retrieval and is not suitable for networked documents. |
| Approach: | They propose a novel divide-and-conquer strategy that retrieves optimal subgraph structure in linear time. |
| Outcome: | The proposed approach outperforms current state-of-the-art methods on graph reasoning benchmarks. |
Aligning Large Language Models to Follow Instructions and Hallucinate Less via Effective Data Filtering (2025.acl-long)
Copied to clipboard
Shuzheng Si, Haozhe Zhao, Gang Chen, Cheng Gao, Yuzhuo Bai, Zhitong Wang, Kaikai An, Kangyang Luo, Chen Qian, Fanchao Qi, Baobao Chang, Maosong Sun
| Challenge: | Existing studies show that training LLMs on data containing unfamiliar knowledge during instruction tuning can encourage hallucinations. |
| Approach: | They propose a framework that measures how familiar the LLM is with instruction data and introduce an expert-aligned reward model to ensure the quality of selected samples. |
| Outcome: | The proposed framework reduces hallucinations while maintaining a competitive ability to follow instructions. |
ViT-TTS: Visual Text-to-Speech with Scalable Diffusion Transformer (2023.emnlp-main)
Copied to clipboard
| Challenge: | Text-to-speech (TTS) performance has improved with the advent of denoising Diffusion Probabilistic Models . however, perceived quality of audio depends on content, pitch, rhythm, and energy . |
| Approach: | They propose a visual TTS model with scalable diffusion transformers that complement phoneme sequences with visual information to generate high-perceived audio. |
| Outcome: | The proposed model outperforms existing models regardless of visibility of the scene . it can generate high-perceived audio, opening up new avenues for AR and VR applications . |
ESC-Eval: Evaluating Emotion Support Conversations in Large Language Models (2024.emnlp-main)
Copied to clipboard
Haiquan Zhao, Lingyu Li, Shisong Chen, Shuqi Kong, Jiaan Wang, Kexin Huang, Tianle Gu, Yixu Wang, Jian Wang, Liang Dandan, Zhixu Li, Yan Teng, Yanghua Xiao, Yingchun Wang
| Challenge: | Emotion Support Conversation (ESC) is a crucial application for reducing stress and providing emotional guidance. |
| Approach: | They re-organize 2,801 role-playing cards to define roles of role-players . they train a specific role- playing model called ESC-Role which behaves more like a confused person than GPT-4 . |
| Outcome: | The proposed model behaves more like a confused person than GPT-4, and the model performs better than GPLs. |
Towards Better Chain-of-Thought: A Reflection on Effectiveness and Faithfulness (2025.findings-acl)
Copied to clipboard
| Challenge: | Chain-of-thought (CoT) prompting demonstrates varying performance under different reasoning tasks. |
| Approach: | They propose to recall extra information from the question to enhance CoT generation and evaluate CoTs based on their information gain. |
| Outcome: | The proposed method improves both the faithfulness and effectiveness of CoT and evaluates it based on their information gain. |
CoMeT: Collaborative Memory Transformer for Efficient Long Context Modeling (2026.acl-long)
Copied to clipboard
Runsong Zhao, Shilei Liu, Jiwei Tang, Langming Liu, Haibin Chen, Weidong Zhang, Yujin Yuan, Tong Xiao, JingBo Zhu, Wenbo Su, Bo Zheng
| Challenge: | a novel architecture that enables LLMs to handle arbitrarily long sequences with constant memory usage and linear time complexity is a major barrier to long-context processing. |
| Approach: | They propose a novel architecture that enables LLMs to handle arbitrarily long sequences with constant memory usage and linear time complexity. |
| Outcome: | The proposed architecture can handle arbitrarily long sequences with constant memory usage and linear time complexity. |
Bridging the Generalization Gap in Text-to-SQL Parsing with Schema Expansion (2022.acl-long)
Copied to clipboard
| Challenge: | Existing text-to-SQL parsers struggle with out-of-domain generalization problems, arguing that they lack the ability to match domain specific phrases to composite operations over columns. |
| Approach: | They propose to use a synthetic dataset and a re-purposed train/test split to quantify out-of-domain generalization over column operations to address this problem. |
| Outcome: | The proposed method outperforms baseline parsers on the domain generalization problem, while boosting the underlying parser’ overall performance by 13.8% relative accuracy gain (5.1% absolute). |
Multi-granularity Temporal Question Answering over Knowledge Graphs (2023.acl-long)
Copied to clipboard
| Challenge: | Existing work on temporal knowledge graphs ignores fact that real-life applications of TKGQA are complex in temporal granularity. |
| Approach: | They propose a large scale dataset for multi-granularity temporal question answering over knowledge graphs . they propose comparing MultiQA over MultiTQ to better reflect real-world challenges . |
| Outcome: | The proposed dataset is among the first of its kind and features multiple temporal granularities. |
RESTful-Llama: Connecting User Queries to RESTful APIs (2024.emnlp-industry)
Copied to clipboard
| Challenge: | Recent advances in Large Language Models (LLMs) have demonstrated exceptional performance in zero-shot learning and reasoning tasks. |
| Approach: | They propose a framework that transforms natural language instructions into effective RESTful API calls and a method to generate fine-tuning datasets from public API documentation. |
| Outcome: | The proposed framework improves performance in a 31.9% improvement in robustness and 2.33x increase in efficiency compared to existing methods. |
Large Language Models Help Humans Verify Truthfulness – Except When They Are Convincingly Wrong (2024.naacl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are increasingly used for accessing information on the web. |
| Approach: | They conduct experiments with 80 crowdworkers to compare LLMs with search engines . they ask LLM to provide contrastive information to reduce over-reliance on LLM . |
| Outcome: | The results show that LLMs can outperform search engines but not LLM explanations . the study shows that LMS explanations are not reliable replacements for reading retrieved passages compared to search engines alone. |
HER: Human-like Reasoning and Reinforcement Learning for LLM Role-playing (2026.findings-acl)
Copied to clipboard
Chengyu Du, Xintao Wang, Aili Chen, Weiyuan Li, Rui Xu, Junteng Liu, Zishan Huang, Rong Tian, Zijun Sun, Yuhao Li, Liheng Feng, Deming Ding, Pengyu Zhao, Yanghua Xiao
| Challenge: | Existing models for LLM role-playing lack high-quality datasets with explicit reasoning traces and reliable reward signals aligned with human preferences. |
| Approach: | They propose a unified framework for cognitive-level persona simulation that strictly distinguishes characters’ first-person thinking processes from LLMs’ third-person reasoning. |
| Outcome: | The proposed framework outperforms the Qwen3-32B baseline model and achieves a 30.26% and 14.97% performance on the minimax benchmarks. |
Getting MoRE out of Mixture of Language Model Reasoning Experts (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing large language models (LLMs) have poor generalizability on question types beyond those seen in the prompt. |
| Approach: | They propose a framework that integrates specialized language models to generalize across question types that require distinct reasoning abilities. |
| Outcome: | The proposed framework gives higher accuracy than any single specialized model on a collection of 12 QA datasets from four reasoning types. |
ControlSpeech: Towards Simultaneous and Independent Zero-shot Speaker Cloning and Zero-shot Language Style Control (2025.acl-long)
Copied to clipboard
Shengpeng Ji, Qian Chen, Wen Wang, Jialong Zuo, Minghui Fang, Ziyue Jiang, Hai Huang, Zehan Wang, Xize Cheng, Siqi Zheng, Zhou Zhao
| Challenge: | Prior zero-shot TTS models only mimic the speaker’s voice without further control and adjustment capabilities while prior controllable TTS systems cannot perform speaker-specific voice generation. |
| Approach: | They propose a style control module that captures codec representations corresponding to timbre, content, and style in a discrete decoupling codec space. |
| Outcome: | The proposed system can fully clone the speaker's voice and perform speech-specific adjustment and control functions. |
Incremental Event Detection via Knowledge Consolidation Networks (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to event detection require a fixed set of pre-defined event types . existing methods cannot handle semantic ambiguity and training data imbalance problems . |
| Approach: | They propose a Knowledge Consolidation Network to address these issues . they propose to use a prototype enhanced retrospection and hierarchical distillation to mitigate the adverse effects of semantic ambiguity and class imbalance. |
| Outcome: | The proposed method outperforms the state-of-the-art model by 19% and 13.4% of whole F1 score on ACE and TAC benchmarks. |
Learning Cooperative Interactions for Multi-Overlap Aspect Sentiment Triplet Extraction (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for aspect sentiment triplet extraction focus on the single interactions between an aspect and an opinion. |
| Approach: | They propose a multi-overlap triplet extraction method which decodes the complex relations between multiple aspects and opinions by learning their cooperative interactions. |
| Outcome: | The proposed method outperforms baselines, especially multi-overlap triplets. |
UrbanVideo-Bench: Benchmarking Vision-Language Models on Embodied Intelligence with Video Data in Urban Spaces (2025.acl-long)
Copied to clipboard
Baining Zhao, Jianjie Fang, Zichao Dai, Ziyou Wang, Jirong Zha, Weichen Zhang, Chen Gao, Yue Wang, Jinqiang Cui, Xinlei Chen, Yong Li
| Challenge: | Large multimodal models exhibit remarkable intelligence, yet their embodied cognitive abilities during motion in open-ended urban aerial spaces remain to be explored. |
| Approach: | They propose a benchmark to evaluate whether large multimodal models can process continuous first-person visual observations like humans. |
| Outcome: | The proposed model can process first-person visual observations like humans, enabling recall, perception, reasoning, and navigation. |
Temporal Knowledge Question Answering via Abstract Reasoning Induction (2024.acl-long)
Copied to clipboard
| Challenge: | a new method to enhance temporal knowledge reasoning in large language models addresses this challenge . Abstract Reasoning Induction (ARI) framework provides factual knowledge support to LLMs . |
| Approach: | They propose an abstract reasoning induction framework which divides temporal reasoning into two phases: Knowledge agnostic and Knowledge-based. |
| Outcome: | The proposed method achieves significant gains on two temporal QA datasets. |
Entailment Graph Learning with Textual Entailment and Soft Transitivity (2022.acl-long)
Copied to clipboard
| Challenge: | Typed entailment graphs suffer from severe sparsity and unreliability of distributional similarity . enlargement relation is critical to semantic understanding and natural language inference . |
| Approach: | They propose a method to learn local entailment relations by recognizing textual enanglement between template sentences formed by typed CCG-parsed predicates. |
| Outcome: | The proposed method can model transitivity in entailment graphs to alleviate sparsity and improve performance over current methods. |
Discriminative Reasoning for Document-level Relation Extraction (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing models use graph networks to implicitly model reasoning skills . but it is yet to be seen whether modeling these reasoning skills implicitly is competitive with intuitive reasoning skills between one entity pair in this document. |
| Approach: | They propose a discriminative reasoning framework to explicitly model the paths of reasoning skills between entity pairs in a document. |
| Outcome: | The proposed method outperforms the previous state-of-the-art on the large-scale DocRE dataset. |
Beyond the Turn-Based Game: Enabling Real-Time Conversations with Duplex Models (2024.emnlp-main)
Copied to clipboard
Xinrong Zhang, Yingfa Chen, Shengding Hu, Xu Han, Zihang Xu, Yuanwei Xu, Weilin Zhao, Maosong Sun, Zhiyuan Liu
| Challenge: | Large language models (LLMs) are increasingly permeating daily lives and require real-time interactions that mirror human conversations. |
| Approach: | They propose to use time-division-multiplexing to process queries and responses pseudo-simultaneously. |
| Outcome: | The proposed model can listen to users while generating output and adjust to provide instant feedback. |
Fin-STAR: Structure-as-Semantics to Resolve Implicitness in Financial Retrieval (2026.findings-acl)
Copied to clipboard
Yu Zou, Yan Chen, Lida He, Qi Zhou, Xiaorui Zhou, Aixi Zhong, Yi Wang, Wei Li, Qingyu Wang, Jiatao Li, Wei Gong, Jialei Zeng, Jingmei Zhao, Ke Jiang, Qing Li
| Challenge: | Existing Retrieval-Augmented Generation systems treat structure as a physical navigational skeleton rather than intrinsic semantic knowledge. |
| Approach: | They propose a framework that redefining hierarchy as intrinsic semantics and uses snippets to enrich hierarchical lineage. |
| Outcome: | The proposed framework outperforms state-of-the-art hierarchical and graph-based benchmarks on FinTierQA Gold. |
Rejection-to-Acceptance Transition: Model Editing-Based Jailbreak Backdoor Injection Not Limited to Few Output Tokens (2026.findings-acl)
Copied to clipboard
Shiji Yang, Min Cai, Hao Xiong, Congyao Mei, Haodong Zou, Shicheng Tan, Jie Chen, Fulan Qian, Shu Zhao
| Challenge: | Existing methods for jailbreaking LLMs are implemented by binding backdoors to predefined phrases as first few output tokens, inducing the LLM’s next-token prediction to produce continuous responses. |
| Approach: | They propose a model editing-based jailbreak backdoor attack that hijacks LLM representations into a acceptance domain rather than binding to a few output tokens. |
| Outcome: | The proposed model editing method outperforms existing methods, showing stronger jailbreak capabilities across LLMs and datasets. |
Multi-Defendant Legal Judgment Prediction via Hierarchical Reasoning (2023.findings-emnlp)
Copied to clipboard
Yougang Lyu, Jitai Hao, Zihan Wang, Kai Zhao, Shen Gao, Pengjie Ren, Zhumin Chen, Fang Wang, Zhaochun Ren
| Challenge: | Existing methods for predicting judgment results for multiple defendants are ineffective. |
| Approach: | They propose a method to predict the judgment results for each defendant in multi-defendant cases . they formalize the multi-diffendant judgment process as hierarchical reasoning chains . |
| Outcome: | The proposed method can predict the judgment results for multiple defendants in multi-defendant cases. |
From Perceptions to Decisions: Wildfire Evacuation Decision Prediction with Behavioral Theory-informed LLMs (2025.acl-long)
Copied to clipboard
| Challenge: | Existing statistical methods for evacuation decision prediction fail to capture complex and diverse behavioral logic of different individuals. |
| Approach: | They propose a Large Language Model (LLM)-based framework that integrates behavioral theories and models to streamline the Chain-of-Thought reasoning and integrates with memory-based Reinforcement Learning module to provide accurate evacuation decision prediction and understanding. |
| Outcome: | The proposed framework improves on three post-wildfire survey datasets with strong cross-event generalizability over existing models. |
Examining Gender Bias in Languages with Grammatical Gender (D19-1)
Copied to clipboard
| Challenge: | Existing studies on gender bias in word embeddings focus on English . however, these studies cannot be extended to languages with morphological agreement on gender . |
| Approach: | They propose new metrics to evaluate gender bias in word embeddings of English and Spanish . they extend existing approaches to mitigate gender bias while preserving original embeddables . |
| Outcome: | The proposed methods reduce gender bias while preserving the original embeddings. |
Document-level Event Extraction via Parallel Prediction Networks (2021.acl-long)
Copied to clipboard
| Challenge: | Document-level event extraction (DEE) is indispensable when events are described throughout a document. |
| Approach: | They propose a document-level event extraction model that can extract structured events from a text in parallel. |
| Outcome: | The proposed model outperforms current state-of-the-art methods on a document-level event extraction task. |
Pre- and In-Parsing Models for Neural Empty Category Detection (P18-1)
Copied to clipboard
| Challenge: | Existing studies on empty category detection have shown positive effects on syntactic parsing . empty categories are used to indicate long-distance dependencies, discontinuous constituents, and certain dropped elements. |
| Approach: | They propose to use ECD to detect empty categories without syntactic analysis. |
| Outcome: | The proposed models outperform the prior state-of-the-art by significant margins. |
Following Occam’s Razor: Dynamic Combination of Structured Knowledge for Multi-Hop Question Answering using LLMs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Multi-hop question answering is a challenging task that requires capturing information from multiple positions in multiple documents. |
| Approach: | They propose a framework for integrating text-based and triple-based paradigms that incorporates structured knowledge into large-scale question answering. |
| Outcome: | The proposed framework improves multi-hop question answering by incorporating structured knowledge into the models. |
SynTQA: Synergistic Table-based Question Answering via Mixture of Text-to-SQL and E2E TQA (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Text-to-SQL parsing and end-to end question answering have yet to be compared and their synergy remains unexplored. |
| Approach: | They propose a Synergistic Table-based Question Answering approach that integrates different models via answer selection. |
| Outcome: | The proposed approach improves on multiple benchmarks and on large scale datasets. |
Safer-Instruct: Aligning Language Models with Automated Preference Data (2024.naacl-long)
Copied to clipboard
| Challenge: | annotating preference data by humans is resource-intensive and creativity-demanding . existing methods face limitations in data diversity and quality . |
| Approach: | They propose a pipeline for annotating large-scale preference data without human annotators. |
| Outcome: | The proposed pipeline outperforms models fine-tuned on human-annotated safety preference data while maintaining a competitive edge in downstream tasks. |
Mitigating Language-Level Performance Disparity in mPLMs via Teacher Language Selection and Cross-lingual Self-Distillation (2024.naacl-long)
Copied to clipboard
| Challenge: | Large-scale multilingual pretrained language models (mPLMs) yield impressive performance on cross-language tasks, yet significant performance disparities exist across different languages within the same mPLm. |
| Approach: | They propose to leverage the learned knowledge from well-performing languages to guide under-performing ones within the same mPLM. |
| Outcome: | The proposed model shows that it can guide under-performing languages while minimizing language-level performance disparities across different mPLMs. |
UniCorn: Towards Self-Improving Unified Multimodal Models through Self-Generated Supervision (2026.acl-long)
Copied to clipboard
Zhen Fang, Ruiyan Han, XinYu Sun, Yuchen Ma, Ziheng Wang, Yu Zeng, Zehui Chen, Lin Chen, Wenxuan Huang, Wei-Jie Xu, Yi Cao, Feng Zhao
| Challenge: | Unified Multimodal Models have achieved remarkable success in cross-modal comprehension, but a gap persists in their ability to translate internal knowledge into faithful and controllable synthesis. |
| Approach: | They propose a self-improvement framework that partitions a single UMM into three collaborative roles: Proposer, Solver, and Judge. |
| Outcome: | The proposed framework improves on TIIF, DPG, CompBench and UniCycle benchmarks. |
Zero-Shot Cross-Lingual Document-Level Event Causality Identification with Heterogeneous Graph Contrastive Transfer Learning (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies focus on sentence-level ECI with high-resource languages, leaving document-level DECI with low-resourced languages under-explored. |
| Approach: | They propose a Heterogeneous Graph Interaction Model with Multi-granularity Contrastive Transfer Learning for zero-shot cross-lingual ECI. |
| Outcome: | The proposed model outperforms the state-of-the-art model on monolingual and multilingual scenarios by 9.4% and 8.2% of average F1 score. |
Fully Hyperbolic Neural Networks (2022.acl-long)
Copied to clipboard
| Challenge: | Existing hyperbolic neural networks encode features in the hyperbolical space yet formalize most of their operations in the tangent space. |
| Approach: | They propose a fully hyperbolic framework to build hyperbolical networks based on the Lorentz model by adapting Lorentzer transformations to formalize essential operations of neural networks. |
| Outcome: | The proposed framework has better performance on four NLP tasks compared with existing hyperbolic models . |
T⋆: Progressive Block Scaling for Masked Diffusion Language Models Through Trajectory Aware Reinforcement Learning (2026.acl-short)
Copied to clipboard
| Challenge: | Autoregressive (AR) modeling via next-token prediction dominates scaling practice and deployed systems. |
| Approach: | They propose a TraceRL-based curriculum for progressive block-size scaling in masked diffusion language models. |
| Outcome: | The proposed curriculum outperforms direct large-block TraceRL on two SDAR scales and three benchmarks and retains block-size-specific non-monotone updates while improving accuracy. |
ALinFiK: Learning to Approximate Linearized Future Influence Kernel for Scalable Third-Parity LLM Data Valuation (2025.naacl-long)
Copied to clipboard
Yanzhou Pan, Huawei Lin, Yide Ran, Jiamin Chen, Xiaodong Yu, Weijie Zhao, Denghui Zhang, Zhaozhuo Xu
| Challenge: | Large Language Models (LLMs) heavily rely on high-quality training data, making data valuation crucial for optimizing model performance. |
| Approach: | They propose a third-party data valuation approach that assesses the value of individual data samples and proposes a learning strategy to approximate LinFiK. |
| Outcome: | The proposed approach surpasses baselines in effectiveness and efficiency, showing significant scalability advantages as LLM parameters increase. |
A Survey on Detection of LLMs-Generated Content (2024.findings-emnlp)
Copied to clipboard
Xianjun Yang, Liangming Pan, Xuandong Zhao, Haifeng Chen, Linda Petzold, William Yang Wang, Wei Cheng
| Challenge: | Recent advances in large language models have led to an increase in synthetic content generation . the ability to detect LLMs-generated content has become of paramount importance . |
| Approach: | They propose to provide a detailed overview of existing detection strategies and benchmarks, scrutinizing their differences and advocating for more adaptable and robust models to enhance detection accuracy. |
| Outcome: | The proposed model will be able to detect human-written content in real time. |
Little Giants: Synthesizing High-Quality Embedding Data at Scale (2025.naacl-long)
Copied to clipboard
| Challenge: | Synthetic data generation is an increasingly popular way of training models without the need for large, manually labeled datasets. |
| Approach: | They propose a framework that aligns open-source small models to efficiently generate large-scale embedding data. |
| Outcome: | The proposed framework outperforms state-of-the-art embedding models by using only 1/10 of the GPT API calls. |
Demystify the Role of Memory in Machine Learning Engineering Agents (2026.findings-acl)
Copied to clipboard
Xinyu Zhao, Junpeng Wang, Yuzhong Chen, Menghai Pan, Chin-Chia Michael Yeh, Jiarui Sun, Yan Zheng, Mahashweta Das, Tianlong Chen
| Challenge: | Unlike short, reactive exchanges, MLE agents solve tasks through cycles of experimentation and improvement where past errors can inform future success. |
| Approach: | They propose a dynamic coding memory that captures and reuses debugging experiences and integrates it into two representative agent paradigms. |
| Outcome: | The proposed agent model captures and reuses debugging experiences and integrates it into two agent paradigms. |
Benchmarking Generation and Evaluation Capabilities of Large Language Models for Instruction Controllable Summarization (2024.findings-naacl)
Copied to clipboard
Yixin Liu, Alexander Fabbri, Jiawen Chen, Yilun Zhao, Simeng Han, Shafiq Joty, Pengfei Liu, Dragomir Radev, Chien-Sheng Wu, Arman Cohan
| Challenge: | Recent studies have found that large language models (LLMs) can achieve state-of-the-art performance on generic summarization benchmarks, but their performance on more complex summarizing task settings is less studied. |
| Approach: | They benchmark large language models on instruction controllable text summarization . they use 4 evaluation protocols and 11 LLMs to evaluate their performance . |
| Outcome: | The proposed model performs well on instruction controllable text summarization tasks with 4 evaluation protocols and 11 LLMs. |
Cross-Lingual Pitfalls: Automatic Probing Cross-Lingual Weakness of Multilingual Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models have achieved remarkable success in Natural Language Processing, yet their cross-lingual consistency remains a significant challenge. |
| Approach: | They propose a method to identify cross-lingual weaknesses in Large Language Models . they construct bilingual question pairs that expose performance discrepancies between English and target languages . |
| Outcome: | The proposed method uncovers over 50% accuracy drops in target languages across models. |
LLM Factoscope: Uncovering LLMs’ Factual Discernment through Measuring Inner States (2024.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) produce outputs that deviate from factual reality, especially in sensitive applications such as medical consultation and legal advice. |
| Approach: | They propose a Siamese network-based model that leverages LLMs’ inner states for factual detection. |
| Outcome: | The proposed model achieves over 96% accuracy on a custom-collected factual detection dataset. |
WatME: Towards Lossless Watermarking Through Lexical Redundancy (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods for text watermarking rely on arbitrary vocabulary partitioning during decoding, which compromises the availability of suitable tokens and significantly degrades the quality of responses. |
| Approach: | They propose a method that leverages linguistic prior knowledge of lexical redundancies in LLM vocabularies to seamlessly integrate watermarks. |
| Outcome: | The proposed approach preserves the expressive power of large language models while preserving watermark detectability. |
DeepSieve: Information Sieving via LLM-as-a-Knowledge-Router (2026.findings-eacl)
Copied to clipboard
Minghao Guo, Qingcheng Zeng, Xujiang Zhao, Yanchi Liu, Wenchao Yu, Mengnan Du, Haifeng Chen, Wei Cheng
| Challenge: | Existing RAG methods lack fine-grained control over query and source sides, resulting in noisy retrieval and shallow reasoning. |
| Approach: | They propose an agentic RAG framework that integrates information sieving via LLM-as-a-knowledge-router. |
| Outcome: | Experiments on multi-hop QA tasks across heterogeneous sources demonstrate improved reasoning depth, retrieval precision, and interpretability over conventional approaches. |
Towards Fine-grained Audio Captioning with Multimodal Contextual Fusion (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for audio captioning lack fine-grained detail and contextual accuracy due to limited unimodal or superficial information. |
| Approach: | They propose a two-stage automated pipeline that uses pretrained models to extract contextual cues from video . a large language model synthesizes these inputs to generate detailed and context-aware captions . |
| Outcome: | The proposed method is scalable and generates detailed and context-aware captions on large-scale audio datasets. |
PCA-Bench: Evaluating Multimodal Large Language Models in Perception-Cognition-Action Chain (2024.findings-acl)
Copied to clipboard
Liang Chen, Yichi Zhang, Shuhuai Ren, Haozhe Zhao, Zefan Cai, Yuchi Wang, Peiyi Wang, Xiangdi Meng, Tianyu Liu, Baobao Chang
| Challenge: | a new multimodal decision-making benchmark evaluates the integrated capabilities of multimodal large language models. |
| Approach: | They propose a multimodal decision-making benchmark for evaluating MLLMs . they propose an automatic evaluation protocol to assess 10 prevalent ML models . |
| Outcome: | The proposed benchmark improves performance of multimodal large language models in three scenarios . the model is required to integrate multiple capabilities to make accurate decisions . |
Understanding Programs by Exploiting (Fuzzing) Test Cases (2023.findings-acl)
Copied to clipboard
| Challenge: | Semantic understanding of programs has attracted great attention in the community . large language models (LLMs) are capable of learning contextual information from data at scale . |
| Approach: | They propose to incorporate a relationship between inputs and possible outputs into learning for achieving a deeper semantic understanding of programs. |
| Outcome: | The proposed method outperforms current state-of-the-art on two programming tasks and outperformed current state of the art by large margins. |
Generalizing Conversational Dense Retrieval via LLM-Cognition Data Augmentation (2024.acl-long)
Copied to clipboard
| Challenge: | Existing conversational dense retrieval models view a conversation as a fixed sequence of questions and responses, and these alternate conversations are unrecorded. |
| Approach: | They propose a framework for generalizing Conversational dense retrieval via LLM-cognition data Augmentation (ConvAug) they first generate multi-level augmented conversations to capture the diverse nature of conversational contexts. |
| Outcome: | The proposed framework generalizes Conversational dense retrieval via LLM-cognition data Augmentation on four public datasets. |
LimRank: Less is More for Reasoning-Intensive Information Reranking (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to rerank information require large-scale fine-tuning, which is computationally expensive. |
| Approach: | They propose an open-source pipeline for generating diverse, challenging, and realistic reranking examples. |
| Outcome: | The proposed model performs competitively on two benchmarks, while being trained on less than 5% of the data typically used in prior work. |
On the Representation Geometry of LoRA Model Merging (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for low-rank Adaptation (LoRA) fine-tuning focus on globally shared structure . combining SVD with CUR improves performance of LoRA model merging . |
| Approach: | They propose a training-free method that combines SVD and CUR decomposition to improve LoRA merging performance. |
| Outcome: | The proposed procedure improves on vision and language benchmarks. |
Boosting LLM Agents with Recursive Contemplation for Effective Deception Handling (2024.findings-acl)
Copied to clipboard
Shenzhi Wang, Chang Liu, Zilong Zheng, Siyuan Qi, Shuo Chen, Qisen Yang, Andrew Zhao, Chaofei Wang, Shiji Song, Gao Huang
| Challenge: | Recent advances in large language models (LLMs) have led to significant success in using LLMs as agents. |
| Approach: | They propose a cognitive framework that incorporates first-order and second-order perspective transitions into LLMs to enhance their ability to identify and counteract deceptive information. |
| Outcome: | The proposed framework enhances LLMs’ ability to identify and counteract deceptive information without extra fine-tuning and data. |
Re-Examining Calibration: The Case of Question Answering (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing calibration methods do not provide significant gains in accuracy. |
| Approach: | They propose a new calibration metric that better captures whether the model assigns low confidence to wrong predictions and high confidence to correct predictions. |
| Outcome: | The proposed calibration method better captures whether the model assigns low confidence to wrong predictions and high confidence to correct predictions. |
VMSMO: Learning to Generate Multimodal Summary for Video-based News Articles (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies show that multimodal news can significantly improve users' sense of satisfaction for informativeness. |
| Approach: | They propose a task of Video-based Multimodal Summarization with Multimodal Output to solve this problem. |
| Outcome: | The proposed method can generate multimodal summaries with a single input . it can model the temporal dependency of video with semantic meaning of article . |
GBV-SQL: Guided Generation and SQL2Text Back-Translation Validation for Multi-Agent Text2SQL (2026.acl-long)
Copied to clipboard
| Challenge: | Existing frameworks for Text2SQL generation still have a critical semantic gap . a dedicated validator translates generated SQL back into natural language and checks whether its logic is aligned with the original question. |
| Approach: | They propose a framework that introduces Guided Generation with SQL2Text Back-translation Validation . dedicated validator translates generated SQL back into natural language and checks whether logic is aligned with original question . |
| Outcome: | The proposed framework achieves 63.23% execution accuracy on the BIRD benchmark and 90.42% on repaired BIDR dev. |
Medico: Towards Hallucination Detection and Correction with Multi-source Evidence Fusion (2024.emnlp-demo)
Copied to clipboard
| Challenge: | Existing studies show that LLMs can confidently state non-existent facts rather than answering "I don't know". |
| Approach: | They propose a multi-source evidence fusion enhanced hallucination detection and correction framework that fuses evidence from multiple sources and iteratively revises the hallucinous content. |
| Outcome: | The proposed framework detects whether the generated content contains factual errors, provides the rationale behind the judgment, and iteratively revises the hallucinated content. |
CogIE: An Information Extraction Toolkit for Bridging Texts and CogNet (2021.acl-demo)
Copied to clipboard
| Challenge: | CogNet is a knowledge base that integrates three types of knowledge: linguistic knowledge, world knowledge and commonsense knowledge. |
| Approach: | They propose an information extraction toolkit called CogIE that is a bridge connecting raw texts and CogNet. |
| Outcome: | The proposed toolkit can ground raw texts to CogNet and leverage different types of knowledge to enrich extracted results. |
Uncertainty Quantification for In-Context Learning of Large Language Models (2024.naacl-long)
Copied to clipboard
Chen Ling, Xujiang Zhao, Xuchao Zhang, Wei Cheng, Yanchi Liu, Yiyou Sun, Mika Oishi, Takao Osaki, Katsushi Matsuda, Jie Ji, Guangji Bai, Liang Zhao, Haifeng Chen
| Challenge: | Existing studies on in-context learning have focused on quantifying the uncertainty associated with the model's response, but they neglect the complexity of the LLM and the uniqueness of in-constitut learning. |
| Approach: | They propose a method to quantify the uncertainty associated with in-context learning and propose corresponding estimation method to quantify both types of uncertainties. |
| Outcome: | The proposed method offers an unsupervised way to understand the prediction of in-context learning in a plug-and-play fashion. |
Grammar-Based Code Representation: Is It a Worthy Pursuit for LLMs? (2025.findings-acl)
Copied to clipboard
Qingyuan Liang, Zhao Zhang, Zeyu Sun, Zheng Lin, Qi Luo, Xiao Yueyi, Yizhou Chen, Yuqun Zhang, Haotian Zhang, Lu Zhang, Chenbin Chenbin, Yingfei Xiong
| Challenge: | Existing research demonstrates the effectiveness of grammar-based code representations in small-scale models, showing their ability to reduce syntax errors and enhance performance. |
| Approach: | They develop a series of billion-scale grammar-based code representations that incorporate grammar rules into the code generation process. |
| Outcome: | Experiments on HumanEval and MBPP show that grammar-based representations reduce syntax errors and improve performance even in billion-scale models. |
Better Zero-Shot Reasoning with Role-Play Prompting (2024.naacl-long)
Copied to clipboard
Aobo Kong, Shiwan Zhao, Hao Chen, Qicheng Li, Yong Qin, Ruiqi Sun, Xin Zhou, Enzhi Wang, Xiaohang Dong
| Challenge: | Recent years have witnessed a paradigm shift in natural language processing, driven by large language models such as GPT-3, PaLM, and Llama. |
| Approach: | They propose a strategy for role-play prompting and assess its performance under the zero-shot setting. |
| Outcome: | The proposed method outperforms the standard zero-shot prompting approach across 12 reasoning benchmarks. |
On the Potential of Lexico-logical Alignments for Semantic Parsing to SQL Queries (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Large-scale semantic parsing datasets annotated with logical forms have enabled advances in supervised approaches. |
| Approach: | They propose to enrich English-language questions with SQL equivalents and alignments . they propose to use supervised attention and an auxiliary objective to disambiguate references . |
| Outcome: | The proposed method improves over strong baselines by 4.4% execution accuracy. |
How to Write Summaries with Patterns? Learning towards Abstractive Summarization through Prototype Editing (D19-1)
Copied to clipboard
| Challenge: | Extensive experiments on a large-scale real-world text summarization dataset show that PESG achieves the state-of-the-art performance in terms of both automatic metrics and human evaluations. |
| Approach: | They propose a model that learns summary patterns and prototype facts from a prototype document . they use a fact checker to estimate mutual information between the input document and generated summary . |
| Outcome: | Experiments on a large-scale real-world text summarization dataset show that PESG achieves state-of-the-art performance. |
A Survey of Multimodal Mathematical Reasoning: From Perception, Alignment to Reasoning (2026.acl-long)
Copied to clipboard
Tianyu Yang, Sihong Wu, Yilun Zhao, Zhenwen Liang, Lisen Dai, Chen Zhao, Minhao Cheng, Arman Cohan, Xiangliang Zhang
| Challenge: | Multimodal mathematical Reasoning (MMR) has attracted increasing attention for its ability to solve mathematical problems involving both textual and visual modalities. |
| Approach: | They review the theoretical frameworks of multimodal reasoning and examine the challenges they face in visual math tasks. |
| Outcome: | The proposed models can solve problems involving both textual and visual modalities. |
Beyond Static Rules: Automated Discovery of Latent Vulnerabilities in Text-to-SQL (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have been successful in Text-to-SQL tasks, but their deployment in real-world environments is hindered by latent reliability issues. |
| Approach: | They propose a framework to autonomously uncover latent failure patterns in LLM-based Text-to-SQL generation. |
| Outcome: | The proposed framework uncovers a substantial number of failure cases on state-of-the-art open-source LLMs. |
Generalizing Few-Shot Named Entity Recognizers to Unseen Domains with Type-Related Features (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Few-shot named entity recognition methods struggle with out-of-domain (OOD) examples due to their reliance on manual labeling for the target domain. |
| Approach: | They propose a framework to enable generalization to an unseen target domain with only a few labeled examples. |
| Outcome: | The proposed framework achieves significant performance improvements on in-domain and cross-domain datasets. |
Breaking Block Boundaries: Anchor-based History-stable Decoding for Diffusion Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Semi-autoregressive (Semi-AR) decoding suffers from inherent block constraints . naive lookahead decoding is unreliable, token stability closely correlates with convergence trend, and historical information is isolated. |
| Approach: | They propose a training-free, plug-and-play dynamic decoding strategy that monitors the stability of tokens in real time through dynamic anchors. |
| Outcome: | The proposed approach reduces decoding steps by 80% while improving performance by 3.67% on the BBH benchmark. |
MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing methods for training pre-trained language models have limited practicality due to latency requirements. |
| Approach: | They propose a method that uses a Mixture-of-Experts structure to increase model capacity and inference speed. |
| Outcome: | The proposed method outperforms existing distillation methods on natural language understanding and question answering tasks. |
A Unified Model for Reverse Dictionary and Definition Modelling (2022.aacl-short)
Copied to clipboard
| Challenge: | Using neural networks, we argue that both tasks can be learned and dealt with concurrently, based on the intuition that a word and its definition share the same meaning. |
| Approach: | They build a dual-way neural dictionary to retrieve words given definitions and produce definitions for queried words. |
| Outcome: | The proposed model achieves high scores on previous benchmarks without extra resources. |
WebSRC: A Dataset for Web-Based Structural Reading Comprehension (2021.emnlp-main)
Copied to clipboard
| Challenge: | Using a web page and a question, a machine can't understand the contents of web pages. |
| Approach: | They propose a novel dataset for web-based structural reading comprehension that consists of 400K question-answer pairs and a dataset of 6.4K web pages. |
| Outcome: | The proposed dataset consists of 400K question-answer pairs, collected from 6.4K web pages with corresponding HTML source code, screenshots, and metadata. |
ChatCoT: Tool-Augmented Chain-of-Thought Reasoning on Chat-based Large Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) have excellent performance in evaluation benchmarks, but struggle in complex reasoning tasks. |
| Approach: | They propose a tool-augmented chain-of-thought reasoning framework for chat-based LLMs . they model chain- of-thoughting reasoning as multi-turn conversations to utilize tools . |
| Outcome: | The proposed framework can outperform state-of-the-art models on complex reasoning tasks. |
H-MAS: Hierarchical Multi-Agent Scheduling for Multi-Tenant LLM Serving (2026.findings-acl)
Copied to clipboard
Yuhan Liu, Cong Xu, Qi Jia, Yihua Wang, Feiyu Chen, Liang Jin, Lu Liu, Yaqian Zhao, Yuting Ding, Xiang Li
| Challenge: | Multi-tenant Model-as-a-Service (MaaS) workloads exhibit non-stationarity across multiple time scales . existing request schedulers often rely on a fixed policy that remains unchanged at runtime . |
| Approach: | They propose a hierarchical multi-agent scheduler that operates in a layered closed loop . they propose to maintain 1.2–3.0 higher Goodput than SGLang and vLLM . |
| Outcome: | Experiments show that H-MAS achieves 1.2–3.0 higher Goodput than SGLang and vLLM . it maintains more stable QoS under diverse request lengths and heterogeneous SLO targets . |
CityNavAgent: Aerial Vision-and-Language Navigation with Hierarchical Semantic Planning and Global Memory (2025.acl-long)
Copied to clipboard
Weichen Zhang, Chen Gao, Shiquan Yu, Ruiying Peng, Baining Zhao, Qian Zhang, Jinqiang Cui, Xinlei Chen, Yong Li
| Challenge: | Existing ground VLN agents struggle in aerial VLLN due to the lack of predefined navigation graphs and the exponentially expanding action space in long-horizon exploration. |
| Approach: | They propose a large language model-empowered aerial VLN agent that decomposes the long-horizon task into sub-goals with different semantic levels. |
| Outcome: | The proposed method achieves state-of-the-art performance with significant improvement in continuous city environments. |
Bilateral Masking with prompt for Knowledge Graph Completion (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing word matching methods fail to obtain satisfactory single embedding representations for entities. |
| Approach: | They propose a bi-encoder-based approach to enhance entity representations by using prompts to narrow the distance between the predicted entity and the known entity. |
| Outcome: | The proposed model achieves state-of-the-art performance on the WN18RR dataset. |
Multi-Agent Procedural Graph Extraction with Structural and Logical Refinement (2026.findings-eacl)
Copied to clipboard
Wangyang Ying, Yanchi Liu, Xujiang Zhao, Wei Cheng, Zhengzhang Chen, Wenchao Yu, Yanjie Fu, Haifeng Chen
| Challenge: | Recent advances in large language models (LLMs) show potential for graph extraction, but often yield ill-formed structures or misinterpret logical constructs such as gateways. |
| Approach: | They propose a framework that treats procedural graph extraction as a multi-round reasoning process with structural and logical refinement agents. |
| Outcome: | The proposed framework achieves significant improvements in structural correctness and logical consistency over strong baselines. |
A Hierarchical Interactive Network for Joint Span-based Aspect-Sentiment Analysis (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for aspect-sentiment analysis ignore internal correlations between aspect extraction and sentiment classification. |
| Approach: | They propose a hierarchical interactive network to model two-way interactions between two tasks appropriately using shallow-level and deep-level inputs. |
| Outcome: | Extensive experiments on three real-world datasets demonstrate that the proposed model outperforms existing methods. |
GeoPQA: Bridging the Visual Perception Gap in MLLMs for Geometric Reasoning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Recent advances in reinforcement learning (RL) have enhanced the reasoning abilities of large language models, but the impact on multimodal LLMs is limited. |
| Approach: | They propose a two-stage RL framework that enhances visual perception and fosters reasoning capabilities. |
| Outcome: | The proposed framework improves geometric reasoning by 9.7% and problem-solving by 9.1% compared to direct reasoning training approach. |
Complex Event Schema Induction with Knowledge-Enriched Diffusion Model (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies on event schema induction have been hindered by errors and data quality issues. |
| Approach: | They propose a knowledge-enriched discrete diffusion model that distills event scenario knowledge from LLMs. |
| Outcome: | The proposed model achieves outstanding performance across evaluation metrics. |
Self-Improvement Programming for Temporal Knowledge Graph Question Answering (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods implicitly model time constraints by learning time-aware embeddings of questions and candidate answers, which is far from understanding the question comprehensively. |
| Approach: | They propose a temporal-based temporal programming method that leverages the in-context learning ability of Large Language Models to understand combinatory time constraints in questions. |
| Outcome: | The proposed method outperforms existing methods on multiTQ and CronQuestions datasets and is highly efficient on multi-level questions. |
BalanceSFT: Improving LLM Function Calling with Balanced Training Signals and Data Hardness (2026.findings-acl)
Copied to clipboard
Bingguang Hao, Zengzhuang Xu, Maolin Wang, Yuntao Wen, Yicheng Chen, Cunyin Peng, Long Chen, Xiangyu Zhao, Jinjie Gu, Chenyi Zhuang, Ji Zhang
| Challenge: | Currently, Supervised Fine-Tuning (SFT) is the prevailing method for equipping Large Language Models (LLMs) with function calling capabilities, but its effectiveness is often compromised by two challenges: 1) lengthy Chain-of-Thought (CoT) reasoning tokens dominate training signals over concise function calls in the learning objective; 2) scarcity of hard training examples. |
| Approach: | They propose a framework that uses a self-adjusted signal balancing loss and a hard data re-sampling strategy to selectively generate new, high-quality complex data guided by model errors. |
| Outcome: | The proposed framework surpasses state-of-the-art models like GPT-5 in function calling performance. |
SCALE: Synergized Collaboration of Asymmetric Language Translation Engines (2024.findings-acl)
Copied to clipboard
| Challenge: | In this paper, we introduce SCALE, a collaborative framework that connects a compact Specialized Translation Model (STM) and a general-purpose Large Language Model (LLM) as one unified translation engine. |
| Approach: | They propose a collaborative framework that connects a Specialized Translation Model (STM) and a general-purpose Large Language Model (LLM) as one unified translation engine. |
| Outcome: | The proposed framework outperforms both LLMs and supervised models in high-resource or challenging low-resourced settings. |
Self-Training with Differentiable Teacher (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods for self-training are interpreted as teacher-student frameworks, where the teacher generates pseudo-labels and the student makes predictions. |
| Approach: | They propose a differentiable self-training method that treats teacher-student as a Stackelberg game where a leader is always in a more advantageous position than a follower. |
| Outcome: | The proposed model outperforms existing methods on semi- and weakly-supervised learning tasks on semi and weak supervised tasks. |
Crafting Customisable Characters with LLMs: A Persona-Driven Role-Playing Agent Framework (2025.findings-emnlp)
Copied to clipboard
Bohao Yang, Dong Liu, Chenghao Xiao, Kun Zhao, Chen Tang, Chao Li, Lin Yuan, Yang Guang, Chenghua Lin
| Challenge: | Large Language Models (LLMs) are capable of generating human-like text, but the potential for freely customisable characters remains underexplored. |
| Approach: | They propose a framework which employs Large Language Models to create freely customisable characters through personalised characteristic feature injection. |
| Outcome: | The proposed framework provides valuable insights for developing more accurate and customisable human simulacra. |
Uncertainty Propagation on LLM Agent (2025.acl-long)
Copied to clipboard
Qiwei Zhao, Dong Li, Yanchi Liu, Wei Cheng, Yiyou Sun, Mika Oishi, Takao Osaki, Katsushi Matsuda, Huaxiu Yao, Chen Zhao, Haifeng Chen, Xujiang Zhao
| Challenge: | Existing methods for estimating uncertainty in large language models (LLMs) focus on final-step outputs, which fail to account for cumulative uncertainty over multi-step decision-making process and dynamic interactions between agents and their environments. |
| Approach: | They propose a framework that propagates uncertainty through each step of an LLM-based agent’s reasoning process. |
| Outcome: | Extensive experiments on benchmark datasets show that the proposed framework outperforms state-of-the-art methods by 20%. |
PMIndiaSum: Multilingual and Cross-lingual Headline Summarization for Languages in India (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing datasets for Indian languages are limited in terms of coverage and size. |
| Approach: | They propose a multilingual and massively parallel summarization corpus focused on languages in India that provides a training and testing ground for four language families, 14 languages, and the largest to date with 196 language pairs. |
| Outcome: | The proposed dataset provides a training and testing ground for four language families, 14 languages, and the largest to date with 196 language pairs. |
Ambiguity Awareness Optimization: Towards Semantic Disambiguation for Direct Preference Optimization (2025.emnlp-main)
Copied to clipboard
| Challenge: | Direct Preference Optimization (DPO) is a widely used reinforcement learning from human feedback (RLHF) method across various domains. |
| Approach: | They propose an approach that automatically re-weights ambiguous content to reduce ambiguities by calculating semantic similarity from preference pairs. |
| Outcome: | The proposed approach outperforms state-of-the-art approaches in performance across multiple model scales and widely adopted benchmark datasets. |
Knowledge-Enriched Event Causality Identification via Latent Structure Induction Networks (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for identifying causal relations of events are limited . Existing approaches cannot handle well the problem, especially in the condition of lacking training data. |
| Approach: | They propose a Latent Structure Induction Network to integrate external structural knowledge into a causality reasoning task. |
| Outcome: | The proposed approach outperforms existing state-of-the-art methods on two widely used datasets. |
Automatic ICD Coding via Interactive Shared Representation Networks with Self-distillation Mechanism (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for ICD coding ignore the long-tail of code frequency or noisy clinical notes. |
| Approach: | They propose to use an interactive shared representation network to model code co-occurrences while focusing on the clinical note's noteworthy part and extract valuable information through a self-distillation learning mechanism to solve the long-tail problem. |
| Outcome: | The proposed model reduces the long-tail of code frequency and noise in clinical notes and extracts valuable information through a self-distillation learning mechanism. |
Scaling Beyond Context: A Survey of Multimodal Retrieval-Augmented Generation for Document Understanding (2026.acl-long)
Copied to clipboard
Sensen Gao, Shanshan Zhao, Xu Jiang, Lunhao Duan, Yong Xien Chng, Qing-Guo Chen, Weihua Luo, Kaifu Zhang, Jia-Wang Bian, Mingming Gong
| Challenge: | Document understanding is critical for applications from financial analysis to scientific discovery. |
| Approach: | They propose a taxonomy based on domain, retrieval modality, and granularity and review advances involving graph structures and agentic frameworks. |
| Outcome: | The proposed model enables holistic retrieval and reasoning across all modalities, unlocking comprehensive document intelligence. |
MemRec: Collaborative Memory-Augmented Agentic Recommender System (2026.acl-long)
Copied to clipboard
Weixin Chen, Yuhan Zhao, Jingyuan Huang, Zihe Ye, Mingxuan Ju, Tong Zhao, Neil Shah, Li Chen, Yongfeng Zhang
| Challenge: | Existing recommender systems rely on semantic user and item memories to make predictions, but these memories are kept in isolation. |
| Approach: | They propose a framework that architecturally decouples memory management from reasoning to decouple memory management and reasoning from the user and item memories. |
| Outcome: | The proposed framework decouples memory management from reasoning and achieves state-of-the-art performance on four benchmarks. |
Improving MLLM’s Document Image Machine Translation via Synchronously Self-reviewing Its OCR Proficiency (2025.findings-acl)
Copied to clipboard
| Challenge: | Multimodal Large Language Models (MLLMs) have shown strong performance in document image tasks, especially Optical Character Recognition (OCR). However, they struggle with Document Image Machine Translation (DIMT), which requires handling both cross-modal and cross-lingual challenges. |
| Approach: | They propose a novel fine-tuning paradigm that allows the model to generate OCR text before producing translation text, which allows it to leverage its strong monolingual OCR ability while learning to translate text across languages. |
| Outcome: | The proposed model can leverage its strong monolingual OCR ability while learning to translate text across languages. |
Redundancy Principles for MLLMs Benchmarks (2025.acl-long)
Copied to clipboard
Zicheng Zhang, Xiangyu Zhao, Xinyu Fang, Chunyi Li, Xiaohong Liu, Xiongkuo Min, Haodong Duan, Kai Chen, Guangtao Zhai
| Challenge: | Rapid growth of Multi-modality Large Language Models has led to significant redundancy among benchmarks. |
| Approach: | They propose a framework to improve MLLM benchmark design by identifying redundancy at three levels: dimension, instance, and cross-benchmark redundancies. |
| Outcome: | The proposed framework streamlines evaluations and enhances reliability. |
Large Language Models Can Be Contextual Privacy Protection Learners (2024.emnlp-main)
Copied to clipboard
Yijia Xiao, Yiqiao Jin, Yushi Bai, Yue Wu, Xianjun Yang, Xiao Luo, Wenchao Yu, Xujiang Zhao, Yanchi Liu, Quanquan Gu, Haifeng Chen, Wei Wang, Wei Cheng
| Challenge: | Large Language Models (LLMs) have demonstrated remarkable linguistic comprehension and generation capability, but when applied to specialized industries, they face challenges such as hallucination, insufficient domain knowledge, and failing to incorporate the latest domain knowledge. |
| Approach: | They propose a paradigm for fine-tuning LLMs that effectively injects domain-specific knowledge while safeguarding inference-time data privacy. |
| Outcome: | The proposed model protects private data while enhancing the model's knowledge. |
Does Theory of Mind Improvement Really Benefit Human-AI Interactions? Empirical Findings from Interactive Evaluations (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks measure ToM capability improvement through story-reading, multiple-choice questions from a third-person perspective, while ignoring the first-person, dynamic nature of human-AI interactions. |
| Approach: | They propose a new paradigm of interactive ToM evaluation with both perspective and metric shifts. |
| Outcome: | The proposed approach improves the performance of four representative LLM enhancement techniques using real-world datasets and a user study. |
PlaM: Training-Free Plateau-Guided Model Merging for Better Visual Grounding in MLLMs (2026.findings-acl)
Copied to clipboard
Zijing Wang, YongKang Liu, Mingyang Wang, Ercong Nie, Deyuan Chen, Zhengjie Zhao, Shi Feng, Daling Wang, Xiaocui Yang, Yifei Zhang, Hinrich Schuetze
| Challenge: | Multimodal instruction fine-tuning degrades textual reasoning capability, undermining multimodal performance. |
| Approach: | They propose a plateau-guided model merging method that selectively injects base language model parameters into MLLMs to mitigate this degradation. |
| Outcome: | The proposed framework reduces multimodal instruction fine-tuning degradation by incorporating a plateau-guided model merging method into MLLMs. |
DopplerBAS: Binaural Audio Synthesis Addressing Doppler Effect (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for binaural audio synthesis are limited in phase estimation, which is crucial for spatial hearing. |
| Approach: | They propose a method to explicitly address the Doppler effect of the moving speaker . it calculates the radial relative velocity of the speaker in spherical coordinates . |
| Outcome: | The proposed method improves the representative WarpNet and BinauralGrad backbones in phase error metric and reaches a new state of the art (SOTA) it is compared with the current method which is limited in phase estimation . |
WinSpot: GUI Grounding Benchmark with Multimodal Large Language Models (2025.acl-short)
Copied to clipboard
| Challenge: | Existing GUI grounding data focuses on web-based elements, leaving a gap in real-world GUI interaction data for non-web applications. |
| Approach: | They propose a framework that leverages Large Language Models to generate large-scale GUI grounding data. |
| Outcome: | The framework validates and refines 5,000 GUI coordinate-instruction pairs and provides high-quality data for training and evaluating visual GUI agents. |
RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment (2025.findings-acl)
Copied to clipboard
Zhuoran Jin, Hongbang Yuan, Tianyi Men, Pengfei Cao, Yubo Chen, Jiexin Xu, Huaijun Li, Xiaojian Jiang, Kang Liu, Jun Zhao
| Challenge: | Existing retrieval augmented language models often overlook effective alignment with human preferences. |
| Approach: | They propose a benchmark to evaluate RMs in retrieval augmented language models . they incorporate 18 RAG subsets, six retrievers, and 24 RALMs to increase diversity . |
| Outcome: | The proposed benchmark combines 18 RAG subsets, six retrievers, and 24 RALMs to increase diversity of data sources. |
SQL Injection Jailbreak: A Structural Disaster of Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to jailbreak Large Language Models (LLMs) exploited internal properties or capabilities of the model, such as optimization-based jailbreak methods and methods that leveraged the model’s context-learning abilities. |
| Approach: | They propose a new method which injects jailbreak information into user prompts and induces the model to generate harmful content. |
| Outcome: | The proposed method achieves near 100% success rates on open-source models while incurring lower time costs compared to previous methods. |
AdaTP: Attention-Debiased Token Pruning for Video Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing visual token compression methods rely on attention scores but have inherent biases . global and local attention biased scores cause excessive computational overhead . |
| Approach: | They propose a token pruning pipeline that targets global and local attention biases . the pipeline is designed to reduce computational overhead of Video Large Language Models based on visual tokens compiled from multiple video frames . |
| Outcome: | The proposed method significantly reduces the computational overhead of Video Large Language Models while retaining the performance of vanilla models. |
SportQA: A Benchmark for Sports Understanding in Large Language Models (2024.naacl-long)
Copied to clipboard
Haotian Xia, Zhengbang Yang, Yuqing Wang, Rhys Tracy, Yun Zhao, Dongdong Huang, Zezhi Chen, Yan Zhu, Yuan-fang Wang, Weining Shen
| Challenge: | SportQA is a benchmark specifically designed for evaluating Large Language Models (LLMs) sports knowledge is characterized by its fast pace, variety of types, abundance of strategies, and rich player narratives . |
| Approach: | They propose a benchmark specifically designed for evaluating Large Language Models in the context of sports understanding. |
| Outcome: | The proposed benchmark aims to bridge the gap between existing and specialized benchmarks in sports understanding. |
Knowledge Distillation for Multilingual Unsupervised Neural Machine Translation (2020.acl-main)
Copied to clipboard
| Challenge: | Unsupervised neural machine translation (UNMT) can only translate between a single language pair and cannot produce translation results for multiple language pairs at the same time. |
| Approach: | They propose a method to translate between 13 languages using a single encoder and a decoder . they propose two knowledge distillation methods to further enhance multilingual UNMT performance . |
| Outcome: | The proposed method improves translation performance for all languages using multilingual data. |
MixLLM: Dynamic Routing in Mixed Large Language Models (2025.naacl-long)
Copied to clipboard
Xinyuan Wang, Yanchi Liu, Wei Cheng, Xujiang Zhao, Zhengzhang Chen, Wenchao Yu, Yanjie Fu, Haifeng Chen
| Challenge: | Large Language Models (LLMs) exhibit potential artificial generic intelligence, however, their usage is costly with high response latency. |
| Approach: | They develop a dynamic contextual-bandit-based routing system for query-LLM assignment that leverages query tags to enhance query embeddings. |
| Outcome: | The proposed model maximizes response quality and minimizes cost and latency. |
Context-Aware Sentiment Forecasting via LLM-based Multi-Perspective Role-Playing Agents (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods to predict sentiments on social media are limited and do not consider reciprocal influences among social media users. |
| Approach: | They propose a multi-perspective role-playing framework to simulate human response processes to extract sentiment-related features from social media messages. |
| Outcome: | The proposed model improves sentiment forecasting at microscopic and macroscopic levels. |
On the Limitations of Language-targeted Pruning: Investigating the Calibration Language Impact in Multilingual LLM Pruning (2026.tacl-1)
Copied to clipboard
| Challenge: | Recent advances in large language model pruning have shown high predictive performance in post-training settings. |
| Approach: | They conduct an empirical study on the performance and internal representation changes associated with pruning multilingual models for monolingual applications. |
| Outcome: | The proposed pruning methods retain perplexity and yield high signal-to-noise ratios, but not consistently improve downstream tasks. |
TextBox 2.0: A Text Generation Library with Pre-trained Language Models (2022.emnlp-demos)
Copied to clipboard
Tianyi Tang, Junyi Li, Zhipeng Chen, Yiwen Hu, Zhuohao Yu, Wenxun Dai, Wayne Xin Zhao, Jian-yun Nie, Ji-rong Wen
| Challenge: | TextBox 2.0 focuses on the use of pre-trained language models (PLMs) to generate text. |
| Approach: | They propose a library that integrates pre-trained language models into 13 common text generation tasks and 83 datasets. |
| Outcome: | The proposed library covers 13 common text generation tasks and their corresponding datasets and incorporates 45 PLMs covering general, translation, Chinese, dialogue, controllable, distilled, prompting, and lightweight PLM. |
Mirror in the Model: Ad Banner Image Generation via Reflective Multi-LLM and Multi-modal Agents (2025.emnlp-industry)
Copied to clipboard
| Challenge: | Recent advances in generative modeling have greatly improved image synthesis quality. |
| Approach: | They propose an agentic refinement framework for automatic ad banner generation that integrates a hierarchical multimodal agent system with a coordination loop. |
| Outcome: | The proposed model outperforms existing models in real-world banner design scenarios. |
Execution as Verification: Fine-Grained Self-Correcting Reasoning for Complex KBQA (2026.acl-long)
Copied to clipboard
| Challenge: | Existing knowledge base question answering methods are limited by syntactic constraints and are prone to structural deviations that render queries unexecutable. |
| Approach: | They propose a framework that reframes semantic parsing as an iterative reasoning process driven by execution feedback. |
| Outcome: | The proposed method achieves significant improvements in query executability and answer accuracy on the WebQSP and CWQ datasets. |
Lifelong Event Detection with Embedding Space Separation and Compaction (2024.naacl-short)
Copied to clipboard
| Challenge: | Existing methods for event detection are prone to forgetting due to overlap between memory data and the previously learned embedding space. |
| Approach: | They propose a method that embeds feature distributions away from the previous embedding space and mitigates overfitting by a memory calibration mechanism. |
| Outcome: | The proposed method outperforms existing state-of-the-art methods with extensive experiments. |
MirrorCAPTCHA: Wild CAPTCHA, Wild Distribution, Wild Web-based Platform Meet Multimodal LLM Agents (2026.acl-long)
Copied to clipboard
Xiangyu Wu, Yuwei Hu, Tianyu Cui, Yueying Tian, Qing-Guo Chen, Zhao Xu, Weihua Luo, Kaifu Zhang, Yang Yang, Jianfeng Lu
| Challenge: | Existing agent benchmarks fail to evaluate an agent's real-world capacity to handle CAPTCHA . Existing benchmarks ignore this practical challenge, failing to evaluate agents' ability to handle complex visual CAPTchas. |
| Approach: | They propose a benchmark annotated with Weighted Pass Rate and a new metric to measure agent's ability to handle CAPTCHA. |
| Outcome: | The proposed benchmark outperforms current state-of-the-art closed-source models on mirrorCAPTCHA and achieves 9.4% higher average weighted pass rate and 2.13% higher average Completion degree. |
DTELS: Towards Dynamic Granularity of Timeline Summarization (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing timeline summarizations lack flexibility to meet diverse granularity needs . a fine-grained timeline showing the technical details is preferred for news topics . |
| Approach: | They propose a new paradigm to construct adaptive timelines based on user instructions or requirements. |
| Outcome: | The proposed timelines are informative and granularly consistent, but they struggle to generate consistent timelines. |
Decoding Scientific Experimental Images: The SPUR Benchmark for Perception, Understanding, and Reasoning (2026.acl-long)
Copied to clipboard
Junpeng Ding, Zichen Tang, Haihong E, Mengyuan Ji, Yang Liu, Haolin Tian, Haiyang Sun, Pengqi Sun, Yang Xu, Yichen Liu, Haocheng Gao, Zijie Xi, Ruomeng Jiang, Peizhi Zhao, Rongjin Li, Yuanze Li, Jiacheng Liu, Zhongjun Yang, Jintong Chen, Siying Lin
| Challenge: | Xu and Peng, 2025) . . SPUR is a comprehensive benchmark for scientific experimental image perception, understanding, and reasoning, comprising 4,264 question-answering (QA) pairs derived from 1,084 expert-curated images. |
| Approach: | They propose to use 4,264 question-answering (QA) pairs derived from 1,084 expert-curated images to evaluate the visual perception of multimodal large language models (MLLMs) . they also propose to utilize cross-panel relation understanding to evaluate MLLM’s ability to decipher intricate cross-panel relations. |
| Outcome: | The proposed model is based on 4,264 question-answering pairs derived from 1,084 expert-curated images. |
Towards Explainable Diagnosis: A Self-learned Explanatory Knowledge Base Approach (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have great potential to facilitate explainable diagnosis, but their effectiveness is often constrained by insufficient diagnostic expertise. |
| Approach: | They propose a unified LLM-based framework for faithful and explainable diagnosis that builds a high-quality diagnostic knowledge base through a record-driven explanation learning paradigm. |
| Outcome: | The proposed framework outperforms baselines on the DiReCT and JAMA benchmarks and improves the explanation completeness metric from 64.5% to 76.9% over the best existing methods. |
Empowering GUI Agents via Autonomous Experience Exploration and Hindsight Experience Utilization for Task Planning (2026.acl-long)
Copied to clipboard
| Challenge: | Multimodal web agents are cost-efficient and privacy-preserving, but suffer from weak planning and limited cross-website generalization. |
| Approach: | They propose a method which autonomously explores environments to discover experiences and utilizes hindsight experience to synthesize strictly aligned, high-level training data. |
| Outcome: | The proposed method outperforms Qwen2.5-VL-32B model on real-world benchmarks and demonstrates that mastering low-level atomic skills does not guarantee high-level planning competence. |
Syntax in End-to-End Natural Language Processing (2021.emnlp-tutorials)
Copied to clipboard
| Challenge: | tutorial focuses on syntactic parsing and syntax in end-to-end natural language processing (NLP) tasks. |
| Approach: | tutorial will introduce syntactic parsing and the role of syntax in end-to-end natural language processing (NLP) tasks. |
| Outcome: | This tutorial will introduce the background and the latest progress of syntactic parsing and SRL/NMT. |
Knowledge Guided Metric Learning for Few-Shot Text Classification (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing methods to learn from limited examples are insufficient for many-shot text classification tasks. |
| Approach: | They propose to introduce external knowledge into few-shot learning to imitate human knowledge by creating a parameter generator network that generates different metrics for different tasks. |
| Outcome: | The proposed method outperforms the SoTA few-shot text classification models. |
MCP-Flow: Facilitating LLM Agents to Master Real-World, Diverse and Scaling MCP Tools (2026.acl-long)
Copied to clipboard
WenHao Wang, Peizhi Niu, Zhao Xu, Zhaoyu Chen, Jian Du, Yaxin Du, Xianghe Pang, Keduan Huang, Yanfeng Wang, Qiang Yan, Siheng Chen
| Challenge: | Existing research on Large Language Models (LLMs) relies on few servers and lacks training support. |
| Approach: | They propose a web-agent-driven pipeline for large-scale server discovery, data synthesis, and model training that collects and filters data from 1166 servers and 11536 tools. |
| Outcome: | Empirical evidence shows that MCP-Flow generates higher quality instruction-function call pairs and higher agentic task performance than previous work. |
Self-Training for Unsupervised Neural Machine Translation in Unbalanced Training Data Scenarios (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing methods that use monolingual corpora for translation are not suitable for low-resource languages such as Estonian. |
| Approach: | They propose unsupervised neural machine translation (UNMT) that relies on monolingual corpora to train a robust UNMT system and improve its performance. |
| Outcome: | The proposed methods outperform conventional UNMT systems on several language pairs. |
From Imitation to Introspection: Probing Self-Consciousness in Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing language models demonstrate impressive abilities in areas like natural language understanding, content creation, and reasoning. |
| Approach: | They propose a definition of self-consciousness for language models and refine ten core concepts by leveraging structural causal games. |
| Outcome: | The proposed definitions are based on structural causal games and ten core concepts. |
GumbelSoft: Diversified Language Model Watermarking via the GumbelMax-trick (2024.acl-long)
Copied to clipboard
| Challenge: | Large language models generate human-like content, but they also pose a problem with generation diversity, negatively impacting generation diversity and user experience. |
| Approach: | They propose a Logits-Addition watermark and three variants that aim to enhance diversity to overcome generation diversity challenges. |
| Outcome: | The Logits-Addition watermark outperforms the Logits+Trick-based watermark in diversity tests and outperformed other decoding-based methods by 0.1 to 0.3. |
LLMBox: A Comprehensive Library for Large Language Models (2024.acl-demos)
Copied to clipboard
Tianyi Tang, Hu Yiwen, Bingqian Li, Wenyang Luo, ZiJing Qin, Haoxiang Sun, Jiapeng Wang, Shiyi Xu, Xiaoxue Cheng, Geyang Guo, Han Peng, Bowen Zheng, Yiru Tang, Yingqian Min, Yushuo Chen, Jie Chen, Ranchi Zhao, Luran Ding, Yuhao Wang, Zican Dong, Xia Chunxuan, Junyi Li, Kun Zhou, Xin Zhao, Ji-Rong Wen
| Challenge: | a library to facilitate the development, use, and evaluation of large language models (LLMs) is presented. |
| Approach: | They propose a unified library to facilitate the development, use and evaluation of large language models (LLMs). |
| Outcome: | The proposed library is based on extensive experiments in a variety of evaluation settings. |
Selective Contrastive Learning For Gloss Free Sign Language Translation (2026.acl-long)
Copied to clipboard
| Challenge: | Recent SLT systems adopt CLIP-like Vision-Language pretraining, but the random in-batch contrast provides few, batch-dependent negatives. |
| Approach: | They propose a method to train sign video-text similarity over a time period of 3 months . they use a random in-batch contrast strategy to track negative video- text similarity . |
| Outcome: | The proposed system improves sign language translation by focusing on challenging negatives . the results show that the random in-batch contrast provides few negatives and noisy supervision . |
InstructoR: Instructing Unsupervised Conversational Dense Retrieval with Large Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for conversational retrieval only fine-tune on limited supervised data, making it difficult for the retriever to fully grasp the entire conversation. |
| Approach: | They propose a method to instruct unsupervised conversational dense retrieval with large language models (LLMs) they use supervised data to discover the user's query intent from the conversation context . |
| Outcome: | The proposed method can bring significant improvements across various ad-hoc retrievers, surpassing the current state-of-the-art method. |
SCOPE: Boosting LLM Efficiency with Scoped Position Encoding (2026.acl-long)
Copied to clipboard
| Challenge: | Positional encodings are fundamental to Transformers, but explicit methods like RoPE can degrade under length extrapolation and incur extra arithmetic and memory-access overhead. |
| Approach: | They propose a framework that reimagines structured sparsity as an intrinsic position encoding mechanism. |
| Outcome: | The proposed framework reduces the number of attention FLOPs by 8x compared to RoPE on LLaMA-3-8B architectures while reducing training and inference latency. |
LESA: Learnable LLM Layer Scaling-Up (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for depth scaling-up rely on empirical heuristic rules for layer duplication, resulting in poor initialization and slower convergence during continual pre-training. |
| Approach: | They propose a method for learning latent parameters between layers by concatenating parameters from each layer and applying Singular Value Decomposition. |
| Outcome: | Experiments show that LESA outperforms baseline models with less than half the cost of existing methods. |
mmE5: Improving Multimodal Multilingual Embeddings via High-quality Synthetic Data (2025.findings-acl)
Copied to clipboard
| Challenge: | Multimodal embedding models encode multimedia inputs into latent vector representations. |
| Approach: | They propose to synthesize multimodal multilingual data using a multimodal large language model . they identify three criteria for high-quality synthetic multimodal data . |
| Outcome: | The proposed model outperforms existing models on the MMEB Benchmark and the XTD benchmark. |
Resonant Context Anchoring: Decoupling Attention Routing and Signal Gain at Inference Time (2026.findings-acl)
Copied to clipboard
Mingkuan Zhao, Yide Gao, Wentao Hu, Suquan Chen, Tianchen Huang, Zhenhua An, Zetao Chang, Xiayu Sun, Yuheng Min
| Challenge: | Existing mitigation strategies rely on suppressing specific neuron activations or employing computationally expensive contrastive decoding mechanisms, which often result in increased perplexity or significantly elevated inference latency. |
| Approach: | They propose a lightweight inference-time intervention method grounded in the perspective of residual stream signal dynamics to resolve the signal attenuation of external evidence during its propagation through deep networks. |
| Outcome: | The proposed method improves contextual faithfulness across multiple factual consistency and strong knowledge-conflict tasks while maintaining the model’s general language understanding capabilities. |
A Semantic Uncertainty Sampling Strategy for Back-Translation in Low-Resources Neural Machine Translation (2025.acl-srw)
Copied to clipboard
Yepai Jia, Yatu Ji, Xiang Xue, Shilei@imufe.edu.cn Shilei@imufe.edu.cn, Qing-Dao-Er-Ji Ren, Nier Wu, Na Liu, Chen Zhao, Fu Liu
| Challenge: | Back-translation methods rely on large-scale parallel corpora to enhance performance, but ignore the semantic quality of monolingual data. |
| Approach: | They propose a method which prioritizes sentences with higher semantic uncertainty as training samples by computationally evaluating the complexity of unannotated monolingual data. |
| Outcome: | The proposed method improves translation accuracy and fluency by +1.7 on all three translation tasks. |
Apertus: Democratizing Open and Compliant LLMs for Global Language Environments (2026.acl-long)
Copied to clipboard
Alejandro Hernández-Cano, Alexander Hägele, Allen Hao Huang, Angelika Romanou, Antoni-Joan Solergibert, Barna Pásztor, Bettina Messmer, Dhia Garbaya, Eduard Frank Ďurech, Ido Hakimi, Juan Garcia Giraldo, Mete Ismayilzada, Negar Foroutan, Skander Moalla, Tiancheng Chen, Vinko Sabolčec, Yixuan Xu, Michael Aerni, Badr AlKhamissi, Inés Altemir Marinas, Mohammad Hossein Amani, Matin Ansaripour, Ilia Badanin, Harold Benoit, Emanuela Boros, Nicholas John Browning, Fabian Bösch, Maximilian Böther, Niklas Canova, Camille Challier, Clément Charmillot, Jonathan Coles, Jan Milan Deriu, Arnout Devos, Lukas Drescher, Daniil Dzenhaliou, Maud Ehrmann, Dongyang Fan, Simin Fan, Silin Gao, Miguel Gila, María Grandury, Diba Hashemi, Alexander Miserlis Hoyle, Jiaming Jiang, Mark Klein, Andrei Kucharavy, Anastasiia Kucherenko, Frederike Lübeck, Roman Machacek, Theofilos Ioannis Manitaras, Andreas Marfurt, Kyle Matoba, Simon Matrenok, Henrique Mendonça, Fawzi Roberto Mohamed, Syrielle Montariol, Luca Mouchel, Sven Najem-Meyer, Jingwei Ni, Gennaro Oliva, Matteo Pagliardini, Elia Palme, Andrei Panferov, Léo Paoletti, Marco Passerini, Ivan Pavlov, Auguste Poiroux, Kaustubh Ponkshe, Nathan Ranchin, Javier Rando, Mathieu Sauser, Jakhongir Saydaliev, Mukhammadali Sayfiddinov, Marian Schneider, Stefano Schuppli, Marco Scialanga, Andrei Semenov, Kumar Shridhar, Raghav Singhal, Anna Sotnikova, Alexander Sternfeld, Ayush Kumar Tarun, Paul Teiletche, Jannis Vamvas, Xiaozhe Yao, Hao Zhao, Alexander Ilic, Ana Klimovic, Andreas Krause, Caglar Gulcehre, David Rosenthal, Elliott Ash, Florian Tramèr, Joost VandeVondele, Livio Veraldi, Martin Rajman, Thomas C. Schulthess, Torsten Hoefler, Antoine Bosselut, Martin Jaggi, Imanol Schlag
| Challenge: | Apertus is a fully open suite of large language models (LLMs) designed to address responsibility shortcomings in today’s open model ecosystem, namely data responsibility and global representation. |
| Approach: | They propose to release a fully open suite of large language models (LLMs) that address data responsibility and global representation shortcomings in today’s open model ecosystem. |
| Outcome: | The proposed model is pretrained on openly available data and suppresses verbatim recall of data while retaining task performance. |
FreeAL: Towards Human-Free Active Learning in the Era of Large Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Modern machine learning models require a huge collection of precisely labeled data, which can be labor-intensive and time-consuming. |
| Approach: | They propose a collaborative learning framework that interactively distills and filters the task-specific knowledge from LLMs. |
| Outcome: | The proposed framework improves zero-shot performance on eight benchmark datasets without human supervision. |
InteractSpeech: A Speech Dialogue Interaction Corpus for Spoken Dialogue Model (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Spoken Dialogue models face challenges in handling nuanced interactional phenomena, such as interruptions and backchannels. |
| Approach: | They propose to use a 150-hour English speech interaction dialogue dataset to empower spoken dialogue models with nuanced real-time interaction capabilities. |
| Outcome: | The proposed dataset trains and evaluates a speech understanding model that classifies key interactional events directly from audio. |
MAKIEval: A Multilingual Automatic WiKidata-based Framework for Cultural Awareness Evaluation for LLMs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) are used globally across many languages, but their English-centric pretraining raises concerns about cross-lingual disparities for cultural awareness . |
| Approach: | They introduce an automatic multilingual framework for evaluating cultural awareness in large language models across languages, regions, and topics. |
| Outcome: | The framework evaluates open-ended text generation, capturing how models express culturally grounded knowledge in natural language. |
Alignment Precedes Fusion: Open-Vocabulary Named Entity Recognition as Context-Type Semantic Matching (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Continual learning and zero-shot learning approaches have not been adopted to scale to novel-emerging types. |
| Approach: | They propose a method to recognize entities in novel types by their textual names or descriptions. |
| Outcome: | The proposed method outperforms the state-of-the-art methods on three challenging OVNER benchmarks by 9.7%, 9.5%, and 1.8% F1-score of novel types. |
The GaoYao Benchmark: A Comprehensive Framework for Evaluating Multilingual and Multicultural Abilities of Large Language Models (2026.acl-long)
Copied to clipboard
Yilun Liu, Chunguang Zhao, Mengyao Piao, Lingqi Miao, Shimin Tao, Minggui HE, Chenxin Liu, Zhang Li, null Mahongxia, Jiaxin Guo, Chen Liu, Liqun Deng, Jiansheng Wei, Xiaojun Meng, Fanyi Du, Daimeng Wei, Yanghua Xiao
| Challenge: | Existing multilingual evaluation benchmarks neglect cultural nuances and lack language coverage in subjective tasks. |
| Approach: | They propose a framework that categorizes evaluation tasks into three cultural layers and nine cognitive sub-layers. |
| Outcome: | The proposed framework surpasses prior coverage by up to 111% on 20+ LLMs. |
Automatic Instruction Evolving for Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Evol-Instruct is an end-to-end framework that evolves instruction datasets without human effort. |
| Approach: | They propose an end-to-end framework that evolves instruction datasets without human effort by analyzing and analyzing evolutionary strategies for the given instruction data. |
| Outcome: | The proposed method outperforms human-designed methods on various benchmarks including MT-Bench, AlpacaEval, GSM8K, and HumanEval. |
MRAG: A Modular Retrieval Framework for Time-Sensitive Question Answering (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for answering time-sensitive questions lack temporal reasoning . existing methods struggle with these time-intensive questions, authors say . |
| Approach: | They propose a temporal-based question-answering framework that integrates temporal perturbations and gold evidence labels into a question processing framework. |
| Outcome: | The proposed framework outperforms baseline retrieval methods in retrieval performance. |
Stick to the Facts: Learning towards a Fidelity-oriented E-Commerce Product Description Generation (D19-1)
Copied to clipboard
Zhangming Chan, Xiuying Chen, Yongliang Wang, Juntao Li, Zhiqiang Zhang, Kun Gai, Dongyan Zhao, Rui Yan
| Challenge: | Existing models for product description generation do not take the product attribute information into account. |
| Approach: | They propose a model that takes the embedding and the entity label of each word into account . they establish a keyword memory that stores the entity labels as keys and keywords as values . |
| Outcome: | The proposed model increases the fidelity of the generated descriptions by 25%. |
Conditional Memory via Scalable Lookup: A New Axis of Sparsity for Large Language Models (2026.acl-long)
Copied to clipboard
Xin Cheng, Wangding Zeng, Damai Dai, Qinyu Chen, Bingxuan Wang, Zhenda Xie, Kezhao Huang, Xingkai Yu, Zhewen Hao, Han Zhang, Yu-Kun Li, Huishuai Zhang, Dongyan Zhao, Wenfeng Liang
| Challenge: | Mixture-of-Experts (MoE) scales capacity via conditional computation, but lacks knowledge lookup primitive. |
| Approach: | They propose a conditional memory instantiated via Deep Sparse Embedding (DSE) they propose 'u-shaped scaling law' that identifies optimal balance between MoE experts and DSE memory . |
| Outcome: | The proposed model outperforms an iso-parameter and isoFLOPs MoE baseline across knowledge and reasoning benchmarks and is infrastructure-efficient. |
MRT: Multi-modal Short- and Long-range Temporal Convolutional Network for Time-sync Comment Video Behavior Prediction (2024.lrec-main)
Copied to clipboard
| Challenge: | Using time-sync comments, it is difficult to understand user behavior due to complexity of interactions between users, videos, and comments. |
| Approach: | They propose a novel time-sync comment behavior prediction model that takes historical behavior into account and optimizes it on the basis of user preferences. |
| Outcome: | The proposed model improves the performance of time-sync comments on visual frames and textual comments on two cats playing simultaneously. |
Pruning General Large Language Models into Customized Expert Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) require significant computational resources to maintain their general capabilities. |
| Approach: | They propose a Custom Pruning method to prune a large general model into a smaller lightweight expert model, positioned along the "language", "domain" and "task" dimensions. |
| Outcome: | The proposed method outperforms existing pruning methods and achieves minimal loss in both expert and general capabilities across models from different model families and sizes. |
Cracking Factual Knowledge: A Comprehensive Analysis of Degenerate Knowledge Neurons in Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) are believed to store extensive factual knowledge, yet the mechanisms of knowledge storage in LLMs remain largely unexplored. |
| Approach: | They propose that some multi-layer perceptron neurons can store "knowledge". |
| Outcome: | The proposed model can store "knowledge" in multi-layer perceptron neurons, but not redundancy. |
Revealing the Deceptiveness of Knowledge Editing: A Mechanistic Analysis of Superficial Editing (2025.acl-long)
Copied to clipboard
| Challenge: | Existing knowledge editing algorithms are prone to generating original knowledge . despite the fact that many models achieve near-perfect performance, superficial editing remains a challenge . |
| Approach: | They propose to use "**superficial editing**" to describe the phenomenon . they investigate the internal mechanisms of the attention module and their corresponding left singular vectors . |
| Outcome: | The proposed method can modify specific knowledge in a pretrained large language model while ensuring that unrelated knowledge remains unaffected. |
Relaxing the Constraints: A Dual-Importance Projection Mechanism for Lifelong Model Editing (2026.findings-acl)
Copied to clipboard
Zhenghai Chen, Senbin Xu, Jiaxi Tan, Xinhua Wu, Yan Zhang, Xiawu Zheng, Shengchuan Zhang, Ke Li, Sicheng Zhao, Liujuan Cao, Rongrong Ji
| Challenge: | Existing knowledge editing methods rely on strict orthogonal projection to preserve previously edited knowledge, but this constraint limits gradient expressiveness, resulting in degradation of model generalization and overall performance as the number of edits increases. |
| Approach: | They propose a method that leverages Singular Value Decomposition to identify critical gradient subspaces and introduces a dual mechanism comprising "accumulated importance" and "projection importance" |
| Outcome: | Extensive experiments on five mainstream LLMs show that the proposed method achieves an average comprehensive performance improvement of 10.36% and effectively maintains the model’s general capabilities on downstream tasks. |
TKGT: Redefinition and A New Way of Text-to-Table Tasks Based on Real World Demands and Knowledge Graphs Augmented LLMs (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on text-to-table tasks that ignore domain structures and use simple datasets to extract structured information from unstructured text. |
| Approach: | They propose a new text-to-table task that generates domain knowledge graphs from raw text using a mixed-IE method and a hybrid retrieval augmented generation method. |
| Outcome: | The proposed dataset improves compatibility with long text-processing tasks by incorporating domain knowledge graphs (KGs) classes into tables. |
OS Agents: A Survey on MLLM-based Agents for Computer, Phone and Browser Use (2025.acl-long)
Copied to clipboard
Xueyu Hu, Tao Xiong, Biao Yi, Zishu Wei, Ruixuan Xiao, Yurun Chen, Jiasheng Ye, Meiling Tao, Xiangxin Zhou, Ziyu Zhao, Yuhuai Li, Shengze Xu, Shenzhi Wang, Xinchen Xu, Shuofei Qiao, Zhaokai Wang, Kun Kuang, Tieyong Zeng, Liang Wang, Jiwei Li, Yuchen Eleanor Jiang, Wangchunshu Zhou, Guoyin Wang, Keting Yin, Zhou Zhao, Hongxia Yang, Fan Wu, Shengyu Zhang, Fei Wu
| Challenge: | a new generation of (M)LLMs is enabling the creation of superintelligent AI assistants . OS Agents can complete tasks autonomously and have the potential to significantly enhance the lives of billions of users worldwide. |
| Approach: | They propose to build OS Agents that operate within operating systems' GUIs and GUIs . they examine evaluation metrics and benchmarks to identify promising directions . |
| Outcome: | The proposed agents are based on operating systems (OS) and operating systems frameworks. |
Exploring the Choice Behavior of Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are increasingly being adopted across various domains where they help to make choices. |
| Approach: | They construct a virtual QA platform that includes three different experimental conditions, with four models from GPT and Llama series participating in repeated experiments. |
| Outcome: | The proposed model includes three experimental conditions and four models from GPT and Llama series. |
Dense X Retrieval: What Retrieval Granularity Should We Use? (2024.emnlp-main)
Copied to clipboard
| Challenge: | a learned dense retrieval model is often overlooked when using a corpus for inference, resulting in a design choice of retrieval unit . granularity of retrievals is important for both retrieval and downstream tasks . |
| Approach: | They propose a retrieval unit for dense retrieval that uses propositions to index corpus . propositions are defined as atomic expressions within text, each encapsulating a distinct factoid . |
| Outcome: | The proposed retrieval unit outperforms passage-level units on retrieval and downstream tasks. |
Making RALM Robust to Irrelevant Contexts via Layer Knowledge Guided Attention (2025.findings-acl)
Copied to clipboard
Weijie Shi, Hao Chen, Jiaming Li, Yao Zhao, Yazhong Zhang, Qijin Chen, Jipeng Zhang, Ruiyuan Zhang, Jia Zhu, Jiajie Xu, Xiaofang Zhou
| Challenge: | Large language models (LLMs) face factual hallucination and knowledge obsolescence when tackling knowledge-intensive tasks. |
| Approach: | They propose a layer-knowledge guided attention method which harnesses the layer-wise knowledge of large language models to optimize per-layer attention on useful passages. |
| Outcome: | The proposed method outperforms existing methods on RALM benchmarks. |
LeTS: Learning to Think-and-Search via Process-and-Outcome Reward Hybridization (2025.emnlp-main)
Copied to clipboard
Qi Zhang, Shouqing Yang, Lirong Gao, Hao Chen, Xiaomeng Hu, Jinglei Chen, Jiexiang Wang, Sheng Guo, Bo Zheng, Haobo Wang, Junbo Zhao
| Challenge: | Recent research focuses on integrating reasoning capabilities into the realm of retrieval-augmented generation (RAG) via outcome-supervised reinforcement learning (RL). |
| Approach: | They propose a process-level reward module to mitigate the unawareness of intermediate reasoning steps in outcome-level supervision without additional annotation. |
| Outcome: | The proposed framework can boost LLMs’ reasoning ability by integrating external knowledge sources through retrieval-augmented generation (RAG) The proposed model can mitigate the unawareness of intermediate reasoning steps in outcome-level supervision without additional annotation. |
GATEAU: Selecting Influential Samples for Long Context Alignment (2025.emnlp-main)
Copied to clipboard
Shuzheng Si, Haozhe Zhao, Gang Chen, Yunshui Li, Kangyang Luo, Chuancheng Lv, Kaikai An, Fanchao Qi, Baobao Chang, Maosong Sun
| Challenge: | Existing studies have attempted to scale up the available data volume by synthesizing long instruction-following samples, but a lack of a well-defined strategy for ensuring data quality may introduce low-quality samples and restrict the model’s performance. |
| Approach: | They propose a framework to identify influential samples enriched with long-range dependency relations that can be used to align large language models to handle instructions with extremely long contexts. |
| Outcome: | The proposed framework identifies samples with long-range dependency relations and shows that the model trained on these samples exhibits better instruction-following and long-context understanding capabilities. |
WavAlign: Enhancing Intelligence and Expressiveness in Spoken Dialogue Models via Adaptive Hybrid Post-Training (2026.findings-acl)
Copied to clipboard
Yifu Chen, Shengpeng Ji, Qian Chen, Tianle Liang, Yangzhuo Li, Ziqing Wang, Wen Wang, Jingyu Lu, Haoxiao Wang, Xueyi Pu, Fan Zhuo, Zhou Zhao
| Challenge: | End-to-end spoken dialogue models have higher potential ceiling in expressiveness and perceptual ability than cascaded systems. |
| Approach: | They propose a modality-aware adaptive post-training recipe that constrains preference updates to the semantic channel and improves acoustic behavior via explicit anchoring. |
| Outcome: | The proposed model improves speech quality and expressiveness across spoken dialogue benchmarks and architectures. |
Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing studies focus on prompt engineering or framework scheduling of one/multiple LLMs. |
| Approach: | They propose to integrate LLMs as agents into their training corpus by decomposition and redesigning the training corpu . they propose to use LLM-FLAN to effectively fine-tune LANguage models for Agents by reducing hallucinations. |
| Outcome: | The proposed model outperforms prior best models by 3.5% across agent evaluation datasets. |
Bi-Directional Multi-Granularity Generation Framework for Knowledge Graph-to-Text with Large Language Model (2024.acl-short)
Copied to clipboard
| Challenge: | Existing methods generate whole text based on all KG triples at once and may incorporate incorrect KG Triples for each sentence. |
| Approach: | They propose a bi-directional multi-granularity generation framework that generates graph-level sentences based on KG triples instead of the whole text at a time. |
| Outcome: | The proposed framework achieves state-of-the-art in benchmark dataset WebNLG and further analysis shows the efficiency of different modules. |
CompTab: A Comprehensive Benchmark for Real-World TableQA with Complex Reasoning and Irregular Tables (2026.acl-long)
Copied to clipboard
Zhen Yang, Wei Du, Jie Wang, Wenze Zhou, Xiangfeng Meng, Zhengyang Wang, Suping Sun, Ziwei Du, Haodong Zou, Jie Chen, Yongbin Liu, Shicheng Tan, Jiahao Ying, Shu Zhao
| Challenge: | Existing benchmarks focus on well-structured tables and fail to reflect irregular structures and complex reasoning commonly encountered in real-world scenarios. |
| Approach: | They propose a benchmark to evaluate TableQA under complex reasoning and irregular table conditions. |
| Outcome: | The proposed framework improves generalization and realism of large language models under complex and irregular table conditions. |
Parallel Structures in Pre-training Data Yield In-Context Learning (2024.acl-long)
Copied to clipboard
| Challenge: | Pre-trained language models (LMs) are capable of in-context learning (ICL) however, it is unclear where this ability comes from as there is a stark distribution shift between pre-training text and ICL prompts. |
| Approach: | They find that pre-trained language models are capable of in-context learning (ICL) they detect parallel structures in the pre-training data and conduct ablation experiments to study their effect on ICL. |
| Outcome: | The proposed model can adapt to a task with a few examples given in the prompt without any parameter update. |
QTSumm: Query-Focused Summarization over Tabular Data (2023.emnlp-main)
Copied to clipboard
Yilun Zhao, Zhenting Qi, Linyong Nan, Boyu Mi, Yixin Liu, Weijin Zou, Simeng Han, Ruizhe Chen, Xiangru Tang, Yumo Xu, Dragomir Radev, Arman Cohan
| Challenge: | Existing text generation systems that can provide accurate table summaries can facilitate more efficient access to relevant data insights. |
| Approach: | They propose a query-focused task where text generation models have to perform human-like reasoning and analysis over the given table to generate a tailored table summary. |
| Outcome: | The proposed method improves existing baselines on table-to-text generation and large language models by concatenating generated facts to the model input. |
Learn to Relax with Large Language Models: Solving Constraint Optimization Problems via Bidirectional Coevolution (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Model (LLM)-based optimization has shown promise for autonomous problem solving, but most approaches cast LLMs as passive constraint checkers rather than proactive strategy designers. |
| Approach: | They propose an end-to-end Automated Constraint Optimization method that tightly couples operations-research principles of constraint relaxation with LLM reasoning. |
| Outcome: | Extensive experiments on three challenging COP benchmarks validate AutoCO’s consistent effectiveness and superior performance, especially in hard regimes where current methods degrade. |
CAMERO: Consistency Regularized Ensemble of Perturbed Language Models with Weight Sharing (2022.acl-long)
Copied to clipboard
| Challenge: | Existing work has resorted to sharing weights among models, but results are not affordable for real-world deployment. |
| Approach: | They propose a consistency-regularized ensemble learning approach based on perturbed models to retain ensemble benefits while maintaining a low memory cost. |
| Outcome: | The proposed approach outperforms the standard ensemble of 8 BERT-base models on the GLUE benchmark by 0.7 with a significantly smaller model size. |
A Pretraining Numerical Reasoning Model for Ordinal Constrained Question Answering on Knowledge Base (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing knowledge bases (KBs) can explicitly facilitate the QA process. |
| Approach: | They propose a numerical reasoning model pretraining NumGNN and NumTransformer, guided by explicit self-supervision signals, to enhance numerical reasoning ability for IR-based KBQA models. |
| Outcome: | Extensive experiments on two KBQA benchmarks confirm the effectiveness of the proposed model. |
GuideLLM: Exploring LLM-Guided Conversation with Applications in Autobiography Interviewing (2025.naacl-long)
Copied to clipboard
Jinhao Duan, Xinyu Zhao, Zhuoxuan Zhang, Eunhye Grace Ko, Lily Boddy, Chenan Wang, Tianhao Li, Alexander Rasgon, Junyuan Hong, Min Kyung Lee, Chenxi Yuan, Qi Long, Ying Ding, Tianlong Chen, Kaidi Xu
| Challenge: | Large Language Models (LLMs) have demonstrated their effectiveness in human-guided dialogues, but tasks in the real world are more complex and require greater autonomy from LLMs. |
| Approach: | They propose to characterize LLM-guided conversation into three fundamental components: Goal Navigation, Context Management, Empathetic Engagement and implement an interviewing environment for the evaluation of LLMs. |
| Outcome: | The proposed LLM outperforms baseline LLMs in interviewing quality and autobiography generation quality. |
Sharper and Faster mean Better: Towards More Efficient Vision-Language Model for Hour-scale Long Video Understanding (2025.acl-long)
Copied to clipboard
| Challenge: | Existing multimodal large language models (LLMs) have shown impressive performance on the video understanding task, but extremely long videos still pose significant challenges to their context length, memory consumption, and computational complexity. |
| Approach: | They propose a vision-language model named Sophia for long video understanding which can efficiently handle hour-scale long videos. |
| Outcome: | The proposed model exhibits competitive performance compared to existing video understanding baselines across various benchmarks for long video understanding with reduced time and memory consumption. |
A Good Neighbor, A Found Treasure: Mining Treasured Neighbors for Knowledge Graph Entity Typing (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to infer missing types for knowledge graphs only leverage one-hop neighbor information of the central entity, ignoring multi-hop neighbors that can provide valuable clues for inference. |
| Approach: | They propose a method to infer missing types for knowledge graph entities by using neighbor information and co-occurrence relations between types. |
| Outcome: | The proposed method significantly outperforms existing state-of-the-art methods on two widely used datasets. |
Improving Event Causality Identification via Self-Supervised Representation Learning on External Causal Statement (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for event causality identification (ECI) rely on labeled data, but the scale of annotated datasets is limited. |
| Approach: | They propose a self-supervised framework to learn context-specific causal patterns from external causal statements and adopt a contrastive transfer strategy to incorporate the learned context- specific causal patterns into the target ECI model. |
| Outcome: | The proposed method significantly outperforms existing methods on EventSto-ryLine and Causal-TimeBank (+2.0 and +3.4 points on F1 value respectively). |
Dialogue State Tracking with Explicit Slot Connection Modeling (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods to track dialogue state are lacking in multi-domain scenarios. |
| Approach: | They propose a model that explicitly considers slot correlations across domains . they propose ellipsis and reference to express values that have been mentioned by slots from other domains. |
| Outcome: | The proposed model outperforms existing models on multi-domain datasets and achieves state-of-the-art performance. |
Multi-Domain Neural Machine Translation with Word-Level Adaptive Layer-wise Domain Mixing (2020.acl-main)
Copied to clipboard
| Challenge: | Existing multi-domain neural machine translation models lack adaptation to individual domains. |
| Approach: | They propose a multi-domain neural machine translation model with individual modules for each domain . they use word-level, adaptive and layer-wise domain mixing to achieve this . |
| Outcome: | The proposed model outperforms existing models in several NMT tasks. |
Behavioral Consistency Validation for LLM Agents: An Analysis of Trading-Style Switching through Stock-Market Simulation (2026.findings-acl)
Copied to clipboard
Zeping Li, Guancheng Wan, Keyang Chen, Yu Chen, Yiwen Zhao, Philip Torr, Guangnan Ye, Zhenfei Yin, Hongfeng Chai
| Challenge: | Recent studies have applied Large Language Models (LLMs) as agents in financial stock market simulations to test if micro-level behaviors aggregate into macro-level phenomena. |
| Approach: | They propose four alignment metrics and use Mann–Whitney U tests to compare agents’ style-switching behavior with financial theory. |
| Outcome: | The proposed model is only partially consistent with financial theory. |
Watermarking with Low-Entropy POS-Guided Token Partitioning and Z-Score-Driven Dynamic Bias for Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing watermarking methods reduce the fidelity of semantics in LLMs . |
| Approach: | They propose a low-entropy token partitioning mechanism and z-score-driven dynamic bias mechanism to enhance semantics. |
| Outcome: | The proposed framework improves semantic fidelity and robustness against bias sparsity attacks. |
BLEURT Has Universal Translations: An Analysis of Automatic Metrics by Minimum Risk Training (2023.acl-long)
Copied to clipboard
| Challenge: | Automated metrics are used for machine translation, but they are often considered to be black boxes with potential biases that are difficult to detect. |
| Approach: | They analyze automatic metrics from the perspective of their guidance for machine translation training. |
| Outcome: | The proposed measures improve the performance of machine translation models. |
AgentsCourt: Building Judicial Decision-Making Agents with Court Debate Simulation and Legal Knowledge Augmentation (2024.findings-emnlp)
Copied to clipboard
Zhitao He, Pengfei Cao, Chenhao Wang, Zhuoran Jin, Yubo Chen, Jiexin Xu, Huaijun Li, Kang Liu, Jun Zhao
| Challenge: | Recent advances in deep learning have significantly impacted the legal domain. |
| Approach: | They propose a multi-agent framework for judicial decision-making that simulates the court trial process . they propose 420 Chinese judgment documents to support their framework and build a large-scale legal knowledge base . |
| Outcome: | The proposed framework outperforms existing methods in various aspects, especially in generating legal articles. |
M2Edit: Locate and Edit Multi-Granularity Knowledge in Multimodal Large Language Model (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing knowledge editing methods for MLLMs lack multi-granularity knowledge . existing knowledge editing approaches lack multimodality knowledge and generalize to multimodal data. |
| Approach: | They propose a multimodal knowledge editing method which integrates key knowledge layers within MLLMs and collaboratively edits them. |
| Outcome: | The proposed method improves visual generality performance on knowledge data of different granularities. |
Your Inference Request Will Become a Black Box: Confidential Inference for Cloud-based Large Language Models (2026.acl-long)
Copied to clipboard
Chung-ju Huang, Huiqiang Zhao, Yuanpeng He, Lijian Li, Wenpin Jiao, Zhi Jin, Peixuan Chen, Leye Wang
| Challenge: | Existing approaches fail to ensure privacy, maintain model performance, and preserve computational efficiency simultaneously. |
| Approach: | They propose a confidential inference framework that partitions the LLM pipeline between a client-verified Confidential Virtual Machine (CVM) and the public cloud to protect client data without compromising the cloud’s model intellectual property or inference quality. |
| Outcome: | The proposed framework can defend against state-of-the-art token inference attacks while preserving model privacy, performance, and efficiency. |
LongTableBench: Benchmarking Long-Context Table Reasoning across Real-World Formats and Domains (2025.findings-emnlp)
Copied to clipboard
Liyao Li, Jiaming Tian, Hao Chen, Wentao Ye, Chao Ye, Haobo Wang, Ningtao Wang, Xing Fu, Gang Chen, Junbo Zhao
| Challenge: | Evaluating 52 LLMs reveals that only the strongest models maintain robust performance under increasing context lengths and format diversity. |
| Approach: | They propose a benchmark for evaluating long-context reasoning over semi-structured tables across diverse formats, tasks, and domains. |
| Outcome: | The proposed model outperforms compression-based approaches on tasks requiring semantic integration. |
Can an Individual Manipulate the Collective Decisions of Multi-Agents? (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies show that coordinated multi-agent systems exhibit enhanced decision-making and reasoning abilities through collaboration. |
| Approach: | They propose a framework that simulates agent interactions within a multi-agent system to generate adversarial samples and use them to manipulate the target agent in the target system. |
| Outcome: | The proposed framework generates adversarial samples that are used to manipulate the target agent in the target system, misleading the system’s decision-making process. |
Self-EmoQ: Plutchik-Guided Value-based Planning to Drive Streaming Emotional TTS (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing systems lack a self-emotion determination mechanism to drive the streaming text-to-speech (TTS) synthesis. |
| Approach: | They propose an emotion-planning framework that determines the emotion prior to the textual generation, grounding the downstream emotional TTS in a streaming manner. |
| Outcome: | The proposed framework outperforms baselines on DailyDialog, EmoryNLP, IMEOCAP, and MELD on emotional alignment, contextual coherence, and expressive fluency. |
LANTERN in the Event Stream: Training-Free Temporal Knowledge Graph Forecasting by Balancing Inertia and Shifts (2026.findings-acl)
Copied to clipboard
| Challenge: | Temporal knowledge graph forecasting (TKGF) uses long-window strengthscores and short-windowed novelty scores to predict missing entities in future queries. |
| Approach: | They propose a training-freeprompting framework that uses two perspectives of history to predict missing entities in future queries. |
| Outcome: | The proposed framework outperforms the state-of-the-art baselineAnRe framework in ICEWS14, ICEW05-15, and GDELT. |
Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing reinforcement learning methods do not provide fine-grained supervision for complex reasoning tasks. |
| Approach: | They propose a reinforcement learning method that incorporates a generative model as the reward model and a token-level supervision model for RL training. |
| Outcome: | Experiments on 8 tasks show the proposed method is effective . |
Thinking Beyond the Local: Multi-View Instructed Adaptive Reasoning in KG-Enhanced LLMs (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods for large language models adopt query-driven iterative reasoning from a local perspective, limiting efficiency and accuracy for complex multi-hop tasks. |
| Approach: | They propose a multi-view instructed adaptive reasoning of LLM on Knowledge Graphs that allows LLMs to plan, evaluate, and adapt reasoning paths from a global perspective. |
| Outcome: | The proposed model overcomes the limitations of local exploration by enabling LLMs to plan, evaluate, and adapt reasoning paths from a global perspective. |
Unsupervised Bilingual Word Embedding Agreement for Unsupervised Neural Machine Translation (P19-1)
Copied to clipboard
| Challenge: | Unsupervised bilingual word embedding (UBWE) has helped unsupervised neural machine translation (UNMT) achieve remarkable results in several language pairs. |
| Approach: | They propose two methods that train UNMT with UBWE agreement . they propose to use UBwe to initialize word embedding in UNMT . |
| Outcome: | The proposed methods outperform conventional methods on several language pairs. |
Not Everything is All You Need: Toward Low-Redundant Optimization for Large Language Model Alignment (2024.emnlp-main)
Copied to clipboard
| Challenge: | Experimental results show that large language models are struggling to align with human preference in complex tasks and scenarios. |
| Approach: | They propose a low-redundant alignment method that selects the top-10% most updated parameters in LLMs for alignment training. |
| Outcome: | The proposed method improves on 10 datasets and shows that it is redundant . it can be used to train LLMs on QA and ECQA datasets, but it is not feasible to test it on a large dataset. |
FedDQC: Data Quality Control in Federated Instruction-tuning of Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Federated Learning (FL) enables privacy-preserving collaborative instruction tuning of large language models. |
| Approach: | They propose a federated instruction tuning framework with dynamic data quality control to solve this problem. |
| Outcome: | The proposed framework improves performance on mixed-quality datasets on synthetic and real-world datasets. |
Signer Diversity-driven Data Augmentation for Signer-Independent Sign Language Translation (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods for sign language translation (SLT) rely on signer identity labels, which is often impractical and costly in real-world applications. |
| Approach: | They propose a signer diversity-driven data augmentation method that can generalize to signers not encountered during training. |
| Outcome: | The proposed method achieves state-of-the-art results without relying on signer identity labels. |
Exploring the Hidden Reasoning Process of Large Language Models by Misleading Them (2025.findings-emnlp)
Copied to clipboard
Guanyu Chen, Peiyang Wang, Yizhou Jiang, Yuqian Liu, Chujie Zhao, Ying Fang, Tianren Zhang, Feng Chen
| Challenge: | Existing large language models can perform abstract reasoning tasks but are they actually engaging in rule-based reasoning beyond mere memorization? |
| Approach: | They propose a method to examine whether large language models perform abstract reasoning . they fine-tune the model to learn those contradictory rules and assess its generalization ability . |
| Outcome: | The proposed approach examines whether large language models perform abstract reasoning by altering their original understanding of fundamental rules. |
MCTS-RAG: Enhancing Retrieval-Augmented Generation with Monte Carlo Tree Search (2025.findings-emnlp)
Copied to clipboard
| Challenge: | MCTS-RAG combines structured reasoning with adaptive retrieval . compared to conventional MCTLs, MCTR-RAg relies on internal model knowledge without external facts . |
| Approach: | a new approach integrates retrieval-augmented generation and Monte Carlo Tree Search to enhance reasoning capabilities of small language models. |
| Outcome: | MCTS-RAG integrates retrieval-augmented generation and Monte Carlo Tree Search to improve reasoning paths. |
NutFrame: Frame-based Conceptual Structure Induction with LLMs (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies focus on syntactic knowledge and world knowledge, but conceptual structure is not well-understood. |
| Approach: | They propose a benchmark for coNceptual structure induction based on FrameNet . they use prompts to induce conceptual structure of Framenet with LLMs . |
| Outcome: | The proposed model is able to induce conceptual structure of FrameNet with LLMs. |
Inside Out: Evolving User-Centric Core Memory Trees for Long-Term Personalized Dialogue Systems (2026.acl-long)
Copied to clipboard
| Challenge: | Existing personalized dialogue systems struggle to reconcile unbounded interactions with finite context constraints. |
| Approach: | They propose a framework that utilizes a globally maintained PersonaTree as the carrier of long-term user profiling. |
| Outcome: | The proposed framework outperforms existing systems in suppressing contextual noise and persona inconsistency. |
SportReason: Evaluating Retrieval-Augmented Reasoning across Tables and Text for Sports Question Answering (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing benchmarks for retrieval-augmented reasoning on numerical sports questions focus on one or two evidence units. |
| Approach: | They propose a benchmark for retrieval-augmented reasoning on numerical sports questions . they evaluate existing retrievers and rerankers, along with agentic Retrieval-Augmented Generation systems. |
| Outcome: | The proposed benchmarks focus on the sports domain because it offers rich multi-modal resources. |
On the Relation between Sensitivity and Accuracy in In-Context Learning (2023.findings-emnlp)
Copied to clipboard
| Challenge: | In-context learning (ICL) suffers from oversensitivity to the prompt, making it unreliable in real-world scenarios. |
| Approach: | They propose a few-shot selective prediction method that abstains from sensitive predictions. |
| Outcome: | The proposed method outperforms confidence-based and entropy-based methods on ten classification datasets. |
Benchmarking LLMs for Translating Classical Chinese Poetry: Evaluating Adequacy, Fluency, and Elegance (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing large language models fall short of translating culturally significant content . existing models fall behind in achieving such translations, authors say . |
| Approach: | They propose a suitable benchmark for translating classical Chinese poetry into English . they propose RAT, a retrieval-augmented machine translation method that enhances the translation process . |
| Outcome: | The proposed method improves translation quality in terms of adequate, fluent, and elegant translations. |
MMEvalPro: Calibrating Multimodal Benchmarks Towards Trustworthy and Efficient Evaluation (2025.naacl-long)
Copied to clipboard
Jinsheng Huang, Liang Chen, Taian Guo, Fu Zeng, Yusheng Zhao, Bohan Wu, Ye Yuan, Haozhe Zhao, Zhihui Guo, Yichi Zhang, Jingyang Yuan, Wei Ju, Luchen Liu, Tianyu Liu, Baobao Chang, Ming Zhang
| Challenge: | Large Multimodal Models (LMMs) exhibit impressive cross-modal understanding and reasoning abilities, but many benchmarks suffer from systematic biases. |
| Approach: | They propose a benchmark to avoid Type-I errors by creating one perception question and one knowledge anchor question through a meticulous annotation process. |
| Outcome: | The proposed benchmark avoids Type-I errors while maintaining reliability of MCQ evaluations. |
WildFeedback: Aligning LLMs With In-situ User Interactions And Feedback (2026.acl-long)
Copied to clipboard
Taiwei Shi, Zhuoer Wang, Longqi Yang, Ying-Chun Lin, Zexue He, Mengting Wan, Pei Zhou, Sujay Kumar Jauhar, Sihao Chen, Shan Xia, Hongfei Zhang, Jieyu Zhao, Xiaofeng Xu, Xia Song, Jennifer Neville
| Challenge: | Traditional alignment methods rely on human annotations and are subjective and misalignment with real-world user preferences. |
| Approach: | They propose a framework that leverages in-situ user feedback during conversations with LLMs to create preference datasets automatically. |
| Outcome: | The proposed framework identifies and classifies user feedback to LLM responses between conversation turns and creates examples of preferred and dispreferred responses according to user preferences. |
A.S.E: A Repository-Level Benchmark for Evaluating Security in AI-Generated Code (2026.findings-acl)
Copied to clipboard
Keke Lian, Wang Bin, Lei Zhang, Libo Chen, Junjie Wang, Ziming Zhao, Yujiu Yang, Miaoqian Lin, Haotong Duan, Haoran Zhao, Shuang Liao, Mingda Guo, Quan Jiazheng, Yilu Zhong, Chenhao He, Chen Zichuan, Jie Wu, Haoling Li, Zhaoxuan Li, Jiongchi Yu, Hui LI, Dong Zhang
| Challenge: | Existing security evaluation benchmarks lack relevance to real-world AI programming tasks . current LLMs struggle with secure coding, research shows . |
| Approach: | They propose a repository-level evaluation benchmark to assess security of AI-generated code. |
| Outcome: | The proposed framework mirrors real-world AI programming tasks and offers valuable insights into the state of AI code generation. |
Adversarial Transfer Learning for Chinese Named Entity Recognition with Self-Attention Mechanism (D18-1)
Copied to clipboard
| Challenge: | Existing methods for named entity recognition (NER) do not exploit word boundary information from CWS or cannot filter the specific information of CWS. |
| Approach: | They propose to exploit task-shared boundary information to make full use of Chinese NER task and Chinese word segmentation (CWS) . |
| Outcome: | The proposed model significantly outperforms other state-of-the-art methods on two widely used datasets. |
Embedding and Gradient Say Wrong: A White-Box Method for Hallucination Detection (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for hallucination detection have attracted more attention from the community. |
| Approach: | They propose to model the distributional distance between the regular conditional output and the unconditional output, which is generated without a given input text. |
| Outcome: | The proposed model achieves state-of-the-art on the hallucination benchmarks HADES and other datasets. |
Symbolic Planning and Code Generation for Grounded Dialogue (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models excel at processing and generating text and code, but lack a grounded task-oriented dialogue system that can handle grounding. |
| Approach: | They propose a modular and interpretable grounded dialogue system that integrates a reader and planner to convert partner utterances into executable code and a symbolic planner to determine the next appropriate response. |
| Outcome: | The proposed system outperforms the existing state-of-the-art on a one-common dialogue task and improves task success in human evaluations from 56% to 69% in the most challenging setting. |
More than Minorities and Majorities: Understanding Multilateral Bias in Language Generation (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on bias dataset construction and mitigation focus on one demographic group . in real-world applications, there are more than two demographic groups at risk of the same bias. |
| Approach: | They propose to analyze and reduce biases across multiple demographic groups using a multi-demographic bias dataset. |
| Outcome: | The proposed method can mitigate biases among multiple demographic groups effectively, the authors show . |
Multi-perspective Improvement of Knowledge Graph Completion with Large Language Models (2024.lrec-main)
Copied to clipboard
Derong Xu, Ziheng Zhang, Zhenxi Lin, Xian Wu, Zhihong Zhu, Tong Xu, Xiangyu Zhao, Yefeng Zheng, Enhong Chen
| Challenge: | Knowledge graph completion (KGC) is a widely used method to tackle incompleteness in knowledge graphs (KGs). |
| Approach: | They propose a general framework to compensate for the deficiency of contextualized knowledge by querying large language models from various perspectives. |
| Outcome: | The proposed framework improves knowledge graph completion (KGC) by querying large language models from various perspectives. |
SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for fine-tuning pre-trained models fail to generalize to unseen data. |
| Approach: | They propose a framework for robust and efficient fine-tuning for pre-trained models . proposed framework achieves new state-of-the-art performance on a number of NLP tasks . |
| Outcome: | The proposed framework outperforms the state-of-the-art T5 model on GLUE, SNLI, SciTail and ANLI. |
Neural Cross-Lingual Event Detection with Minimal Parallel Resources (D19-1)
Copied to clipboard
| Challenge: | Existing methods for event detection (ED) rely on high-performance machine translation systems or manually aligned documents to achieve a decent performance. |
| Approach: | They propose a method that uses context-dependent translation to construct a lexical mapping between different languages and a shared syntactic order event detector for multilingual co-training. |
| Outcome: | The proposed method performs cross-lingual transfer and tackles the extremely annotation-poor scenario. |
Beyond Single-shot Writing: Deep Research Agents are Unreliable at Multi-turn Report Revision (2026.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks for Deep Research Agents (DRAs) treat report generation as a single-shot writing task. |
| Approach: | They propose an evaluation suite that establishes multi-turn report revision as a new axis. |
| Outcome: | The evaluation suite establishes multi-turn report revision as a new axis. |
TextBox: A Unified, Modularized, and Extensible Framework for Text Generation (2021.acl-demo)
Copied to clipboard
Junyi Li, Tianyi Tang, Gaole He, Jinhao Jiang, Xiaoxuan Hu, Puzhao Xie, Zhipeng Chen, Zhuohao Yu, Wayne Xin Zhao, Ji-Rong Wen
| Challenge: | TextBox is an open-source text generation framework that is modularized and extensible. |
| Approach: | They propose to provide a unified, modularized, and extensible text generation framework that implements 21 text generation models on 9 benchmark datasets. |
| Outcome: | The proposed framework implements 21 models on 9 benchmark datasets and is available under the Apache License 2.0 license. |
Evaluating Personalized Tool-Augmented LLMs from the Perspectives of Personalization and Proactivity (2025.acl-long)
Copied to clipboard
| Challenge: | Personalized tool utilization is essential for aligning large language models (LLMs) with user preference in interaction scenarios with various tools. |
| Approach: | They propose a key-point-based LLM evaluation method that mitigates biases by manually annotating key points for each test case and providing them to LLM as the reference. |
| Outcome: | The proposed method mitigates biases in the LLM-as-a-judge system by manually annotating key points for each test case and providing them to LLM as the reference. |
Hyperlink-induced Pre-training for Passage Retrieval in Open-domain Question Answering (2022.acl-long)
Copied to clipboard
Jiawei Zhou, Xiaoguang Li, Lifeng Shang, Lan Luo, Ke Zhan, Enrui Hu, Xinyu Zhang, Hao Jiang, Zhao Cao, Fan Yu, Xin Jiang, Qun Liu, Lei Chen
| Challenge: | Existing methods to train dense passage retrieval have a large data gap between upstream and downstream relevance. |
| Approach: | They propose a method to pre-train the dense retriever with the text relevance induced by hyperlinks within Web documents. |
| Outcome: | The proposed method outperforms existing methods under different scenarios and in the open-domain question answering domain. |
Search-in-Context: Efficient Multi-Hop QA over Long Contexts via Monte Carlo Tree Search with Dynamic KV Retrieval (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to multihop question answering (MHQA) over long contexts are often neglecting explicit reasoning or incurring expensive computational costs due to full-attention mechanisms over long contextuals. |
| Approach: | They propose a framework that integrates Monte Carlo Tree Search (MCTS) with dynamic key-value retrieval to enable iterative, context-aware reasoning. |
| Outcome: | The proposed framework integrates Monte Carlo Tree Search (MCTS) with dynamic key-value (KV) retrieval to enable iterative, context-aware reasoning. |
Learning Diverse Responses with Prefix-Conditioned Supervised Fine-Tuning (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models exhibit highly homogeneous, repetitive responses, resulting in inefficient exploration. |
| Approach: | They propose a method that constructs semantically consistent yet distributionally distinct prior contents to different responses and decouple the one-to-many mapping. |
| Outcome: | The proposed method improves absolute performance by 5.3% and increases generation diversity by 198.3% on average while significantly enhancing output diversity and test-time scaling. |
ElitePLM: An Empirical Study on General Language Ability Evaluation of Pretrained Language Models (2022.naacl-main)
Copied to clipboard
Junyi Li, Tianyi Tang, Zheng Gong, Lixin Yang, Zhuohao Yu, Zhipeng Chen, Jingyuan Wang, Xin Zhao, Ji-Rong Wen
| Challenge: | Recent years have featured a trend towards Transformer based pretrained language models (PLMs) in natural language processing systems. |
| Approach: | They propose to use four evaluation dimensions to evaluate ten widely-used PLMs . they find that pretrained language models are good at different ability tests . |
| Outcome: | The results show that pretrained language models are good at different ability tests and have excellent transferability between tasks. |
Leros: Learning Explicit Reasoning on Synthesized Data for Commonsense Question Answering (2024.lrec-main)
Copied to clipboard
Chenhao Wang, Pengfei Cao, Jiachun Li, Yubo Chen, Kang Liu, Xiaojian Jiang, Jiexin Xu, Li Qiuxia, Jun Zhao
| Challenge: | Recent work shows large language models can generate useful rationales for commonsense question answering (CQA) however, the cost of deployment and further tuning is relatively expensive for the large models. |
| Approach: | They propose a framework that leverages both knowledge graphs and large language models to synthesize rationale-augmented CQA data. |
| Outcome: | The proposed model can generate useful rationales on unseen CQA benchmarks. |
OmniAlign-V: Towards Enhanced Alignment of MLLMs with Human Preference (2025.acl-long)
Copied to clipboard
Xiangyu Zhao, Shengyuan Ding, Zicheng Zhang, Haian Huang, Maosongcao Maosongcao, Jiaqi Wang, Weiyun Wang, Xinyu Fang, Wenhai Wang, Guangtao Zhai, Hua Yang, Haodong Duan, Kai Chen
| Challenge: | Existing open-source multi-modal large language models (MLLMs) focus on enhancing foundational capabilities, leaving a significant gap in human preference alignment. |
| Approach: | They propose a dataset of 200K high-quality training samples featuring diverse images, complex questions, and varied response formats to improve MLLMs’ alignment with human preferences. |
| Outcome: | The proposed dataset of 200K high-quality training samples improves human preference alignment while maintaining or enhancing performance on standard VQA benchmarks. |
CLEVA: Chinese Language Models EVAluation Platform (2023.emnlp-demo)
Copied to clipboard
Yanyang Li, Jianqiao Zhao, Duo Zheng, Zi-Yuan Hu, Zhi Chen, Xiaohui Su, Yongfeng Huang, Shijia Huang, Dahua Lin, Michael Lyu, Liwei Wang
| Challenge: | Large language models (LLMs) have revolutionized natural language processing. |
| Approach: | They propose a Chinese-based platform that assesses Chinese LLMs using a standardized workflow and a unique sampling strategy. |
| Outcome: | CLEVA evaluates Chinese LLMs on a standardized workflow and a competitive leaderboard with minimal coding. |
Infrared-LLaVA: Enhancing Understanding of Infrared Images in Multi-Modal Large Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for infrared modeling ignore supervisory signals of infra-modality-specific attributes, which may lead to biased understanding of in-frarea images. |
| Approach: | They propose a multi-agent generation system which transfers knowledge from visible images to generate infrared image-text pairs and infra-instructional data. |
| Outcome: | The proposed system generates infrared image-text pairs and infra-response data and is able to answer common infreas tasks with the proposed model. |
KuiLeiXi: a Chinese Open-Ended Text Adventure Game (2021.acl-demo)
Copied to clipboard
Yadong Xi, Xiaoxi Mao, Le Li, Lei Lin, Yanjiang Chen, Shuhan Yang, Xuhan Chen, Kailun Tao, Zhi Li, Gongzheng Li, Lin Jiang, Siyan Liu, Zeng Zhao, Minlie Huang, Changjie Fan, Zhipeng Hu
| Challenge: | Recent advances in pre-trained language models have made it possible to generate human-like text. |
| Approach: | They propose to integrate an open-ended text adventure game in Chinese, named KuiLeiXi, where players interact with the AI until the plot goals are reached. |
| Outcome: | The proposed game lacks incentives and relies on players to explore on their own. |
SpeechLLM-as-Judges: Towards General and Interpretable Speech Quality Evaluation (2026.acl-long)
Copied to clipboard
Hui Wang, Jinghua Zhao, Yifan Yang, Shujie Liu, Junyang Chen, Yanzhe Zhang, Shiwan Zhao, Jinyu Li, Jiaming Zhou, Haoqin Sun, Yan Lu, Yong Qin
| Challenge: | Existing methods for evaluating the perceptual quality of synthetic speech are limited due to the complexity of perceptual quality factors and the diversity of speech generation tasks. |
| Approach: | They propose a new paradigm for enabling large language models to conduct structured speech quality evaluation using a large-scale dataset. |
| Outcome: | The proposed model performs well across tasks and languages. |
Memory-augmented Query Reconstruction for LLM-based Knowledge Graph Reasoning (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods that confuse tool utilization with knowledge reasoning harm readability and give rise to tool invocation hallucinations. |
| Approach: | They propose to decouple LLM from tool invocation tasks by establishing a memory module with explicit descriptions of query statements and a query memory module to facilitate the KGQA process. |
| Outcome: | The proposed method achieves state-of-the-art on WebQSP and CWQ benchmarks. |
T-Eval: Evaluating the Tool Utilization Capability of Large Language Models Step by Step (2024.acl-long)
Copied to clipboard
Zehui Chen, Weihua Du, Wenwei Zhang, Kuikun Liu, Jiangning Liu, Miao Zheng, Jingming Zhuo, Songyang Zhang, Dahua Lin, Kai Chen, Feng Zhao
| Challenge: | Existing studies evaluate the tool utilization ability of large language models based on the final output or only consider the single-step tool calling. |
| Approach: | They propose a new approach to evaluate the tool utilization capability of large language models (LLMs) they decompose the tool usage into multiple sub-processes, including instruction following, planning, reasoning, retrieval, understanding, and review. |
| Outcome: | The proposed model exhibits consistency with the outcome-oriented evaluation and provides a more fine-grained analysis of the capabilities of LLMs. |
The Knowledge Microscope: Features as Better Analytical Lenses than Neurons (2025.acl-long)
Copied to clipboard
| Challenge: | Recent studies have shown that features are superior analytical units for understanding factual knowledge in Language Models. |
| Approach: | They propose a feature-based editing method that decomposes neurons into features rather than neurons to understand the mechanisms of factual knowledge in Language Models. |
| Outcome: | The proposed method demonstrates superior performance over neuron-based approaches in erasing privacy-sensitive information from LMs. |
CYCLE-INSTRUCT: Fully Seed-Free Instruction Tuning via Dual Self-Training and Cycle Consistency (2025.emnlp-main)
Copied to clipboard
Zhanming Shen, Hao Chen, Yulei Tang, Shaolin Zhu, Wentao Ye, Xiaomeng Hu, Haobo Wang, Gang Chen, Junbo Zhao
| Challenge: | Existing methods for instruction tuning rely on expensive human-annotated seed data or powerful external teacher models. |
| Approach: | They propose a framework that achieves fully seed-free instruction tuning by employing a dual self-training loop where two models are bootstrapped solely from raw, unlabeled text. |
| Outcome: | The proposed framework outperforms seed-driven back-translation baselines and achieves comparable performance to strongly supervised methods. |