Papers by Qiao Qiao
Improving Knowledge Graph Completion with Generative Hard Negative Mining (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for knowledge graph completion (KGC) use generative methods with a self-information-enhanced training strategy to generate high-quality negatives. |
| Approach: | They propose to leverage a sequence-to-sequence architecture to generate high-quality hard negatives from the same decoding distributions as the anchor. |
| Outcome: | The proposed method produces high-quality negatives with good hardness and diversity on three KGC benchmarks. |
We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning? (2025.acl-long)
Copied to clipboard
Runqi Qiao, Qiuna Tan, Guanting Dong, MinhuiWu MinhuiWu, Chong Sun, Xiaoshuai Song, Jiapeng Wang, Zhuoma GongQue, Shanglin Lei, YiFan Zhang, Zhe Wei, Miaoxuan Zhang, Runfeng Qiao, Xiao Zong, Yida Xu, Peiqing Yang, Zhimin Bao, Muxi Diao, Chen Li, Honggang Zhang
| Challenge: | Existing benchmarks focus more on end-to-end performance, but neglect the underlying principles of knowledge acquisition and generalization. |
| Approach: | They propose a benchmark specifically designed to explore the problem-solving principles by decomposing 6.5K visual math problems into 10.9K step-level questions for evaluation. |
| Outcome: | The proposed benchmark covers 6.5K visual math problems and 10.9K step-level questions spanning 5 layers of knowledge granularity and 67 hierarchical knowledge concepts. |
Agentic Knowledgeable Self-awareness (2025.acl-long)
Copied to clipboard
Shuofei Qiao, Zhisong Qiu, Baochang Ren, Xiaobin Wang, Xiangyuan Ru, Ningyu Zhang, Xiang Chen, Yong Jiang, Pengjun Xie, Fei Huang, Huajun Chen
| Challenge: | Large Language Models (LLMs) have achieved considerable performance across various agentic planning tasks. |
| Approach: | They propose a data-centric approach that applies agents with knowledgeable self-awareness like humans to a heuristic situation judgement criterion to mark special tokens on their self-explored trajectories for collecting training data. |
| Outcome: | The proposed paradigm outperforms baseline models on various tasks with minimal external knowledge. |
Towards Self-Evolving Agents: Enabling Autonomy through Interactive Experience Refinement (2026.findings-acl)
Copied to clipboard
Cheng Yang, Xuemeng Yang, Licheng Wen, Daocheng Fu, Jianbiao Mei, Rong Wu, Pinlong Cai, Yufan Shen, Nianchen Deng, Jia Xu, Botian Shi, Yu Qiao, Haifeng Li
| Challenge: | Large Language Models struggle with complex, multi-step operational tasks because they remain static during inference and cannot learn from past experience. |
| Approach: | They propose a framework that organizes cross-domain insights to facilitate orchestration of long-horizon workflows. |
| Outcome: | The proposed framework outperforms existing methods on the TAC productivity benchmark and shows strong cross-task transferability. |
KnowRL: Exploring Knowledgeable Reinforcement Learning for Factuality (2026.acl-long)
Copied to clipboard
| Challenge: | Existing Reinforcement Learning approaches rely on outcome-oriented rewards to reinforce fabricated reasoning paths when the final answer is correct. |
| Approach: | They propose a framework that integrates factual supervision directly into reasoning . they propose to decompose chain of thought into atomic facts and verify them against ground-truth knowledge . |
| Outcome: | The proposed framework reduces the Incorrect Rate on SimpleQA by 20.3% while maintaining strong performance on complex reasoning benchmarks. |
R2A-TLS: Reflective Retrieval-Augmented Timeline Summarization with Causal-Semantic Integration (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods struggle to capture coherent event narratives due to fragmented descriptions . Existing approaches accumulate noise through iterative retrieval strategies that lack relevance evaluation. |
| Approach: | They propose a reflective retrieval-augmented timeline summarization with Causal-Semantic Intergration approach for open-domain timeline summarizing . |
| Outcome: | The proposed approach outperforms the best prior published approaches. |
Dolphin: Moving Towards Closed-loop Auto-research through Thinking, Practice, and Feedback (2025.acl-long)
Copied to clipboard
Jiakang Yuan, Xiangchao Yan, Bo Zhang, Tao Chen, Botian Shi, Wanli Ouyang, Yu Qiao, Lei Bai, Bowen Zhou
| Challenge: | Recent studies show that AI-assisted research methods can improve research efficiency . a closed-loop framework is used to enhance the automation level of scientific research . |
| Approach: | They propose a closed-loop LLM-driven framework to enhance the automation level of scientific research. |
| Outcome: | The proposed framework improves the efficiency of scientific research by improving data analysis, accelerating computation, and fostering novel idea generation. |
Disentangled Multi-span Evolutionary Network against Temporal Knowledge Graph Reasoning (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for temporal knowledge Graphs neglect internal structural interactions between subgraphs and ignore potential smooth features that do not lead to semantic changes. |
| Approach: | They propose to use a disentangled multi-span evolutionary network to capture local neighbor features while perceiving historical neighbor semantic information. |
| Outcome: | Extensive experiments show that the proposed model outperforms the state-of-the-art in TKG reasoning by 22.7%. |
FinToolSyn: A forward synthesis Framework for Financial Tool-Use Dialogue Data with Dynamic Tool Retrieval (2026.findings-acl)
Copied to clipboard
Caishuang Huang, Yang Qiao, Rongyu Zhang, Junjie Ye, Pu Lu, null Wuwenxi, Meng Zhou, Xiku Du, Qi Zhang, Tao Gui, Xuanjing Huang
| Challenge: | Existing data synthesis methods rely on static tools to generate queries . this approach fails to capture the implicit, event-driven nature of real-world needs . |
| Approach: | They propose a forward synthesis framework to generate high-quality financial dialogues . they construct a repository of 43,066 tools and synthesize over 148k dialogue instances . |
| Outcome: | Experiments show that models trained on FinToolSyn achieve a 21.06% improvement . the framework is designed to generate high-quality financial dialogues . |
LightThinker: Thinking Step-by-Step Compression (2025.emnlp-main)
Copied to clipboard
Jintian Zhang, Yuqi Zhu, Mengshu Sun, Yujie Luo, Shuofei Qiao, Lun Du, Da Zheng, Huajun Chen, Ningyu Zhang
| Challenge: | Recent advances in Large Language Models have demonstrated their remarkable capabilities in complex reasoning tasks, but their efficiency is hindered by the substantial memory and computational costs associated with generating lengthy tokens. |
| Approach: | They propose a method that dynamically compresses verbose thought steps into compact representations and discards original reasoning chains. |
| Outcome: | The proposed method reduces peak memory usage and inference time while maintaining competitive accuracy. |
Towards Better Hierarchical Text Classification with Data Generation (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to improve hierarchical text classification are expensive and lack high-quality labeled data. |
| Approach: | They propose a hierarchical text classification framework that can achieve both label controllability and text diversity by extracting high-quality hierarchic label information. |
| Outcome: | The proposed method can achieve label controllability and text diversity by extracting high-quality hierarchical label information. |
FOLIO: Natural Language Reasoning with First-Order Logic (2024.emnlp-main)
Copied to clipboard
Simeng Han, Hailey Schoelkopf, Yilun Zhao, Zhenting Qi, Martin Riddell, Wenfei Zhou, James Coady, David Peng, Yujie Qiao, Luke Benson, Lucy Sun, Alexander Wardle-Solano, Hannah Szabó, Ekaterina Zubova, Matthew Burtell, Jonathan Fan, Yixin Liu, Brian Wong, Malcolm Sailor, Ansong Ni, Linyong Nan, Jungo Kasai, Tao Yu, Rui Zhang, Alexander Fabbri, Wojciech Kryscinski, Semih Yavuz, Ye Liu, Xi Lin, Shafiq Joty, Yingbo Zhou, Caiming Xiong, Rex Ying, Arman Cohan, Dragomir Radev
| Challenge: | Existing benchmarks for logical reasoning in large language models lack language naturalness or limited complexity. |
| Approach: | They propose to use first-order logic annotations to evaluate logical reasoning capabilities of large language models. |
| Outcome: | The proposed dataset evaluates the FOL reasoning ability of supervised fine-tuning on medium-sized language models. |
Enabling Stroke-Level Structural Analysis of Hieroglyphic Scripts without Language-Specific Priors (2026.findings-acl)
Copied to clipboard
Fuwen Luo, Zihao Wan, Ziyue Wang, Yaluo Liu, Pau Tong Lin Xu, Xuanjia Qiao, Xiaolong Wang, Peng Li, Yang Liu
| Challenge: | Existing structural analysis methods for hieroglyphic scripts are script-specific and labor-intensive. |
| Approach: | They propose a hieroglyphic Stroke Analyzer framework that captures character-internal structures and semantics without handcrafted data. |
| Outcome: | The proposed framework captures character-internal structures and semantics without priors . it can be used to generalize hieroglyphic scripts across languages . |
Benchmarking Retrieval-Augmented Generation for Medicine (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have state-of-the-art performance on a wide range of medical question answering tasks, but they still face challenges with hallucinations and outdated knowledge. |
| Approach: | They propose a benchmark to evaluate medical RAG systems using large-scale experiments with over 1.8 trillion prompt tokens. |
| Outcome: | The proposed benchmark improves accuracy of six different LLMs by up to 18% over chain-of-thought prompting. |
Neural Models for Reasoning over Multiple Mentions Using Coreference (N18-2)
Copied to clipboard
| Challenge: | Existing Recurrent Neural Network (RNN) layers are biased towards short-term dependencies and hence not suited to such tasks. |
| Approach: | They propose a recurrent layer which is instead biased towards coreferent dependencies and uses coreference annotations extracted from an external system to connect entity mentions belonging to the same cluster. |
| Outcome: | The proposed layer improves performance on Wikihop, LAMBADA and the bAbi AI datasets with large gains when training data is scarce. |
MINER: Improving Out-of-Vocabulary Named Entity Recognition from an Information Theoretic Perspective (2022.acl-long)
Copied to clipboard
Xiao Wang, Shihan Dou, Limao Xiong, Yicheng Zou, Qi Zhang, Tao Gui, Liang Qiao, Zhanzhan Cheng, Xuanjing Huang
| Challenge: | Named Entity Recognition models are feature-engineering and machine learning based. |
| Approach: | They propose a new NER learning framework that uses entity mentions to improve model performance. |
| Outcome: | The proposed model achieves better performance on OOV entities on various settings and datasets. |
HYDEN: Hyperbolic Density Representations for Medical Images and Reports (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for visual semantic representation learning struggle to address semantic uncertainty, especially in the medical domain. |
| Approach: | They propose a hyperbolic density embedding based image-text representation learning approach tailored for specific medical domain data. |
| Outcome: | The proposed method performs better than baseline methods on zero-shot tasks and fine-tuning tasks on different datasets. |
Uncovering Scaling Laws for Large Language Models via Inverse Problems (2025.findings-emnlp)
Copied to clipboard
Arun Verma, Zhaoxuan Wu, Zijian Zhou, Xiaoqiang Lin, Zhiliang Chen, Rachael Hwee Ling Sim, Rui Qiao, Jingtan Wang, Nhung Bui, Xinyuan Niu, Wenyang Hu, Gregory Kang Ruey Lau, Zi-Yu Khoo, Zitong Zhao, Xinyi Xu, Apivich Hemachandra, See-Kiong Ng, Bryan Kian Hsiang Low
| Challenge: | Large Language Models (LLMs) have achieved remarkable success across diverse domains. |
| Approach: | inverse problems can efficiently uncover scaling laws that guide the building of LLMs, authors argue . authors propose brute-force approaches to improve LLM training costs due to high costs . |
| Outcome: | This paper advocates that inverse problems can efficiently uncover scaling laws that guide the building of LLMs to achieve the desirable performance with significantly better cost-effectiveness. |
HacRED: A Large-Scale Relation Extraction Dataset Toward Hard Cases in Practical Applications (2021.findings-acl)
Copied to clipboard
Qiao Cheng, Juntao Liu, Xiaoye Qu, Jin Zhao, Jiaqing Liang, Zhefeng Wang, Baoxing Huai, Nicholas Jing Yuan, Yanghua Xiao
| Challenge: | Relation extraction (RE) is an essential topic in natural language processing and has attracted extensive attention. |
| Approach: | They propose a case-oriented construction framework to build a hard case relation extraction dataset with 65,225 relational facts annotated from 9,231 documents. |
| Outcome: | The proposed model achieves a high 96% F1 score on data quality and is far lower than humans. |
CrisisTS: Coupling Social Media Textual Data and Meteorological Time Series for Urgency Classification (2025.acl-long)
Copied to clipboard
| Challenge: | Existing studies on fusion of texts and tabular-based time series to improve performance of NLP applications have focused on coupling texts with tabular time series. |
| Approach: | They propose a multimodal and multilingual dataset for urgency classification that allows for temporal and location alignment even in the absence of location mention in the text. |
| Outcome: | The proposed dataset outperforms text-only models in many applications while ensuring model generalizability. |
Grafting Pre-trained Models for Multimodal Headline Generation (2022.emnlp-industry)
Copied to clipboard
| Challenge: | Existing approaches to generate video headlines with pre-trained language models are labor intensive and impractical. |
| Approach: | They propose to graft the encoder from the pre-trained video-language model on the generative pre-trainer model and propose a consensus fusion mechanism for the integration of different components. |
| Outcome: | The proposed model achieves strong results on a brand-new dataset collected from real-world applications. |
SCE: Semantic Consistency Enhanced Reinforcement Learning for Multi-Hop Knowledge Graph Reasoning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to multihop reasoning fail to address the problem of spurious paths . existing approaches neglect the internal semantic consistency of the reward function . |
| Approach: | They propose a framework that incorporates semantic consistency into the reward function to guide multi-hop reasoning. |
| Outcome: | The proposed framework outperforms baseline methods and facilitates more interpretable reasoning paths. |
UFO: A UI-Focused Agent for Windows OS Interaction (2025.naacl-long)
Copied to clipboard
Chaoyun Zhang, Liqun Li, Shilin He, Xu Zhang, Bo Qiao, Si Qin, Minghua Ma, Yu Kang, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang, Qi Zhang
| Challenge: | UFO is a UI-Fcused agent designed to fulfill user requests tailored to Windows OS applications . it decomposes user requests using divide-and-conquer approach, enabling seamless navigation and addressing sub-tasks across multiple applications. |
| Approach: | They propose a UI-Fcused Windows OS agent that decomposes user requests using a divide-and-conquer approach and incorporates a control interaction module tailored for Windows OS. |
| Outcome: | The proposed agent decomposes user requests using divide-and-conquer approach, enabling seamless navigation and addressing sub-tasks across multiple applications. |
GEMS: Generation-Based Event Argument Extraction via Multi-perspective Prompts and Ontology Steering (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for event argument extraction rely on a single prompt . existing methods ignore complex structural and dynamic interdependencies between event arguments . |
| Approach: | They propose a multi-prompt learning framework that generates event arguments via multi-perspective prompts and ontology steering. |
| Outcome: | The proposed framework captures interrelationships between arguments and ontology steering . it uses multiple unfilled prompts for each sentence to generate event arguments . |
CB-Whisper: Contextual Biasing Whisper Using Open-Vocabulary Keyword-Spotting (2024.lrec-main)
Copied to clipboard
Yuang Li, Yinglu Li, Min Zhang, Chang Su, Jiawei Yu, Mengyao Piao, Xiaosong Qiao, Miaomiao Ma, Yanqing Zhao, Hao Yang
| Challenge: | End-to-end automatic speech recognition systems struggle to recognize rare name entities such as personal names, organizations and terminologies that are not frequently encountered in the training data. |
| Approach: | They propose a convolutional neural network-based ASR system that performs open-vocabulary keyword-spotting before the decoder to match the features between the entities and the utterances. |
| Outcome: | The proposed system significantly improves mixed-error-rate (MER) and entity recall compared to the original Whisper model on three internal datasets and two publicly available datasets. |
MMRC: A Large-Scale Benchmark for Understanding Multimodal Large Language Model in Real-World Conversation (2025.acl-long)
Copied to clipboard
Haochen Xue, Feilong Tang, Ming Hu, Yexin Liu, Qidong Huang, Yulong Li, Chengzhi Liu, Zhongxing Xu, Chong Zhang, Chun-Mei Feng, Yutong Xie, Imran Razzak, Zongyuan Ge, Jionglong Su, Junjun He, Yu Qiao
| Challenge: | Existing multimodal large language models lack the ability to memorize, recall, and reason in sustained interactions. |
| Approach: | They propose a multimodal real-world conversation benchmark for evaluating open-ended abilities of multimodal large language models. |
| Outcome: | The proposed benchmarks show that the models perform better in open-ended conversations. |
SMHD-GER: A Large-Scale Benchmark Dataset for Automatic Mental Health Detection from Social Media in German (2023.findings-eacl)
Copied to clipboard
| Challenge: | Mental health problems are a challenge to our modern society, and their prevalence is predicted to increase worldwide. |
| Approach: | They propose a large-scale, carefully constructed dataset for MHC detection built on high-precision patterns and the approach proposed for English. |
| Outcome: | The proposed model leverages engineered (psycho-)linguistic features as well as BERT-German to facilitate further research and conduct extensive experiments. |
ConCISE: Confidence-guided Compression in Step-by-step Efficient Reasoning (2025.emnlp-main)
Copied to clipboard
Ziqing Qiao, Yongheng Deng, Jiali Zeng, Dong Wang, Lai Wei, Guanbo Wang, Fandong Meng, Jie Zhou, Ju Ren, Yaoxue Zhang
| Challenge: | Existing methods for fine-tuning-based compression suffer from verbose outputs, increasing computational overhead. |
| Approach: | They propose a framework to generate concise reasoning chains using Confidence Injection and Early Stopping. |
| Outcome: | The proposed framework reduces the length of the model by up to 50% while maintaining high task accuracy. |
Balancing Fidelity and Plasticity: Aligning Mixed-Precision Fine-Tuning with Linguistic Hierarchies (2026.findings-acl)
Copied to clipboard
Changhai Zhou, Shiyang Zhang, Yuhua Zhou, Jun Gao, Qian Qiao, Shichao Weng, Weizhong Zhang, Cheng Jin
| Challenge: | Existing quantization-aware fine-tuning methods decouple weight precision and adapter capacity, overlooking that a layer’s ability to adapt is constrained by the information preserved in its frozen weights. |
| Approach: | They propose a framework that jointly optimizes per-layer quantization bit-width and LoRA rank. |
| Outcome: | Experiments on LLaMA and Qwen models show that the proposed framework matches or approaches 16-bit baselines while using substantially less memory. |
DecoupleSearch: Decouple Planning and Search via Hierarchical Reward Modeling (2025.emnlp-main)
Copied to clipboard
Hao Sun, Zile Qiao, Bo Wang, Guoxin Chen, Yingyan Hou, Yong Jiang, Pengjun Xie, Fei Huang, Yan Zhang
| Challenge: | Retrieval-Augmented Generation (RAG) systems have emerged as a pivotal methodology for enhancing Large Language Models (LLMs). |
| Approach: | They propose a framework that decouples planning and search processes using dual value models, enabling independent optimization of plan reasoning and search grounding. |
| Outcome: | The proposed framework decouples planning and search processes using dual value models, enabling independent optimization of plan reasoning and search grounding. |
P-FOLIO: Evaluating and Improving Logical Reasoning with Abundant Human-Written Reasoning Chains (2024.findings-emnlp)
Copied to clipboard
Simeng Han, Aaron Yu, Rui Shen, Zhenting Qi, Martin Riddell, Wenfei Zhou, Yujie Qiao, Yilun Zhao, Semih Yavuz, Ye Liu, Shafiq Joty, Yingbo Zhou, Caiming Xiong, Dragomir Radev, Rex Ying, Arman Cohan
| Challenge: | Existing methods on understanding the capabilities of LLMs in logical reasoning rely on binary entailment classification or synthetically derived rationales. |
| Approach: | They propose to annotate a human-annotated dataset consisting of diverse and complex reasoning chains for a set of realistic logical reasoning stories also written by humans. |
| Outcome: | The proposed model outperforms existing methods on understanding the capabilities of LLMs in logical reasoning by 10% or more. |
GenPoE: Generative Passage-level Mixture of Experts for Knowledge Enhancement of LLMs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | GenPoE is a passage-level mixture of experts for enhancing knowledge of large language models. |
| Approach: | They propose a novel “generative” passage-level mixture of experts (MoEs) that takes in-context retrieved passages and generates their “expert” parameters. |
| Outcome: | The proposed system is based on a novel hypernetwork which takes in-context retrieved passages and generates their "expert'' parameters. |
Mixture-of-Minds: Multi-Agent Reinforcement Learning for Table Understanding (2026.acl-long)
Copied to clipboard
Yuhang Zhou, Mingrui Zhang, Ke Li, Mingyi Wang, Qiao Liu, Qifei Wang, Jiayi Liu, Fei Liu, Serena Li, Weiwei LI, Mingze Gao, Abhishek Kumar, Xiangjun Fan, Zhuokai Zhao, Lizhu Zhang
| Challenge: | Large language models (LLMs) have shown promise on understanding and reasoning over tables, but current approaches remain limited. |
| Approach: | They propose a multi-agent framework that decomposes table reasoning into three specialized roles: planning, coding, and answering. |
| Outcome: | The proposed framework decomposes table reasoning into three specialized roles: planning, coding, and answering. |
Flooding-X: Improving BERT’s Resistance to Adversarial Attacks via Loss-Restricted Fine-Tuning (2022.acl-long)
Copied to clipboard
Qin Liu, Rui Zheng, Bao Rong, Jingyi Liu, ZhiHua Liu, Zhanzhan Cheng, Liang Qiao, Tao Gui, Qi Zhang, Xuanjing Huang
| Challenge: | Existing approaches to generating adversarial perturbations scale up the cost of training computational complexity by the number of gradient steps it takes to obtain the adversarials. |
| Approach: | They propose a flood method which aims at better generalization and a criterion to bring hyper-parameter-dependent flooding into effect with a narrowed-down search space by measuring how the gradient steps taken within one epoch affect the loss of each batch. |
| Outcome: | The proposed method improves BERT’s resistance to textual adversarial attacks by a large margin and achieves state-of-the-art robust accuracy on various text classification and GLUE tasks. |
LLM Reasoning as Trajectories: Step-Specific Representation Geometry and Correctness Signals (2026.acl-long)
Copied to clipboard
| Challenge: | Existing models generate tokens by updating high-dimensional representations and decoding from them at each timestep. |
| Approach: | They propose a framework that allows reasoning correction and length control based on derived ideal trajectories. |
| Outcome: | The proposed model can predict correctness and length control based on ideal trajectories. |
Vision-and-Language Navigation with Analogical Textual Descriptions in LLMs (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing zero-shot LLM-based Vision-and-Language Navigation agents either encode images as textual scene descriptions, potentially oversimplifying visual details, or process raw image inputs, which can fail to capture abstract semantics required for high-level reasoning. |
| Approach: | They propose to integrate large language models into embodied AI models by incorporating textual descriptions that facilitate analogical reasoning across images from multiple perspectives. |
| Outcome: | The proposed approach improves the agent’s contextual understanding on the R2R dataset, showing that it can make better decisions based on the LLMs. |
DISC: Plug-and-Play Decoding Intervention with Similarity of Characters for Chinese Spelling Check (2025.acl-long)
Copied to clipboard
Ziheng Qiao, Houquan Zhou, Yumeng Liu, Zhenghua Li, Min Zhang, Bo Zhang, Chen Li, Ji Zhang, Fei Huang
| Challenge: | Chinese spelling check (CSC) tasks require that incorrect characters are usually similar to the correct ones in either phonetics or glyph. |
| Approach: | They propose a plug-and-play decoding intervention with similarity of characters module for Chinese spelling check (CSC) they propose to incorporate phonetic and glyph similarities only during the inference phase. |
| Outcome: | The proposed method significantly improves Chinese spelling check models on benchmarks and on benchmark datasets. |
SmartSpanNER: Making SpanNER Robust in Low Resource Scenarios (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) is one of the most fundamental tasks in natural language processing. |
| Approach: | They propose a method which introduces a Named Entity Head (NEH) prediction task to SpanNER and performs multi-task learning together with task of span classification. |
| Outcome: | The proposed method improves the robustness of SpanNER in low resource scenarios on the CoNLL03, Few-NERD, GENIA and ACE05 benchmark datasets. |
Sparrow: Text-Anchored Window Attention with Visual-Semantic Glimpsing for Speculative Decoding in Video LLMs (2026.acl-long)
Copied to clipboard
| Challenge: | Existing speculative decoding models face performance collapse due to key-value cache explosion and context window mismatches. |
| Approach: | They propose a framework that offloads visual computation to the target model by using hidden state reuse. |
| Outcome: | The proposed framework achieves an average speedup of 2.82x even with 25k visual tokens . |
Rumor Detection on Social Media with Crowd Intelligence and ChatGPT-Assisted Networks (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing research on rumor detection challenges the expressive power of text encoding sequences, and insufficient mining of semantic structural information. |
| Approach: | They propose a Crowd Intelligence-based semantic feature learning module to capture textual content’s sequential and hierarchical features and a knowledge-based structural mining module that leverages ChatGPT for knowledge enhancement. |
| Outcome: | The proposed system achieves performance improvement in rumor detection tasks validating the effectiveness and rationality of using large language models as auxiliary tools. |
GenDecider: Integrating “None of the Candidates” Judgments in Zero-Shot Entity Linking Re-ranking (2024.naacl-short)
Copied to clipboard
| Challenge: | Existing methods for zero-shot reranking assume the correct entity is always among the retrieved candidates. |
| Approach: | They propose a novel re-ranking approach for Zero-Shot Entity Linking . they use the Llama model to detect scenarios where the correct entity is not retrieved . |
| Outcome: | The proposed approach significantly improves disambiguation and accuracy on the ZESHEL dataset. |
Fake Alignment: Are LLMs Really Aligned Well? (2024.naacl-long)
Copied to clipboard
Yixu Wang, Yan Teng, Kexin Huang, Chengqi Lyu, Songyang Zhang, Wenwei Zhang, Xingjun Ma, Yu-Gang Jiang, Yu Qiao, Yingchun Wang
| Challenge: | Existing studies on large language models have shown that they are poorly aligned in practice. |
| Approach: | They propose a framework to evaluate safety in large language models . they propose two new metrics to quantify fake alignment and obtain corrected performance estimation. |
| Outcome: | The proposed framework and two metrics show that some models with purported safety are poorly aligned in practice. |
Leveraging Key Information Modeling to Improve Less-Data Constrained News Headline Generation via Duality Fine-Tuning (2022.aacl-main)
Copied to clipboard
| Challenge: | Recent language generative models are mostly trained on large-scale datasets, while in some real scenarios, the training datasets are often expensive and would be small-scale. |
| Approach: | They propose a novel duality fine-tuning method to capture more information from limited data and build connections between tasks. |
| Outcome: | The proposed method can capture more information from limited data, build connections between separate tasks, and is suitable for less-data constrained generation tasks. |
Enhancing Nursing and Elderly Care with Large Language Models: An AI-Driven Framework (2025.coling-main)
Copied to clipboard
| Challenge: | Experimental results demonstrate significant improvements, paving the way for AI-driven solutions to meet the growing demands of healthcare in aging populations. |
| Approach: | They introduce a Chinese nursing dataset and implement incremental pre-training and supervised fine-tuning techniques to enhance LLM performance in specialized tasks. |
| Outcome: | The proposed model performs better in real-time patient monitoring and interaction tasks than previous models. |
TAGQuant: Token-Aware Clustering for Group-Wise Quantization (2026.eacl-industry)
Copied to clipboard
| Challenge: | Existing work clusters channels using token dimension, which is suboptimal for grouping . a common challenge in LLM quantization is supporting "group-wise" quantization . |
| Approach: | They propose a method to group channels with similar activation distributions using tokens . they propose shuffle operation that reduces relative GSM8K error by 86% . |
| Outcome: | The proposed method reduces GSM8K error by 86% in both INT4 and MXFP4 formats compared to baselines . |
AutoAct: Automatic Agent Learning from Scratch for QA via Self-Planning (2024.acl-long)
Copied to clipboard
Shuofei Qiao, Ningyu Zhang, Runnan Fang, Yujie Luo, Wangchunshu Zhou, Yuchen Jiang, Chengfei Lv, Huajun Chen
| Challenge: | Existing language agent systems struggle with costly data reliance and need multiple models for multiple functions. |
| Approach: | They propose an automatic agent learning framework for QA that synthesizes planning trajectories without human intervention. |
| Outcome: | The proposed framework outperforms existing models on question-answering tasks with a division-of-labor strategy. |
Memp: Exploring Agent Procedural Memory (2026.findings-acl)
Copied to clipboard
Runnan Fang, Yuan Liang, Xiaobin Wang, Jialong Wu, Shuofei Qiao, Pengjun Xie, Fei Huang, Huajun Chen, Ningyu Zhang
| Challenge: | Large Language Models (LLMs) based agents suffer from brittle procedural memory that is manually engineered or entangled in static parameters. |
| Approach: | They propose a procedural-memory repository that distills past agent trajectories into fine-grained, step-by-step instructions and higher-level, script-like abstractions. |
| Outcome: | The proposed repository can be used to improve agents' performance on travelplanner and Alfworld. |
TCPO: Thought-Centric Preference Optimization for Effective Embodied Decision-making (2025.emnlp-main)
Copied to clipboard
Kechen Jiao, Zhirui Fang, Jiahao Liu, Bei Li, Qifan Wang, Xinyu Liu, Junhao Ruan, Zhongjian Qiao, Yifan Zhu, Yaxin Xu, Jingang Wang, Xiu Li
| Challenge: | Existing post-SFT methods for embodied AI are constrained by sparse rewards and action-only optimization, resulting in low sample efficiency, poor consistency, and model degradation. |
| Approach: | They propose to integrate Thought-Centric Preference Optimization (TCPO) into embodied decision-making by transforming sparse reward signals into richer step sample pairs. |
| Outcome: | The proposed approach achieves an average success rate of 26.67% in the ALFWorld environment, and a 6% improvement over RL4VLM. |
KBM: Delineating Knowledge Boundary for Adaptive Retrieval in Large Language Models (2025.findings-emnlp)
Copied to clipboard
Zhen Zhang, Xinyu Wang, Yong Jiang, Zile Qiao, Zhuo Chen, Guangyu Li, Feiteng Mu, Mengting Hu, Pengjun Xie, Fei Huang
| Challenge: | Retrieval-augmented generation (RAG) is employed to tackle these challenges . a Knowledge Boundary Model (KBM) is used to express the known/unknown of a given question . |
| Approach: | They propose a Knowledge Boundary Model to express the known/unknown of a given question . they find that not all questions need to trigger RAG to improve performance . |
| Outcome: | The proposed model reduces time and computational costs by retrieving parts of unknown knowledge . the proposed model can express the known/unknown of a given question and determine whether a RAG needs to be triggered . |
LLM-based Rumor Detection via Influence Guided Sample Selection and Game-based Perspective Analysis (2025.acl-long)
Copied to clipboard
Zhiliang Tian, Jingyuan Huang, Zejiang He, Zhen Huang, Menglong Lu, Linbo Qiao, Songzhu Mei, Yijie Wang, Dongsheng Li
| Challenge: | Existing methods for rumor detection on social media are limited by limited modeling capacity and insufficient training corpora. |
| Approach: | They propose an SFT-based rumor detection model with Influence guided Sample selection and Game-based multi-perspective analysis to address these issues. |
| Outcome: | The proposed model outperforms existing SOTA on three datasets. |
Threshold-driven Pruning with Segmented Maximum Term Weights for Approximate Cluster-based Sparse Retrieval (2024.emnlp-main)
Copied to clipboard
| Challenge: | Using rank score thresholding, sparse retrieval skips the index at cluster and document levels. |
| Approach: | They propose a pruning control scheme with a probabilistic guarantee on rank-safeness competitiveness. |
| Outcome: | The proposed pruning control scheme improves accuracy and safeness while delivering low latency on single-threaded CPU. |
When Is Thinking Enough? Early Exit via Sufficiency Assessment for Efficient Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to early exit reasoning often rely on handcrafted or empirical indicators that are unreliable and impractical. |
| Approach: | They propose a framework that allows LRMs to assess the sufficiency of its chain-of-thought and determine the optimal point for early exit. |
| Outcome: | The proposed framework reduces reasoning length by 28.9%–34.9% with minimal performance loss, effectively mitigating overthinking. |
Inference-Time Language Model Alignment via Integrated Value Guidance (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models are fine-tuned to align with human preferences, but tuning large models is computationally intensive and complex. |
| Approach: | They propose a method that uses implicit and explicit value functions to guide language model decoding at token and chunk-level respectively. |
| Outcome: | The proposed method outperforms traditional methods and circumvents the complexities of fine-tuning. |
Towards Tracing Trustworthiness Dynamics: Revisiting Pre-training Period of Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing studies focus on pre-trained LLMs to better understand and improve their trustworthiness. |
| Approach: | They apply linear probing to LLMs to explore five key dimensions of trustworthiness: reliability, privacy, toxicity, fairness, and robustness. |
| Outcome: | The proposed model can distinguish concepts in each trustworthiness dimension, suggesting that it can be trained in early pre-training. |
Predicting Clinical Trial Results by Implicit Evidence Integration (2020.emnlp-main)
Copied to clipboard
| Challenge: | Clinical trials are expensive and time-consuming, and inappropriately designed studies can be devastating in a pandemic. |
| Approach: | They propose a model that takes a PICO-formatted clinical trial proposal and predicts the outcome from it. |
| Outcome: | The proposed model outperforms baseline models on a benchmark dataset with 10.7% relative gain over BioBERT. |
LLaMAX: Scaling Linguistic Horizons of LLM by Enhancing Translation Capabilities Beyond 100 Languages (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) exhibit exceptional translation capabilities in high-resource language tasks, yet their effectiveness in low-resourced languages is suboptimal. |
| Approach: | They conduct extensive multilingual continual pre-training on the LLaMA series models and develop LLiMAX for translation support across more than 100 languages. |
| Outcome: | The proposed model achieves higher translation performance than existing open-source models and performs on-par with specialized translation model on the Flores-101 benchmark. |
Progressive Planning and Reinforced Reasoning: Large Language Model-Guided Multi-hop Question Answering over Knowledge Graph (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to multi-hop question answering lack effective intermediate guidance and policy networks focus on local neighborhood information, making it difficult to anticipate the long-term consequences of decisions. |
| Approach: | They propose a framework that converts decomposed sub-question sequences into stepwise decision guidance and a structure-aware lookahead policy network to enhance the agent's global state awareness and decision foresight in complex environments. |
| Outcome: | The proposed framework surpasses state-of-the-art methods while showing strong generalization. |
Dr. Assistant: Enhancing Clinical Diagnostic Inquiry via Structured Diagnostic Reasoning Data and Reinforcement Learning (2026.findings-acl)
Copied to clipboard
Yue Guo, Fanfu Wang, Jianwei Lv, Xincheng Shi, Yuchen Li, Youya Wang, Yunsheng Zeng, Yujing Liu, Yunhao Qiao, Gen Li, Junfeng Wang, Bo Yuan
| Challenge: | Clinical Decision Support Systems (CDSSs) provide reasoning and inquiry guidance for physicians, yet they face high maintenance costs and low generalization capability. |
| Approach: | They propose a clinical diagnostic model with clinical reasoning and inquiry skills, the Dr. Assistant, and a pipeline to capture abstract reasoning logic. |
| Outcome: | The proposed model outperforms open-source models and achieves competitive performance to closed-source model. |
PersLEARN: Research Training through the Lens of Perspective Cultivation (2023.acl-demo)
Copied to clipboard
Yu-Zhe Shi, Shiqian Li, Xinyi Niu, Qiao Xu, Jiawen Liu, Yifan Xu, Shiyu Gu, Bingru He, Xinyang Li, Xinyu Zhao, Zijian Zhao, Yidong Lyu, Zhen Li, Sijia Liu, Lin Qiu, Jinhao Ji, Lecheng Ruan, Yuxi Ma, Wenjuan Han, Yixin Zhu
| Challenge: | PersLEARN is a tool designed to facilitate the cultivation of scientific perspectives . junior researchers struggle to identify the perspectives reflected in the literature and struggle to develop their own viewpoints. |
| Approach: | They propose a tool to facilitate the cultivation of scientific perspectives by interacting with a prompt-based model and allowing students to develop their own perspectives explicitly. |
| Outcome: | The proposed tool outperforms baseline approaches across multiple domains of literature from different perspectives. |
Suggest-Verify-Revise: A Three-Stage Document-Level Event Causality Identification with Narrative Consistency (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for document-level Event Causality Identification rely on local semantic similarity for independent event-pair discrimination . Existing approaches ignore the influence of the overall narrative backbone in the propagation of causal dependencies and the role differentiation of events within multi-cause/multi-effect structures. |
| Approach: | They propose a suggest-verify-revise approach for document-level Event Causality Identification with narrative consistency (SVRECI) they integrate heuristic causal suggestions generated by an LLM with structural suggestions derived from hypergraph modeling . |
| Outcome: | The proposed approach outperforms existing methods on event-storylines and Causal-TimeBank datasets. |
Reasoning with Language Model Prompting: A Survey (2023.acl-long)
Copied to clipboard
Shuofei Qiao, Yixin Ou, Ningyu Zhang, Xiang Chen, Yunzhi Yao, Shumin Deng, Chuanqi Tan, Fei Huang, Huajun Chen
| Challenge: | Reasoning is an essential ability for complex problem-solving and can provide back-end support for various real-world applications. |
| Approach: | They present cutting-edge research on reasoning with language model prompting and provide systematic resources to help beginners. |
| Outcome: | The proposed approaches have not been systematically reviewed and analyzed. |
SelfMix: Robust Learning against Textual Label Noise with Self-Mixup Training (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods to handle label noise in text classification tasks are limited to visual data. |
| Approach: | They propose a method to handle label noise in text classification tasks using a Gaussian Mixture Model. |
| Outcome: | The proposed method outperforms baselines on three types of text classification tasks on visual and textual data. |
Mitigating Context Interference for Reliable and Efficient Search Agents (2026.acl-long)
Copied to clipboard
Boyang Xue, Bin Wu, Shuofei Qiao, Sheng Wang, Rui Wang, Yiming Du, Hongru Wang, Jeff Z. Pan, Emine Yilmaz, Kam-Fai Wong, Aldo Lipani
| Challenge: | Recent research empowers Large Language Models (LLMs) as multi-turn search agents to iteratively retrieve and generate outputs until complex tasks are solved. |
| Approach: | They propose a distill-based context refiner to dynamically mitigate context interference . they also propose RLs that refine contexts to generate outputs . |
| Outcome: | The proposed refiner can mitigate context interference in multi-turn search agents. |
Multimodal Document-level Triple Extraction via Dynamic Graph Enhancement and Relation-Aware Reflection (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for extracting structured triples knowledge from multimodal documents face limitations in simultaneously processing long textual content and multiple associated images for triple extraction. |
| Approach: | They propose a multimodal document-level triple extraction framework that integrates multimodal text and visual content into a large language model and injects the global information and external knowledge into the model. |
| Outcome: | The proposed framework outperforms the state-of-the-art methods and fills the gap in multimodal document extraction. |
Breaking the Evaluation Paradox: Evaluating High-Entropy Search with Computationally Irreducible Constraints (2026.findings-acl)
Copied to clipboard
| Challenge: | a new framework for evaluation of exhaustive search capabilities is needed . high-entropy enumeration tasks make such ground truth impossible for humans to create . VERITAS is a framework built on the principle of computationally irreducible constraints . |
| Approach: | They propose a framework that uses non-optimizable constraints to create verifiable searches . VERITAS can generate infinite number of test cases with perfect ground truth and precise difficulty control . |
| Outcome: | a new evaluation framework for large language models is based on non-optimizable constraints . the framework can generate infinite number of test cases with perfect ground truth and precise difficulty control . |
Cross-Domain Audio Deepfake Detection: Dataset and Analysis (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing audio deepfake detection datasets are outdated and lack generalization capabilities. |
| Approach: | They construct a new cross-domain audio deepfake detection dataset comprising over 300 hours of speech data that is generated by five advanced zero-shot TTS models. |
| Outcome: | The proposed models achieve 4.1% and 6.5% error rates in the cross-domain ADD dataset generated by five advanced zero-shot TTS models. |
Assessing the Efficacy of Grammar Error Correction: A Human Evaluation Approach in the Japanese Context (2024.lrec-main)
Copied to clipboard
| Challenge: | Using an automatic annotation toolkit, we evaluated the performance of the sequence tagging grammar error detection and correction model (SeqTagger) using Japanese university students’ writing samples. |
| Approach: | They evaluated the performance of the state-of-the-art sequence tagging grammar error detection and correction model using Japanese university students’ writing samples. |
| Outcome: | The proposed model shows a high precision but conservativeness in error detection and correction. |
Understanding the Dynamics of Second Language Writing through Keystroke Logging and Complexity Contours (2020.lrec-1)
Copied to clipboard
| Challenge: | a large corpus of data on keystroke logging is available for research on literacy (reading and writing) this resource is a reflection of the urgent need to obtain ecologically valid data . |
| Approach: | They propose to use Etherpad's keystroke logging data to analyze complex texts . they propose to relate behavioral data to indices of syntactic and lexical complexity . |
| Outcome: | The proposed method aims to improve alignment between keystroke-logging measures and cognitive processes and L2 writing performance measures. |
Uncovering Main Causalities for Long-tailed Information Extraction (2021.emnlp-main)
Copied to clipboard
| Challenge: | Information Extraction (IE) aims to extract structural information from unstructured texts. |
| Approach: | They propose a framework that aims to uncover the main causalities behind data in the view of causal inference. |
| Outcome: | The proposed framework can detect the main causalities behind data in the view of causal inference. |
Lego-MT: Learning Detachable Models for Massively Multilingual Machine Translation (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing monolithic models for multilingual neural machine translation encounter parameter interference and inefficient inference for large models. |
| Approach: | They propose a detachable multi-way model that assigns each language to an individual branch . they use data from OPUS to build a translation benchmark covering 433 languages . |
| Outcome: | The proposed model outperforms existing models in OPUS and is faster than existing models. |
DeepKE: A Deep Learning Based Knowledge Extraction Toolkit for Knowledge Base Population (2022.emnlp-demos)
Copied to clipboard
Ningyu Zhang, Xin Xu, Liankuan Tao, Haiyang Yu, Hongbin Ye, Shuofei Qiao, Xin Xie, Xiang Chen, Zhoubo Li, Lei Li
| Challenge: | Existing knowledge extraction tools are not complete due to emerging entities and relations in real-world applications. |
| Approach: | They propose an open-source knowledge extraction toolkit DeepKE that supports low-resource, document-level and multimodal scenarios in the knowledge base population. |
| Outcome: | The proposed toolkit supports low-resource, document-level and multimodal scenarios in the knowledge base population. |
Attacks, Defenses and Evaluations for LLM Conversation Safety: A Survey (2024.naacl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are now commonplace in conversation applications, but their misuse for generating harmful responses has raised serious societal concerns. |
| Approach: | They provide a comprehensive overview of recent studies covering attacks, defenses, and evaluations of Large Language Models (LLMs) . |
| Outcome: | The proposed review summarizes three aspects of LLM conversation safety: attacks, defenses, and evaluations. |
CoRE: A Fine-Grained Code Reasoning Benchmark Beyond Output Prediction (2026.findings-acl)
Copied to clipboard
Jun Gao, Yun Peng, Qian Qiao, Changhai Zhou, Yuhua Zhou, Shiyang Zhang, Shichao Weng, Zhenchang Xing, Xiaoxue Ren
| Challenge: | Existing code reasoning benchmarks evaluate final output correctness under a single implementation. |
| Approach: | They propose a Code Reasoning benchmark that evaluates code reasoning through implementation invariance and process transparency. |
| Outcome: | The proposed benchmarks lack implementation invariance and process transparency . they observe superficial execution where models arrive at correct outputs without reasoning . |
Two-stage Generative Question Answering on Temporal Knowledge Graph Using Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Temporal knowledge graph question answering (TKGQA) is one of the most challenging QA tasks due to the temporal constraints hidden in questions and the answers sought from dynamic structured knowledge. |
| Approach: | They propose a generative temporal knowledge graph question answering framework which guides LLMs to answer temporal questions through two phases: Subgraph Retrieval and Answer Generation. |
| Outcome: | The proposed framework exploits LLM’s intrinsic knowledge to mine temporal constraints and structural links in the questions without extra training, thus narrowing down the subgraph search space in both temporal and structural dimensions. |
Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent approaches to language model alignment assume homogeneous human preferences, but actual human preferences vary widely and are hard to satisfy with a single language model. |
| Approach: | They propose an RL-free extension of Direct Preference Optimization (DPO) that folds language modeling directly into reward modeling and trains language models as collective reward models that combine all objectives with specific weights. |
| Outcome: | The proposed method matches or outperforms existing methods in safety alignment and long-form question answering. |
From Mimesis to Metamorphosis: Evolving VLM Judges via In-Context Comparing and Knowledge Internalization (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to subjective assessment are inconsistent and inconsistent due to inconsistent scales and inherent preference biases. |
| Approach: | They propose a framework that operationalizes subjective assessment as comparative analysis and internalizes it via Language Buttons. |
| Outcome: | The proposed framework achieves state-of-the-art performance across multiple benchmarks and is scale-steerable. |
Common Sense Beyond English: Evaluating and Improving Multilingual Language Models for Commonsense Reasoning (2021.acl-long)
Copied to clipboard
| Challenge: | Using multilingual language models, commonsense reasoning research has been limited to English. |
| Approach: | They propose a Mickey Probe task to evaluate commonsense across languages . they propose X-CSQA and XCODAH datasets to be translated to 14 languages based on the Mickey corpus . |
| Outcome: | The proposed method significantly improves sentence representations beyond English. |
Read Extensively, Focus Smartly: A Cross-document Semantic Enhancement Method for Visual Documents NER (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods to extract entities from visually-rich documents ignore the inherent multimodality of VRDs and thus the suboptimal results are achieved. |
| Approach: | They propose a multimodal semantic enhancement method that filters redundant information in the current document and a cross-document information awareness technique to enrich the entity-related context. |
| Outcome: | The proposed method outperforms existing methods on two documents understanding benchmarks covering eight languages. |
Natural-Language Policies to Executable Decisions: An Interpretable Large Language Model Framework (2026.acl-industry)
Copied to clipboard
Ziqiang Zhang, Jing Ma, Zilong Wang, Jiayuan Chen, Yi Qiao, Yu He, Wei Zhang, Dai Cheng, Xiaoyu Shen
| Challenge: | a production-grade pricing system for tourism is challenging due to unstructured nature of travel orders and ever-evolving pricing policies. |
| Approach: | They propose a production-grade pricing system with a strict decision boundary . they propose to combine structured extraction and bounded policy/path selection with interpretable condition trees . |
| Outcome: | The proposed system processed 3,960 orders in six months and reduced the order management team from 15-20 to 3 . the system reduced the per-order handling time from 10 minutes to 2 minutes. |
COMEM: In-Context Retrieval-Augmented Mass-Editing Memory in Large Language Models (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods for "knowledge editing" in large language models are inadequate . authors propose a method that can be used to update outdated information or correct false information . |
| Approach: | They propose a unified knowledge editing method called in-COntext retrieval-augmented Mass-Editing Memory . it incorporates retrieval augmented IKE, a novel extension of IKE designed for massive editing tasks . |
| Outcome: | The proposed method outperforms existing methods on the zsRE and CounterFact datasets. |
Calibrating Inference Time Alignment with Sequence-level Risk Accumulation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to decode large language models (LLMs) often over-reject benign information, limiting their generalizability in real-world scenarios where harmful and benign information coexist. |
| Approach: | They propose a framework to regulate decoding alignments for Large Language Models (LLMs) they employ a reward-guided branch decoding paradigm to incorporate safety awareness during generation. |
| Outcome: | The proposed framework achieves superior performance on four attack benchmarks and two neutral datasets. |
Beyond the Score: Uncertainty-Calibrated LLMs for Automated Essay Assessment (2025.emnlp-main)
Copied to clipboard
| Challenge: | Automated Essay Scoring (AES) systems attain near–human agreement on some public benchmarks, but real-world adoption is limited. |
| Approach: | They propose a distribution-free wrapper that equips any classifier with set-valued outputs enjoying formal coverage guarantees. |
| Outcome: | The proposed model achieves coverage targets while keeping prediction sets compact. |
Let’s Be Self-generated via Step by Step: A Curriculum Learning Approach to Automated Reasoning with Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing efforts to improve CoT prompting have limitations that require extensive human effort or performance needs to be improved. |
| Approach: | They propose a prompt approach for automatic reasoning called LBS3 inspired by curriculum learning which better reflects human learning habits. |
| Outcome: | The proposed approach achieves strongly competitive performance compared to baselines in reasoning-intensive tasks with varying open- and closed-source LLMs. |
MathBench: Evaluating the Theory and Application Proficiency of LLMs with a Hierarchical Mathematics Benchmark (2024.findings-acl)
Copied to clipboard
Hongwei Liu, Zilong Zheng, Yuxuan Qiao, Haodong Duan, Zhiwei Fei, Fengzhe Zhou, Wenwei Zhang, Songyang Zhang, Dahua Lin, Kai Chen
| Challenge: | Recent advances in large language models have showcased significant improvements in mathematics, but traditional benchmarks like GSM8k offer a unidimensional perspective. |
| Approach: | MathBench is a benchmark that rigorously assesses the mathematical capabilities of large language models. |
| Outcome: | MathBench spans a wide range of mathematical disciplines, offering a detailed evaluation of both theoretical understanding and practical problem-solving skills. |
Emancipating Event Extraction from the Constraints of Long-Tailed Distribution Data Utilizing Large Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for EE depend on manual annotations, which are expensive and scarce. |
| Approach: | They propose to transform the event extraction task into multi-turn dialogues and a novel method for generating high-quality data. |
| Outcome: | The proposed methods significantly improve existing models’ performance with various paradigms and structures, especially on tail types. |
Semantically Consistent Data Augmentation for Neural Machine Translation via Conditional Masked Language Model (2022.coling-1)
Copied to clipboard
| Challenge: | Neural network models have a large number of parameters to train, but data augmentation is relatively under-explored in natural language processing. |
| Approach: | They propose a bi-directional conditional Masked Language Model (CMLM) that can be conditional on both left and right contexts and the label. |
| Outcome: | The proposed method achieves the best performance on four translation datasets and yields up to 1.90 BLEU points over the baseline. |
OS-Symphony: A Holistic Framework for Robust and Generalist Computer-Using Agents (2026.acl-long)
Copied to clipboard
Bowen Yang, Kaiming Jin, Zhenyu Wu, Zhaoyang Liu, Qiushi Sun, Zehao Li, JingJing Xie, Zhoumianze Liu, Fangzhi Xu, Kanzhi Cheng, Yian Wang, Qingyun Li, Yu Qiao, Zun Wang, Zichen Ding
| Challenge: | Vision-Language Models (VLMs) lack visual-aware tutorial retrieval and historical visual context curation and pruning. |
| Approach: | They propose a framework that integrates an orchestrator and a Reflection-Memory Agent for robust automation. |
| Outcome: | Experimental results show that OS-Symphony delivers substantial performance gains across model scales. |
A Quantum-Inspired Matching Network with Linguistic Theories for Metaphor Detection (2024.lrec-main)
Copied to clipboard
| Challenge: | Metaphor identification procedures and selectional preference violations are challenging for machines to recognize and comprehend metaphors. |
| Approach: | They propose a quantum-inspired matching network for metaphor detection based on QLM . metaphors are widely present in the language, thought and behavior of humans . |
| Outcome: | The proposed method can be used to detect metaphors even in the face of conventional metaphors. |
Negative-Aware Diffusion Process for Temporal Knowledge Graph Extrapolation (2026.findings-eacl)
Copied to clipboard
| Challenge: | Temporal Knowledge Graphs (TKGs) are dynamic structures representing entities and their evolving relationships through time. |
| Approach: | They propose a non-parametric model that encodes subject-centric histories into sequential embeddings. |
| Outcome: | The proposed model encodes subject-centric histories of entities, relations and temporal intervals into sequential embeddings. |
HiChunk: Evaluating and Enhancing Retrieval Augmented Generation with Hierarchical Chunking (2026.acl-long)
Copied to clipboard
| Challenge: | Existing evaluation benchmarks for document chunking are inadequate due to evidence sparsity . evaluators are unable to evaluate different chunking methods due to the evidence sparing . |
| Approach: | They propose a QA benchmark for document chunking and a hierarchical document structuring framework for it. |
| Outcome: | The proposed framework improves document chunking quality within reasonable time consumption. |
QPruner: Probabilistic Decision Quantization for Structured Pruning in Large Language Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Structured pruning can reduce model size but results in significant accuracy degradation . quantization and pruning increase the difficulty of fine-tuning, requiring a more refined quantization scheme. |
| Approach: | They propose a structured pruning framework followed by a layer-wise mixed-precision quantization scheme to reduce model memory consumption during fine-tuning and inference. |
| Outcome: | Experiments on benchmark datasets show that QPruner outperforms existing methods in memory savings while maintaining or improving model performance. |
Learning from the Irrecoverable: Error-Localized Policy Optimization for Tool-Integrated LLM Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Tool-integrated reasoning (TIR) enables LLM agents to solve tasks through planning, tool use, and iterative revision, but outcome-only reinforcement learning suffers from sparse, delayed rewards and weak step-level credit assignment. |
| Approach: | They propose a tool-integrated reasoning approach that localizes the first irrecoverable step and leverages it for fine-grained credit assignment. |
| Outcome: | The proposed algorithm outperforms strong Agentic RL benchmarks in math, science QA, and code execution with additional gains in Pass@K and Major@K scaling, rollout ranking quality, and tool-call efficiency. |
OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesis (2025.acl-long)
Copied to clipboard
Qiushi Sun, Kanzhi Cheng, Zichen Ding, Chuanyang Jin, Yian Wang, Fangzhi Xu, Zhenyu Wu, Chengyou Jia, Liheng Chen, Zhoumianze Liu, Ben Kao, Guohao Li, Junxian He, Yu Qiao, Zhiyong Wu
| Challenge: | Graphical User Interface (GUI) agents powered by Vision-Language Models (VLMs) have demonstrated human-like computer control capability. |
| Approach: | They propose a GUI data synthesis pipeline that reverse engineers GUI trajectory construction process by executing pre-defined tasks. |
| Outcome: | The proposed GUI data synthesis pipeline overcomes the bottlenecks of previous methods that rely on pre-defined tasks and limited data diversity. |
Exploiting Hybrid Semantics of Relation Paths for Multi-hop Question Answering over Knowledge Graphs (2022.coling-1)
Copied to clipboard
| Challenge: | Existing approaches to answer natural language questions on knowledge graphs (KGQA) use large-scale entity-related text corpus or knowledge graph embeddings as auxiliary information to facilitate answer selection. |
| Approach: | They propose to integrate explicit textual information and implicit KG structural features of relation paths into a novel rotate-and-scale entity link prediction framework. |
| Outcome: | The proposed method is superior to existing methods on three KGQA datasets and shows that it can be used to identify answer entities. |
RolePlot: A Systematic Framework for Evaluating and Enhancing the Plot-Progression Capabilities of Role-Playing Agents (2025.acl-long)
Copied to clipboard
| Challenge: | Existing research has focused on role-playing agents’ ability to portray specified characters, but their ability to advance the plot requires substantial improvements to deliver more engaging interaction. |
| Approach: | They propose a role-playing framework to evaluate and enhance the plot-progression capabilities of role-players. |
| Outcome: | The proposed framework improves RPAs’ ability to time plot developments and yields a significant increase in conversation turns and sustained higher arousal levels. |
Why Do Emotions Change? Appraisal-Guided Reasoning for Emotion–Cause Triplet Extraction in Conversations (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for multi-turn, multi-speaker multimodal affect understanding are difficult to maintain conversation-level consistency under within-speaks' emotion shifts. |
| Approach: | They propose a framework that combines appraisal-guided structured generation with graph-structured reinforcement learning to extract triplets from multi-turn multimodal conversations. |
| Outcome: | The proposed framework outperforms baselines on public MECTEC benchmarks and improves structure-aware metrics on emotion shift coherence and core events. |
Uni-MMMU: A Massive Multi-discipline Multimodal Unified Benchmark (2026.acl-long)
Copied to clipboard
Kai Zou, Ziqi Huang, Yuhao Dong, Shulin Tian, Dian Zheng, Hongbo Liu, Jingwen He, Bin Liu, Yu Qiao, Ziwei Liu
| Challenge: | Existing evaluations treat visual understanding and generation in isolation or overlook tasks that inherently couple them. |
| Approach: | They propose a benchmark that examines the bidirectional synergy between generation and understanding across eight reasoning-centric domains. |
| Outcome: | The proposed model systematically unfolds the bidirectional synergy between generation and understanding across eight reasoning-centric domains. |
Symbol-LLM: Towards Foundational Symbol-centric Interface For Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have limitations when it comes to comprehending and expressing world knowledge that extends beyond the boundaries of natural language. |
| Approach: | They propose a model that integrates symbolic data into LLM training without loss of generality ability. |
| Outcome: | The proposed model performs better on symbol- and NL-centric tasks. |
Supportiveness-based Knowledge Rewriting for Retrieval-augmented Language Modeling (2025.findings-naacl)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have significantly enhanced their performance in various natural language processing tasks. |
| Approach: | They propose a robust and pluggable knowledge rewriter that is optimized for LLM generation by supporting the model's supportiveness. |
| Outcome: | The proposed model can be used to rewrite knowledge in a supervised manner. |
LLMs know their vulnerabilities: Uncover Safety Gaps through Natural Distribution Shifts (2025.acl-long)
Copied to clipboard
Qibing Ren, Hao Li, Dongrui Liu, Zhanxu Xie, Xiaoya Lu, Yu Qiao, Lei Sha, Junchi Yan, Lizhuang Ma, Jing Shao
| Challenge: | Current safety training focuses on teaching models to reject harmful queries, but recent research shows that adversarial attacks or jailbreak methods bypass these safety mechanisms. |
| Approach: | They propose to use a new attack method to craft multi-turn toxic prompts that gradually lead LLMs to reveal unsafe content. |
| Outcome: | The proposed method outperforms existing methods in diversity, effectiveness, and efficiency across aligned LLMs. |
DistillMIKE: Editing Distillation of Massive In-Context Knowledge Editing in Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | In-context knowledge editing has shown respectable abilities on knowledge editing in terms of generalization and specificity. |
| Approach: | They propose a novel extension of in-context knowledge editing (IKE) that allows for massive edits to be injected into large language models. |
| Outcome: | The proposed method shows state-of-the-art perfomrances and comparable performance with MIKE. |
DiFiNet: Boundary-Aware Semantic Differentiation and Filtration Network for Nested Named Entity Recognition (2024.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to Named Entity Recognition focus on identifying non-nested entities, but there is no explicit guidance for boundary detection. |
| Approach: | They propose a Boundary-aware Semantic Differentiation and Filtration Network for nested NER that leverages a biaffine attention mechanism to generate a span representation matrix. |
| Outcome: | Extensive experiments on three benchmark datasets demonstrate the proposed model yields a new state-of-the-art performance. |
Investigating Context Faithfulness in Large Language Models: The Roles of Memory Strength and Evidence Style (2025.findings-acl)
Copied to clipboard
| Challenge: | Retrieval-augmented generation improves Large Language Models (LLMs) by integrating external information into the response generation process. |
| Approach: | They investigate the impact of memory strength and evidence presentation on LLMs’ receptiveness to external evidence by measuring the divergence in LLM responses to different paraphrases of the same question. |
| Outcome: | The proposed method improves Large Language Models (LLMs) by integrating external information into the response generation process. |
Sequential-NIAH: A Needle-In-A-Haystack Benchmark for Extracting Sequential Needles from Long Contexts (2025.emnlp-main)
Copied to clipboard
Yifei Yu, Qian-Wen Zhang, Lingfeng Qiao, Di Yin, Fang Li, Jie Wang, Chen Zeng Xi, Suncong Zheng, Xiaolong Liang, Xing Sun
| Challenge: | Recent models have extended Corresponding Author. context lengths to millions of tokens while maintaining reasoning and comprehension capabilities. |
| Approach: | They propose a benchmark to evaluate the ability of large language models to extract sequential information items from long contexts. |
| Outcome: | The proposed model achieves maximum accuracy of 63.50% on six well-known LLMs. |
Aspect and Sentiment Aware Abstractive Review Summarization (C18-1)
Copied to clipboard
| Challenge: | Abstractive summarization is a task that generates short and concise summaries of user generated reviews. |
| Approach: | They propose an interactive attention mechanism to learn the representations of context and aspect words within reviews, acted as an encoder. |
| Outcome: | The proposed model achieves impressive results compared to other strong competitors on a real-life dataset. |
AutoGraph-R1: End-to-End Reinforcement Learning for Knowledge Graph Construction (2026.acl-long)
Copied to clipboard
Hong Ting Tsang, Jiaxin Bai, Haoyu Huang, Qiao Xiao, Tianshi Zheng, Baixuan Xu, Shujie Liu, Yangqiu Song
| Challenge: | Currently, knowledge graphs are decoupled from their downstream application, resulting in suboptimal graph structures. |
| Approach: | They propose a framework to directly optimize KG construction for task performance using Reinforcement Learning (RL). |
| Outcome: | The proposed framework improves performance across multiple QA benchmarks and consistently achieves significant performance gains over task-agnostic baseline graphs. |
CoTrust: Privacy-Preserving Collaboration Between Large and Small Language Models in Trusted Execution Environments (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) provide powerful text generation capabilities, but accessing sensitive user inputs raises privacy concerns. |
| Approach: | They propose a privacy-preserving collaborative inference framework that combines large language models with small language models inside TEE to preserve privacy. |
| Outcome: | Experiments show that CoTrust outperforms unconstrained LLMs on multiple question answering and summarization benchmarks while maintaining strong privacy protection. |
CFBench: A Comprehensive Constraints-Following Benchmark for LLMs (2025.acl-long)
Copied to clipboard
Tao Zhang, ChengLIn Zhu, Yanjun Shen, Wenjing Luo, Yan Zhang, Hao Liang, Tao Zhang, Fan Yang, Mingan Lin, Yujing Qiao, Weipeng Chen, Bin Cui, Wentao Zhang, Zenan Zhou
| Challenge: | Existing evaluations of Large Language Models (LLMs) focus on fragmented constraints or narrow scenarios, but they overlook the comprehensiveness and authenticity of constraints from the user’s perspective. |
| Approach: | They propose a Chinese Comprehensive Constraints Following Benchmark for LLMs that compiles constraints from real-world instructions and constructs a systematic framework for constraint types. |
| Outcome: | The proposed framework integrates multi-dimensional assessment criteria with requirement prioritization, covering various perspectives of constraints, instructions, and requirement fulfillment. |
Beyond Benchmarks: A Capability-Based Maturity Model for Systematic AI Integration in Hospitals (2026.findings-acl)
Copied to clipboard
| Challenge: | Current Large Language Models (LLMs) excel in standardized tests focused on medical knowledge recall, but not in real-world healthcare scenarios. |
| Approach: | They propose a "capability-based hospital AI Maturity Model" framework that categorizes capabilities into distinct maturity levels . medical artificial intelligence is currently at a critical transition stage from technical verification to deep clinical integration . |
| Outcome: | The proposed model provides a clear, stepwise evolutionary path for hospitals from foundational infrastructure construction to ubiquitous intelligence. |
SPADE: A Big Five-Mturk Dataset of Argumentative Speech Enriched with Socio-Demographics for Personality Detection (2022.lrec-1)
Copied to clipboard
| Challenge: | Recent efforts to create such datasets from social media do not include continuous and contextualized language use. |
| Approach: | They propose to use argumentative speech to generate a dataset with continuous arguments labeled with the Big Five personality traits and enriched with socio-demographic data. |
| Outcome: | The proposed model leverages 436 (psycho)linguistic features extracted from transcribed speech and speaker-level metainformation with transformers to investigate which types of features contribute to the prediction of individual personality traits. |
Rose-SQL: Role-State Evolution Guided Structured Reasoning for Multi-Turn Text-to-SQL (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to multi-turn Text-to-SQL tasks rely on unstable APIs or expensive fine-tuning. |
| Approach: | They propose a training-free framework that leverages small-scale LRMs through in-context learning to enable accurate context-dependent parsing. |
| Outcome: | The proposed framework outperforms in-context learning baselines at the 4B scale and surpasses state-of-the-art models at the 8B and 14B scales. |
Evaluation Agent: Efficient and Promptable Evaluation Framework for Visual Generative Models (2025.acl-long)
Copied to clipboard
| Challenge: | Existing evaluation methods rely on rigid pipelines that overlook user needs and provide numerical results without clear explanations. |
| Approach: | They propose an evaluation framework that employs human-like strategies for efficient, dynamic, multi-round evaluations using only a few samples per round. |
| Outcome: | The evaluation agent framework reduces evaluation time to 10% of traditional methods while delivering comparable results. |
What to Fuse and How to Fuse: Exploring Emotion and Personality Fusion Strategies for Explainable Mental Disorder Detection (2023.findings-acl)
Copied to clipboard
| Challenge: | Mental health disorders (MHD) are one of the greatest challenges facing our healthcare systems and modern societies in general. |
| Approach: | They integrate and extend the research by conducting extensive experiments with three types of deep learning-based fusion strategies: feature-level fusion, model fusion and task fusion. |
| Outcome: | The proposed techniques show that they can be used to improve mental health detection from textual data. |
Multi-grained Attention with Object-level Grounding for Visual Question Answering (P19-1)
Copied to clipboard
| Challenge: | Current approaches to visual question answering train attention models from coarse-grained associations between sentences and images, which fail on small objects or uncommon concepts. |
| Approach: | They propose a multi-grained attention method that learns explicit word-object correspondence by word-level attention complementary to the sentence-image association. |
| Outcome: | The proposed method achieves competitive performance with state-of-the-art models on the VQA benchmark. |
Expanding the Boundaries of Vision Prior Knowledge in Multi-modal Large Language Models (2026.eacl-long)
Copied to clipboard
Qiao Liang, Yanjiang Liu, Weixiang Zhou, Ben He, Yaojie Lu, Hongyu Lin, Jia Zheng, Xianpei Han, Le Sun, Yingfei Sun
| Challenge: | Existing research treats MLLMs as unified systems optimized through end-to-end training, but the impact of vision encoder’s prior knowledge is seldom investigated. |
| Approach: | They propose a metric to quantify the effect of prior knowledge on MLLM performance by integrating prior knowledge at the vision encoder level into a training framework. |
| Outcome: | The proposed training framework incorporates prior knowledge at the vision encoder level, and significantly boosts visual understanding capabilities of MLLMs. |
V-Oracle: Making Progressive Reasoning in Deciphering Oracle Bones for You and Me (2025.acl-long)
Copied to clipboard
Runqi Qiao, Qiuna Tan, Guanting Dong, MinhuiWu MinhuiWu, Jiapeng Wang, YiFan Zhang, Zhuoma GongQue, Chong Sun, Yida Xu, Yadong Xue, Ye Tian, Zhimin Bao, Lan Yang, Chen Li, Honggang Zhang
| Challenge: | Deciphering oracle bone scripts using AI technology is not an overnight task due to the evolution of written language over millennia. |
| Approach: | They propose a framework that utilizes Large Multi-modal Models (LMMs) for interpreting Oracle Bone Script (OBS). |
| Outcome: | The proposed framework provides quantitative analyses and superior deciphering capability. |
A Sentiment-Controllable Topic-to-Essay Generator with Topic Knowledge Graph (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Topic-to-essay generation is a promising task for natural language generation. |
| Approach: | They propose a Sentiment Controllable topic-to- essay generator with a Topic Knowledge Graph enhanced decoder to generate essays with only several given topic words. |
| Outcome: | The proposed model outperforms the state-of-the-art model on automatic and human evaluation. |
Interactive Evolution: A Neural-Symbolic Self-Training Framework For Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods to fine-tune Large Language Models without human annotations are lacking in the field of natural language training. |
| Approach: | They propose an environment-guided neural-symbolic self-training framework to overcome two main challenges: the scarcity of symbolic data and the limited proficiency of LLMs in processing symbolic language. |
| Outcome: | The proposed framework overcomes two main challenges: the scarcity of symbolic data, and the limited proficiency of LLMs in processing symbolic language. |
XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generation (2020.emnlp-main)
Copied to clipboard
Yaobo Liang, Nan Duan, Yeyun Gong, Ning Wu, Fenfei Guo, Weizhen Qi, Ming Gong, Linjun Shou, Daxin Jiang, Guihong Cao, Xiaodong Fan, Ruofei Zhang, Rahul Agrawal, Edward Cui, Sining Wei, Taroon Bharti, Ying Qiao, Jiun-Hung Chen, Winnie Wu, Shuguang Liu, Fan Yang, Daniel Campos, Rangan Majumder, Ming Zhou
| Challenge: | XGLUE provides a benchmark dataset to train large-scale cross-lingual pre-trained models . XCLUE provides 11 diversified tasks that cover both understanding and generation scenarios . |
| Approach: | They introduce a new benchmark dataset to train large-scale cross-lingual pre-trained models using multilingual and bilingual corpora. |
| Outcome: | The proposed dataset is labeled in English and includes only natural language understanding tasks. |
Emotion Trajectory-aware Retrieval for Markov-driven Emotion Anticipation in LLM-based Emotional Support Conversation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing strategies focus on planning the next-turn dialogue strategies, while external strategy planners focus on generating empathetic responses. |
| Approach: | They propose a Markov-driven emotion anticipation framework with emotion trajectory-aware retrieval for LLM-based ESC, which anticipates future emotion states to guide strategy planning and achieve sustained emotional support. |
| Outcome: | The proposed framework can anticipate future emotions and achieve sustained emotional support on two datasets with two models. |
Fact-based Text Editing (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for fact-based text editing are not suitable for all situations. |
| Approach: | They propose a method for automatically generating a dataset with a draft text, revised text, and several facts represented in triples. |
| Outcome: | The proposed method outperforms the encoder-decoder approach on two datasets and shows that it conducts inference faster than the encoded-decoding approach. |
SEER: Facilitating Structured Reasoning and Explanation via Reinforcement Learning (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods focus on single-step reasoning, ignoring logical dependencies between steps. |
| Approach: | They propose a method that maximizes a structure-based return to facilitate structured reasoning and explanation. |
| Outcome: | The proposed method outperforms state-of-the-art methods on EntailmentBank and STREET benchmarks. |
Graph-guided Cross-composition Feature Disentanglement for Compositional Zero-shot Learning (2025.findings-acl)
Copied to clipboard
Yuxia Geng, Runkai Zhu, Jiaoyan Chen, Jintai Chen, Xiang Chen, Zhuo Chen, Shuofei Qiao, Yuxiang Wang, Xiaoliang Xu, Sheng-Jun Huang
| Challenge: | Disentanglement of visual features of primitives (i.e., attributes and objects) has shown exceptional results in Compositional Zero-shot Learning (CZSL). |
| Approach: | They propose a solution that takes multiple compositions as inputs and constrains disentangled primitive features to be general across compositions. |
| Outcome: | The proposed architecture significantly improves performance on three popular CZSL benchmarks and has been verified by solid ablation studies. |
Zipage: Maintain High Request Concurrency for LLM Reasoning through Compressed PagedAttention (2026.findings-acl)
Copied to clipboard
Mengqi Liao, Lu Wang, Chaoyun Zhang, Bo Qiao, Si Qin, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang, Huaiyu Wan
| Challenge: | Existing methods to evict KV cache during inference phase are impractical for industrial-grade applications. |
| Approach: | They propose a method that combines token-wise KV cache eviction with PagedAttention and propose 'zipage' it achieves 95% of the performance of Full KV inference engines while delivering over 2.1 speedup . |
| Outcome: | The proposed method achieves 95% of the performance of Full KV inference engines while delivering over 2.1 speedup on large-scale mathematical reasoning tasks. |
EasyInstruct: An Easy-to-use Instruction Processing Framework for Large Language Models (2024.acl-demos)
Copied to clipboard
Yixin Ou, Ningyu Zhang, Honghao Gui, Ziwen Xu, Shuofei Qiao, Runnan Fang, Lei Li, Zhen Bi, Guozhou Zheng, Huajun Chen
| Challenge: | Large Language Models (LLMs) have improved performance across tasks and domains . instruction tuning is a crucial technique to enhance the capabilities of LLMs - but there is no standard open-source instruction processing framework available for the community . |
| Approach: | They propose an open-source instruction tuning framework for Large Language Models that modularizes instruction generation, selection, prompting and their combination and interaction. |
| Outcome: | The proposed framework is open-source and available on Github. |
Deputy: Accelerating Large Language Model Inference with Dynamic Low-Rank Substitution (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing dynamic schemes such as early-exit and layer-drop reduce FLOPs but break batch processing or introduce KV-cache inconsistency. |
| Approach: | They propose a dynamic low-rank substitution framework that employs a lightweight decision module at each layer to dynamically determine the execution branch for different tokens. |
| Outcome: | The proposed model reduces computation by approximately 40% compared to the original dense model while outperforming existing baseline methods. |
On-the-Fly VLA Adaptation via Test-Time Reinforcement Learning (2026.acl-long)
Copied to clipboard
Changyu Liu, Yiyang Liu, Taowen Wang, Qiao Zhuang, James Chenhao Liang, Wenhao Yang, Renjing Xu, Qifan Wang, Dongfang Liu, Cheng Han
| Challenge: | Existing vision-language-action models are unsuitable for simulated or physical-world deployments . current methods fail when confronted with inherent real-world dynamic variability. |
| Approach: | They propose a test-time reinforcement learning framework that enables on-the-fly policy adaptation during inference. |
| Outcome: | Empirical results show that the proposed framework improves adaptability, stability and task success in dynamic, previously unseen scenarios. |
MoPS: Modular Story Premise Synthesis for Open-Ended Automatic Story Generation (2024.acl-long)
Copied to clipboard
| Challenge: | Existing sources of story premises are limited by a lack of diversity, uneven quality, and high costs that make them difficult to scale. |
| Approach: | They propose a method which breaks down story premises into modules like background and persona for automated design and generation. |
| Outcome: | The proposed framework excels in diversity, fascination, completeness, and originality compared to those induced from large language models and captured from public datasets. |
Making Language Models Better Tool Learners with Execution Feedback (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing tool learning methodologies induce large language models to utilize tools indiscriminately . Existing frameworks that teach language models when and how to use tools propagate errors rather than enhance performance. |
| Approach: | They propose a framework that enables large language models to continually learn through feedback derived from tool execution. |
| Outcome: | The proposed framework can make large language models selectively use tools . it improves accuracy while enhancing insufficient tool learning, it shows . |
STUN: Structured-Then-Unstructured Pruning for Scalable MoE Pruning (2025.acl-long)
Copied to clipboard
| Challenge: | Mixture-of-experts (MoEs) have been adopted for reducing inference costs by sparsely activating experts in large language models (LLMs). |
| Approach: | They propose a structured-then-unstructured approach outperforming both of structured and unstructured pruning for MoEs. |
| Outcome: | The proposed approach outperforms both of structured and unstructured pruning, especially for MoEs with hundreds of experts. |
Towards a More Generalized Approach in Open Relation Extraction (2025.acl-long)
Copied to clipboard
| Challenge: | Existing OpenRE methods assume unlabeled data is a mixture of known and novel instances. |
| Approach: | They propose a generalized OpenRE setting that considers unlabeled data as a mixture of known and novel instances. |
| Outcome: | The proposed framework outperforms baselines in relation classification and clustering on three benchmark datasets. |
Evolving Sparsity: Leveraging Token Importance Dynamics for Efficient LLM Decoding with Sparse Attention (2026.acl-long)
Copied to clipboard
| Challenge: | Efficient long-context inference remains a major challenge for large language models (LLMs), as the cost of attention computation during auto-regressive decoding grows linearly with the context length. |
| Approach: | They propose to model token importance as a dynamic process that evolves over decoding steps and propagates through model layers. |
| Outcome: | The proposed method outperforms baseline sparse attention methods and achieves speedups of up to 5.36 for attention latency and 2.33 for end-to-end decoding. |
GRASS: Gradient-based Adaptive Layer-wise Importance Sampling for Memory-efficient Large Language Model Fine-tuning (2026.findings-acl)
Copied to clipboard
Kaiyuan Tian, Linbo Qiao, Yu Tang, Gongqingjian Jiang, Baihui Liu, Yifu Gao, Xialin Su, Dongsheng Li
| Challenge: | Low-rank adaptation methods for large language models limit expressiveness and performance . layer-wise fine-tuning methods overlook variations in layer importance across tasks and training stages, resulting in suboptimal performance on downstream tasks. |
| Approach: | They propose a gradient-based adaptive layer-wise importance sampling framework that updates only a subset of parameters to reduce memory usage. |
| Outcome: | The proposed framework outperforms state-of-the-art methods in accuracy and memory usage. |
PENS: A Dataset and Generic Framework for Personalized News Headline Generation (2021.acl-long)
Copied to clipboard
| Challenge: | Using a dataset of Microsoft News, we propose a generic framework to personalize a text generator and establish personalized headlines. |
| Approach: | They propose a generic framework to personalize a news headline generator and establish personalized headlines by leveraging user behavioral data. |
| Outcome: | The proposed framework is based on user preference data and user preference injections to personalize a text generator and establish personalized headlines. |
Predicting the Unpredictable: Uncertainty-Aware Reasoning over Temporal Knowledge Graphs via Diffusion Process (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for Temporal Knowledge Graph reasoning capture indeterminacy in future events, but they are limited in capturing it. |
| Approach: | They propose a Temporal Knowledge Graph reasoning process that denoises historical events and introduces Gaussian noise to corrupt target facts. |
| Outcome: | Empirical results show that DiffuTKG outperforms state-of-the-art methods on four real-world datasets. |
MiniConGTS: A Near Ultimate Minimalist Contrastive Grid Tagging Scheme for Aspect Sentiment Triplet Extraction (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches within the pretraining-finetuning paradigm tend to meticulously craft complex tagging schemes and classification heads, or incorporate external semantic enhancements to enhance performance. |
| Approach: | They propose to integrate a minimalist tagging scheme and a novel token-level contrastive learning strategy to improve pretrained representations. |
| Outcome: | The proposed framework achieves comparable or superior performance compared to state-of-the-art techniques while featuring a more compact design and reduced computational overhead. |
M3HG: Multimodal, Multi-scale, and Multi-type Node Heterogeneous Graph for Emotion Cause Triplet Extraction in Conversations (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for ECAC focus on textual contexts, overlooking other modalities. |
| Approach: | They propose a multimodal, multi-scenario MECTEC dataset that captures emotional and causal contexts and effectively fuses contextual information at different levels. |
| Outcome: | The proposed model captures emotional and causal contexts and effectively fuses contextual information at both inter- and intra-utterance levels. |
A Framework for Effective Invocation Methods of Various LLM Services (2025.coling-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are becoming a fundamental tool for various natural language processing tasks due to commercial reasons, the potential risk of misuse and expensive tuning cost. |
| Approach: | They propose a framework for constructing an effective LLM services invocation strategy that best meets task demands. |
| Outcome: | The proposed framework classifies existing methods into four categories: input abstraction, semantic cache, solution design, and output enhancement, which can be used separately or jointly during the invocation life cycle. |
Alloc-MoE: Budget-Aware Expert Activation Allocation for Efficient Mixture-of-Experts Inference (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches that reduce expert activations lead to severe model performance degradation. |
| Approach: | They propose a framework that optimizes budget allocation coordinately at layer and token levels to minimize model performance degradation. |
| Outcome: | The proposed framework achieves 1.15 prefill and 1.34 decode speedups on DeepSeek-V2-Lite at half of the original budget. |
Exploring Pre-trained Language Models for Event Extraction and Generation (P19-1)
Copied to clipboard
| Challenge: | Existing methods to extract event data are laborious to create and limited in size. |
| Approach: | They propose an event extraction model to overcome the roles overlap problem by separating the argument prediction in terms of roles. |
| Outcome: | The proposed method surpasses existing methods on the ACE2005 dataset and improves on the previous methods. |
Dynamic Simulation Framework for Disinformation Dissemination and Correction With Social Bots (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Current studies rely on simplistic user and network modeling and neglect dynamic behavior of bots. |
| Approach: | They propose a multi-agent-based framework for disinformation dissemination . it incorporates both malicious and legitimate bots and allows quantitative evaluation of correction strategies. |
| Outcome: | The proposed framework incorporates both malicious and legitimate bots and their controlled dynamic participation allows for quantitative analysis of correction strategies. |
Compact Token Representations with Contextual Quantization for Efficient Document Re-ranking (2022.acl-long)
Copied to clipboard
| Challenge: | Recent work has adopted a late interaction architecture with pre-computed contextual token representations at the cost of a large online storage. |
| Approach: | They propose to decouple document-specific and document-independent ranking contributions during codebook-based compression for effective online decompression and embedding composition for better search relevance. |
| Outcome: | The proposed model achieves high relevance and space efficiency with minimal computational cost and low computational complexity. |
SwiftKV: Fast Prefill-Optimized Inference with Knowledge-Preserving Model Transformation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are an integral enabler of enterprise applications such as summarization, retrieval augmented generation, and agentic workflows. |
| Approach: | They propose a model transformation and distillation procedure that prefills later layers’ KV cache using an earlier layer’s output, allowing prompt tokens to skip those later layers. |
| Outcome: | The proposed procedure can reduce prefill computation by 25-50% across several LLM families while incurring minimum quality degradation. |
Learning Joint Structural and Temporal Contextualized Knowledge Embeddings for Temporal Knowledge Graph Completion (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods that incorporate time information into static knowledge graph embedding ignore the contextual nature of the TKG structure. |
| Approach: | They propose a method that employs pre-trained language models to learn joint Structural and Temporal Contextualized Knowledge Embeddings. |
| Outcome: | The proposed method is superior to existing methods that ignore the contextual nature of the TKG structure. |
GUI0: Self-Evolving Foundational GUI Agents in Super App Ecosystems (2026.acl-long)
Copied to clipboard
Xinyi Wang, Wei Dai, Kyle Qiao, Ke Wang, Peng Chen, Gang Cao, null Kangqin, Zhongpu Wang, Xiaode Zhang, Yanming Liu, Jihao Gu, Jingtao Xu, Gong Zhi
| Challenge: | Automated interaction with graphical user interfaces (GUIs) is central to general artificial intelligence, but remains challenging within Super App ecosystems. |
| Approach: | They propose a framework synergizing autonomous data synthesis with dual-agent co-evolution . GUI0 establishes a domain-aware foundation model via synthesized corpora and employs curriculum-driven reinforcement learning . |
| Outcome: | The proposed framework outperforms Gemini-2.5-Pro and Claude-4-Sonnet in the SuperAPP benchmark and has universal efficacy across base models. |
MIND: A Large-scale Dataset for News Recommendation (2020.acl-main)
Copied to clipboard
Fangzhao Wu, Ying Qiao, Jiun-Hung Chen, Chuhan Wu, Tao Qi, Jianxun Lian, Danyang Liu, Xing Xie, Jianfeng Gao, Winnie Wu, Ming Zhou
| Challenge: | Personalized news recommendation is an important technique for personalized news service. |
| Approach: | They propose to build a large-scale news recommendation dataset from Microsoft News . they demonstrate that news recommendation relies on the quality of news content understanding . |
| Outcome: | The proposed dataset contains 1 million users and more than 160k English news articles, each of which has rich textual content such as title, abstract and body. |
Decoder-Only LLMs can be Masked Auto-Encoders (2025.acl-short)
Copied to clipboard
Dan Qiao, Yuan Gao, Zheming Yang, Di Yang, Ziheng Wu, Pengcheng Lu, Minghui Qiu, Juntao Li, Min Zhang
| Challenge: | Modern NLP workflows require different models for generation and embedding tasks. |
| Approach: | They propose a method that transforms an LLM into a Uni-Directional Masked Auto-Encoder. |
| Outcome: | The proposed method achieves state-of-the-art under unsupervised conditions with merely 100 training steps. |
BrowseConf: Confidence-Guided Test-Time Scaling for Web Agents (2026.findings-acl)
Copied to clipboard
Litu Ou, Kuan Li, Huifeng Yin, Liwen Zhang, Zhongwang Zhang, Xixi Wu, Rui Ye, Zile Qiao, Yong Jiang, Pengjun Xie, Fei Huang, Jingren Zhou
| Challenge: | Existing work on confidence in LLMs is limited. |
| Approach: | They propose to use confidence scores to determine model answer quality and encourage model to try again until it reaches satisfactory confidence level. |
| Outcome: | The proposed methods significantly reduce token consumption while demonstrating competitive performance compared to baseline fixed budget methods. |
Mixture of Small and Large Models for Chinese Spelling Check (2025.acl-long)
Copied to clipboard
| Challenge: | Chinese Spelling Check (CSC) tasks have been developed to correct spelling errors in given sentences . fine-tuned BERT-based models show excellent performance but suffer from edit pattern overfitting . a novel mixture approach that effectively combines small models and LLMs during beam search decoding phase improves accuracy and fluency of LLM. |
| Approach: | They propose a dynamic mixture approach that effectively combines small models and LLMs during beam search decoding phase. |
| Outcome: | The proposed method significantly boosts error correction capabilities, achieving state-of-the-art results across multiple datasets. |
Synergetic Interaction Network with Cross-task Attention for Joint Relational Triple Extraction (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing approaches to joint entity-relation extraction are limited in their ability to capture the interdependence between the two sub-tasks. |
| Approach: | They propose a synergistic approach to capture interdependence between named entity recognition and relation extraction sub-tasks in a Synergetic Interaction Network. |
| Outcome: | The proposed model achieves significantly better performance on three benchmark datasets. |
ChartAssistant: A Universal Chart Multimodal Language Model via Chart-to-Table Pre-training and Multitask Instruction Tuning (2024.findings-acl)
Copied to clipboard
| Challenge: | Charts are an effective tool for understanding data patterns, but their combination of graphical elements and textual components poses challenges for general-purpose multimodal models. |
| Approach: | They propose a chart-based vision-language model for universal chart comprehension and reasoning that leverages a dataset of chart-related tasks. |
| Outcome: | The proposed model outperforms the state-of-the-art charts with zero-shot setting on various chart tasks. |
MedCite: Can Language Models Generate Verifiable Text for Medicine? (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing LLM-based medical question answering systems lack citation generation and evaluation capabilities, raising concerns about their adoption in practice. |
| Approach: | They propose a framework that facilitates the design and evaluation of LLM citations for medical tasks and a retrieval-citation method that generates high-quality citation. |
| Outcome: | The proposed method achieves superior citation precision and recall improvements compared to strong baseline methods and correlates well with annotation results from professional experts. |
OS Agents: A Survey on MLLM-based Agents for Computer, Phone and Browser Use (2025.acl-long)
Copied to clipboard
Xueyu Hu, Tao Xiong, Biao Yi, Zishu Wei, Ruixuan Xiao, Yurun Chen, Jiasheng Ye, Meiling Tao, Xiangxin Zhou, Ziyu Zhao, Yuhuai Li, Shengze Xu, Shenzhi Wang, Xinchen Xu, Shuofei Qiao, Zhaokai Wang, Kun Kuang, Tieyong Zeng, Liang Wang, Jiwei Li, Yuchen Eleanor Jiang, Wangchunshu Zhou, Guoyin Wang, Keting Yin, Zhou Zhao, Hongxia Yang, Fan Wu, Shengyu Zhang, Fei Wu
| Challenge: | a new generation of (M)LLMs is enabling the creation of superintelligent AI assistants . OS Agents can complete tasks autonomously and have the potential to significantly enhance the lives of billions of users worldwide. |
| Approach: | They propose to build OS Agents that operate within operating systems' GUIs and GUIs . they examine evaluation metrics and benchmarks to identify promising directions . |
| Outcome: | The proposed agents are based on operating systems (OS) and operating systems frameworks. |
MADAWSD: Multi-Agent Debate Framework for Adversarial Word Sense Disambiguation (2025.emnlp-main)
Copied to clipboard
Kaiyuan Zhang, Qian Liu, Luyang Zhang, Chaoqun Zheng, Shuaimin Li, Bing Xu, Muyun Yang, Xinxiao Qiao, Wenpeng Lu
| Challenge: | Word sense disambiguation (WSD) is a fundamental yet challenging task in natural language processing. |
| Approach: | a novel multi-agent Debate framework for adversarial word Sense disambiguation is proposed . the framework simulates a real-world debate environment where multiple agents engage in discussions about ambiguous words in the context of adversarials. |
| Outcome: | The proposed framework integrates with existing LLMs and improves models in Chinese language . it shows that it can be used to improve models in the Chinese language and improve performance . |
Knowledge Mechanisms in Large Language Models: A Survey and Perspective (2024.findings-emnlp)
Copied to clipboard
Mengru Wang, Yunzhi Yao, Ziwen Xu, Shuofei Qiao, Shumin Deng, Peng Wang, Xiang Chen, Jia-Chen Gu, Yong Jiang, Pengjun Xie, Fei Huang, Huajun Chen, Ningyu Zhang
| Challenge: | Using large language models, we can understand knowledge mechanisms in LLMs for learning, storage, utilization, and evolution. |
| Approach: | They propose to analyze knowledge mechanisms in Large Language Models (LLMs) they examine utilization, evolution, and the potential dark knowledge (hypothesis) they hope to help understand knowledge in LLMs and provide insights for future research . |
| Outcome: | The proposed model can be used to analyze the evolution of parametric knowledge in LLMs. |
Improving Unsupervised Relation Extraction by Augmenting Diverse Sentence Pairs (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies on relation representation learning focus on contrastive learning strategies, but these studies overlook important aspects. |
| Approach: | They propose to use within-sentence pairs augmentation and cross-sentent pairs extraction to increase diversity of positive pairs and strengthen the discriminative power of contrastive learning. |
| Outcome: | The proposed task increases diversity of positive pairs and strengthens discriminative power . it overcomes limitations of traditional Relation Extraction tasks, which require manual annotations . |
DongbaMIE: A Multimodal Information Extraction Dataset for Evaluating Semantic Understanding of Dongba Pictograms (2025.findings-emnlp)
Copied to clipboard
Xiaojun Bi, Shuo Li, Junyao Xing, Ziyue Wang, Fuwen Luo, Weizheng Qiao, Lu Han, Ziwei Sun, Peng Li, Yang Liu
| Challenge: | Dongba pictographic is the only pictograph script still in use in the world. |
| Approach: | DongbaMIE is the first dataset focusing on multimodal information extraction of Dongbe pictographs. |
| Outcome: | The dataset contains 23,530 sentence-level and 2,539 paragraph-level high-quality text-image pairs. |
SynWorld: Virtual Scenario Synthesis for Agentic Action Knowledge Refinement (2025.acl-short)
Copied to clipboard
Runnan Fang, Xiaobin Wang, Yuan Liang, Shuofei Qiao, Jialong Wu, Zekun Xi, Ningyu Zhang, Yong Jiang, Pengjun Xie, Fei Huang, Huajun Chen
| Challenge: | Using Large Language Models (LLMs)-based agents can enhance their understanding of environments and tasks. |
| Approach: | They propose a framework that allows agents to synthesize possible scenarios with multi-step action invocation within the action space and perform Monte Carlo Tree Search exploration to refine their action knowledge in the current environment. |
| Outcome: | The proposed framework synthesizes possible scenarios with multi-step action invocation within the action space and performs Monte Carlo Tree Search exploration to refine action knowledge in the current environment. |
DiffusionRet: Diffusion-Enhanced Generative Retriever using Constrained Decoding (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Generative retrieval methods have suffered from the lack of the intermediate reasoning step . generative retrieval uses sequence-to-sequence diffusion models to map a query to relevant docids . |
| Approach: | They propose a novel method that uses query as an intermediate step before retrieval . they propose to use sequence-to-sequence diffusion models to map a query to relevant docids . |
| Outcome: | Experiments show that proposed method outperforms existing methods on MARCO and Natural Questions datasets. |
A Survey on Foundation Language Models for Single-cell Biology (2025.acl-long)
Copied to clipboard
| Challenge: | Existing single-cell foundation language models are based on pre-trained and large language models. |
| Approach: | They review the development of single-cell foundation language models . they discuss data tokenization strategies and pre-training paradigms . |
| Outcome: | The proposed models have shown remarkable performance in a variety of single-cell data analysis tasks. |
SALAD-Bench: A Hierarchical and Comprehensive Safety Benchmark for Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | SALAD-Bench is a safety benchmark specifically designed for LLMs . it provides a robust source for evaluating both attack and defense algorithms . |
| Approach: | They propose a hierarchical safety benchmark specifically designed for LLMs . it uses a taxonomy of questions spanning three levels and a robust taxonomies based on a QA pair . |
| Outcome: | The proposed safety benchmark shows that LLMs are resilient against emerging threats and the effectiveness of contemporary defense methods. |
A Knowledge-driven Adaptive Collaboration of LLMs for Enhancing Medical Decision-making (2025.emnlp-main)
Copied to clipboard
| Challenge: | Medical decision-making often involves integrating knowledge from multiple clinical specialties. static, pre-assigned roles hinder adaptability and dynamic knowledge integration. |
| Approach: | They propose a Knowledge-driven Adaptive Multi-Agent Collaboration framework that emulates large language models to emulate expert teamwork. |
| Outcome: | The proposed framework outperforms single-agent and advanced multi-agend methods on two real-world medical scenarios. |
KnowAgent: Knowledge-Augmented Planning for LLM-Based Agents (2025.findings-naacl)
Copied to clipboard
Yuqi Zhu, Shuofei Qiao, Yixin Ou, Shumin Deng, Shiwei Lyu, Yue Shen, Lei Liang, Jinjie Gu, Huajun Chen, Ningyu Zhang
| Challenge: | Large Language Models (LLMs) fail to effectively guide the planning trajectories during task solving and result in planning hallucinations. |
| Approach: | They propose a novel approach to enhance the planning capabilities of large language models by incorporating explicit action knowledge. |
| Outcome: | The proposed approach can achieve comparable or superior performance to existing baselines on HotpotQA and ALFWorld. |
OpenICL: An Open-Source Framework for In-context Learning (2023.acl-demo)
Copied to clipboard
| Challenge: | In-context Learning (ICL) is a new paradigm for large language model evaluation. |
| Approach: | They propose an open-source toolkit for ICL and LLM evaluation. |
| Outcome: | The proposed framework is highly flexible and flexible and can be easily combined with other tools to suit users' needs. |
Empower Large Language Model to Perform Better on Industrial Domain-Specific Question Answering (2023.emnlp-industry)
Copied to clipboard
Fangkai Yang, Pu Zhao, Zezhong Wang, Lu Wang, Bo Qiao, Jue Zhang, Mohit Garg, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang
| Challenge: | Large Language Models (LLMs) have gained popularity but lack specific domain knowledge in domain-specific tasks. |
| Approach: | They propose a model interaction paradigm that empowers LLM to achieve better performance on domain-specific tasks where it is not proficient. |
| Outcome: | The proposed approach outperforms the commonly used LLM with retrieval methods in domain-specific tasks. |
DANCE: Diversity-attended Dynamic Caching with Asymmetric Quantization for Test-time Adaptation of Vision-Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to test-time adaptation of vision-language models measure prediction entropy but these samples tend to approach prototypes with limited coverage of data distributions. |
| Approach: | They propose a new approach for test-time adaptation of vision-language models . they construct a dynamic cache to store diversity-aware test samples . |
| Outcome: | The proposed approach is more efficient than current methods on augmented visual models. |
Position Paper: Data-Centric AI in the Age of Large Language Models (2024.findings-emnlp)
Copied to clipboard
Xinyi Xu, Zhaoxuan Wu, Rui Qiao, Arun Verma, Yao Shu, Jingtan Wang, Xinyuan Niu, Zhenfeng He, Jiangwei Chen, Zijian Zhou, Gregory Kang Ruey Lau, Hieu Dao, Lucas Agussurja, Rachael Hwee Ling Sim, Xiaoqiang Lin, Wenyang Hu, Zhongxiang Dai, Pang Wei Koh, Bryan Kian Hsiang Low
| Challenge: | a paper proposes a data-centric perspective of AI research, focusing on large language models. |
| Approach: | They propose a data-centric viewpoint of AI research, focusing on large language models . they propose four scenarios centered around data, including data curation, attribution, knowledge transfer . |
| Outcome: | The proposed research focuses on large language models with data centric benchmarks . the proposed benchmarks can be used to develop new data curation methods . |
Measuring the Impact of (Psycho-)Linguistic and Readability Features and Their Spill Over Effects on the Prediction of Eye Movement Patterns (2022.acl-long)
Copied to clipboard
| Challenge: | Existing work to predict gaze patterns during naturalistic reading has not been conducted on general text characteristics. |
| Approach: | They propose to use two eye-tracking corpora of naturalistic reading and two language models to test their performance. |
| Outcome: | The proposed models predict eye-tracking measures during naturalistic reading and language processing. |
PubMedQA: A Dataset for Biomedical Research Question Answering (D19-1)
Copied to clipboard
| Challenge: | PubMedQA is a biomedical question answering dataset based on PubMed abstracts . 68.1% accuracy is achieved, compared to single human performance of 78.0% . |
| Approach: | They propose a biomedical question answering dataset from PubMed abstracts . the dataset is annotated by experts and has 1k instances of QA . |
| Outcome: | The proposed model achieves 68.1% accuracy compared to human performance of 78.0% and majority-baseline of 55.2%. |
SeqMMR: Sequential Model Merging and LLM Routing for Enhanced Batched Sequential Knowledge Editing (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing research has demonstrated strong performance in single-instance or few-instantial sequential editing and one-time massive editing scenarios, but the batched sequential editing paradigm remains a significant challenge. |
| Approach: | They propose a framework for batched sequential knowledge editing that leverages **SeqMMR** and a model router to merge parameters from current batch-edited models with those of their predecessors. |
| Outcome: | The proposed framework iteratively merges parameters from current batch-edited models with those of their predecessors, ensuring that newly emerging knowledge is integrated while mitigating the forgetting of previously edited knowledge. |
IG-Pruning: Input-Guided Block Pruning for Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for efficient inference rely on fixed block masks, which can lead to suboptimal performance. |
| Approach: | They propose an input-aware block-wise pruning method that dynamically selects layer masks at inference time. |
| Outcome: | The proposed method outperforms state-of-the-art static depth pruning methods . it is particularly suitable for resource-constrained deployment scenarios . |
Evaluating Robustness of Large Audio Language Models to Audio Injection: An Empirical Study (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Audio-Language Models (LALMs) are increasingly being deployed in real-world applications, yet their robustness against malicious audio injection remains underexplored. |
| Approach: | They quantitatively assess their vulnerabilities and resilience using metrics: the Defense Success Rate, Context Robustness Score, and Judgment Robustic Index. |
| Outcome: | The proposed models demonstrate significant performance disparities across four attack scenarios. |
Partial Order-centered Hyperbolic Representation Learning for Few-shot Relation Extraction (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for few-shot relation extraction are limited to labeled instances and rely on data labeling. |
| Approach: | They propose a partial order-centered hyperbolic representation learning framework which imposes constraints on relations on instances by modeling partial order in hyperbolical space. |
| Outcome: | The proposed framework outperforms baseline methods on three benchmark datasets on 1-shot settings lacking relation descriptions. |
Re-Examine Distantly Supervised NER: A New Benchmark and a Simple Approach (2025.coling-main)
Copied to clipboard
| Challenge: | Existing DS-NER approaches rely on large validation sets and test set for tuning inappropriately. |
| Approach: | They propose a method where training data is annotated using domain dictionaries and test data is analyzed by domain experts. |
| Outcome: | The proposed method reduces the need for labor-intensive manual annotations but rely on large human labeled validation set. |
Multimodal Machine Translation with Text-Image In-depth Questioning (2025.findings-acl)
Copied to clipboard
| Challenge: | Multimodal machine translation (MMT) models focus on intermodal interactions, but focus on simple interactions between nouns and entities in image, overlooking global semantic alignment. |
| Approach: | They propose a Text-Image In-depth Questioning method to deepen interactions and optimize translations by utilizing visual data to capture global semantic alignment. |
| Outcome: | The proposed method achieves state-of-the-art results on five translation directions of Multi30K and AmbigCaps, with +2.35 BLEU on the challenging MSCOCO benchmark. |