Papers by Zhao Kang
Answering Numerical Reasoning Questions in Table-Text Hybrid Contents with Graph-based Encoder and Tree-based Decoder (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for numerical reasoning are not flexible enough to handle diverse expressions. |
| Approach: | They propose a Relational Graph enhanced Hybrid table-text Numerical reasoning model with Tree decoder which captures relationship between numerical value, table schema, and text information on the encoder side. |
| Outcome: | The proposed model outperforms the baseline model and achieves state-of-the-art results on the publicly available tabletext hybrid QA benchmark. |
Set Generation Networks for End-to-End Knowledge Base Population (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing knowledge base population systems require a machine translation task to generate multiple facts, but the fact order is not considered. |
| Approach: | They propose a knowledge base population task that aims to discover facts about entities from texts and expand a KB with these facts. |
| Outcome: | The proposed networks achieve state-of-the-art (SoTA) performance on two benchmark datasets. |
Consistent Representation Learning for Continual Relation Extraction (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to train relation extraction models overfit memory samples and perform poorly on imbalanced datasets. |
| Approach: | They propose a method which uses contrastive learning and knowledge distillation to train a model on data with new relations while avoiding forgetting old ones. |
| Outcome: | The proposed method significantly outperforms state-of-the-art baselines and yields strong robustness on the imbalanced datasets. |
Agent-RewardBench: Towards a Unified Benchmark for Reward Modeling across Perception, Planning, and Safety in Real-World Multimodal Agents (2025.acl-long)
Copied to clipboard
| Challenge: | Multimodal Large Language Models (MLLMs) are developing but lack external feedback . there is no clear on how to select reward models for agents . |
| Approach: | They propose a benchmark to evaluate agent reward modeling ability in MLLMs . they use multiple dimensions and real-world agent scenarios evaluation . |
| Outcome: | The proposed benchmark evaluates agent performance in multimodal large language models . it covers perception, planning, and safety with 7 scenarios and is highly difficult and high-quality . |
Extracting Relational Facts by an End-to-End Neural Model with Copy Mechanism (P18-1)
Copied to clipboard
| Challenge: | Existing methods focus on normal class and fail to extract relational triplets precisely. |
| Approach: | They propose an end-to-end model which can jointly extract relational triplets from sentences . they employ two different strategies in decoding process: employing only one united decoder or applying multiple separated decodeurs. |
| Outcome: | The proposed model outperforms the baseline method significantly in two datasets. |
Low-Resource Comparative Opinion Quintuple Extraction by Data Augmentation with Prompting (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Comparative Opinion Quintuple Extraction (COQE) aims to predict comparative opinion quintuples from comparative sentences. |
| Approach: | They propose a low-resource approach to extract comparative opinion quintuples from comparative sentences . they propose augmentation using ChatGPT and a data-centric approach . |
| Outcome: | The proposed approach improves the existing pipeline-based method and achieves state-of-the-art results. |
Event Ontology Completion with Hierarchical Structure Evolution Networks (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for event detection require predefined schemas, but manual defining is expensive and labor-intensive. |
| Approach: | They propose a task to achieve event clustering, hierarchy expansion and type naming . they propose 'neighbor Contrastive Clustering' module and a Hierarchy-Aware Linking module . |
| Outcome: | The proposed method outperforms baseline methods on three datasets. |
Continual Few-shot Event Detection via Hierarchical Augmentation Networks (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for continual few-shot event detection use labeled data, but in real-world applications, new event types emerge continually. |
| Approach: | They propose a memory-based framework for continual few-shot event detection . they incorporate prototypical augmentation into the memory set to memorize previous event types . |
| Outcome: | The proposed method outperforms existing methods in multiple continual few-shot event detection tasks. |
CroAno : A Crowd Annotation Platform for Improving Label Consistency of Chinese NER Dataset (2021.emnlp-demo)
Copied to clipboard
Baoli Zhang, Zhucong Li, Zhen Gan, Yubo Chen, Jing Wan, Kang Liu, Jun Zhao, Shengping Liu, Yafei Shi
| Challenge: | Existing crowd annotation tools for named entity recognition (NER) focus on efficiency and don't consider consistency of datasets. |
| Approach: | They propose a crowd annotation platform for Chinese named entity recognition (NER) CroAno provides a systematic solution for improving label consistency of Chinese NER datasets. |
| Outcome: | The proposed platform improves label consistency of Chinese NER datasets. |
LEGO: A Multi-agent Collaborative Framework with Role-playing and Iterative Feedback for Causality Explanation Generation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Causality explanation generation is a generative task that aims to explain why a given cause-effect pair is true using natural language. |
| Approach: | They propose a multi-agent framework with role-playing and iterative feedback for causality explanation generation. |
| Outcome: | The proposed framework is superior to existing frameworks on WIKIWHY and e-CARE datasets. |
MenatQA: A New Dataset for Testing the Temporal Comprehension and Reasoning Abilities of Large Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) have shown nearly saturated performance on many NLP tasks. |
| Approach: | They construct multiple sensitive factors time QA which encompasses three temporal factors . they test current mainstream LLMs with different parameter sizes . |
| Outcome: | The proposed model incorporates three temporal factors with 2,853 samples . the results show that LLMs fall behind smaller models on these factors . |
BANER: Boundary-Aware LLMs for Few-Shot Named Entity Recognition (2025.coling-main)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) is a fundamental task in Natural Language Processing (NLP) that aims to detect the entity spans of text and classify them into pre-defined set of entity types. |
| Approach: | They propose a boundary-aware contrastive learning strategy to enhance the LLM’s ability to perceive entity boundaries for generalized entity spans. |
| Outcome: | The proposed framework outperforms prior methods and validates its effectiveness across a range of LLM architectures. |
Look Light, Think Heavy: What Multimodal Chain-of-Thought Reasoning Can and Cannot Do (2026.acl-long)
Copied to clipboard
| Challenge: | Existing open-source models often yield only marginal overall improvements, possibly due to an overemphasis on mathematical reasoning at the expense of broader capabilities. |
| Approach: | They evaluate 12 multimodal tasks using 14 non-reasoning models and 8 reasoning models. |
| Outcome: | The proposed method is effective in multimodal reasoning tasks, the authors show . they show that it lacks the ability to maintain deep visual introspection throughout the reasoning process. |
Generate-on-Graph: Treat LLM as both Agent and KG for Incomplete Knowledge Graph Question Answering (2024.emnlp-main)
Copied to clipboard
Yao Xu, Shizhu He, Jiabei Chen, Zihao Wang, Yangqiu Song, Hanghang Tong, Guang Liu, Jun Zhao, Kang Liu
| Challenge: | Existing methods to integrate LLMs with Knowledge Graphs (KGs) however, these methods are often incomplete to cover all the knowledge required to answer questions. |
| Approach: | They propose to integrate LLMs with Knowledge Graphs (KGs) to address insufficient knowledge and hallucination issues in Large Language Models. |
| Outcome: | The proposed method outperforms existing methods on two datasets. |
WilKE: Wise-Layer Knowledge Editor for Lifelong Knowledge Editing (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing knowledge editing methods focus on single editing, failing to meet the requirements for lifelong editing. |
| Approach: | They propose an approach that selects editing layer based on the pattern matching degree of editing knowledge across different layers in language models. |
| Outcome: | The proposed method improves on GPT2-XL and GPT-J in lifelong editing compared to state-of-the-art methods . |
Tug-of-War between Knowledge: Exploring and Resolving Knowledge Conflicts in Retrieval-Augmented Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing knowledge conflicts in RALMs can ensnare them in a tug-of-war between knowledge and evidence, limiting their practical applicability. |
| Approach: | They propose a method called Conflict-Disentangle Contrastive Decoding (CD2) to better calibrate the model’s confidence. |
| Outcome: | The proposed method can resolve knowledge conflicts in large language models with the help of conflict-disentangle contrast decoding (CD2) . |
Uncertain Local-to-Global Networks for Document-Level Event Factuality Identification (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on identifying event factuality at sentence level, which leads to conflicts between different mentions of the same event. |
| Approach: | They propose a document-level event factuality identification model that uses local uncertainty and global structure to model event factuality. |
| Outcome: | The proposed method outperforms existing models on two widely used datasets. |
TexSmart: A System for Enhanced Natural Language Understanding (2021.acl-demo)
Copied to clipboard
Lemao Liu, Haisong Zhang, Haiyun Jiang, Yangming Li, Enbo Zhao, Kun Xu, Linfeng Song, Suncong Zheng, Botong Zhou, Dick Zhu, Xiao Feng, Tao Chen, Tao Yang, Dong Yu, Feng Zhang, ZhanHui Kang, Shuming Shi
| Challenge: | TexSmart supports fine-grained named entity recognition (NER) Large-scale fine-granular entity types are expected to provide richer semantic information for downstream NLP applications. |
| Approach: | They introduce TexSmart, a text understanding system that supports fine-grained named entity recognition (NER) and enhanced semantic analysis functionalities. |
| Outcome: | The proposed system supports fine-grained named entity recognition (NER) and enhanced semantic analysis functions. |
Skeleton-Guided-Translation: A Benchmarking Framework for Code Repository Translation with Fine-Grained Quality Evaluation (2025.findings-emnlp)
Copied to clipboard
Xing Zhang, Jiaheng Wen, Fangkai Yang, Yu Kang, Pu Zhao, Junhao Wang, Maoquan Wang, Yufan Huang, Shengyu Fu, Elsie Nallipogu, Qingwei Lin, Yingnong Dang, Saravan Rajmohan, Dongmei Zhang
| Challenge: | Existing code translation benchmarks focus on individual functions, overlooking repository-level challenges like intermodule coherence and dependency management. |
| Approach: | They propose a framework for benchmarking Java-to-C# translation at the repository level . it uses a translation framework guided by skeletons and fine-grained quality evaluation . |
| Outcome: | The proposed framework improves Java-to-C# translation quality at the repository level. |
CogKTR: A Knowledge-Enhanced Text Representation Toolkit for Natural Language Understanding (2022.emnlp-demos)
Copied to clipboard
Zhuoran Jin, Tianyi Men, Hongbang Yuan, Yuyang Zhou, Pengfei Cao, Yubo Chen, Zhipeng Xue, Kang Liu, Jun Zhao
| Challenge: | Existing knowledge-enhanced methods are limited to knowledge-intensive tasks. |
| Approach: | They propose a knowledge-enhanced text representation toolkit for natural language understanding . it combines knowledge acquisition, knowledge representation, knowledge injection and knowledge application . |
| Outcome: | The proposed toolkit supports knowledge acquisition, knowledge representation, knowledge injection, and knowledge application. |
Know-MRI: A Knowledge Mechanisms Revealer&Interpreter for Large Language Models (2025.acl-demo)
Copied to clipboard
Jiaxiang Liu, Boxuan Xing, Chenhao Yuan, ChenxiangZhang ChenxiangZhang, Di Wu, Xiusheng Huang, Haida Yu, Chuhan Lang, Pengfei Cao, Jun Zhao, Kang Liu
| Challenge: | Existing interpretation methods only support tasks with specific inputs, limiting their practical applications. |
| Approach: | They propose an extensible module that matches different input data with interpretation methods and consolidates the interpreting outputs. |
| Outcome: | The proposed module can match different input data with interpretation methods and consolidate the interpreting outputs. |
Query2Triple: Unified Query Encoding for Answering Diverse Complex Queries over Knowledge Graphs (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Complex Query Answering (CQA) is a challenge task of Knowledge Graphs due to incompleteness of KGs. |
| Approach: | They propose a query embedding approach that decouples the training for simple and complex queries. |
| Outcome: | The proposed approach decouples training for simple and complex queries and achieves state-of-the-art performance over three public benchmarks. |
A Troublemaker with Contagious Jailbreak Makes Chaos in Honest Towns (2025.acl-long)
Copied to clipboard
| Challenge: | Existing research focuses on single-agent attacks and shared memory attacks, but real-world scenarios often involve independent memory. |
| Approach: | They propose a large-scale, multi-agent, multitopology attack evaluation framework that exploits the memory of an agent to make it more vulnerable to jailbreak attacks. |
| Outcome: | The proposed framework improves on the troublemaker makes chaos in Honest Town task with 23.51%, 18.95%, and 52.93% improvements in line, star topologies, and 100-agent settings. |
CMQA: A Dataset of Conditional Question Answering with Multiple-Span Answers (2022.coling-1)
Copied to clipboard
| Challenge: | Existing QA datasets only contain unconditional and parallel answers . conditional question answering with hierarchical multi-span answers is challenging for the community to solve . |
| Approach: | They propose a conditional question answering task with hierarchical multi-span answers . they propose CMQA, which contains conditional and hierarchic samples . |
| Outcome: | The proposed task can be used to build more reliable and sophisticated QA systems. |
Optimizing User Profiles via Contextual Bandits for Retrieval-Augmented LLM Personalization (2026.acl-long)
Copied to clipboard
Linfeng Du, Ye Yuan, Zichen Zhao, Fuyuan Lyu, Emiliano Penaloza, Xiuying Chen, Zipeng Sun, Jikun Kang, Laurent Charlin, Xue Liu, Haolun Wu
| Challenge: | Existing approaches for personalizing large language models require modifying parameters. |
| Approach: | They propose a lightweight approach to personalizing large language models via retrieval augmentation . relevance serves as an unreliable proxy for utility, they argue . |
| Outcome: | The proposed framework outperforms strong heuristic and retrieval-augmented baselines on nine personalization tasks. |
Cutting Off the Head Ends the Conflict: A Mechanism for Interpreting and Mitigating Knowledge Conflicts in Language Models (2024.findings-acl)
Copied to clipboard
Zhuoran Jin, Pengfei Cao, Hongbang Yuan, Yubo Chen, Jiexin Xu, Huaijun Li, Xiaojian Jiang, Kang Liu, Jun Zhao
| Challenge: | Existing methods to expand internal memory boundaries of language models by providing external context can often conflict, leading to knowledge conflicts. |
| Approach: | They propose a method that prunes conflicting attention heads without updating model parameters. |
| Outcome: | The proposed method can flexibly control eight LMs to use internal memory or external context without updating model parameters. |
EventOA: An Event Ontology Alignment Benchmark Based on FrameNet and Wikidata (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on event ontologies focus on entity-based OA, and neglect event-based one . however, independent development of event ontoologies often results in heterogeneous representations that raise the need for establishing alignments between semantically related events. |
| Approach: | They propose a multi-view event ontology alignment method that utilizes description information and neighbor information to obtain richer representations of the event ontoologies. |
| Outcome: | The proposed method outperforms existing entity-based methods and can serve as a strong baseline for future research. |
R³A: Reinforced Reasoning for Relevance Assessment for RAG in User-Generated Content Platforms (2026.acl-industry)
Copied to clipboard
| Challenge: | Existing approaches to query–document relevance assessment are limited . ambiguous user intent and asymmetric relevance are challenges for RAG platforms . |
| Approach: | They propose a decomposed reasoning model for relevance assessment that decomposes query intent into intent inference and evidence grounding. |
| Outcome: | The proposed model outperforms strong baselines on offline benchmarks and achieves significant gains in large-scale online A/B testing. |
Focus on Your Question! Interpreting and Mitigating Toxic CoT Problems in Commonsense Reasoning (2024.acl-long)
Copied to clipboard
| Challenge: | Large language models exhibit high-level commonsense reasoning abilities, especially with enhancement methods like Chain-of-Thought (CoT). |
| Approach: | They propose a chain-of-thought-like method to elicit models' potential abilities to generate rationales and answers that are based on attribution tracing and causal tracers to probe the internal working mechanism of the LLM. |
| Outcome: | The proposed method eliminates Toxic CoT problems and improves the model’s overall commonsense reasoning performance by 5.5%. |
Evolving Knowledge Distillation with Large Language Models and Active Learning (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies have focused on the direct use of large language models for text generation and labeling, without fully exploring their potential to comprehend the target task and acquire valuable knowledge. |
| Approach: | They propose to distill the knowledge of large language models into smaller models by generating annotated data. |
| Outcome: | The proposed method improves the performance of small domain models while enhancing the ability of large language models. |
Improve Rule Retrieval and Reasoning with Self-Induction and Relevance ReEstimate (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing rule retrieval methods suffer from low accuracy due to semantic gap between instantiated facts and abstract representations of rules. |
| Approach: | They propose a method that induces inferential rules that might offer benefits for reasoning by abstracting the underlying knowledge and logical structure in queries. |
| Outcome: | The proposed method improves retrieval effectiveness and accuracy across settings. |
KnowDis: Knowledge Enhanced Data Augmentation for Event Causality Detection via Distant Supervision (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods of event causality detection use hand-labeled training data. |
| Approach: | They propose a framework for event causality detection that augments training data via distant supervision. |
| Outcome: | The proposed framework outperforms existing methods on two benchmark datasets . it outperformed previous methods by a large margin assisted with automatically labeled training data. |
Beyond Ranking: Fine-Grained Diagnostics and Self-Improvement for MLLMs (2026.acl-long)
Copied to clipboard
| Challenge: | Current paradigms rely on holistic scoring and static leaderboards to disentangle fine-grained competencies. |
| Approach: | They propose a framework to shift the focus from ranking to fine-grained diagnosis. |
| Outcome: | The proposed framework surpasses the strongest baseline by 7.92%. |
On the Empirical Complexity of Reasoning and Planning in LLMs (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Evidence shows that the relative performance of CoT, ToT, and their variants may vary from task to task. |
| Approach: | They propose to use chain-of-thought (CoT), tree-of thought (ToT), and related techniques to solve complex reasoning tasks with Large Language Models. |
| Outcome: | The proposed methods outperform the linear structure of CoT on hard reasoning tasks. |
Harmonizing the Past, Present, and Future: A Null-Space Constrained Region-Specific Method for Continual Learning in LLMs (2026.acl-long)
Copied to clipboard
Jinhui Chen, Shizhu He, Xingchang Yang, Huanxuan Liao, Yequan Wang, Xiangwen Liao, Wenhao Teng, Kang Liu, Jun Zhao
| Challenge: | Existing continual learning paradigms prioritize instant performance through dense updates, leading to catastrophic forgetting and rapid exhaustion of model capacity. |
| Approach: | They propose a method that preserves previously acquired knowledge and acquires new task-specific skills while preserving sufficient parameter capacity for subsequent adaptation. |
| Outcome: | The proposed method is based on the brain's functional partitioning and can be used to map tasks between specialized and generalist neurons. |
Transparentize the Internal and External Knowledge Utilization in LLMs with Trustworthy Citation (2025.findings-acl)
Copied to clipboard
| Challenge: | citation generation and retrieval-augmented generation are still lacking in large language models due to hallucinations. |
| Approach: | They propose a retrieval-augmented citation generation task that requires models to generate citations considering both external and internal knowledge while providing trustworthy references. |
| Outcome: | The proposed method achieves better performance across scenarios compared to baselines . retrieval quality, question types, and model knowledge influence trustworthiness . |
ExpNote: Black-box Large Language Models are better Task Solvers with Experience Notebook (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown great power in solving various tasks but fail in many specific tasks. |
| Approach: | They propose a framework to help black-box LLMs better adapt to unfamiliar tasks by reflecting and noting experiences from training data and retrieving them from external memory during testing. |
| Outcome: | The proposed framework improves the performance of black-box Large Language Models on multiple tasks and demonstrates that it is a good choice for the future. |
Interpreting Sentiment Composition with Latent Semantic Tree (2023.findings-acl)
Copied to clipboard
| Challenge: | Current researches on sentiment classification are shifting from improving model performance to interpretability. |
| Approach: | They propose a new tree form capable of interpreting sentiment composition in a principled way. |
| Outcome: | The proposed tree can explain sentiment composition in a principled way. |
MULFE: A Multi-Level Benchmark for Free Text Model Editing (2024.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have impressive capabilities in comprehending human language and vast parametric knowledge obtained from large corpora. |
| Approach: | They propose a multi-level benchmark for free text model editing to bridge the gap . they categorize probe queries into three levels of generalization . |
| Outcome: | The proposed method improves the generalization performance of large langugae models. |
Break Through the Compression Bottleneck: From Theory to Practice (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing compression methods suffer from bottleneck issues when compression ratio is increased. |
| Approach: | They propose a novel approach to combine low-rank decomposition and quantization methods to reduce the compression bottleneck. |
| Outcome: | The proposed method reduces the computational and memory overhead of existing methods while maintaining model accuracy. |
Scene Restoring for Narrative Machine Reading Comprehension (2020.emnlp-main)
Copied to clipboard
| Challenge: | Narrative passages describe a chain of events, which helps the machine understand the passage comprehensively. |
| Approach: | They propose a method to let machine read narrative passages with their prior knowledge . they build a scene graph using Atomic as external knowledge and encode it with GDIN . |
| Outcome: | The proposed method achieves state-of-the-art on a Story Cloze Test and CosmosQA datasets. |
Document-Level Relation Extraction via Pair-Aware and Entity-Enhanced Representation Learning (2022.coling-1)
Copied to clipboard
| Challenge: | Existing document-level relation extraction methods are sparse in relational entity pairs and the representation of entity pairs is insufficient. |
| Approach: | They propose a Pair-Aware and Entity-Enhanced(PAEE) model to solve two challenges . they propose predicting potential relational entity pairs and assembling directional entity pairs . |
| Outcome: | The proposed model can obtain state-of-the-art performance on four benchmark datasets . it can predict potential relational entity pairs and assemble directional entity pairs . |
Efficient Prior-Guided Reasoning for Robust Retrieval-Augmented Generation under Conflicts (2026.acl-long)
Copied to clipboard
| Challenge: | Retrieval-Augmented Generation (RAG) has become a standard paradigm for grounding Large Language Models (LLMs) however, performance degrades substantially when faced with noisy, outdated, or conflicting retrieved information. |
| Approach: | They propose a framework that explicitly elicits the model’s parametric knowledge as prior information to guide reasoning on retrieved documents. |
| Outcome: | The proposed framework achieves robust performance across varying degrees of external inconsistency and noise. |
CN-AutoMIC: Distilling Chinese Commonsense Knowledge from Pretrained Language Models (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing commonsense knowledge graphs are limited to English, hindering research in non-English languages. |
| Approach: | They propose a Chinese CKG generated from multilingual PLMs that is translated into Chinese . they propose 'generate-by-category' strategy to reduce invalid generation . |
| Outcome: | The proposed CKG has high quality and diversity, surpassing the direct translation version of similar English CKGs. |
HyperCore: Hyperbolic and Co-graph Representation for Automatic ICD Coding (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for ICD coding ignore Code Hierarchy and Code Co-occurrence . cost of manual coding estimated to be $25 billion per year in the US . |
| Approach: | They propose a hyperbolic representation method to leverage the code hierarchy and a graph convolutional network to utilize the code co-occurrence. |
| Outcome: | The proposed model outperforms state-of-the-art methods on two widely used datasets. |
Hetero-Designer: Automated Design of Multi-Agent Systems with Heterogeneous LLMs (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to design LLM-based Multi-agent systems are constrained by homogeneous LLMs. |
| Approach: | They propose an automated design of heterogeneous-LLMs-based MAS with a binary-star transformer and an autoregressive graph generation pipeline. |
| Outcome: | The proposed pipeline is high-performing on various benchmarks and extensible to unseen LLMs and roles. |
MotivGraph-SoIQ: Integrating Motivational Knowledge Graphs and Socratic Dialogue for Enhanced LLM Ideation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have limitations in grounding ideas and mitigating confirmation bias during refinement. |
| Approach: | They propose a framework that integrates a Motivational Knowledge Graph with a Q-Driven Socratic Ideator to enhance LLM ideation. |
| Outcome: | The proposed framework enhances LLM ideation by integrating a Motivational Knowledge Graph with a Q-Driven Socratic Ideator. |
Collective Event Detection via a Hierarchical and Bias Tagging Networks with Gated Multi-level Attention Mechanisms (D18-1)
Copied to clipboard
| Challenge: | Existing approaches to ACE event detection treat multiple events in one sentence as independent ones and recognize them separately. |
| Approach: | They propose a hierarchical and bias tagging network framework to detect multiple events in one sentence collectively and a gated multi-level attention mechanism to automatically extract and fuse the sentence-level and document-level information. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on a 2005 ACE dataset. |
Towards Adaptive Mechanism Activation in Language Agent (2025.coling-main)
Copied to clipboard
| Challenge: | Existing Language Agents rely on a fixed mechanism or a set of mechanisms activated in a predefined order, limiting their adaptation to varied potential task solution structures. |
| Approach: | They propose to use language agents to learn to activate different mechanisms without relying on expert models to optimize their adaptation to different task solutions. |
| Outcome: | The proposed approach improves agent performance by enabling it to activate the appropriate mechanisms according to the potential characteristics of the task. |
Distantly Supervised Relation Extraction in Federated Settings (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to label training datasets using distant supervision are expensive and cannot cover all walks of life. |
| Approach: | They propose a federated denoising framework to suppress label noise in federation . they propose to use a multiple instance learning based denoisation method to select reliable sentences . |
| Outcome: | The proposed method can select reliable sentences via cross-platform collaboration. |
S3Eval: A Synthetic, Scalable, Systematic Evaluation Suite for Large Language Model (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing benchmarks fail to evaluate extremely long-context LLMs or analyze their limitations. |
| Approach: | They propose a Synthetic, Scalable, Systematic evaluation suite for LLMs using SQL execution. |
| Outcome: | The proposed evaluation suite is able to scale text length and difficulty across scenarios and provides strong correlations with real-world benchmarks. |
TencentPretrain: A Scalable and Flexible Toolkit for Pre-training Models of Different Modalities (2023.acl-demo)
Copied to clipboard
Zhe Zhao, Yudong Li, Cheng Hou, Jing Zhao, Rong Tian, Weijie Liu, Yiren Chen, Ningyuan Sun, Haoyan Liu, Weiquan Mao, Han Guo, Weigang Gou, Taiqiang Wu, Tao Zhu, Wenhang Shi, Chen Chen, Shan Huang, Sihong Chen, Liqun Liu, Feifei Li, Xiaoshuai Chen, Xingwu Sun, Zhanhui Kang, Xiaoyong Du, Linlin Shen, Kimmo Yan
| Challenge: | Several pre-training models of different modalities are showing a rising trend of homogeneity in their model structures. |
| Approach: | They propose a toolkit that supports pre-training models of different modalities. |
| Outcome: | The proposed toolkit can match the performance of the original implementations on text, vision, and audio benchmarks. |
Whispers that Shake Foundations: Analyzing and Mitigating False Premise Hallucinations in Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models generate hallucinated text when confronted with false premise questions . authors propose a method to mitigate false premises hallucinosity . |
| Approach: | They propose a method to constrain false premise attention heads during the model inference process. |
| Outcome: | The proposed method improves performance by constraining false premise attention heads . it yields a notable increase of nearly 20% of model performance . |
Generating Temporally-ordered Event Sequences via Event Optimal Transport (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for temporal event ordering and event infilling ignore the global semantics of events, and the model adopts a word-level objective to model events in texts. |
| Approach: | They propose a temporal event ordering and event infilling task using a model that uses maximum likelihood estimation to model events in texts. |
| Outcome: | The proposed model outperforms existing models on all evaluation datasets. |
LINKED: Eliciting, Filtering and Integrating Knowledge in Large Language Model for Commonsense Reasoning (2024.findings-emnlp)
Copied to clipboard
Jiachun Li, Pengfei Cao, Chenhao Wang, Zhuoran Jin, Yubo Chen, Kang Liu, Xiaojian Jiang, Jiexin Xu, Jun Zhao
| Challenge: | Large language models (LLMs) often exhibit poor performance on knowledge-intensive tasks, such as commonsense reasoning. |
| Approach: | They propose a method to elicit, filter and integrate knowledge in large language models (LINKED) they propose 'reward model' to filter out noisy knowledge and 'take marginal consistent reasoning module' |
| Outcome: | The proposed method outperforms SOTA baselines on two commonsense reasoning tasks. |
DiffusionSL: Sequence Labeling via Tag Diffusion Process (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Sequence Labeling (SL) is a long-standing field of natural language processing. |
| Approach: | They propose a framework that utilizes a conditional discrete diffusion model for generating discrete tag data. |
| Outcome: | The proposed framework outperforms gpt-3.5-turbo on multiple benchmark datasets and tasks. |
DCFEE: A Document-level Chinese Financial Event Extraction System based on Automatically Labeled Training Data (P18-4)
Copied to clipboard
| Challenge: | Existing methods to extract events from documents are limited due to the high cost of labeling . Experimental results demonstrate the effectiveness of a document-level Chinese financial event extraction system. |
| Approach: | They propose a document-level Chinese financial event extraction framework which detects event mentions and extracts events from financial news. |
| Outcome: | The proposed system detects event mentions and extracts events from financial news . it can generate large scale labeled data and extract events from entire document . |
I²B-LPO: Latent Policy Optimization via Iterative Information Bottleneck (2026.acl-long)
Copied to clipboard
Huilin Deng, Hongchen Luo, Yue Zhu, Long Li, Zhuoyue Chen, Xinghao Zhao, Ming LI, Chuyang Zhao, Jihai Zhang, MengChang Wang, Yang Cao, Yu Kang
| Challenge: | Existing methods for large language model reasoning suffer from exploration collapse due to the semantic homogeneity of random rollouts. |
| Approach: | They propose to use latent policy optimization via iterative information bottleneck to optimize reasoning trajectories by diversifying reasoning . |
| Outcome: | Empirical results show that the proposed method achieves state-of-the-art performance with margins of up to 5.3% in accuracy and 7.4% in diversity metrics. |
Find Parent then Label Children: A Two-stage Taxonomy Completion Method with Pre-trained Language Model (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing taxonomies focus on adding concepts to the leaf nodes of the existing tree, which does not fully utilize the taxonomy’s knowledge and is unable to update the original taxomy structure. |
| Approach: | They propose a two-stage method called ATTEMPT for taxonomy completion that inserts new concepts into the correct position by finding a parent node and labeling child nodes. |
| Outcome: | The proposed method performs best on taxonomy completion and extension tasks, surpassing existing methods. |
LLaSA: Large Language and Structured Data Assistant (2025.naacl-long)
Copied to clipboard
Yao Xu, Shizhu He, Jiabei Chen, ZengXiangrong ZengXiangrong, Bingning Wang, Guang Liu, Jun Zhao, Kang Liu
| Challenge: | Structured knowledge grounding (SKG) tasks are a key part of many NLP applications. |
| Approach: | They propose a framework for enhancing LLMs' ability to handle structured data . they represent various types of structured data in a unified hypergraph format . |
| Outcome: | The proposed framework outperforms existing methods on SKG tasks using LoRA finetuning. |
ZhuJiu: A Multi-dimensional, Multi-faceted Chinese Benchmark for Large Language Models (2023.emnlp-demo)
Copied to clipboard
Baoli Zhang, Haining Xie, Pengfan Du, Junhao Chen, Pengfei Cao, Yubo Chen, Shengping Liu, Kang Liu, Jun Zhao
| Challenge: | Various types of LLMs have recently been rapidly developing, such as Llama2 and ChatGLM2 . |
| Approach: | They propose a benchmark that comprehensively evaluates LLMs across 7 ability dimensions covering 51 tasks. |
| Outcome: | The proposed benchmarks are comprehensive and systematic, with a high level of accuracy and authority. |
Neural Incompatibility: The Unbridgeable Gap of Cross-Scale Parametric Knowledge Transfer in Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have a transparent brain with accessible parameters that encode extensive knowledge, which can be analyzed, located and transferred. |
| Approach: | They propose a new paradigm that aligns parametric spaces of LLMs using several training steps without following training. |
| Outcome: | The proposed model aligns parametric spaces across scales using only training steps without following training. |
Learning How to Remember: A Meta-Cognitive Management Method for Structured and Transferable Agent Memory (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches store memory in fixed representations and reuse it at a single or implicit level of abstraction, which limits generalization and often leads to negative transfer when distribution shift. |
| Approach: | They propose a Meta-Cognitive Memory Abstraction method which decouples task execution from memory management by combining a frozen task model with a learned memory copilot. |
| Outcome: | Experiments on ALFWorld, ScienceWorld, and BabyAI show that the proposed method improves performance, out-of-distribution generalization, and cross-task transfer over several baselines. |
Pattern-revising Enhanced Simple Question Answering over Knowledge Bases (C18-1)
Copied to clipboard
| Challenge: | Simple question answering over knowledge bases is one of the most important natural language processing tasks. |
| Approach: | They propose to conduct pattern extraction and entity linking first and put forward pattern revising procedure to mitigate the error propagation problem. |
| Outcome: | The proposed method outperforms the current state-of-the-art in this task by an absolute large margin. |
Awakening Augmented Generation: Learning to Awaken Internal Knowledge of Large Language Models for Question Answering (2025.coling-main)
Copied to clipboard
| Challenge: | Recent studies indicate that Large Language Models model rich knowledge, but it is often not activated and awakened. |
| Approach: | They propose a framework that leverages richer context to enhance question answering . Explicit awakening fine-tunes a context generator to create a synthetic, compressed document that functions as symbolic context. |
| Outcome: | The proposed framework mimics the human ability to answer questions using only thinking and recalling to compensate for knowledge gaps. |
CiteLab: Developing and Diagnosing LLM Citation Generation Workflows via the Human-LLM Interaction (2025.acl-demo)
Copied to clipboard
| Challenge: | Existing frameworks for enabling Large Language Models to generate citations are lacking . however, they can still produce hallucinated responses that are non-factual or irrelevant to the input. |
| Approach: | They propose an open-source and modular framework for enabling LLMs to generate citations in Question-Answering tasks. |
| Outcome: | The proposed framework is extensible and paired with a visual interface, Citefix, facilitating case study and modification of existing citation generation methods. |
RexUIE: A Recursive Method with Explicit Schema Instructor for Universal Information Extraction (2023.findings-emnlp)
Copied to clipboard
Chengyuan Liu, Fubang Zhao, Yangyang Kang, Jingyuan Zhang, Xiang Zhou, Changlong Sun, Kun Kuang, Fei Wu
| Challenge: | Named Entity Recognition (NER) and Relation Extraction (RE) models have limited success when extracting general schemas such as quadruples and quintuples. |
| Approach: | They propose a formal formulation that covers almost all extraction schemas and a Recursive Method with Explicit Schema Instructor for UIE. |
| Outcome: | The proposed method shows strong performance under full-shot and few-shot settings and achieves state-of-the-art results on the tasks of extracting complex schemas. |
Augmentation, Retrieval, Generation: Event Sequence Prediction with a Three-Stage Sequence-to-Sequence Approach (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods to predict event sequences are complex and ignore the knowledge of external events. |
| Approach: | They propose a statistical induction problem to generate a sequence of events by exploring the similarity between the given goal and known sequences of events. |
| Outcome: | The proposed model outperforms existing methods on an event sequence prediction task. |
More Than Catastrophic Forgetting: Integrating General Capabilities For Domain-Specific LLMs (2024.emnlp-main)
Copied to clipboard
Chengyuan Liu, Yangyang Kang, Shihang Wang, Lizhi Qing, Fubang Zhao, Chao Wu, Changlong Sun, Kun Kuang, Fei Wu
| Challenge: | a recent study shows that performance on general tasks decreases after Large Language Models are fine-tuned on domain-specific tasks. |
| Approach: | They propose a general capability integration approach to integrate general capabilities and domain knowledge within a single instance. |
| Outcome: | The proposed method improves performance on domain-specific tasks by integrating general capabilities and domain knowledge. |
Leveraging Explicit Lexico-logical Alignments in Text-to-SQL Parsing (2022.acl-short)
Copied to clipboard
| Challenge: | Text-to-SQL parsing aims to parse natural language questions into SQL queries . current attention-based approaches can only model alignments at the token level . |
| Approach: | They propose a method to leverage explicit lexico-logical alignments by identifying possible phrase-level alignments and injecting them as additional contexts into the parsing procedure. |
| Outcome: | The proposed approach improves performance by 3.4% on Squall. |
Connecting Embeddings for Knowledge Graph Entity Typing (2020.acl-main)
Copied to clipboard
| Challenge: | Existing knowledge graphs suffer from incompleteness and miss important facts, jeopardizing their usefulness in downstream tasks such as question answering. |
| Approach: | They propose a method which is trained by utilizing local typing knowledge from existing entity type assertions and global triple knowledge in KGs. |
| Outcome: | The proposed model favors inferences that agree with both entity type instances and triple knowledge in KGs. |
LLM-based Medical Assistant Personalization with Short- and Long-Term Memory Coordination (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing studies have focused on learning and enhancing large language models to understand and generate natural language. |
| Approach: | They propose a computational bionic memory mechanism equipped with a parameter-efficient fine-tuning schema to personalize medical assistants. |
| Outcome: | The proposed method can enhance the response with aware of previous mistakes for new queries during a dialogue session, but the training costs are prohibitive. |
Curr-ReFT: Overcoming Training Bottlenecks in Small-scale Vision-Language Models via Curriculum Reinforcement Finetuning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | State-of-the-art vision-language models require massive scaling that limits practical deployment. |
| Approach: | They propose to use supervised fine-tuning to train small-scale vision-language models but face out-of-domain collapse when trained with traditional supervised learning (SFT). |
| Outcome: | Experiments show that curr-reFT achieves state-of-the-art performance across visual tasks in both in- and out-of domain settings and benchmarks. |
Improving Zero-shot LLM Re-Ranker with Risk Minimization (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are effective Query Likelihood Models, but their estimation is biased and the model's accuracy is poor. |
| Approach: | They propose a framework which leverages Bayesian decision theory to quantify and mitigate this bias. |
| Outcome: | The proposed framework improves re-ranking, especially in improving the Top-1 accuracy. |
Landmark Embedding: A Chunking-Free Embedding Method For Retrieval Augmented Long-Context Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods for retrieval augmentation work with chunked contexts, which leads to poor quality of semantic representation and incomplete retrieval of useful information. |
| Approach: | They propose a method for retrieval augmentation of long-context language modeling using landmark embedding. |
| Outcome: | The proposed method outperforms existing retrieval methods with a notable advantage. |
ZhuJiu-Knowledge: A Fairer Platform for Evaluating Multiple Knowledge Types in Large Language Models (2024.naacl-demo)
Copied to clipboard
| Challenge: | evaluating the knowledge of large language models (LLMs) is crucial, and rapid advancement in large language modeling has heightened the importance of model evaluations. |
| Approach: | They propose a fairer benchmark for evaluating multiple knowledge types of LLMs by focusing on commonsense knowledge, world knowledge, and language knowledge. |
| Outcome: | The proposed framework evaluates 14 current mainstream LLMs and provides a detailed discussion and analysis of their results. |
Efficient and Accurate Prompt Optimization: the Benefit of Memory in Exemplar-Guided Reflection (2025.acl-long)
Copied to clipboard
Cilin Yan, Jingyun Wang, Lin Zhang, Ruihui Zhao, Xiaopu Wu, Kai Xiong, Qingsong Liu, Guoliang Kang, Yangyang Kang
| Challenge: | Recent work utilizes feedbacks generated from erroneous cases to guide prompt optimization . previous methods rely on computational resources and powerful GPUs . |
| Approach: | They propose an automatic prompt engineering method that leverages feedbacks from erroneous cases to guide prompt optimization. |
| Outcome: | The proposed method surpasses state-of-the-art methods with less steps and lower computational resources. |
Exploiting Contextual Knowledge in LLMs through 𝒱-usable Information based Layer Enhancement (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to enhance the context-faithfulness of Large Language Models (LLMs) ignore the fundamental mechanism of how contextual information is processed within LLMs’ internal states. |
| Approach: | They propose a method that enhances the utilization of contextual knowledge within LLMs’ internal representations by employing V-usable information analysis. |
| Outcome: | The proposed method improves context-faithfulness generation in Question-Answering tasks, particularly in scenarios involving unknown or conflicting contextual knowledge. |
A Large-Scale Chinese Multimodal NER Dataset with Speech Clues (2021.acl-long)
Copied to clipboard
| Challenge: | Using a large-scale dataset, we explore Chinese named entity recognition (NER) with both textual and acoustic contents. |
| Approach: | They propose a Chinese multimodal named entity recognition dataset . their corpus contains 42,987 annotated sentences and 71 hours of speech data . |
| Outcome: | The proposed model yields state-of-the-art (SoTA) results on Chinese multimodal named entity recognition (NER) based on 42,987 annotated sentences and 71 hours of speech data. |
Beyond Detection: Evaluating Fallacy Awareness of LLMs in Interactive Scenarios (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models fail to recognize fallacious reasoning in real-world interactions despite strong performance on static fallacy detection tasks. |
| Approach: | They propose a Chinese benchmark to assess fallacy awareness without explicit cues . they propose 'fate' evaluation framework that assesses fallacy without explicit . |
| Outcome: | The proposed framework assesses fallacy awareness without explicit cues, combining natural dialogue responses and reasoning-based decisions. |
Commonsense Knowledge Editing Based on Free-Text in LLMs (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing knowledge editing methods focus on editing triple-based facts such as entity-relation pairs and events (multiple triplets). |
| Approach: | They propose a Knowledge Localization for Free-Text method which uses a Dynamics-aware Module to locate the parameter positions corresponding to commonsense knowledge and a knowledge editing module to update knowledge. |
| Outcome: | The proposed method exploits the potential of the MLP and Attention layers and edits commonsense knowledge based on free-text. |
MedConQA: Medical Conversational Question Answering System based on Knowledge Graphs (2022.emnlp-demos)
Copied to clipboard
| Challenge: | Existing medical dialogue systems have the problems of weak scalability, insufficient knowledge, and poor controllability. |
| Approach: | They propose a medical conversational question-answering system based on the knowledge graph to improve scalability and controllability. |
| Outcome: | The proposed system can conduct knowledge-grounded dialogues with users, using a Chinese medical knowledge graph and a large-scale dataset. |
HMoE: Heterogeneous Mixture of Experts for Language Modeling (2025.emnlp-main)
Copied to clipboard
An Wang, Xingwu Sun, Ruobing Xie, Shuaipeng Li, Jiaqi Zhu, Zhen Yang, Pinxue Zhao, Weidong Han, Zhanhui Kang, Di Wang, Naoaki Okazaki, Cheng-zhong Xu
| Challenge: | Mixture of Experts (MoE) models use homogeneous experts with diverse capacities, resulting in a lack of expert specialization and parameter utilization. |
| Approach: | They propose a framework where experts differ in size and possess diverse capacities . they propose HMoE to encourage frequent activation of smaller experts . |
| Outcome: | The proposed framework outperforms homogeneous homogenous MoE models on evaluation benchmarks and achieves lower loss rate with fewer activated parameters. |
Decoupling Mixture-of-Graphs: Unseen Relational Learning for Knowledge Graph Completion by Fusing Ontology and Textual Experts (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for knowledge Graph Completion (KGC) fail in unseen relation representations. |
| Approach: | They propose to use three kinds of graphs to obtain unseen relation representations . they propose to decouple mixture-of-graph experts (DMoG) for unseened relations learning . |
| Outcome: | The proposed method outperforms the state-of-the-art methods on unseen relation representations. |
Learning with Partial Annotations for Event Detection (2023.acl-long)
Copied to clipboard
| Challenge: | Event detection (ED) requires fully labeled and high-quality training data. |
| Approach: | They propose a new trigger localization formulation using contrastive learning to distinguish ground-truth triggers from contexts and show a decent robustness for addressing partial annotation noise. |
| Outcome: | The proposed approach achieves an F1 score of over 60% in an extreme scenario where 90% of events are unlabeled. |
LearnDA: Learnable Knowledge-Guided Data Augmentation for Event Causality Identification (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for event causality identification (ECI) rely on annotated training data. |
| Approach: | They propose a method to augment training data for event causality identification by iteratively generating new examples and classifying event causalities in a dual learning framework. |
| Outcome: | The proposed method outperforms existing methods on EventStoryLine and Causal-TimeBank. |
Vocabulary Pyramid Network: Multi-Pass Encoding and Decoding with Multi-Level Vocabularies for Response Generation (P19-1)
Copied to clipboard
| Challenge: | Conventional methods employ a fixed vocabulary and one-pass decoding, which make them prone to safe and general responses and lack further refinement to the first generated raw sequence. |
| Approach: | They propose a Vocabulary Pyramid Network which integrates multi-pass encoding and decoding with multi-level vocabularies into response generation. |
| Outcome: | The proposed system outperforms strong baselines on English Twitter and Chinese Weibo datasets. |
Domain-Lifelong Learning for Dialogue State Tracking via Knowledge Preservation Networks (2021.emnlp-main)
Copied to clipboard
Qingbin Liu, Pengfei Cao, Cao Liu, Jiansong Chen, Xunliang Cai, Fan Yang, Shizhu He, Kang Liu, Jun Zhao
| Challenge: | Existing offline DST models require a fixed dataset to train . Existing domain-lifelong learning methods are impractical in real-world applications . |
| Approach: | They propose a domain-lifelong learning method to continuously train a DST model on new data to learn incessantly emerging new domains while avoiding catastrophically forgetting old learned domains. |
| Outcome: | The proposed method outperforms state-of-the-art lifelong learning methods by 4.25% and 8.27% on the MultiWOZ and the SGD benchmarks. |
Teaching Small Language Models to Reason for Knowledge-Intensive Multi-Hop Question Answering (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models can teach small language models to solve complex reasoning tasks by Chain-of-thought Distillation (CoTD) e.g., mathematical question answering. |
| Approach: | They propose a method that distills two student models to solve a multi-hop question . they use chain-of-thought distillation to generate step-by-step reasoning paths . |
| Outcome: | The proposed method surpasses existing methods on knowledge-intensive multi-hop questions. |
Shuttle Between Symbolic Instructions and Neural Parameters of Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Despite their distinct external representations, a deeper analysis reveals their intrinsic nature: instructions serve as a natural language compression devised by humans for data governing specific mapping patterns, whereas parameters act as 'neuro compression' of the same task data. |
| Approach: | They propose a neural network framework to model and learn the bi-directional mappings between instructions and parameters of large language models by evaluating it on the tasks of instruction deduction and induction. |
| Outcome: | The proposed framework can map one of the instructions/parameters to the other by evaluating it on the tasks of instruction deduction and induction. |
CogMG: Collaborative Augmentation Between Large Language Model and Knowledge Graph (2024.acl-demos)
Copied to clipboard
| Challenge: | Large language models (LLMs) are susceptible to generating hallucinated content and often encompass factually inaccurate information. |
| Approach: | They propose a framework that leverages knowledge graphs to address the limitations of Large Language Models (LLMs) they identify and decompose required knowledge triples that are not present in the KG, enriching them and aligning updates with real-world demands. |
| Outcome: | The proposed framework reduces hallucinations and increases factual accuracy in QA scenarios while retaining the same quality of knowledge. |
Why and How LLMs Benefit from Knowledge Introspection in Commonsense Reasoning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) can improve commonsense reasoning by generating intermediate knowledge, but the effectiveness of this knowledge introspection is not always guaranteed. |
| Approach: | They propose a training-free strategy that optimizes introspection via two stages: Knowledge Detection and Knowledge Regeneration. |
| Outcome: | The proposed approach mitigates the limitations of standard introspection and has consistent performance gains across all settings. |
CTFN: Hierarchical Learning for Multimodal Sentiment Analysis Using Coupled-Translation Fusion Network (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for multimodal sentiment analysis require all modalities as input, thus are sensitive to missing modality at predicting time. |
| Approach: | They propose to model bi-direction interplay via couple learning and exploit multiple bi-directional translations to exploit multimodal fusion embeddings. |
| Outcome: | The proposed framework achieves state-of-the-art or often competitive performance on two multimodal benchmarks with extensive ablation studies. |
Reconstructing Event Regions for Event Extraction via Graph Attention Networks (2020.aacl-main)
Copied to clipboard
| Challenge: | Existing approaches for event extraction focus on sentence-level event extraction, but they lack a broader view of the document context. |
| Approach: | They build graphs with candidate event filler extractions enriched by sentential embeddings as nodes and use graph attention networks to identify event regions in a document and aggregate event information. |
| Outcome: | The proposed method performs well on two languages and shows that it is faster than previous methods. |
Class Lifelong Learning for Intent Detection via Structure Consolidation Networks (2023.findings-acl)
Copied to clipboard
Qingbin Liu, Yanchao Hao, Xiaolong Liu, Bo Li, Dianbo Sui, Shizhu He, Kang Liu, Jun Zhao, Xi Chen, Ningyu Zhang, Jiaoyan Chen
| Challenge: | Existing intent detection models can only handle predefined intent classes in the offline environment. |
| Approach: | They propose a method that continually learns new intent classes from new data . structure-based retrospection and contrastive knowledge distillation are used to solve these problems . |
| Outcome: | The proposed method outperforms existing models on three benchmarks. |
Towards Graph-hop Retrieval and Reasoning in Complex Question Answering over Textual Database (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing benchmarks for textual question answering only focus on single-chain or single-hop retrieval . Existing approaches to answer complex questions have limitations . |
| Approach: | They propose to conduct Graph-Hop, a novel multi-chains and multi-hops retrieval paradigm in complex question answering. |
| Outcome: | The proposed model provides explicit and fine-grained evidence graphs for complex question to support comprehensive and detailed reasoning. |
Question-guided Knowledge Graph Re-scoring and Injection for Knowledge Graph Question Answering (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Knowledge graph question answering (KGQA) aims to provide factual answers to natural language questions by leveraging structured information stored in a knowledge graph. |
| Approach: | They propose a Question-guided Knowledge Graph Re-scoring method to eliminate noisy pathways for the input question, thereby focusing specifically on pertinent factual knowledge. |
| Outcome: | The proposed method eliminates noisy pathways for the input question, thereby focusing specifically on pertinent factual knowledge. |
Unlocking the Future: Exploring Look-Ahead Planning Mechanistic Interpretability in Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have shown that large language models may possess preliminary planning capabilities. |
| Approach: | They examine the look-ahead planning mechanism in large language models from the perspectives of information flow and internal representations. |
| Outcome: | The proposed model can decode the decision from the output of MHSA in the middle layers at the last token. |
Pre-trained Language Model Based Active Learning for Sentence Matching (2020.coling-main)
Copied to clipboard
| Challenge: | Existing active learning approaches for natural language processing ignore the characteristics of natural language. |
| Approach: | They propose a pre-trained language model based active learning approach for sentence matching that provides linguistic criteria to measure instances and help select more effective instances for annotation. |
| Outcome: | The proposed approach can achieve greater accuracy with fewer labeled training instances. |
ExeCoder: Empowering Large Language Models with Executability Representation for Code Translation (2025.emnlp-main)
Copied to clipboard
Minghua He, Yue Chen, Fangkai Yang, Pu Zhao, Wenjie Yin, Yu Kang, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang
| Challenge: | Existing code translation models only learn the contextual semantics of code during pre-training, neglecting executability information closely related to the execution state of the code. |
| Approach: | They propose an LLM specifically designed for code translation called ExeCoder . it uses executability representations such as functional semantics and syntax structures to enhance LLMs' capabilities. |
| Outcome: | The proposed model outperforms existing open-source code translation models on two metrics. |
MAS-Bench: A Unified Benchmark for Shortcut-Augmented Hybrid Mobile GUI Agents (2026.acl-long)
Copied to clipboard
Pengxiang Zhao, Guangyi Liu, Yaozhen Liang, Weiqing He, Zhengxi Lu, WenHao Wang, Yuehao Huang, Yuxiang Chai, Zhaolu Kang, Yaxuan Guo, Hao Wang, Kexin Zhang, Liang Liu, Yong Liu
| Challenge: | Shortcuts such as APIs and deep-links have emerged as efficient complements to flexible GUI operations, but systematic evaluation of GUI–shortcut hybrid agents remains underexplored. |
| Approach: | They propose a benchmark that evaluates GUI-shortcut hybrid agents with a specific focus on the mobile domain. |
| Outcome: | MAS-Bench evaluates agent's ability to generate shortcuts by discovering and creating reusable, low-cost workflows. |
Incremental Intent Detection for Medical Domain with Contrast Replay Networks (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to detect medical intents require fixed pre-defined intent categories . however, novel medical intent categories incessantly emerge with new data and intents in the real world . |
| Approach: | They propose to incrementally learn emerged medical intents from continually arriving data of new intents while avoiding catastrophically forgetting old ones. |
| Outcome: | The proposed method outperforms the state-of-the-art model on two benchmarks by 5.7% and 9.1% accuracy. |
Probing into the Root: A Dataset for Reason Extraction of Structural Events from Financial Documents (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing methods for event reason extraction are far from resolving this problem. |
| Approach: | They propose a task to extract causal explanations from document-level texts . they use a dataset FinReason for evaluation to provide Reasons annotation for financial events . |
| Outcome: | The proposed task performs better than existing methods on a dataset of 8,794 documents, 12,861 financial events and 11,006 reason spans. |
Clinical-Coder: Assigning Interpretable ICD-10 Codes to Chinese Clinical Notes (2020.acl-demos)
Copied to clipboard
| Challenge: | Existing methods of automatic coding prediction have been successful, but the interpretability of predicted codes is a challenge. |
| Approach: | They propose an online system that can predict ICD codes for Chinese clinical notes by using a Dilated Convolutional Attention network with N-gram Matching mechanism. |
| Outcome: | The proposed system is able to provide supporting information in clinical decision making. |
ItD: Large Language Models Can Teach Themselves Induction through Deduction (2024.acl-long)
Copied to clipboard
| Challenge: | Recent studies have shown that Large Language Models (LLMs) have limited ability to conduct induction. |
| Approach: | They propose a framework to enable LLMs to teach themselves induction through deduction. |
| Outcome: | The proposed framework improves performance on two induction benchmarks and shows that it can be used to teach induction through deduction. |
Learning the Extraction Order of Multiple Relational Facts in a Sentence with Reinforcement Learning (D19-1)
Copied to clipboard
| Challenge: | Existing works didn’t consider the extraction order of relational facts in a sentence. |
| Approach: | They propose to take the extraction order into consideration by applying reinforcement learning into a sequence-to-sequence model. |
| Outcome: | The proposed model could generate relational facts freely. |
Discerning and Resolving Knowledge Conflicts through Adaptive Decoding with Contextual Information-Entropy Constraint (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing decoding methods for large language models (LLMs) are specialized in resolving knowledge conflicts and could inadvertently deteriorate performance in absence of conflicts. |
| Approach: | They propose an adaptive decoding method to discern whether knowledge conflicts occur and resolve them by a contextual information-entropy constraint decoding technique. |
| Outcome: | The proposed method improves the model’s faithfulness to conflicting context and maintains high performance among non-conflicting contexts. |
Leverage Lexical Knowledge for Chinese Named Entity Recognition via Collaborative Graph Network (D19-1)
Copied to clipboard
| Challenge: | Existing models for named entity recognition (NER) lack word boundaries information, which is a major barrier to developing a high performance named entity system. |
| Approach: | They propose a Chinese named entity recognition system with word boundaries information . they use word-level representations and character-level models to integrate lexical knowledge into Chinese NER . |
| Outcome: | The proposed model outperforms the state-of-the-art model and achieves a speed of up to 15 times faster than the SOTA model. |
Reinforcing Agentic Search Via Reward Density Optimization (2026.acl-long)
Copied to clipboard
| Challenge: | Reinforcement Learning with Verifiable Rewards (RLVR) is a promising approach for enhancing agentic search, but its performance is often hindered by reward sparsity . |
| Approach: | They propose a new research problem to improve the reward obtained per unit of exploration cost by using a system that decomposes long-horizon tasks into intermediate objectives and assigns process-level rewards to provide denser learning signals. |
| Outcome: | The proposed framework outperforms strong baselines on several agentic search benchmarks and achieves comparable performance to that of advanced proprietary models. |
KMatrix: A Flexible Heterogeneous Knowledge Enhancement Toolkit for Large Language Model (2024.emnlp-demo)
Copied to clipboard
| Challenge: | Existing Knowledge-Enhanced Large Language Models (K-LLMs) toolkits focus on free-textual knowledge and lack robust datasets, models, and user-friendly experience. |
| Approach: | They propose a flexible heterogeneous knowledge enhancement toolkit to enhance Large Language Models (LLMs) using external knowledge. |
| Outcome: | KMatrix: a flexible heterogeneous knowledge enhancement toolkit for LLMs includes verbalizing-retrieval and parsing-query methods. |
KMatrix-2: A Comprehensive Heterogeneous Knowledge Collaborative Enhancement Toolkit for Large Language Model (2025.emnlp-demos)
Copied to clipboard
Shun Wu, Di Wu, Wangtao Sun, Ziyang Huang, Xiaowei Yuan, Kun Luo, XueYou Zhang, Shizhu He, Jun Zhao, Kang Liu
| Challenge: | Existing studies on K-LLMs systems focus on declarative knowledge and procedural knowledge (rules) . |
| Approach: | They propose to build a toolkit that supports comprehensive heterogeneous knowledge collaborative enhancement for Large Language Models (LLMs). |
| Outcome: | The proposed toolkit provides unified knowledge integration and joint knowledge retrieval methods to achieve more comprehensive heterogeneous knowledge collaborative enhancement. |
A Layer-wise Analysis of Supervised Fine-Tuning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for fine-tuning ignore depth-dependent heterogeneity of instruction-following . a critical gap remains in understanding where these changes occur across the model's depth and which layers are essential for instruction- following. |
| Approach: | They propose a method which selectively updates critical intermediate layers . they show that effective alignment is architecturally localized rather than distributed . |
| Outcome: | The proposed method outperforms standard LoRA up to 10.2% on GSM8K with reduced parameter overhead. |
Towards Better Chain-of-Thought: A Reflection on Effectiveness and Faithfulness (2025.findings-acl)
Copied to clipboard
| Challenge: | Chain-of-thought (CoT) prompting demonstrates varying performance under different reasoning tasks. |
| Approach: | They propose to recall extra information from the question to enhance CoT generation and evaluate CoTs based on their information gain. |
| Outcome: | The proposed method improves both the faithfulness and effectiveness of CoT and evaluates it based on their information gain. |
On the In-context Generation of Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have the ability of in-context generation (ICG) when given an in-text prompt, they can implicitly recognize the pattern of the examples and complete the prompt in the desired way. |
| Approach: | They propose a plausible latent variable model to model the distribution of pretrained corpora and formalize ICG as a problem of next topic prediction. |
| Outcome: | The proposed model can model the distribution of pretrained corpora and then formalize ICG as a problem of next topic prediction. |
Alignment Rationale for Natural Language Inference (2021.acl-long)
Copied to clipboard
| Challenge: | Existing explanation methods pick prominent features, but alignments between words or phrases are more enlightening clues to explain the model. |
| Approach: | They propose a method to generate alignment rationale explanations for co-attention based models in NLI by feature selection. |
| Outcome: | The proposed method is more faithful and human-readable compared with existing methods. |
GATE: Graph-based Adaptive Tool Evolution Across Diverse Tasks (2026.acl-long)
Copied to clipboard
Jianwen Luo, Yiming Huang, Jinxiang Meng, Fangyu Lei, Shizhu He, Xiao Liu, Shanshan Jiang, Bin Dong, Jun Zhao, Kang Liu
| Challenge: | Existing toolsets that use large language models are limited to single-task settings. |
| Approach: | They propose a framework that dynamically constructs and evolves a hierarchical graph of reusable tools across multiple scenarios. |
| Outcome: | The proposed framework achieves up to 4.3 faster milestone completion in Minecraft compared to the previous state-of-the-art method and provides an average improvement of 9.23% over existing tool-making methods in code generation tasks and 10.03% in agent tasks. |
STINMatch: Semi-Supervised Semantic-Topological Iteration Network for Financial Risk Detection via News Label Diffusion (2023.emnlp-main)
Copied to clipboard
Xurui Li, Yue Qin, Rui Zhu, Tianqianjin Lin, Yongming Fan, Yangyang Kang, Kaisong Song, Fubang Zhao, Changlong Sun, Haixu Tang, Xiaozhong Liu
| Challenge: | Commercial news provides rich semantics and timely information for automated financial risk detection. |
| Approach: | They propose a semi-supervised Semantic-Topological Iteration Network, STINMatch, along with a news-enterprise knowledge graph to endorse the risk detection enhancement. |
| Outcome: | The proposed model outperforms existing models in terms of generalization and semantics and annotation. |
Document-level Event Extraction via Parallel Prediction Networks (2021.acl-long)
Copied to clipboard
| Challenge: | Document-level event extraction (DEE) is indispensable when events are described throughout a document. |
| Approach: | They propose a document-level event extraction model that can extract structured events from a text in parallel. |
| Outcome: | The proposed model outperforms current state-of-the-art methods on a document-level event extraction task. |
Memory OS of AI Agent (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) face a shortage of long-term memory capabilities and limited personalization due to fixed context windows. |
| Approach: | They propose a Memory Operating System to achieve efficient memory management for AI agents . MemoryOS enables hierarchical memory integration and dynamic updating . |
| Outcome: | The proposed architecture enables hierarchical memory integration and dynamic updating. |
PDAMeta: Meta-Learning Framework with Progressive Data Augmentation for Few-Shot Text Classification (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing text data augmentation methods can not ensure the diversity and quality of the generated data, which leads to sub-optimal performance. |
| Approach: | They propose a meta-learning framework with progressive data augmentation for few-shot text classification using prompt-based data augmented by attention-based methods. |
| Outcome: | The proposed framework outperforms state-of-the-art models and shows better robustness on four public few-shot text classification datasets. |
Dynamic Context Selection for Document-level Neural Machine Translation via Reinforcement Learning (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing document-level neural machine translation methods use all context sentences in a fixed scope. |
| Approach: | They propose an approach to select dynamic context so that document-level neural machine translation models can utilize more useful selected context sentences. |
| Outcome: | The proposed approach can select adaptive context sentences for different source sentences and significantly improves translation quality over sentences in a document. |
MoDE-CoTD: Chain-of-Thought Distillation for Complex Reasoning Tasks with Mixture of Decoupled LoRA-Experts (2024.lrec-main)
Copied to clipboard
| Challenge: | Current Chain-of-thought Distillation methods hinder CoT reasoning performance . student models are separately distilled from specific reasoning tasks . parameter update of student models severely harms CoT ability on unseen reasoning tasks. |
| Approach: | They propose a method which distills Chain-of-thought reasoning ability of large language models to much smaller student models. |
| Outcome: | The proposed method improves the reasoning ability of large language models on 14 datasets. |
Zero-Shot Cross-Lingual Document-Level Event Causality Identification with Heterogeneous Graph Contrastive Transfer Learning (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies focus on sentence-level ECI with high-resource languages, leaving document-level DECI with low-resourced languages under-explored. |
| Approach: | They propose a Heterogeneous Graph Interaction Model with Multi-granularity Contrastive Transfer Learning for zero-shot cross-lingual ECI. |
| Outcome: | The proposed model outperforms the state-of-the-art model on monolingual and multilingual scenarios by 9.4% and 8.2% of average F1 score. |
Fine-tuning CLIP Text Encoders with Two-step Paraphrasing (2024.findings-eacl)
Copied to clipboard
| Challenge: | Contrastive language-image pre-training models have demonstrated considerable success across various vision-language tasks, such as text-to-image retrieval. |
| Approach: | They propose a fine-tuning approach to enhance the representations of CLIP models for paraphrases by leveraging large language models. |
| Outcome: | The proposed model improves on baseline models across paraphrased retrieval, visual genome relation and attribution, and seven semantic textual similarity tasks. |
Biomedical Concept Normalization by Leveraging Hypernyms (2021.emnlp-main)
Copied to clipboard
| Challenge: | Biomedical Concept Normalization (BCN) is widely used in biomedical text processing . despite numerous surface variants of biomedically-defined concepts, it remains challenging and unsolved. |
| Approach: | They propose a framework that uses hypernyms and synonyms to facilitate BCN . they use list-wise training to make use of both hypernies and synonym entities . |
| Outcome: | The proposed framework outperforms the state-of-the-art model on the NCBI dataset. |
S3HQA: A Three-Stage Approach for Multi-hop Text-Table Hybrid Question Answering (2023.acl-short)
Copied to clipboard
| Challenge: | Existing question answering systems use a retriever-reader framework to answer multi-hop questions . existing models lack retrieval, selector, and reasoner capabilities . |
| Approach: | They propose a three-stage text tableQA framework which comprises of retriever, selector, and reasoner. |
| Outcome: | The proposed framework outperforms baseline methods in the few-shot setting and ranks first on the HybridQA leaderboard. |
MIE: A Medical Information Extractor towards Medical Dialogues (2020.acl-main)
Copied to clipboard
| Challenge: | EMRs are important but many doctors suffer from writing them, which is time-consuming and tedious. |
| Approach: | They propose an automatic conversion of medical dialogues to EMRs using a window-sliding style . they propose a medical information extractor (MIE) that extracts medical information from medical dialogue . |
| Outcome: | The proposed model extracts medical information from doctor-patient dialogues. |
MeasHalu: Mitigation of Scientific Measurement Hallucinations for Large Language Models with Enhanced Reasoning (2026.findings-acl)
Copied to clipboard
Ruijun Huang, Zhiqiao Kang, Yuxuan Zhu, Junxiong Li, Jiahao Zhao, Minghuan Tan, Feng Jiang, Min Yang
| Challenge: | Large Language Models (LLMs) exhibit severe hallucinations, which undermine reliability of automated scientific document understanding systems. |
| Approach: | They propose a framework for mitigating scientific measurement hallucinations through enhanced reasoning and targeted optimization. |
| Outcome: | The proposed framework significantly reduces hallucination rates and improves overall accuracy on the MeasEval benchmark. |
Pushing the Limits of LLM Tool Calling via Experiential Knowledge Integration and Activation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches treat tool use as a problem of prompt design, API documents specification, or supervised or unsupervised alignment. |
| Approach: | They propose a knowledge-augmented tool execution framework that integrates experiential knowledge with reasoning-width-expanded inference and knowledge-aware training. |
| Outcome: | The proposed framework improves on BFCL-V3 and AppWorld on three model scales. |
Complex Event Schema Induction with Knowledge-Enriched Diffusion Model (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies on event schema induction have been hindered by errors and data quality issues. |
| Approach: | They propose a knowledge-enriched discrete diffusion model that distills event scenario knowledge from LLMs. |
| Outcome: | The proposed model achieves outstanding performance across evaluation metrics. |
Knowledge-Enriched Event Causality Identification via Latent Structure Induction Networks (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for identifying causal relations of events are limited . Existing approaches cannot handle well the problem, especially in the condition of lacking training data. |
| Approach: | They propose a Latent Structure Induction Network to integrate external structural knowledge into a causality reasoning task. |
| Outcome: | The proposed approach outperforms existing state-of-the-art methods on two widely used datasets. |
Automatic ICD Coding via Interactive Shared Representation Networks with Self-distillation Mechanism (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for ICD coding ignore the long-tail of code frequency or noisy clinical notes. |
| Approach: | They propose to use an interactive shared representation network to model code co-occurrences while focusing on the clinical note's noteworthy part and extract valuable information through a self-distillation learning mechanism to solve the long-tail problem. |
| Outcome: | The proposed model reduces the long-tail of code frequency and noise in clinical notes and extracts valuable information through a self-distillation learning mechanism. |
Machine Reading Comprehension Using Structural Knowledge Graph-aware Network (D19-1)
Copied to clipboard
| Challenge: | Recent large-scale datasets specify that external knowledge is required to answer questions. |
| Approach: | They propose a model that leverages external knowledge to construct sub-graphs for entities in machine comprehension context. |
| Outcome: | The proposed model achieves state-of-the-art performance on the ReCoRD dataset. |
A Hierarchical Explanation Generation Method Based on Feature Interaction Detection (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing work on hierarchical attributions tends to limit text groups to a continuous text span, which is difficult for humans to read. |
| Approach: | They propose a method which captures feature interactions and converts non-hierarchical explanations into hierarchical versions. |
| Outcome: | The proposed method can convert ubiquitous non-hierarchical explanations into their corresponding hierarchical versions. |
RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment (2025.findings-acl)
Copied to clipboard
Zhuoran Jin, Hongbang Yuan, Tianyi Men, Pengfei Cao, Yubo Chen, Jiexin Xu, Huaijun Li, Xiaojian Jiang, Kang Liu, Jun Zhao
| Challenge: | Existing retrieval augmented language models often overlook effective alignment with human preferences. |
| Approach: | They propose a benchmark to evaluate RMs in retrieval augmented language models . they incorporate 18 RAG subsets, six retrievers, and 24 RALMs to increase diversity . |
| Outcome: | The proposed benchmark combines 18 RAG subsets, six retrievers, and 24 RALMs to increase diversity of data sources. |
SKIntern: Internalizing Symbolic Knowledge for Distilling Better CoT Capabilities into Small Language Models (2025.coling-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have high computational costs and privacy concerns due to their high computational expenses and data privacy. |
| Approach: | They propose a method that empowers SLMs to internalize symbolic knowledge and few-shot examples gradually through a progressive fine-tuning process. |
| Outcome: | The proposed approach outperforms state-of-the-art baselines by over 5% while reducing inference costs by up to 4 across a wide range of SLMs in both in-domain (ID) and out-of domain (OOD) tasks. |
Adjacency List Oriented Relational Fact Extraction via Adaptive Multi-task Learning (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing models for relational fact extraction do not analyze the output data structure from the perspective of graph representation flexibility and heterogeneity. |
| Approach: | They propose a relational fact extraction model based on graph-oriented analytical perspective that outperforms other models. |
| Outcome: | The proposed model outperforms state-of-the-art models on two benchmark datasets and shows that it is flexible and space-efficient. |
DTELS: Towards Dynamic Granularity of Timeline Summarization (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing timeline summarizations lack flexibility to meet diverse granularity needs . a fine-grained timeline showing the technical details is preferred for news topics . |
| Approach: | They propose a new paradigm to construct adaptive timelines based on user instructions or requirements. |
| Outcome: | The proposed timelines are informative and granularly consistent, but they struggle to generate consistent timelines. |
From Signal Degradation to Computation Collapse: Uncovering the Two Failure Modes of LLM Quantization (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing research on PTQ spans three primary directions. |
| Approach: | They conduct a systematic analysis of post-training quantization failures using PTQ . they show that targeted repair can mitigate Signal Degradation but remains ineffective for Computation Collapse . |
| Outcome: | The proposed method mitigates Signal Degradation but remains ineffective for Computation Collapse. |
Towards Explainable Diagnosis: A Self-learned Explanatory Knowledge Base Approach (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have great potential to facilitate explainable diagnosis, but their effectiveness is often constrained by insufficient diagnostic expertise. |
| Approach: | They propose a unified LLM-based framework for faithful and explainable diagnosis that builds a high-quality diagnostic knowledge base through a record-driven explanation learning paradigm. |
| Outcome: | The proposed framework outperforms baselines on the DiReCT and JAMA benchmarks and improves the explanation completeness metric from 64.5% to 76.9% over the best existing methods. |
Empowering GUI Agents via Autonomous Experience Exploration and Hindsight Experience Utilization for Task Planning (2026.acl-long)
Copied to clipboard
| Challenge: | Multimodal web agents are cost-efficient and privacy-preserving, but suffer from weak planning and limited cross-website generalization. |
| Approach: | They propose a method which autonomously explores environments to discover experiences and utilizes hindsight experience to synthesize strictly aligned, high-level training data. |
| Outcome: | The proposed method outperforms Qwen2.5-VL-32B model on real-world benchmarks and demonstrates that mastering low-level atomic skills does not guarantee high-level planning competence. |
Knowledge Guided Metric Learning for Few-Shot Text Classification (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing methods to learn from limited examples are insufficient for many-shot text classification tasks. |
| Approach: | They propose to introduce external knowledge into few-shot learning to imitate human knowledge by creating a parameter generator network that generates different metrics for different tasks. |
| Outcome: | The proposed method outperforms the SoTA few-shot text classification models. |
Enhancing Multiple-choice Machine Reading Comprehension by Punishing Illogical Interpretations (2021.emnlp-main)
Copied to clipboard
| Challenge: | Multiple-choice MRC is one of the most studied tasks in MRC due to the convenience of evaluation and the flexibility of answer format. |
| Approach: | They propose to use multiple-choice MRC to explain a trained model and reveal how it arrives at the prediction by punishing illogical attributions. |
| Outcome: | The proposed method improves model performance without external information and model structure change without any external information. |
Task-Stratified Knowledge Scaling Laws for Post-Training Quantized Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing scaling laws focus on general performance, overlooking crucial fine-grained factors and how quantization differentially impacts diverse knowledge capabilities. |
| Approach: | They propose a framework that unifies model size, bit-width, and fine-grained factors into memorization, application, and reasoning. |
| Outcome: | The proposed framework shows strong fit and cross-architecture consistency on 293 different PTQ configurations. |
InstructoR: Instructing Unsupervised Conversational Dense Retrieval with Large Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for conversational retrieval only fine-tune on limited supervised data, making it difficult for the retriever to fully grasp the entire conversation. |
| Approach: | They propose a method to instruct unsupervised conversational dense retrieval with large language models (LLMs) they use supervised data to discover the user's query intent from the conversation context . |
| Outcome: | The proposed method can bring significant improvements across various ad-hoc retrievers, surpassing the current state-of-the-art method. |
Prediction and Calibration: Complex Reasoning over Knowledge Graph with Bi-directional Directed Acyclic Graph Neural Network (2023.findings-acl)
Copied to clipboard
| Challenge: | Knowledge graphs (KGs) organize world knowledge as interlinked triples which describe entities and their relationships. |
| Approach: | They propose a bi-directional Directed Acyclic Graph neural network that splits the reasoning process into prediction and calibration. |
| Outcome: | The proposed model outperforms previous QE models on FB15k, FB16k-237, and NELL995 on prediction and calibration. |
Alignment Precedes Fusion: Open-Vocabulary Named Entity Recognition as Context-Type Semantic Matching (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Continual learning and zero-shot learning approaches have not been adopted to scale to novel-emerging types. |
| Approach: | They propose a method to recognize entities in novel types by their textual names or descriptions. |
| Outcome: | The proposed method outperforms the state-of-the-art methods on three challenging OVNER benchmarks by 9.7%, 9.5%, and 1.8% F1-score of novel types. |
DA-Code: Agent Data Science Code Generation Benchmark for Large Language Models (2024.emnlp-main)
Copied to clipboard
Yiming Huang, Jianwen Luo, Yan Yu, Yitong Zhang, Fangyu Lei, Yifan Wei, Shizhu He, Lifu Huang, Xiao Liu, Jun Zhao, Kang Liu
| Challenge: | DA-Code is a code generation benchmark designed to assess LLMs on agent-based data science tasks. |
| Approach: | They propose a code generation benchmark specifically designed for LLMs on agent-based data science tasks. |
| Outcome: | The benchmark performs better than existing frameworks, but lacks accuracy . it is based on real-world data, and includes examples that cover a wide range of tasks . |
Cracking Factual Knowledge: A Comprehensive Analysis of Degenerate Knowledge Neurons in Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) are believed to store extensive factual knowledge, yet the mechanisms of knowledge storage in LLMs remain largely unexplored. |
| Approach: | They propose that some multi-layer perceptron neurons can store "knowledge". |
| Outcome: | The proposed model can store "knowledge" in multi-layer perceptron neurons, but not redundancy. |
Graph-Based Knowledge Integration for Question Answering over Dialogue (2020.coling-main)
Copied to clipboard
| Challenge: | Existing approaches for question answering over dialogue did not consider dialogue structure and background knowledge (e.g., relationships between speakers). |
| Approach: | They propose a method which organizes a dialogue as a "relational graph" and uses edges to represent relationships between entities to encode multi-relations knowledge for reasoning. |
| Outcome: | The proposed method is better at tackling complex questions requiring relational reasoning and defending adversarial attacks with distracting sentences. |
FCDS: Fusing Constituency and Dependency Syntax into Document-Level Relation Extraction (2024.lrec-main)
Copied to clipboard
| Challenge: | Document-level Relation Extraction (DocRE) aims to identify relation labels between entities within a document. |
| Approach: | They propose to fuse constituency and dependency syntax into DocRE to exploit the rich syntax information in the document. |
| Outcome: | The proposed method is able to identify relation labels between entities within a document and is scalable. |
Revealing the Deceptiveness of Knowledge Editing: A Mechanistic Analysis of Superficial Editing (2025.acl-long)
Copied to clipboard
| Challenge: | Existing knowledge editing algorithms are prone to generating original knowledge . despite the fact that many models achieve near-perfect performance, superficial editing remains a challenge . |
| Approach: | They propose to use "**superficial editing**" to describe the phenomenon . they investigate the internal mechanisms of the attention module and their corresponding left singular vectors . |
| Outcome: | The proposed method can modify specific knowledge in a pretrained large language model while ensuring that unrelated knowledge remains unaffected. |
Lightweight Haar Wavelet Subband Pruning for LLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have impressive performance but require computational and memory resources. |
| Approach: | They propose a post-training framework that uses a Haar wavelet transform to prune weights. |
| Outcome: | The proposed pruning framework reduces pruning time and computational costs by removing less important weights while preserving model architecture. |
AdaNSP: Uncertainty-driven Adaptive Decoding in Neural Semantic Parsing (P19-1)
Copied to clipboard
| Challenge: | Semantic parsing (SP) maps a natural language utterance into a formal language . standard Seq2Seq models ignore underlying grammars and may give ill-formed results. |
| Approach: | They propose an end-to-end model for semantic parsing that transduces a natural language sentence to the formal semantic representation. |
| Outcome: | The proposed model outperforms the state-of-the-art models and does not need expertise like predefined grammar or sketches in the meantime. |
ABSEval: An Agent-based Framework for Script Evaluation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on script evaluation of large language models (LLMs) have not evaluated scripts generated by LLMs due to their logical structure, sequential organization, and open-ended nature. |
| Approach: | They propose to use a script evaluation dataset to evaluate LLM scripts . they propose to develop an agent-based script evaluation framework ABSEval to evaluate scripts. |
| Outcome: | The proposed framework provides superior accuracy and relevance, aligning closely with human evaluation. |
Multilingual Knowledge Graph Completion from Pretrained Language Models with Knowledge Constraints (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for multilingual knowledge graph completion do not align with mKGC tasks because of their English-centric bias. |
| Approach: | They propose to use multilingual pretrained language models to solve queries in different languages by reasoning a tail entity. |
| Outcome: | The proposed method outperforms the previous SOTA on Hits@1 and Hits @10 by 12.32% and 16.03% on public datasets. |
Instance-Level Dynamic LoRAs Composition for Cross-Task Generalization (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models perform well on tasks that have undergone fine-tuning of instructions, but performance on completely unseen tasks is often less than ideal. |
| Approach: | They propose a task-level LoRAs combination which learns the LoRA modules combination weights based on a small number of samples to form the task model. |
| Outcome: | The proposed method outperforms the typical method, LoraHub, on 16 out of 27 tasks. |
TEXTOIR: An Integrated and Visualized Platform for Text Open Intent Recognition (2021.acl-demo)
Copied to clipboard
| Challenge: | TEXTOIR is the first integrated platform for text open intent recognition . currently, many dialogue systems are limited to handle the uncertain open intents . |
| Approach: | TEXTOIR is the first integrated platform for text open intent recognition . it is composed of two main modules: open intent detection and open intent discovery . authors propose a framework to implement a complete process to identify known intents and discover open intents . |
| Outcome: | TEXTOIR is the first integrated and visualized platform for text open intent recognition . it integrates state-of-the-art algorithms and benchmark intent datasets . however, there are still some issues, which bring difficulties for future research . |
Large Language Models as Foundations for Next-Gen Dense Retrieval: A Comprehensive Empirical Assessment (2024.emnlp-main)
Copied to clipboard
| Challenge: | Pre-trained language models have limited generalization capabilities and performance challenges. |
| Approach: | They evaluate 15 different backbone LLMs and non-LLMs to evaluate their performance . larger models and extensive pre-training consistently enhance in-domain accuracy and data efficiency . |
| Outcome: | The results show that larger models and extensive pre-training enhance in-domain accuracy and data efficiency. |
A Good Neighbor, A Found Treasure: Mining Treasured Neighbors for Knowledge Graph Entity Typing (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to infer missing types for knowledge graphs only leverage one-hop neighbor information of the central entity, ignoring multi-hop neighbors that can provide valuable clues for inference. |
| Approach: | They propose a method to infer missing types for knowledge graph entities by using neighbor information and co-occurrence relations between types. |
| Outcome: | The proposed method significantly outperforms existing state-of-the-art methods on two widely used datasets. |
Improving Event Causality Identification via Self-Supervised Representation Learning on External Causal Statement (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for event causality identification (ECI) rely on labeled data, but the scale of annotated datasets is limited. |
| Approach: | They propose a self-supervised framework to learn context-specific causal patterns from external causal statements and adopt a contrastive transfer strategy to incorporate the learned context- specific causal patterns into the target ECI model. |
| Outcome: | The proposed method significantly outperforms existing methods on EventSto-ryLine and Causal-TimeBank (+2.0 and +3.4 points on F1 value respectively). |
AgentsCourt: Building Judicial Decision-Making Agents with Court Debate Simulation and Legal Knowledge Augmentation (2024.findings-emnlp)
Copied to clipboard
Zhitao He, Pengfei Cao, Chenhao Wang, Zhuoran Jin, Yubo Chen, Jiexin Xu, Huaijun Li, Kang Liu, Jun Zhao
| Challenge: | Recent advances in deep learning have significantly impacted the legal domain. |
| Approach: | They propose a multi-agent framework for judicial decision-making that simulates the court trial process . they propose 420 Chinese judgment documents to support their framework and build a large-scale legal knowledge base . |
| Outcome: | The proposed framework outperforms existing methods in various aspects, especially in generating legal articles. |
M2Edit: Locate and Edit Multi-Granularity Knowledge in Multimodal Large Language Model (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing knowledge editing methods for MLLMs lack multi-granularity knowledge . existing knowledge editing approaches lack multimodality knowledge and generalize to multimodal data. |
| Approach: | They propose a multimodal knowledge editing method which integrates key knowledge layers within MLLMs and collaboratively edits them. |
| Outcome: | The proposed method improves visual generality performance on knowledge data of different granularities. |
LANTERN in the Event Stream: Training-Free Temporal Knowledge Graph Forecasting by Balancing Inertia and Shifts (2026.findings-acl)
Copied to clipboard
| Challenge: | Temporal knowledge graph forecasting (TKGF) uses long-window strengthscores and short-windowed novelty scores to predict missing entities in future queries. |
| Approach: | They propose a training-freeprompting framework that uses two perspectives of history to predict missing entities in future queries. |
| Outcome: | The proposed framework outperforms the state-of-the-art baselineAnRe framework in ICEWS14, ICEW05-15, and GDELT. |
Analyzing Uncertainty of LLM-as-a-Judge: Interval Evaluations with Conformal Prediction (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) are powerful automatic evaluators for natural language generation (NLG) tasks, but their uncertainty may limit their deployment in many applications. |
| Approach: | They propose a conformal prediction framework that provides a prediction interval with coverage guarantees and a midpoint-based score as a low-bias alternative to raw model score and weighted average. |
| Outcome: | The proposed framework provides a prediction interval with coverage guarantees and a midpoint-based score as a low-bias alternative to raw model score and weighted average. |
Generative Calibration for In-context Learning (2023.findings-emnlp)
Copied to clipboard
| Challenge: | In-context learning is one of the most exciting features of large language models . performance is sensitive to various configurations of the prompt, such as the choice or order of the training examples. |
| Approach: | They propose to calibrate the in-context predictive distribution by adjusting the label marginal . they find that the proposed method outperforms the ICL and state-of-the-art calibration methods . |
| Outcome: | The proposed method outperforms state-of-the-art methods by 27% absolute in macro-F1. |
NutFrame: Frame-based Conceptual Structure Induction with LLMs (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies focus on syntactic knowledge and world knowledge, but conceptual structure is not well-understood. |
| Approach: | They propose a benchmark for coNceptual structure induction based on FrameNet . they use prompts to induce conceptual structure of Framenet with LLMs . |
| Outcome: | The proposed model is able to induce conceptual structure of FrameNet with LLMs. |
Generating Questions for Knowledge Bases via Incorporating Diversified Contexts and Answer-Aware Loss (D19-1)
Copied to clipboard
| Challenge: | Conventional methods for question generation neglect two crucial research issues: 1) the given predicate needs to be expressed; 2) the answer to the generated question needs to have a definitive answer. |
| Approach: | They propose a neural encoder-decoder model with multi-level copy mechanisms to generate questions . they also introduce answer-aware loss to make generated questions correspond to more definitive answers. |
| Outcome: | The proposed model achieves state-of-the-art performance while corresponding to more definitive answers. |
Large Language Models are Better Reasoners with Self-Verification (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to solve complex natural language processing tasks require multiple steps to verify the answers. |
| Approach: | They propose to use chain of thought prompting to solve reasoning tasks with large language models. |
| Outcome: | The proposed method can improve reasoning performance on arithmetic, commonsense, and logical reasoning datasets. |
Spectral Disentanglement: Rank-Aware Task Adaptation for Rehearsal-free Continual Learning in LLMs (2026.acl-long)
Copied to clipboard
| Challenge: | Continual Learning (CL) for Large Language Models faces a fundamental Stability-Plasticity Dilemma . Rank-Blindness enforces a single rank constraint across diverse tasks, leading to catastrophic forgetting of earlier tasks and underfitting on complex new ones. |
| Approach: | They propose a rank-spectrum-based rehearsal-free framework that explicitly disentangles knowledge into two orthogonal subspaces. |
| Outcome: | The proposed framework achieves a superior stability-plasticity balance compared to single-rank baselines. |
Logic Traps in Evaluating Attribution Scores (2022.acl-long)
Copied to clipboard
| Challenge: | Modern deep learning models are notoriously opaque, which has motivated the development of methods for interpreting how deep models predict. |
| Approach: | They propose to review existing methods for evaluating attribution scores and summarize the logic traps in these methods. |
| Outcome: | The proposed methods show that they do not contain logic traps and that they are not reliable. |
Adversarial Transfer Learning for Chinese Named Entity Recognition with Self-Attention Mechanism (D18-1)
Copied to clipboard
| Challenge: | Existing methods for named entity recognition (NER) do not exploit word boundary information from CWS or cannot filter the specific information of CWS. |
| Approach: | They propose to exploit task-shared boundary information to make full use of Chinese NER task and Chinese word segmentation (CWS) . |
| Outcome: | The proposed model significantly outperforms other state-of-the-art methods on two widely used datasets. |
Neural Cross-Lingual Event Detection with Minimal Parallel Resources (D19-1)
Copied to clipboard
| Challenge: | Existing methods for event detection (ED) rely on high-performance machine translation systems or manually aligned documents to achieve a decent performance. |
| Approach: | They propose a method that uses context-dependent translation to construct a lexical mapping between different languages and a shared syntactic order event detector for multilingual co-training. |
| Outcome: | The proposed method performs cross-lingual transfer and tackles the extremely annotation-poor scenario. |
EMO-RL: Emotion-Rule-Based Reinforcement Learning Enhanced Audio-Language Model for Generalized Speech Emotion Recognition (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Recent advances in reinforcement learning (RL) have shown promise in improving LALMs’ reasoning abilities, but their performance in affective computing tasks remains suboptimal. |
| Approach: | They propose a framework incorporating reinforcement learning with two key innovations: Emotion Similarity-Weighted Reward (ESWR) and Explicit Structured Reasoning (ESR). |
| Outcome: | The proposed framework improves LALMs' reasoning abilities on MELD and IEMOCAP datasets and shows strong generalization. |
Evaluating Personalized Tool-Augmented LLMs from the Perspectives of Personalization and Proactivity (2025.acl-long)
Copied to clipboard
| Challenge: | Personalized tool utilization is essential for aligning large language models (LLMs) with user preference in interaction scenarios with various tools. |
| Approach: | They propose a key-point-based LLM evaluation method that mitigates biases by manually annotating key points for each test case and providing them to LLM as the reference. |
| Outcome: | The proposed method mitigates biases in the LLM-as-a-judge system by manually annotating key points for each test case and providing them to LLM as the reference. |
Search-in-Context: Efficient Multi-Hop QA over Long Contexts via Monte Carlo Tree Search with Dynamic KV Retrieval (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to multihop question answering (MHQA) over long contexts are often neglecting explicit reasoning or incurring expensive computational costs due to full-attention mechanisms over long contextuals. |
| Approach: | They propose a framework that integrates Monte Carlo Tree Search (MCTS) with dynamic key-value retrieval to enable iterative, context-aware reasoning. |
| Outcome: | The proposed framework integrates Monte Carlo Tree Search (MCTS) with dynamic key-value (KV) retrieval to enable iterative, context-aware reasoning. |
Leros: Learning Explicit Reasoning on Synthesized Data for Commonsense Question Answering (2024.lrec-main)
Copied to clipboard
Chenhao Wang, Pengfei Cao, Jiachun Li, Yubo Chen, Kang Liu, Xiaojian Jiang, Jiexin Xu, Li Qiuxia, Jun Zhao
| Challenge: | Recent work shows large language models can generate useful rationales for commonsense question answering (CQA) however, the cost of deployment and further tuning is relatively expensive for the large models. |
| Approach: | They propose a framework that leverages both knowledge graphs and large language models to synthesize rationale-augmented CQA data. |
| Outcome: | The proposed model can generate useful rationales on unseen CQA benchmarks. |
Representative Demonstration Selection for In-Context Learning with Two-Stage Determinantal Point Process (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods tend to select different demonstrations for each test instance, which is time-consuming and poses limitations in practical scenarios. |
| Approach: | They propose to select a representative subset of in-context demonstrations that can prompt different test instances in a specific task. |
| Outcome: | The proposed method can be used to generate representative in-context demonstrations. |
The Knowledge Microscope: Features as Better Analytical Lenses than Neurons (2025.acl-long)
Copied to clipboard
| Challenge: | Recent studies have shown that features are superior analytical units for understanding factual knowledge in Language Models. |
| Approach: | They propose a feature-based editing method that decomposes neurons into features rather than neurons to understand the mechanisms of factual knowledge in Language Models. |
| Outcome: | The proposed method demonstrates superior performance over neuron-based approaches in erasing privacy-sensitive information from LMs. |