Papers by Kang Xu

49 papers
Consistent Representation Learning for Continual Relation Extraction (2022.findings-acl)

Copied to clipboard

Challenge: Existing methods to train relation extraction models overfit memory samples and perform poorly on imbalanced datasets.
Approach: They propose a method which uses contrastive learning and knowledge distillation to train a model on data with new relations while avoiding forgetting old ones.
Outcome: The proposed method significantly outperforms state-of-the-art baselines and yields strong robustness on the imbalanced datasets.
Low-Resource Comparative Opinion Quintuple Extraction by Data Augmentation with Prompting (2023.findings-emnlp)

Copied to clipboard

Challenge: Comparative Opinion Quintuple Extraction (COQE) aims to predict comparative opinion quintuples from comparative sentences.
Approach: They propose a low-resource approach to extract comparative opinion quintuples from comparative sentences . they propose augmentation using ChatGPT and a data-centric approach .
Outcome: The proposed approach improves the existing pipeline-based method and achieves state-of-the-art results.
Event Ontology Completion with Hierarchical Structure Evolution Networks (2023.emnlp-main)

Copied to clipboard

Challenge: Existing methods for event detection require predefined schemas, but manual defining is expensive and labor-intensive.
Approach: They propose a task to achieve event clustering, hierarchy expansion and type naming . they propose 'neighbor Contrastive Clustering' module and a Hierarchy-Aware Linking module .
Outcome: The proposed method outperforms baseline methods on three datasets.
NAP2: A Benchmark for Naturalness and Privacy-Preserving Text Rewriting by Learning from Human (2025.findings-emnlp)

Copied to clipboard

Challenge: a large number of large language models are being used to protect user privacy . sanitizing sensitive text using two common strategies is the answer .
Approach: They propose sanitizing sensitive text using deleting expressions and abstracting them . they propose a tool for text rewriting that uses crowdsourcing and large language models .
Outcome: The proposed approach protects privacy before sending sensitive data to large language models . it combines crowdsourcing and large language modeling to create a text rewrite tool .
Aligning VLM Assistants with Personalized Situated Cognition (2025.acl-long)

Copied to clipboard

Challenge: Existing studies on vision-language models aligned with general human objectives have not been successful because people with diversified backgrounds have different cognition even in the same situation.
Approach: They propose to characterize individuals based on the sociological concept of Role-Set and then evaluate their actions to see whether personalized alignment is achieved.
Outcome: The proposed framework constructs a cognition-aware and action-based reward model for personalized alignment.
Generate-on-Graph: Treat LLM as both Agent and KG for Incomplete Knowledge Graph Question Answering (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods to integrate LLMs with Knowledge Graphs (KGs) however, these methods are often incomplete to cover all the knowledge required to answer questions.
Approach: They propose to integrate LLMs with Knowledge Graphs (KGs) to address insufficient knowledge and hallucination issues in Large Language Models.
Outcome: The proposed method outperforms existing methods on two datasets.
A Cross-Domain Transferable Neural Coherence Model (P19-1)

Copied to clipboard

Challenge: Existing coherence models do not generalize to unseen categories of text . previous work advocates for generative models for cross-domain generalization .
Approach: They propose a local discriminative neural model with a smaller negative sampling space that can discriminate against incorrect orderings.
Outcome: The proposed model outperforms state-of-the-art methods on a standard benchmark dataset on the Wall Street Journal corpus and multiple challenging settings on Wikipedia articles.
Tug-of-War between Knowledge: Exploring and Resolving Knowledge Conflicts in Retrieval-Augmented Language Models (2024.lrec-main)

Copied to clipboard

Challenge: Existing knowledge conflicts in RALMs can ensnare them in a tug-of-war between knowledge and evidence, limiting their practical applicability.
Approach: They propose a method called Conflict-Disentangle Contrastive Decoding (CD2) to better calibrate the model’s confidence.
Outcome: The proposed method can resolve knowledge conflicts in large language models with the help of conflict-disentangle contrast decoding (CD2) .
FOREVER: Forgetting Curve-Inspired Memory Replay for Language Model Continual Learning (2026.acl-long)

Copied to clipboard

Challenge: Continual learning (CL) for large language models (LLMs) aims to enable sequential knowledge acquisition without catastrophic forgetting.
Approach: They propose a framework that aligns replay schedules with a model-centric notion of time.
Outcome: Experiments on three benchmarks show that FOREVER consistently mitigates catastrophic forgetting.
RubricBench: Aligning Model-Generated Rubrics with Human Standards (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks lack discriminative complexity and ground-truth rubric annotations required for rigorous evaluation.
Approach: They propose a curated benchmark with 1,147 pairwise comparisons to assess the reliability of rubric-based evaluation.
Outcome: The proposed benchmarks show that they support diverse domains, exhibit discriminative ability, provide high-quality annotations, and include human-authored rubrics.
TexSmart: A System for Enhanced Natural Language Understanding (2021.acl-demo)

Copied to clipboard

Challenge: TexSmart supports fine-grained named entity recognition (NER) Large-scale fine-granular entity types are expected to provide richer semantic information for downstream NLP applications.
Approach: They introduce TexSmart, a text understanding system that supports fine-grained named entity recognition (NER) and enhanced semantic analysis functionalities.
Outcome: The proposed system supports fine-grained named entity recognition (NER) and enhanced semantic analysis functions.
Query2Triple: Unified Query Encoding for Answering Diverse Complex Queries over Knowledge Graphs (2023.findings-emnlp)

Copied to clipboard

Challenge: Complex Query Answering (CQA) is a challenge task of Knowledge Graphs due to incompleteness of KGs.
Approach: They propose a query embedding approach that decouples the training for simple and complex queries.
Outcome: The proposed approach decouples training for simple and complex queries and achieves state-of-the-art performance over three public benchmarks.
UFO: A UI-Focused Agent for Windows OS Interaction (2025.naacl-long)

Copied to clipboard

Challenge: UFO is a UI-Fcused agent designed to fulfill user requests tailored to Windows OS applications . it decomposes user requests using divide-and-conquer approach, enabling seamless navigation and addressing sub-tasks across multiple applications.
Approach: They propose a UI-Fcused Windows OS agent that decomposes user requests using a divide-and-conquer approach and incorporates a control interaction module tailored for Windows OS.
Outcome: The proposed agent decomposes user requests using divide-and-conquer approach, enabling seamless navigation and addressing sub-tasks across multiple applications.
Cutting Off the Head Ends the Conflict: A Mechanism for Interpreting and Mitigating Knowledge Conflicts in Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Existing methods to expand internal memory boundaries of language models by providing external context can often conflict, leading to knowledge conflicts.
Approach: They propose a method that prunes conflicting attention heads without updating model parameters.
Outcome: The proposed method can flexibly control eight LMs to use internal memory or external context without updating model parameters.
MRN: A Locally and Globally Mention-Based Reasoning Network for Document-Level Relation Extraction (2021.findings-acl)

Copied to clipboard

Challenge: Existing studies on document-level relation extraction focus on sentencelevel RE, but recent studies reveal that a large number of relations can actually be expressed through multiple sentences, which necessitates document- level RE.
Approach: They propose a document-level relation extraction model that captures local and global contextual information as well as close and distant mention interactions.
Outcome: The proposed model outperforms state-of-the-art models on three widely used datasets, namely DocRED, CDR, and GDA.
iMOVE : Instance-Motion-Aware Video Understanding (2025.findings-acl)

Copied to clipboard

Challenge: Recent advances in Video Large Language Models have led to rapid development, significantly enhancing the capture of overall video semantics and achieving remarkable performance in general video understanding tasks.
Approach: They propose a large-scale instance-motion-aware video instruction-tuning dataset iMOVE that utilizes Event-awful Spatiotemporal Efficient Modeling to retain informative instance spatiotemporal motion details while maintaining computational efficiency.
Outcome: The proposed model excels in video temporal understanding and general video understanding.
A Systematic Survey of Automatic Prompt Optimization Techniques (2025.emnlp-main)

Copied to clipboard

Challenge: Recent advances in prompt engineering have created impediments for end users to adopt . however, prompt engineering remains an impedance due to rapid advances in models, tasks, and associated best practices.
Approach: They propose to define APO as a 5-part unifying framework and categorize all relevant works based on their salient features.
Outcome: The proposed framework aims to improve the performance of large language models on various tasks.
Beyond Ranking: Fine-Grained Diagnostics and Self-Improvement for MLLMs (2026.acl-long)

Copied to clipboard

Challenge: Current paradigms rely on holistic scoring and static leaderboards to disentangle fine-grained competencies.
Approach: They propose a framework to shift the focus from ranking to fine-grained diagnosis.
Outcome: The proposed framework surpasses the strongest baseline by 7.92%.
Generating Temporally-ordered Event Sequences via Event Optimal Transport (2022.coling-1)

Copied to clipboard

Challenge: Existing methods for temporal event ordering and event infilling ignore the global semantics of events, and the model adopts a word-level objective to model events in texts.
Approach: They propose a temporal event ordering and event infilling task using a model that uses maximum likelihood estimation to model events in texts.
Outcome: The proposed model outperforms existing models on all evaluation datasets.
LINKED: Eliciting, Filtering and Integrating Knowledge in Large Language Model for Commonsense Reasoning (2024.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) often exhibit poor performance on knowledge-intensive tasks, such as commonsense reasoning.
Approach: They propose a method to elicit, filter and integrate knowledge in large language models (LINKED) they propose 'reward model' to filter out noisy knowledge and 'take marginal consistent reasoning module'
Outcome: The proposed method outperforms SOTA baselines on two commonsense reasoning tasks.
IPR: Intelligent Prompt Routing with User-Controlled Quality-Cost Trade-offs (2025.emnlp-industry)

Copied to clipboard

Challenge: Existing systems require users to manually select models or employ rigid routing rules that fail to capture the continuous spectrum of query complexity.
Approach: They propose a quality-constrained intelligent prompt routing framework that automatically selects optimal models based on predicted response quality and user-specified tolerance levels.
Outcome: The proposed framework achieves 43.9% cost reduction while maintaining quality parity with strongest model in the Claude family and processes requests with sub-150ms latency.
LightVLP: A Lightweight Vision-Language Pre-training via Gated Interactive Masked AutoEncoders (2024.lrec-main)

Copied to clipboard

Challenge: Existing vision-language pre-training models use multi-modal encoders to encode image and text, causing noisy training corpora.
Approach: They propose a vision-language pre-training framework with two autoencoders for efficient training . they propose masked tokens and a gated interaction mechanism to cope with noise .
Outcome: The proposed model achieves 2.2% R@1 gains on COCO Text Retrieval and 1.1% on refCOCO+ on six datasets.
LLaSA: Large Language and Structured Data Assistant (2025.naacl-long)

Copied to clipboard

Challenge: Structured knowledge grounding (SKG) tasks are a key part of many NLP applications.
Approach: They propose a framework for enhancing LLMs' ability to handle structured data . they represent various types of structured data in a unified hypergraph format .
Outcome: The proposed framework outperforms existing methods on SKG tasks using LoRA finetuning.
Awakening Augmented Generation: Learning to Awaken Internal Knowledge of Large Language Models for Question Answering (2025.coling-main)

Copied to clipboard

Challenge: Recent studies indicate that Large Language Models model rich knowledge, but it is often not activated and awakened.
Approach: They propose a framework that leverages richer context to enhance question answering . Explicit awakening fine-tunes a context generator to create a synthetic, compressed document that functions as symbolic context.
Outcome: The proposed framework mimics the human ability to answer questions using only thinking and recalling to compensate for knowledge gaps.
Augmentation, Retrieval, Generation: Event Sequence Prediction with a Three-Stage Sequence-to-Sequence Approach (2022.coling-1)

Copied to clipboard

Challenge: Existing methods to predict event sequences are complex and ignore the knowledge of external events.
Approach: They propose a statistical induction problem to generate a sequence of events by exploring the similarity between the given goal and known sequences of events.
Outcome: The proposed model outperforms existing methods on an event sequence prediction task.
OEE-CFC: A Dataset for Open Event Extraction from Chinese Financial Commentary (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing corpora with unconventional entities serving as event arguments lack rich multi-events and shared arguments.
Approach: They develop an open event template that includes 21 event argument roles and an open corpus supporting open event extraction.
Outcome: The proposed corpus includes 17,469 events, 44,221 arguments, 3,644 complex arguments, and 5,898 shared arguments.
Diffusion Language Model Inference with Monte Carlo Tree Search (2026.findings-eacl)

Copied to clipboard

Challenge: Existing methods for inference use heuristics to determine which positions to unmask and which tokens to commit . MEDAL is an inference-time scaling framework that integrates Monte Carlo Tree SEarch initialization for Diffusion Language Model inference.
Approach: They propose a framework that integrates Monte Carlo Tree SEarch initialization for Diffusion Language Model inference.
Outcome: The proposed framework achieves 22.0% improvement over existing inference strategies across multiple benchmarks.
Learning to Ideate for Machine Learning Engineering Agents (2026.eacl-short)

Copied to clipboard

Challenge: Existing machine learning engineering (MLE) agents struggle to iteratively optimize their implemented algorithms for effectiveness.
Approach: They propose a framework that separates ideation from implementation that allows an implementation agent to request strategic help from a dedicated Ideator.
Outcome: The proposed framework outperforms implementation-only agent baselines on MLE-Bench and can be trained with reinforcement learning to generate more effective ideas.
ScEdit: Script-based Assessment of Knowledge Editing (2025.findings-acl)

Copied to clipboard

Challenge: Knowledge Editing (KE) has gained increasing attention, yet current evaluation frameworks do not integrate KE into real-world application scenarios.
Approach: They propose a script-based benchmark which encompasses both counterfactual and temporal edits and integrates token-level and text-level evaluation methods.
Outcome: The proposed method combines token-level and text-level evaluation methods with a new fact-based evaluation framework.
HMoE: Heterogeneous Mixture of Experts for Language Modeling (2025.emnlp-main)

Copied to clipboard

Challenge: Mixture of Experts (MoE) models use homogeneous experts with diverse capacities, resulting in a lack of expert specialization and parameter utilization.
Approach: They propose a framework where experts differ in size and possess diverse capacities . they propose HMoE to encourage frequent activation of smaller experts .
Outcome: The proposed framework outperforms homogeneous homogenous MoE models on evaluation benchmarks and achieves lower loss rate with fewer activated parameters.
Distill or Annotate? Cost-Efficient Fine-Tuning of Compact Models (2023.acl-long)

Copied to clipboard

Challenge: Increasing the size of pre-trained models can consistently improve performance on downstream tasks after fine-tuning, as seen in studies based on BERT, RoBERTa, T5 and empirical scaling laws.
Approach: They propose to use knowledge distillation to build a compact model with a fixed budget instead of annotating data and manually labeling it.
Outcome: The proposed approach reduces inference costs by reducing costs by hiring annotators and labelling data.
Shuttle Between Symbolic Instructions and Neural Parameters of Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Despite their distinct external representations, a deeper analysis reveals their intrinsic nature: instructions serve as a natural language compression devised by humans for data governing specific mapping patterns, whereas parameters act as 'neuro compression' of the same task data.
Approach: They propose a neural network framework to model and learn the bi-directional mappings between instructions and parameters of large language models by evaluating it on the tasks of instruction deduction and induction.
Outcome: The proposed framework can map one of the instructions/parameters to the other by evaluating it on the tasks of instruction deduction and induction.
Exploring Deductive and Inductive Reasoning Capabilities of Large Language Models in Procedural Planning (2025.findings-emnlp)

Copied to clipboard

Challenge: Deductive and inductive reasoning are fundamental components of human cognition . authors present a benchmark to assess their performance in procedural planning .
Approach: They propose a benchmark to assess the deductive and inductive reasoning abilities of LLMs . they propose IMSE to enable LLM to generate multiple similar procedural plans .
Outcome: The proposed method improves inductive reasoning abilities of LLMs, the authors show . they show that LLM models show excellent deductive reasoning capabilities but suboptimal inductive performance.
ItD: Large Language Models Can Teach Themselves Induction through Deduction (2024.acl-long)

Copied to clipboard

Challenge: Recent studies have shown that Large Language Models (LLMs) have limited ability to conduct induction.
Approach: They propose a framework to enable LLMs to teach themselves induction through deduction.
Outcome: The proposed framework improves performance on two induction benchmarks and shows that it can be used to teach induction through deduction.
Towards Better Chain-of-Thought: A Reflection on Effectiveness and Faithfulness (2025.findings-acl)

Copied to clipboard

Challenge: Chain-of-thought (CoT) prompting demonstrates varying performance under different reasoning tasks.
Approach: They propose to recall extra information from the question to enhance CoT generation and evaluate CoTs based on their information gain.
Outcome: The proposed method improves both the faithfulness and effectiveness of CoT and evaluates it based on their information gain.
MoDE-CoTD: Chain-of-Thought Distillation for Complex Reasoning Tasks with Mixture of Decoupled LoRA-Experts (2024.lrec-main)

Copied to clipboard

Challenge: Current Chain-of-thought Distillation methods hinder CoT reasoning performance . student models are separately distilled from specific reasoning tasks . parameter update of student models severely harms CoT ability on unseen reasoning tasks.
Approach: They propose a method which distills Chain-of-thought reasoning ability of large language models to much smaller student models.
Outcome: The proposed method improves the reasoning ability of large language models on 14 datasets.
When Helpers Become Hazards: A Benchmark for Analyzing Multimodal LLM-Powered Safety in Daily Life (2026.findings-acl)

Copied to clipboard

Challenge: Safety impact of Multimodal Large Language Models (MLLMs) on human behavior is evaluated in this study.
Approach: They propose a safety-warning-based evaluation framework that encourages models to provide clear and informative safety warnings, rather than generic refusals.
Outcome: The proposed safety-warning-based evaluation framework encourages models to provide clear and informative safety warnings, rather than generic refusals.
COF: Adaptive Chain of Feedback for Comparative Opinion Quintuple Extraction (2025.coling-main)

Copied to clipboard

Challenge: Comparative Opinion Quintuple Extraction (COQE) aims to extract all comparative sentiment quintuples from product review text.
Approach: They propose a model-unaware adaptive chain-of-feedback method to extract quintuples from product review text.
Outcome: The proposed method improves performance on three benchmarks.
Complex Event Schema Induction with Knowledge-Enriched Diffusion Model (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing studies on event schema induction have been hindered by errors and data quality issues.
Approach: They propose a knowledge-enriched discrete diffusion model that distills event scenario knowledge from LLMs.
Outcome: The proposed model achieves outstanding performance across evaluation metrics.
WSDPO: A Generative Word Sense Disambiguation Framework with Chain-of-Thought and Preference Optimization (2026.acl-long)

Copied to clipboard

Challenge: Word sense disambiguation (WSD) is a fundamental task in natural language processing.
Approach: They propose a training framework for generative WSD with chain-of-thought (CoT) and preference optimization.
Outcome: The proposed framework achieves significant performance gains on rare and unseen settings and exhibits strong generalization in standard evaluation settings.
An Anchor-based Relative Position Embedding Method for Cross-Modal Tasks (2022.emnlp-main)

Copied to clipboard

Challenge: Position Embedding (PE) is essential for transformer to capture the sequence ordering of input tokens.
Approach: They propose a unified position embedding method that bridges the semantic gap between modalities and embeds the anchor-based distance to guide computation of cross-attention.
Outcome: The proposed method obtains new SOTA results on a wide range of benchmarks.
RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment (2025.findings-acl)

Copied to clipboard

Challenge: Existing retrieval augmented language models often overlook effective alignment with human preferences.
Approach: They propose a benchmark to evaluate RMs in retrieval augmented language models . they incorporate 18 RAG subsets, six retrievers, and 24 RALMs to increase diversity .
Outcome: The proposed benchmark combines 18 RAG subsets, six retrievers, and 24 RALMs to increase diversity of data sources.
Prediction and Calibration: Complex Reasoning over Knowledge Graph with Bi-directional Directed Acyclic Graph Neural Network (2023.findings-acl)

Copied to clipboard

Challenge: Knowledge graphs (KGs) organize world knowledge as interlinked triples which describe entities and their relationships.
Approach: They propose a bi-directional Directed Acyclic Graph neural network that splits the reasoning process into prediction and calibration.
Outcome: The proposed model outperforms previous QE models on FB15k, FB16k-237, and NELL995 on prediction and calibration.
LaoBench: A Large-Scale Multidimensional Lao Benchmark for Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing SEA-focused benchmarks miss Lao-specific cultural grounding and linguistic properties.
Approach: They propose a multi-dimensional benchmark for assessing large language models in Lao . they use open-source and held-out subsets to evaluate languages with a hybrid pipeline .
Outcome: LaoBench is the first large-scale, high-quality, and multidimensional benchmark for assessing LLM language understanding and reasoning in Lao.
Refining and Synthesis: A Simple yet Effective Data Augmentation Framework for Cross-Domain Aspect-based Sentiment Analysis (2024.findings-acl)

Copied to clipboard

Challenge: Aspect-based Sentiment Analysis (ABSA) data augmentation has attracted increasing attention in recent years due to data sparsity.
Approach: They propose a framework to augment ABSA data using pseudo labels for target domain . they refine generated labeled data using a natural language inference filter .
Outcome: The proposed framework outperforms 7 strong baselines on 4 kinds of ABSA tasks.
TEXTOIR: An Integrated and Visualized Platform for Text Open Intent Recognition (2021.acl-demo)

Copied to clipboard

Challenge: TEXTOIR is the first integrated platform for text open intent recognition . currently, many dialogue systems are limited to handle the uncertain open intents .
Approach: TEXTOIR is the first integrated platform for text open intent recognition . it is composed of two main modules: open intent detection and open intent discovery . authors propose a framework to implement a complete process to identify known intents and discover open intents .
Outcome: TEXTOIR is the first integrated and visualized platform for text open intent recognition . it integrates state-of-the-art algorithms and benchmark intent datasets . however, there are still some issues, which bring difficulties for future research .
AgentsCourt: Building Judicial Decision-Making Agents with Court Debate Simulation and Legal Knowledge Augmentation (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent advances in deep learning have significantly impacted the legal domain.
Approach: They propose a multi-agent framework for judicial decision-making that simulates the court trial process . they propose 420 Chinese judgment documents to support their framework and build a large-scale legal knowledge base .
Outcome: The proposed framework outperforms existing methods in various aspects, especially in generating legal articles.
Search-in-Context: Efficient Multi-Hop QA over Long Contexts via Monte Carlo Tree Search with Dynamic KV Retrieval (2025.findings-acl)

Copied to clipboard

Challenge: Existing approaches to multihop question answering (MHQA) over long contexts are often neglecting explicit reasoning or incurring expensive computational costs due to full-attention mechanisms over long contextuals.
Approach: They propose a framework that integrates Monte Carlo Tree Search (MCTS) with dynamic key-value retrieval to enable iterative, context-aware reasoning.
Outcome: The proposed framework integrates Monte Carlo Tree Search (MCTS) with dynamic key-value (KV) retrieval to enable iterative, context-aware reasoning.
Leros: Learning Explicit Reasoning on Synthesized Data for Commonsense Question Answering (2024.lrec-main)

Copied to clipboard

Challenge: Recent work shows large language models can generate useful rationales for commonsense question answering (CQA) however, the cost of deployment and further tuning is relatively expensive for the large models.
Approach: They propose a framework that leverages both knowledge graphs and large language models to synthesize rationale-augmented CQA data.
Outcome: The proposed model can generate useful rationales on unseen CQA benchmarks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations