Papers by Xin Xie

40 papers
SGA-MCTS: Decoupling Planning from Execution via Training-Free Atomic Experience Retrieval (2026.findings-acl)

Copied to clipboard

Challenge: a new framework casts LLM planning as non-parametric retrieval, but high latency of inference-time search and supervised fine-tuning are limitations.
Approach: They propose a framework that casts LLM planning as non-parametric retrieval . they leverage Monte Carlo Tree Search to explore the solution space .
Outcome: Empirical results show that SGA-MCTS can match the performance of SOTA systems without task-specific fine-tuning.
Reveal and Release: Iterative LLM Unlearning with Self-generated Data (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to unlearning large language models assume full access to the forget dataset, overlooking two key challenges: (1) Forget data is often privacy-sensitive, rare, or legally regulated, making it expensive or impractical to obtain (2) The distribution of available forget data may not align with how that information is represented within the model.
Approach: They propose a “Reveal-and-Release” method to unlearn with self-generated data, prompting the model to reveal what it knows using optimized instructions.
Outcome: The proposed method removes the influence of undesirable data from the model.
RMoA: Optimizing Mixture-of-Agents through Diversity Maximization and Residual Compensation (2025.findings-acl)

Copied to clipboard

Challenge: Multi-agent systems based on large language models are limited by high computational overhead, information loss, and robustness.
Approach: They propose a Residual Mixture-of-Agents (RMoA) that integrates residual connections to optimize efficiency and reliability.
Outcome: The proposed model achieves state-of-the-art performance on benchmarks of alignment, mathematical reasoning, code generation, and multitasking understanding, while significantly reducing computational overhead.
mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text Retrieval (2024.emnlp-industry)

Copied to clipboard

Challenge: Existing models for text retrieval are based on a multi-stage process that involves retrieving documents from a large corpus.
Approach: They propose to build a multilingual text representation model and a cross-encoder reranker from scratch for text retrieval.
Outcome: The proposed models outperform the state-of-the-art models on long-context retrieval benchmarks.
CR-UTP: Certified Robustness against Universal Text Perturbations on Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Existing certified robustness methods for certifying input-specific text perturbations have shown promise in certifyling UTPs, but masking only adversarial words can eliminate the attack.
Approach: They propose a method to certify a language model’s robustness against UTPs by using random smoothing.
Outcome: The proposed method achieves high certified accuracy under extensive masking and achieves state-of-the-art results in multiple settings.
ChartM3: A Multi-Stage Code-Driven Pipeline for Constructing Multi-Dimensional and Multi-Step Visual Reasoning Data in Chart Comprehension (2025.findings-emnlp)

Copied to clipboard

Challenge: Currently, research on complex chart understanding tasks is limited . a pipeline for visual reasoning datasets addresses these limitations .
Approach: They propose a code-driven pipeline for generating visual reasoning datasets . pipeline integrates retrieval-augmented generation to retrieve professional chart templates .
Outcome: The proposed pipeline enhances chart diversity and data quality through model-based evaluation.
Generative Psycho-Lexical Approach for Constructing Value Systems in Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have raised concerns regarding their intrinsic values.
Approach: They propose a psychologically grounded five-factor value system for Large Language Models that integrates psychological principles with cutting-edge AI priorities.
Outcome: The proposed value system meets standard psychological criteria, improves LLM safety prediction, and enhances Llm alignment, when compared to the canonical Schwartz’s values.
AgentCPM-GUI: Building Mobile-Use Agents with Reinforcement Fine-Tuning (2025.emnlp-demos)

Copied to clipboard

Challenge: Large language model agents have enabled GUI-based automation, but their deployment is limited by noisy data, poor generalization, and lack of support for non-English GUIs.
Approach: They propose an 8B-parameter GUI agent built for robust and efficient on-device GUI interaction.
Outcome: The proposed GUI agent achieves promising performance on five public benchmarks and proposed Chinese benchmark CAGUI.
MixTEA: Semi-supervised Entity Alignment with Mixture Teaching (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to learn informative entity embeddings are insufficient for semi-supervised entity alignment.
Approach: They propose a semi-supervised method which guides the model learning with an end-to-end mixture teaching of manually labeled mappings and probabilistic pseudo mappings.
Outcome: The proposed method is superior to existing methods on benchmark datasets and further analyses.
Domain-Specific NER via Retrieving Correlated Samples (2022.coling-1)

Copied to clipboard

Challenge: Successful Named Entity Recognition models fail on texts from some special domains, for example, Chinese addresses and e-commerce titles.
Approach: They propose to enhance NER models with correlated samples to help the text understanding . they draw correlated texts by the sparse BM25 retriever from large-scale in-domain unlabeled data .
Outcome: Empirical results show that NER models can be enhanced with correlated samples . the proposed model can be used to reason out the correct answer on hard cases .
AuriSRec: Adversarial User Intention Learning in Sequential Recommendation (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing work focuses on capturing user implicit preferences from historical interactions and matching them with the next behavior, instead of predicting user explicit intentions.
Approach: They propose an adversarial user intention learning approach for sequential recommendaiton . the approach explicitly predicts user current intentions by taking historical reviews as inputs .
Outcome: The proposed approach explicitly predicts user intentions by inferring their decision-making process as explained in target reviews.
Crowdsourcing Learning as Domain Adaptation: A Case Study on Named Entity Recognition (2021.acl-long)

Copied to clipboard

Challenge: Experimental results show that crowdsourced annotations are highly effective under supervised conditions.
Approach: They propose an annotator-aware representation learning model that is inspired by domain adaptation methods which attempt to capture effective domain-alike features.
Outcome: The proposed model is highly effective on a benchmark dataset and achieves state-of-the-art performance with only a very small scale of expert annotations.
A Joint Learning Framework for Restaurant Survival Prediction and Explanation (2022.emnlp-main)

Copied to clipboard

Challenge: Recent advances in deep learning have various models that research reviews and interactions for different kinds of tasks, such as predicting restaurant survival.
Approach: They propose a joint learning framework for explainable restaurant survival prediction based on multi-modal data of user-restaurant interactions and users’ textual reviews.
Outcome: The proposed framework improves on two datasets showing that it can model restaurant interactions and users’ textual reviews.
Evidence-Augmented Policy Optimization with Reward Co-Evolution for Long-Context Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Evidence-Augmented Policy Optimization (EAPO) improves long-context reasoning performance . Xu et al., 2025): large language models are a critical part of NLP .
Approach: They propose an Evidence-Augmented Reasoning paradigm that uses a group-relative reward to improve evidence quality.
Outcome: EAPO significantly improves long-context reasoning performance compared to baselines.
Making Parameter-efficient Tuning More Efficient: A Unified Framework for Classification Tasks (2022.coling-1)

Copied to clipboard

Challenge: Large pre-trained language models (PLMs) have demonstrated superior performance in industrial applications.
Approach: They propose a framework that re-uses existing parameter-efficient methods with a unified classifier.
Outcome: The proposed framework improves the efficiency of existing parameter-efficient methods with a unified classifier.
Wukong-Reader: Multi-modal Pre-training for Fine-grained Visual Document Understanding (2023.acl-long)

Copied to clipboard

Challenge: Existing solutions for visual document understanding lack granularity of document textlines.
Approach: They propose a supervised pre-training program to leverage structural knowledge nested in document textlines to achieve fine-grained alignment between visual regions and texts.
Outcome: The proposed system performs better on various VDU tasks in English and Chinese.
DeepKE: A Deep Learning Based Knowledge Extraction Toolkit for Knowledge Base Population (2022.emnlp-demos)

Copied to clipboard

Challenge: Existing knowledge extraction tools are not complete due to emerging entities and relations in real-world applications.
Approach: They propose an open-source knowledge extraction toolkit DeepKE that supports low-resource, document-level and multimodal scenarios in the knowledge base population.
Outcome: The proposed toolkit supports low-resource, document-level and multimodal scenarios in the knowledge base population.
GR1: Reinforcement-Enhanced LLM for Geoscience Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in large language models have demonstrated RL's substantial capacity to enhance multi-step reasoning beyond what supervised instruction tuning achieves.
Approach: They propose a framework that converts multimodal questions into descriptive text . they propose RL-enhanced geoscience reasoning that can be fine-tuned to a text-only level .
Outcome: The proposed framework improves accuracy and accuracy on multimodal questions while preserving answerability and difficulty.
Towards Realistic Low-resource Relation Extraction: A Benchmark with Empirical Baseline Study (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to extract relational facts from text are limited in their ability to learn from limited labeled data.
Approach: They propose to use prompt-based methods with few-shot labeled data to evaluate performance . data augmentation technologies and self-training are also proposed to generate more labeles in-domain data.
Outcome: The proposed methods perform well in low-resource settings with 8 relation extraction datasets.
Can Prompts Rewind Time for LLMs? Evaluating the Effectiveness of Prompted Knowledge Cutoffs (2025.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) are widely used for temporal prediction tasks . however, their reliance on pretraining data can lead to contamination concerns .
Approach: They investigate the capability of prompting to simulate an earlier knowledge cutoff in large language models.
Outcome: The proposed model fails to induce forgetting when the forgotten content is not directly asked but causally related to the query.
Improving the Language Understanding Capabilities of Large Language Models Using Reinforcement Learning (2025.findings-emnlp)

Copied to clipboard

Challenge: Instruction-fine-tuned large language models (LLMs) under 14B parameters underperform on NLU tasks . we explore a framework to improve the NLU capabilities of LLMs .
Approach: They propose to use Proximal Policy Optimization to improve NLU capabilities . they frame NLU as a reinforcement learning environment and optimize for reward signals .
Outcome: The proposed framework outperforms supervised fine-tuning on GLUE and superGLUE tasks.
BioTool: A Comprehensive Tool-Calling Dataset for Enhancing Biomedical Capabilities of Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: despite the success of large language models, their performance in highly specialized domains remains unsatisfactory.
Approach: They propose a biomedical tool-calling dataset designed for fine-tuning LLMs . the dataset contains 34 frequently used tools from the NCBI, Ensembl, and UniProt databases .
Outcome: The proposed dataset outperforms commercial LLMs on biomedical domains.
Reasoning While Asking: Transforming Reasoning Large Language Models from Passive Solvers to Proactive Inquirers (2026.acl-long)

Copied to clipboard

Challenge: Existing reasoning-oriented LLMs lack a blind self-thinking paradigm . current models fail to recognize when their reasoning is underinformed or based on ambiguous user instructions .
Approach: They propose a new reasoning paradigm that transforms LLMs into proactive inquirers that interleave reasoning with clarification.
Outcome: The proposed model outperforms baseline models on mathematical reasoning, code generation, and document editing.
Latent Part-of-Speech Sequences for Neural Machine Translation (D19-1)

Copied to clipboard

Challenge: Existing methods for learning target side syntactic structure are greedy and only allow them to explore a limited portion of the latent space.
Approach: They propose a new latent variable model, LaSyn, that captures the co-dependence between syntax and semantics while allowing for effective inference over the latent space.
Outcome: The proposed model captures the co-dependence between syntax and semantics while allowing for efficient inference over the latent space.
DPDV: Dual-Pathway and Dual-View Representation Learning for Bridging Information Asymmetry in Text-Video Retrieval (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for text-based person anomaly search fail to address the pose-semantic gap . asymmetric cross-modal information poses a challenge to accurately establishing retrieval relationships .
Approach: They propose a video retrieval framework that partitions visual features into two categories based on relevance to the text query and performs effective interaction.
Outcome: The proposed framework achieves leading retrieval performance on five benchmark datasets.
Navigation as Attackers Wish? Towards Building Robust Embodied Agents under Federated Learning (2024.naacl-long)

Copied to clipboard

Challenge: Towards Byzantine-robust federated embodied agent learning, we study the attack and defense for the task of vision-and-language navigation (VLN)
Approach: They propose a new method to defend against a navigation-and-language navigation attack using navigation as wish (NAW) the method provides the server with a 'prompt' of the vision-and language alignment variance between benign and malicious clients so they can be distinguished during training.
Outcome: The proposed method outperforms other state-of-the-art defense methods on two VLN datasets.
MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluation (2025.emnlp-main)

Copied to clipboard

Challenge: Existing large language model evaluation benchmarks focus on English, while current multilingual tasks lack parallel questions that specifically assess cross-lingual reasoning abilities.
Approach: They propose a comprehensive benchmark covering 29 languages, built on an English benchmark.
Outcome: The MMLU-ProX is a comprehensive benchmark covering 29 languages, built on an English benchmark.
NaviMaster: Learning a Unified Policy for GUI and Embodied Navigation Tasks (2026.acl-long)

Copied to clipboard

Challenge: Recent advances in Graphical User Interface (GUI) and embodied navigation have driven progress, yet these domains have largely evolved in isolation, with disparate datasets and training paradigms.
Approach: They propose a visual-target trajectory collection pipeline that generates trajectories for GUI and embodied tasks using a single formulation.
Outcome: The proposed agent outperforms state-of-the-art agents in GUI navigation, spatial affordance prediction, and embodied navigation.
Experiential Co-Learning of Software-Developing Agents (2024.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have brought significant changes to various domains, especially through autonomous agents.
Approach: They propose a framework that lets agents learn shortcuts from their past tasks and use them for future task execution.
Outcome: The proposed framework enables agents to tackle unseen software-developing tasks more effectively.
Global Context or Local Detail? Adaptive Visual Grounding for Hallucination Mitigation (2026.findings-acl)

Copied to clipboard

Challenge: Large vision–language models suffer from object-existence hallucinations when multi-step deliberation decouples from visual evidence.
Approach: They propose a framework that allocates visual computation by uncertainty . they propose highlighting retains global context, while selective zoom-in performs local verification.
Outcome: The proposed framework reduces the complexity of multimodal reasoning by minimizing the operator trade-off.
Enhancing Chain-of-Thought Reasoning with Critical Representation Fine-tuning (2025.acl-long)

Copied to clipboard

Challenge: Representation Fine-tuning (ReFT) is a proposed method for improving parameter efficiency . however, it yields suboptimal performance, as fixed-position representations have uncertain impact on outputs .
Approach: They propose a method that fine-tunes critical representations in a low-rank linear subspace while freezing the base model.
Outcome: The proposed method improves accuracy of LLaMA-2-7B and ReFT by 18.2 and 3.8 on GSM8K.
MAKI: Multi-layer Aligned Knowledge Injection for Structure-aware Knowledge Graph Completion with Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing knowledge graph completion methods struggle to capture structural information in knowledge graphs (KGs) Existing approaches for KGC focus on learning representations of entities and relations through observed structural patterns.
Approach: They propose a multi-layer Aligned Knowledge Injection model that tightly integrates structured KG information into LLMs through multi-layered alignment.
Outcome: The proposed method outperforms state-of-the-art methods on benchmark datasets.
An Effective and Efficient Entity Alignment Decoding Algorithm via Third-Order Tensor Isomorphism (2022.acl-long)

Copied to clipboard

Challenge: Existing methods focus on graph representation learning, but decoding is a key part of the process.
Approach: They propose an EA Decoding Algorithm via Third-order Tensor Isomorphism (DATTI) they combine two sets of isomorphic equations to enhance the decoding process .
Outcome: The proposed algorithm can deliver significant performance improvements even on the most advanced methods while the extra required time is less than 3 seconds.
WenetSpeech-Wu: Datasets, Benchmarks, and Models for a Unified Chinese Wu Dialect Speech Processing Ecosystem (2026.findings-acl)

Copied to clipboard

Challenge: despite its linguistic significance, the Wu dialect of Chinese has long been hindered by the lack of large-scale speech data, standardized evaluation benchmarks, and publicly available models.
Approach: They propose to use WenetSpeech-Wu as a large-scale, multi-dimensionally annotated open-source speech corpus for the Wu dialect of Chinese.
Outcome: The proposed dataset includes 8,000 hours of speech data and strong open-source models . the proposed dataset is competitive and empirically validated .
Context-Value-Action Architecture for Value-Driven Large Language Model Agents (2026.findings-acl)

Copied to clipboard

Challenge: Existing LLMs exhibit behavioral rigidity, a flaw often masked by the self-referential bias of current "LLM-as-a-judge" evaluations.
Approach: They propose a Context-Value-Action architecture that decouples action generation from cognitive reasoning via a Value Verifier trained on authentic human data to explicitly model dynamic value activation.
Outcome: The proposed architecture significantly outperforms baseline models on 1.1 million real-world interaction traces on CVABench.
Conditional Memory via Scalable Lookup: A New Axis of Sparsity for Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Mixture-of-Experts (MoE) scales capacity via conditional computation, but lacks knowledge lookup primitive.
Approach: They propose a conditional memory instantiated via Deep Sparse Embedding (DSE) they propose 'u-shaped scaling law' that identifies optimal balance between MoE experts and DSE memory .
Outcome: The proposed model outperforms an iso-parameter and isoFLOPs MoE baseline across knowledge and reasoning benchmarks and is infrastructure-efficient.
CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmark (2022.acl-long)

Copied to clipboard

Challenge: a new benchmark for biomedical language understanding is being developed in Chinese . most benchmarks are limited to English, which makes it difficult to replicate success in other languages.
Approach: They propose to use Chinese biomedical language understanding evaluation benchmarks to evaluate Chinese models.
Outcome: The proposed benchmarks show that the current models perform worse than the human ceiling.
Divide-Then-Align: Honest Alignment based on the Knowledge Boundary of RAG (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) augmented with retrieval systems have significantly advanced natural language processing tasks by integrating external knowledge sources.
Approach: They propose a method that conditions large language models to generate answers even in the absence of reliable knowledge.
Outcome: The proposed approach balances accuracy with appropriate abstention, enhancing the reliability and trustworthiness of retrieval-augmented systems.
Towards Text-Image Interleaved Retrieval (2025.acl-long)

Copied to clipboard

Challenge: Existing multimodal information retrieval models rely on single-image inputs . current models use a dense retrieval paradigm, but this approach is not effective .
Approach: They propose a text-image interleaved retrieval task where query and document are interleaves . they adapt off-the-shelf retrievers and build a dense baseline by interleaded multimodal large language model .
Outcome: The proposed model achieves significant improvements over the baseline by substantially fewer visual tokens.
Non-Parametric Unsupervised Domain Adaptation for Neural Machine Translation (2021.findings-emnlp)

Copied to clipboard

Challenge: kNN-MT is a non-parametric method that uses nearest neighbor retrieval to translate out-of-domain sentences, rare words, etc.
Approach: They propose a framework that directly uses in-domain monolingual sentences to build an effective datastore for k-nearest-neighbor retrieval.
Outcome: The proposed framework improves translation accuracy with target-side monolingual data while achieving comparable performance with back-translation.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations