Papers by Jian Xie

30 papers
LCR-RAG: Enhancing Logical Consistency in Retrieval-Augmented Generation via Neuro-symbolic Reinforcement Learning (2026.acl-long)

Copied to clipboard

Challenge: Retrieval-Augmented Generation (RAG) is widely used to ground large language models in external knowledge and improve factual accuracy.
Approach: They propose a framework that integrates neuro-symbolic verification with reinforcement learning to optimize logical consistency.
Outcome: The proposed framework outperforms strong RAG baselines on hotpotQA, ASQA, and TriviaQA.
Automatic, Meta and Human Evaluation for Multimodal Summarization with Multimodal Output (2024.naacl-long)

Copied to clipboard

Challenge: Multimodal summarization with multimodal output (MSMO) has attracted increasing research interest . evaluation is an emerging yet underexplored research topic .
Approach: They propose a framework that studies three research questions of MSMO evaluation . they propose an automatic evaluation metric and a meta-evaluation benchmark dataset .
Outcome: The proposed evaluation metric and human-annotated meta-evaluation benchmark are used to assess the quality of evaluation metrics and show the framework is effective.
UniEDU: Toward Unified and Efficient Large Multimodal Models for Educational Tasks (2025.emnlp-industry)

Copied to clipboard

Challenge: Existing research has focused on plain text, while real-world K-12 scenarios often involve multimodal data.
Approach: They propose a unified language and vision assistant called UniEDU for educational applications . it excels across multiple educational tasks while maintaining strong generalization capabilities . authors propose to use UniEDu for industry-scale deployment .
Outcome: The proposed model excels across multiple educational tasks while maintaining strong generalization capabilities.
WebClipper: Efficient Evolution of Web Agents with Graph-based Trajectory Pruning (2026.acl-long)

Copied to clipboard

Challenge: Open-source web agents rely on long tool-call trajectories with cyclic reasoning loops and exploration of unproductive branches.
Approach: They propose a framework that compresses web agent trajectories via graph-based pruning.
Outcome: The proposed framework reduces tool-call rounds by 20% while improving accuracy and efficiency while maintaining the same level of performance as existing models.
Towards Reliable Large Audio Language Model (2025.findings-acl)

Copied to clipboard

Challenge: Recent advances in large audio language models (LALMs) have demonstrated impressive results and promising prospects in universal understanding and reasoning across speech, music, and general sound.
Approach: They propose to use training-free and training-based methods to enhance LALM reliability to different extents.
Outcome: The proposed methods improve the reliability of large audio language models to different extents.
Retrieval Augmented Instruction Tuning for Open NER with Large Language Models (2025.coling-main)

Copied to clipboard

Challenge: Existing studies have focused on integrating large language models (LLMs) with information extraction (IE) however, the best approach to incorporate information with LLMs for IE remains an open question.
Approach: They propose to use a Chinese IT dataset to perform RA-IT for IE . they use semantically similar examples from the training dataset as the context .
Outcome: The proposed approach is evaluated in English and Chinese scenarios.
Revealing the Barriers of Language Agents in Planning (2025.naacl-long)

Copied to clipboard

Challenge: Existing studies show language agents lack human-level planning abilities . limitations and mechanisms to address them remain insufficiently understood .
Approach: They apply a feature attribution study to identify key factors hindering agent planning . they identify the limited role of constraints and diminishing influence of questions .
Outcome: The proposed model achieves 15.6% on a real-world planning benchmark.
MBA-RAG: a Bandit Approach for Adaptive Retrieval-Augmented Generation through Question Complexity (2025.coling-main)

Copied to clipboard

Challenge: Existing RAG frameworks either indiscriminately perform retrieval or rely on rigid single-label classifiers to select retrieval methods.
Approach: They propose a framework that dynamically selects the most suitable retrieval strategy based on query complexity.
Outcome: The proposed framework achieves state-of-the-art results on multiple single-hop and multi-hop datasets while reducing retrieval costs.
ARM2: Adaptive Reasoning Model with Vision Understanding and Executable Code (2026.findings-acl)

Copied to clipboard

Challenge: Large Reasoning Models suffer from the "over-thinking" problem, causing performance degradation.
Approach: They propose a unified model that balances reasoning performance and efficiency across multiple formats through a reinforcement learning framework augmented with length-aware optimization.
Outcome: The proposed model reduces token costs while preserving performance compared to traditional models.
Unifying Discrete and Continuous Representations for Unsupervised Paraphrase Generation (2023.emnlp-main)

Copied to clipboard

Challenge: Existing unsupervised paraphrase generation methods require large-scale, manually annotated paraphrase datasets, which are labor-intensive to build.
Approach: They propose a self-supervised pseudo-data construction method that generates diverse pseudo-paraphrases in distinct surface structures for a given sentence.
Outcome: The proposed method generates diverse pseudo-paraphrases in distinct surface structures for a given sentence.
LLM Agents for Education: Advances and Applications (2025.findings-emnlp)

Copied to clipboard

Challenge: Large Language Model (LLM) agents are transforming education by automating complex tasks and enhancing both teaching and learning processes.
Approach: This survey analyzes recent advances in applying Large Language Model agents to educational settings . it highlights ethical issues, hallucination and overreliance, and integration with existing ecosystems .
Outcome: The authors analyze the technologies enabling LLM agents and highlight key challenges in deploying them in educational settings.
Attention and Edge-Label Guided Graph Convolutional Networks for Named Entity Recognition (2022.emnlp-main)

Copied to clipboard

Challenge: Named entity recognition (NER) is the recognition of entities with specific meanings in the text, mainly including person, organization, location, etc.
Approach: They propose an edge-aware node joint update module and introduce a node-awful edge update module to explore hidden in structured information and solve the wrong dependency label information to some extent.
Outcome: The proposed model can exploit the structured information on the dependency tree to improve the recognition of long entities.
FinSafetyBench: Evaluating LLM Safety in Real-World Financial Scenarios (2026.findings-acl)

Copied to clipboard

Challenge: Existing large language models (LLMs) are prone to misuse and misinformation, posing serious compliance risks.
Approach: They propose a bilingual red-teaming benchmark to test an LLM’s refusal of requests that violate financial compliance.
Outcome: The proposed benchmark is based on real-world financial crime cases and ethical violations and includes 14 subcategories covering financial crimes and ethical breaches.
Sentient Agent as a Judge: Evaluating Higher-Order Social Cognition in Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) have evolved from statistical sequence predictors to sophisticated autonomous agents capable of reasoning, planning, and sustaining multi-turn conversa-tions.
Approach: They propose a system that instantiates a "Sentient Agent" that simulates human-like emotional changes and inner thoughts to provide a more realistic evaluation of the model in multi-turn conversations.
Outcome: The proposed framework measures the agent's higher-order social cognition in multi-turn conversations.
MCGA: A Multi-task Classical Chinese Literary Genre Audio Corpus (2026.findings-acl)

Copied to clipboard

Challenge: Multimodal Large Language Models (MLLMs) have advanced Chinese Classical Studies (CCS) but the audio dimension of CCS remains underexplored due to a lack of high-quality, domain-specific audio corpora.
Approach: They propose a 119-hour audio corpus comprising 22,000 audio samples to bridge this gap . it encompasses a diverse range of literary genres across six tasks .
Outcome: The proposed corpus encompasses a diverse range of literary genres across six tasks: Automatic Speech Recognition (ASR), Speech-to-Text Translation (S2TT), Speech Emotion Captioning (SEC), Spoken Question Answering ( SQA), Speech Understanding (SU), and Speech Reasoning (SR).
Empirical Study of Zero-Shot NER with ChatGPT (2023.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) have been a key component of natural language processing (NLP) .
Approach: They propose to decompose the NER task into simpler subproblems by labels and propose a syntactic augmentation strategy to stimulate model's intermediate thinking.
Outcome: The proposed methods achieve remarkable improvements for zero-shot NER across seven benchmarks, including Chinese and English datasets.
SlotRefine: A Fast Non-Autoregressive Model for Joint Intent Detection and Slot Filling (2020.emnlp-main)

Copied to clipboard

Challenge: Slot filling and intent detection are two main tasks in spoken language understanding systems.
Approach: They propose a non-autoregressive slot filling model with two-pass iteration mechanism to handle uncoordinated slots problem.
Outcome: The proposed model significantly outperforms previous models in slot filling task while speeding up decoding.
ReCaLL: Membership Inference via Relative Conditional Log-Likelihoods (2024.emnlp-main)

Copied to clipboard

Challenge: ReCaLL (Relative Conditional Log-Likelihood) is a membership inference attack that can detect LLMs’ pretraining data by leveraging their conditional language modeling capabilities.
Approach: They propose a membership inference attack to detect LLMs’ pretraining data by leveraging their conditional language modeling capabilities.
Outcome: The proposed model achieves state-of-the-art performance on the WikiMIA dataset, even with random and synthetic prefixes, and can be further improved using an ensemble approach.
DT-Solver: Automated Theorem Proving with Dynamic-Tree Sampling Guided by Proof-level Value Function (2023.acl-long)

Copied to clipboard

Challenge: Recent advances in neural theorem-proving resort to large language models and tree searches.
Approach: They propose a Dynamic-Tree Driven Theorem Solver to accommodate general theoremes by guiding the search procedure with state confidence and proof-level values.
Outcome: The proposed method outperforms state-of-the-art methods on two popular theorem-proving datasets with a 6.65% improvement on average in terms of success rate.
Implicit Reasoning in Transformers is Reasoning through Shortcuts (2025.findings-acl)

Copied to clipboard

Challenge: Language models can perform step-by-step reasoning and achieve high accuracy in both in-domain and out-of-domain tests via implicit reasoning.
Approach: They train GPT-2 from scratch on a curated multi-step mathematical reasoning dataset and conduct analytical experiments to investigate how language models perform implicit reasoning in multi- step tasks.
Outcome: The proposed model performs better on multi-step tasks than the explicit reasoning model.
Disco-RAG: Discourse-Aware Retrieval-Augmented Generation (2026.acl-long)

Copied to clipboard

Challenge: Existing RAG strategies treat retrieved passages in a flat and unstructured way, which prevents the model from capturing structural cues and constrains its ability to synthesize knowledge from dispersed evidence across documents.
Approach: They propose a framework that explicitly injects discourse signals into the generation process.
Outcome: Experiments on question answering and long-document summarization benchmarks show the efficacy of the proposed framework.
CogniBench: A Legal-inspired Framework and Dataset for Assessing Cognitive Faithfulness of Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Existing benchmarks focus on “factual statements” that rephrase source materials, but ignore “cognitive statements” . evaluating and detecting "faithfulness hallucinations" remains challenging .
Approach: They propose a framework to assess faithfulness of cognitive statements and introduce a dataset to scale easily across models.
Outcome: The proposed framework assesses faithfulness of cognitive statements and scales easily across models.
GUI Agents: A Survey (2025.findings-acl)

Copied to clipboard

Challenge: Large Foundation Models (LFMs) have transformed the landscape of AI research and day-to-day life.
Approach: They propose a framework that delineates GUI agents' perception, reasoning, planning, and acting capabilities.
Outcome: The proposed framework delineates their perception, reasoning, planning, and acting capabilities.
UCS-SQL: Uniting Content and Structure for Enhanced Semantic Bridging In Text-to-SQL (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods overlook the challenge of effectively transforming structure information from NL to SQL.
Approach: They propose a text-to-SQL framework that unites content and structure pipes to bridge the gap between NL and SQL.
Outcome: The proposed framework bridges the gap between natural language questions and SQL by combining content and structure pipes.
Understanding and Mitigating Spurious Signal Amplification in Test-Time Reinforcement Learning for Math Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: a framework to mitigate spurious optimization signals is proposed for test-time reinforcement learning (TTRL) Reinforcement learning with verifiable rewards (RLVR) is an effective paradigm for improving large language models on structured challenging reasoning tasks.
Approach: They propose a framework to mitigate spurious optimization signals from label noise . they propose to use a frequency-based sampling strategy to exclude ambiguous samples .
Outcome: The proposed framework outperforms existing TTRL baselines on three large language models across multiple mathematical reasoning benchmarks.
SemRegex: A Semantics-Based Approach for Generating Regular Expressions from Natural Language Specifications (D18-1)

Copied to clipboard

Challenge: Existing approaches to generate programs from natural language do not address program aliasing . semantically equivalent programs may have many syntactically different forms .
Approach: They propose a semantics-based approach to generate regular expressions from natural language.
Outcome: The proposed approach improves on three public datasets.
The Model Agreed, But Didn’t Learn: Diagnosing Surface Compliance in Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models internalize vast world knowledge as parametric memory, yet inherit the staleness and errors of their source corpora.
Approach: They propose a framework that subjects models to discriminative self-assessment under diverse contextual pressures to scrutinize subtle behavioral nuances induced by memory modifications.
Outcome: The proposed framework achieves high benchmarks without overwriting internal beliefs, while recursive modifications accumulate representational residues, triggering cognitive instability and permanently diminishing the reversibility of the model’s memory state.
CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmark (2022.acl-long)

Copied to clipboard

Challenge: a new benchmark for biomedical language understanding is being developed in Chinese . most benchmarks are limited to English, which makes it difficult to replicate success in other languages.
Approach: They propose to use Chinese biomedical language understanding evaluation benchmarks to evaluate Chinese models.
Outcome: The proposed benchmarks show that the current models perform worse than the human ceiling.
Descriptive Prompt Paraphrasing for Target-Oriented Multimodal Sentiment Classification (2023.findings-emnlp)

Copied to clipboard

Challenge: Current researches mainly work on either of two types of targets in a decentralized manner.
Approach: They propose a model to perform sentiment polarity on a target jointly considering its corresponding multiple modalities including text, image, and others.
Outcome: The proposed model performs well on four datasets spanning the above two target types and is prompt-based language modelling.
HumanLLM: Benchmarking and Improving LLM Anthropomorphism via Human Cognitive Patterns (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated remarkable capabilities in reasoning and generation, serving as the foundation for advanced persona simulation and Role-Playing Language Agents (RPLAs).
Approach: They propose a framework that treats psychological patterns as interacting causal forces and synthesizes 113 scenarios where 2-5 patterns reinforce, conflict, or modulate each other.
Outcome: The proposed framework outperforms Qwen3-32B on multi-pattern dynamics despite 4 fewer parameters.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations