Papers by Xiangyu Liu

45 papers
MSEarth: A Multimodal Benchmark for Earth Science Phenomenon Discovery with MLLMs (2026.acl-long)

Copied to clipboard

Challenge: Existing datasets often rely on synthetic data or figure-caption pairs, failing to capture the depth and complexity of geoscientific reasoning.
Approach: They propose a multimodal scientific dataset and benchmark curated from open-access publications.
Outcome: MSEarth features over 289K figures with captions enriched by contextual discussions and reasoning from original papers.
The Elephant in the Room: Exploring the Role of Neutral Words in Language Model Group-Agnostic Debiasing (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) are increasingly integrated into our daily lives, raising ethical concerns, especially about perpetuating stereotypes.
Approach: They propose a method that incorporates a neutral word semantics-based loss function to alleviate the deterioration of the LMS during debiasing.
Outcome: The proposed method alleviates the deterioration of the Language Modeling Score (LMS) by incorporating a neutral word semantics-based loss function.
Beyond Demographics: Enhancing Cultural Value Survey Simulation with Multi-Stage Personality-Driven Cognitive Reasoning (2025.emnlp-main)

Copied to clipboard

Challenge: Introducing **MARK**, a framework for cultural value survey simulation . based on type dynamics theory, it improves accuracy and interpretation of models .
Approach: They propose a framework that integrates psychological theory into cultural value survey simulations.
Outcome: The proposed framework outperforms baseline models on the World Values Survey by 10% accuracy and reduces divergence between model predictions and human preferences.
Lunar Twins: We Choose to Go to the Moon with Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Lunar Twins is the first LLM designed specifically for lunar exploration . Lunar GenData is a multi-agent collaborative workflow for generating lunar instructions .
Approach: They propose a framework that combines both large and small LLMs and Lunar GenData, which integrates real data from Chang'e lunar missions.
Outcome: Experimental validation shows that the proposed framework enhances domain expertise and reveals indications of embodied intelligence potential.
Hierarchical Memory Organization for Wikipedia Generation (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for generating Wikipedia articles do not utilize memory directly for outline generation.
Approach: They propose a method to generate Wikipedia articles autonomously by leveraging a hierarchical memory architecture.
Outcome: The proposed framework outperforms baseline methods in producing informative and reliable articles.
MemoPhishAgent: Memory-Augmented Multi-Modal LLM Agent for Phishing URL Detection (2026.acl-industry)

Copied to clipboard

Challenge: Traditional phishing website detection relies on static heuristics or reference lists, which lag behind rapidly evolving attacks.
Approach: They propose a memory-augmented multi-modal LLM agent that leverages episodic memories to guide decisions on recurring and novel threats.
Outcome: The proposed agent outperforms state-of-the-art phishing detection tools on two public datasets and improves recall by 20%.
Bridging Relevance and Reasoning: Rationale Distillation in Retrieval-Augmented Generation (2025.findings-acl)

Copied to clipboard

Challenge: Existing approaches to rerank and align documents based on reasoning capabilities of large language models (LLMs) . prior work shows that LLMs have exceptional reasoning and text generation capabilities .
Approach: They propose a rationale extraction method that leverages reasoning capabilities of large language models to extract the rationales necessary for answering a query.
Outcome: The proposed method is compared with baseline methods on two tasks across three datasets.
LLMs Trust Humans More, That’s a Problem! Unveiling and Mitigating the Authority Bias in Retrieval-Augmented Generation (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) generate outputs that stray from user input or contravene established knowledge.
Approach: They propose a new phenomenon, Authority Bias, where LLMs favor one knowledge source over the other . they propose atomic information that generates conflicts and a Conflict Detection Enhanced Query framework .
Outcome: The proposed framework reduces Authority bias in large language models . it detects conflicts, performs credibility assessment on conflicting paragraphs, and detects perturbed text .
Counterfactual Adversarial Learning with Representation Interpolation (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing models with statistical bias are prone to memorized correlations . large pre-trained models such as BERT have revolutionized the model development paradigm in natural language processing .
Approach: They propose a framework to tackle the problem from a causal perspective using a latent space interpolation approach.
Outcome: Extensive experiments show that CAT achieves substantial performance improvement over SOTA across different downstream tasks, including sentence classification, natural language inference and question answering.
Multi-Aspect Controllable Text Generation with Disentangled Counterfactual Augmentation (2024.acl-long)

Copied to clipboard

Challenge: Existing studies neglect attribute correlations formed by the intertwining of different attributes.
Approach: They propose a multi-aspect controllable text generation method with disentangled counterfactual augmentation that alleviates imbalanced attribute correlations during training by disentanglement.
Outcome: The proposed method outperforms state-of-the-art methods in imbalanced and balanced attribute correlation scenarios.
Mitigating Hallucinations of Large Language Models in Medical Information Extraction via Contrastive Decoding (2024.findings-emnlp)

Copied to clipboard

Challenge: Medical Information Extraction (MIE) tasks are a fundamental component of medical NLP.
Approach: They propose an alternative adaptive constraint strategy to adjust the scale and scope of contrastive tokens.
Outcome: The proposed approach selectively enhances the identification and classification capabilities while minimizing the influence of other inherent abilities in LLMs.
MILL: Mutual Verification with Large Language Models for Zero-Shot Query Expansion (2024.naacl-long)

Copied to clipboard

Challenge: Existing methods for query expansion lack corpus-specific knowledge and cost.
Approach: They propose a query-query-document generation method that leverages large language models for mutual verification to produce diverse sub-queries and corresponding documents.
Outcome: The proposed method is fully zero-shot and extensive experiments on three public benchmark datasets demonstrate its effectiveness over existing methods.
DESED: Dialogue-based Explanation for Sentence-level Event Detection (2022.coling-1)

Copied to clipboard

Challenge: Existing methods for sentence-level event detection depend on manual annotations or domain expertise to design sophisticated templates and rules.
Approach: They propose a dialogue-based explanation paradigm to enhance sentence semantics for event detection.
Outcome: The proposed method can be applied to two event detection datasets.
ThinkAnswer Loss: Balancing Semantic Similarity and Exact Matching for LLM Reasoning Enhancement (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for knowledge distillation use Chain-of-Thought (CoT) and answer pairs, but they lack appropriate supervision signals.
Approach: They propose a framework that decouples CoT and answer supervision . the framework applies semantic similarity constraints while maintaining strict literal matching for the answer .
Outcome: The proposed framework decouples CoT and answer supervision while maintaining strict literal matching for the answer.
When LLMs Meets Acoustic Landmarks: An Efficient Approach to Integrate Speech into Large Language Models for Depression Detection (2024.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) are used for depression detection but their application remains unexplored.
Approach: They propose to integrate acoustic speech information into LLMs for depression detection by integrating aural landmarks into the framework.
Outcome: The proposed method adds critical dimensions to speech transcripts and provides insights into the unique speech patterns of individuals.
Learning How and What to Memorize: Cognition-Inspired Two-Stage Optimization for Evolving Memory (2026.acl-long)

Copied to clipboard

Challenge: Existing memory systems rely on static, hand-crafted update rules for personalization, but sparse outcome rewards provide weak supervision, resulting in unstable long-horizon optimization.
Approach: They propose a memory guideline optimization framework that learns how memory should be organized and what information to update.
Outcome: The proposed framework learns how memory should be organized and what information to update.
Improving Embedding-based Large-scale Retrieval via Label Enhancement (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for large-scale retrieval are trained with 0-1 hard labels that indicate whether a query is relevant to a document, ignoring rich information of the relevance degree.
Approach: They propose to introduce label enhancement for the first time to characterize query-document relevance degree by embedding label distribution into contextual embeddables.
Outcome: The proposed method significantly outperforms existing retrieval models and its counterparts equipped with two alternative methods on English and Chinese large-scale retrieval tasks.
Can LLMs Hear the Dogwhistle? (2026.findings-acl)

Copied to clipboard

Challenge: Existing safety benchmarks focus on explicitly harmful content, but ignore context-dependent expressions such as dogwhistles.
Approach: They propose a benchmark for evaluating LLM safety under dogwhistle-driven prompts . their findings expose a blind spot in current safety evaluation practices .
Outcome: The proposed benchmark compared safety performance with toxic terms using dogwhistle-driven prompts.
MemSearch-o1: Empowering Large Language Models with Reasoning-Aligned Memory Growth in Agentic Search (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for memory management struggle to capture fine-grained semantic relations between queries and documents.
Approach: They propose a framework for reasoning and agentic search that grows fine-grained memory fragments from seed tokens from queries, then retraces and deep refines the memory via a contribution function.
Outcome: Experiments on eight benchmark datasets show that MemSearch-o1 significantly mitigates memory dilution and more effectively activates reasoning potential of diverse LLMs.
Regularized Attentive Capsule Network for Overlapped Relation Extraction (2020.coling-main)

Copied to clipboard

Challenge: Existing methods to extract relations from distant supervision contain low-quality instances with noisy words and overlapped relations.
Approach: They propose a Regularized Attentive Capsule Network to better identify overlapped relations in informal sentences . they embed multi-head attention into the capsule network as the low-level capsules .
Outcome: Extensive experiments show that the proposed model improves relation extraction.
PsychEthicsBench: Evaluating Large Language Models Against Australian Mental Health Ethics (2026.findings-acl)

Copied to clipboard

Challenge: Mental disorders affect nearly one in seven people worldwide, yet the vast majority do not receive adequate care.
Approach: They propose a framework to evaluate LLMs' ethical knowledge and behavioral responses through multiple-choice and open-ended tasks with fine-grained ethicality annotations.
Outcome: Empirical results across 14 models reveal that refusal rates are poor indicators of ethical behavior, revealing a significant divergence between safety triggers and clinical appropriateness.
Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization (2024.findings-acl)

Copied to clipboard

Challenge: Recent approaches to language model alignment assume homogeneous human preferences, but actual human preferences vary widely and are hard to satisfy with a single language model.
Approach: They propose an RL-free extension of Direct Preference Optimization (DPO) that folds language modeling directly into reward modeling and trains language models as collective reward models that combine all objectives with specific weights.
Outcome: The proposed method matches or outperforms existing methods in safety alignment and long-form question answering.
RU22Fact: Optimizing Evidence for Multilingual Explainable Fact-Checking on Russia-Ukraine Conflict (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods to verify factuality of claims do not provide sufficient evidence for explainable fact-checking systems.
Approach: They propose a method to automatically retrieve and summarize evidence from the Web and a novel multilingual explainable fact-checking dataset on the Russia-Ukraine conflict in 2022.
Outcome: The proposed method can retrieve and summarize evidence from the Web and generate explanations in 16 languages.
Distantly Supervised Relation Extraction using Multi-Layer Revision Network and Confidence-based Multi-Instance Learning (2021.emnlp-main)

Copied to clipboard

Challenge: Distantly supervised relation extraction is used in knowledge bases but its low quality and noisy sentences are present in sentence bags.
Approach: They propose a multi-layer revision network which emphasizes inner-sentence correlations before extracting relevant information within sentences.
Outcome: The proposed method improves on two New York Times datasets.
A Multi-Expert Structural-Semantic Hybrid Framework for Unveiling Historical Patterns in Temporal Knowledge Graphs (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods focus on graph structure learning or semantic reasoning, lacking the capability to capture the inherent differences between historical and non-historical events.
Approach: They propose a temporal knowledge graph reasoning framework that integrates both structural and semantic information to guide the reasoning process for different events.
Outcome: The proposed framework integrates structural and semantic information to predict future events . it can provide evidence for many downstream tasks, including situation analysis and political decision making .
TP-Link: Fine-grained Pre-Training for Text-to-SQL Parsing with Linking Information (2024.lrec-main)

Copied to clipboard

Challenge: Existing pre-training frameworks for text-to-SQL parsing have shown inherent differences in distributions between tables and plain text.
Approach: They propose a framework to improve context-dependent Text-to-SQL parsing by leveraging Linking information.
Outcome: The proposed framework achieves state-of-the-art performance on two leading downstream benchmarks.
Raw Pointer Rewriting with LLMs for Translating C to Safer Rust (2026.findings-acl)

Copied to clipboard

Challenge: C2Rust is a system programming language that enforces strict memory and type safety guarantees.
Approach: They propose a raw pointer rewriting technique that lifts raw pointers in individual functions to appropriate Rust data structures.
Outcome: The proposed technique eliminates 18.57% of local raw pointers and improves memory safety on 28 real-world C projects.
Enhancing Efficiency and Exploration in Reinforcement Learning for LLMs (2025.emnlp-main)

Copied to clipboard

Challenge: Existing approaches allocate an equal number of rollouts to all questions during the RL process, which is inefficient.
Approach: They propose a mechanism for dynamically allocating rollout budgets based on the difficulty of the problems, enabling more efficient RL training.
Outcome: The proposed model improves response precision while preserving exploratory ability to uncover potential correct pathways.
Mitigating Lost-in-Retrieval Problems in Retrieval Augmented Multi-Hop Question Answering (2025.acl-long)

Copied to clipboard

Challenge: Empirical results show that ChainRAG consistently outperforms baselines in both effectiveness and efficiency.
Approach: They propose a method which sequentially handles each sub-question by completing missing key entities and retrieving relevant sentences from a sentence graph for answer generation.
Outcome: The proposed method outperforms baselines on three multi-hop QA datasets.
Label Smoothing for Text Mining (2022.coling-1)

Copied to clipboard

Challenge: Existing text mining models are trained with 0-1 hard label that indicates whether an instance belongs to a class, ignoring rich information of the relevance degree.
Approach: They propose a keyword-based method to automatically generate soft labels from hard labels . they exploit relevance between labels and instances to incorporate them into models .
Outcome: The proposed method improves models under balanced and unbalanced conditions.
Select Before Use: On the Importance of Reference Model Selection in Preference Alignment (2026.acl-long)

Copied to clipboard

Challenge: Supervised Fine-Tuning (SFT) is used as the initialization and reference model for subsequent preference alignment.
Approach: They propose to use RewardRank to estimate initial implicit alignment between reference model and preference objective to ensure LLMs generate safe, helpful, and instruction-aligned content.
Outcome: Empirical evidence shows that using the selected model as reference can gain up to 67.6% relative increase on length-controlled win rate compared to baselines.
EasyGen: Easing Multimodal Generation with BiDiffuser and LLMs (2024.acl-long)

Copied to clipboard

Challenge: Existing multimodal models that depend on encoders like CLIP or ImageBind need ample amounts of training data to bridge modalities.
Approach: They propose an efficient model that leverages bidirectional conditional diffusion model to foster more efficient modality interactions.
Outcome: The proposed model is able to train a projection layer linking an LLM and an adapter to align the LLM’s text space with the bidirectional diffusion model.
MUSIED: A Benchmark for Event Detection from Multi-Source Heterogeneous Informal Texts (2022.emnlp-main)

Copied to clipboard

Challenge: Recent efforts to classify unstructured texts into specific types have been limited in practical scenarios.
Approach: They propose to use Chinese text conversations and phone conversations to expand event detection to the scenarios involving informal and heterogeneous texts.
Outcome: The proposed dataset is based on user reviews, text conversations, and phone conversations in a leading e-commerce platform for food service.
RoChBert: Towards Robust BERT Fine-tuning for Chinese (2022.findings-emnlp)

Copied to clipboard

Challenge: Pre-trained language models (e.g., BERT) have been proved vulnerable to adversarial texts.
Approach: They propose to fuse Chinese phonetic and glyph features into pre-trained models by using a more comprehensive adversarial graph.
Outcome: The proposed framework outperforms existing methods in significant ways on a wide range of tasks while remaining accurate on benign texts.
SemAttack: Natural Textual Attacks via Different Semantic Spaces (2022.findings-naacl)

Copied to clipboard

Challenge: Existing approaches to attack pre-trained language models suffer from low success rates or fail to search efficiently in the exponentially large perturbation space.
Approach: They propose an efficient framework to generate natural adversarial text by constructing different semantic perturbation functions.
Outcome: The proposed framework generates natural adversarial texts for different languages with high success rates.
Redundancy Principles for MLLMs Benchmarks (2025.acl-long)

Copied to clipboard

Challenge: Rapid growth of Multi-modality Large Language Models has led to significant redundancy among benchmarks.
Approach: They propose a framework to improve MLLM benchmark design by identifying redundancy at three levels: dimension, instance, and cross-benchmark redundancies.
Outcome: The proposed framework streamlines evaluations and enhances reliability.
SpeechT-RAG: Reliable Depression Detection in LLMs with Retrieval-Augmented Generation Using Speech Timing Information (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have been extensively utilized for health-related tasks, yet their performance in depression detection remains limited when relying solely on text input.
Approach: They propose a system that leverages speech timing features for depression detection and reliable confidence estimation.
Outcome: The proposed system outperforms text-based RAG systems in depression detection and confidence estimation.
Efficient Dynamic Clustering-Based Document Compression for Retrieval-Augmented-Generation (2025.findings-emnlp)

Copied to clipboard

Challenge: RAG implementations face challenges in addressing retrieved noise and redundant content . current RAG methods lack the ability to exploit fine-grained inter-document relationships .
Approach: They propose a retrieval-augmented generation framework that exploits latent inter-document relationships while removing irrelevant information and redundant content.
Outcome: The proposed framework achieves consistent performance improvements on knowledge-QA and hallucination-Detection datasets.
Speaking in Wavelet Domain: A Simple and Efficient Approach to Speed up Speech Diffusion Model (2024.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to enhance inference speed and training require complex modifications to the model.
Approach: They propose to double the training and inference speed of Denoising Diffusion Probabilistic Models by simply redirecting the generative target to the wavelet domain.
Outcome: The proposed method doubles the training and inference speed of Speech DDPMs by redirecting the generative target to the wavelet domain.
Stepwise Reasoning Disruption Attack of LLMs (2025.acl-long)

Copied to clipboard

Challenge: Existing attacks on LLM reasoning are constrained by specific settings or lack of imperceptibility, limiting their feasibility and generalizability.
Approach: They propose a stepwise rEasoning error disruption attack that subtly injects errors into prior reasoning steps to mislead the model into producing incorrect subsequent reasoning and final answers.
Outcome: The proposed attack is compatible with zero-shot and few-shot settings, maintains the natural reasoning flow, and ensures covert execution without modification of the instruction.
An Empirical Study of LLM Reasoning Ability Under Strict Output Length Constraint (2025.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) are a powerful tool for test-time scaling, but they are often used under time constraints.
Approach: They propose to use LLMs to make models think before answering questions . they also use self-correction and best-of-N decoding to encourage deeper thinking .
Outcome: The proposed models are able to achieve higher inference accuracy with extra inference computation under time constraints.
Avoiding Knowledge Edit Skipping in Multi-hop Question Answering with Guided Decomposition (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for knowledge editing fail to work in multi-hop question answering due to 'edit skipping' edit skipping occurs due to the mismatch between the granularity of LLMs in problem-solving and the facts in the edited memory.
Approach: They propose a retrieval-augmented generation-based method that edits knowledge without modifying parameters without retraining LLMs.
Outcome: The proposed method outperforms state-of-the-art methods for KE in multi-hop question answering.
CHiRPE: A Step Towards Real-World Clinical NLP with Clinician-Oriented Model Explanations (2026.eacl-short)

Copied to clipboard

Challenge: Psychotic disorders are a major contributor to the global health burden due to their relatively high mortality risk.
Approach: They propose an NLP pipeline that takes semi-structured clinical interviews to predict psychosis risk and generate novel SHAP explanation formats.
Outcome: The proposed pipeline outperforms baseline models and achieves 90% accuracy across three BERT variants.
OneRec-Think: In-Text Reasoning for Generative Recommendation (2026.acl-long)

Copied to clipboard

Challenge: Existing generative models lack the capacity for explicit and controllable reasoning, a key advantage of LLMs.
Approach: They propose a framework that integrates dialogue, reasoning, and personalized recommendation.
Outcome: Experiments across public benchmarks show state-of-the-art performance.
SEARCH-R: Structured Entity-Aware Retrieval with Chain-of-Reasoning Navigator for Multi-hop Question Answering (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to multi-hop question answering lack effective control over reasoning paths, leading to astray results.
Approach: They propose a framework for multi-hop question answering that trains an end-to-end reasoning path navigator to provide a powerful sub-question decomposer by fine-tuning the Llama3.1-8B model.
Outcome: The proposed framework trains an end-to-end reasoning path navigator . it is able to provide a powerful sub-question decomposer by fine-tuning the Llama3.1-8B model .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations