Papers by Xiangyu Zhao

41 papers
MSEarth: A Multimodal Benchmark for Earth Science Phenomenon Discovery with MLLMs (2026.acl-long)

Copied to clipboard

Challenge: Existing datasets often rely on synthetic data or figure-caption pairs, failing to capture the depth and complexity of geoscientific reasoning.
Approach: They propose a multimodal scientific dataset and benchmark curated from open-access publications.
Outcome: MSEarth features over 289K figures with captions enriched by contextual discussions and reasoning from original papers.
MTA:A Merge-then-Adapt Framework for Personalized Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Personalized Large Language Models (PLLMs) aim to align outputs with individual user preferences . current methods of fine-tuning a separate module for each user are unscalable .
Approach: They propose a Merge-then-Adapt framework for Personalized Large Language Models . they construct a shared Meta-LoRA bank and propose an Adaptive LoRA Fusion stage .
Outcome: The proposed framework outperforms existing SOTA methods on the LaMP benchmark.
The Elephant in the Room: Exploring the Role of Neutral Words in Language Model Group-Agnostic Debiasing (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) are increasingly integrated into our daily lives, raising ethical concerns, especially about perpetuating stereotypes.
Approach: They propose a method that incorporates a neutral word semantics-based loss function to alleviate the deterioration of the LMS during debiasing.
Outcome: The proposed method alleviates the deterioration of the Language Modeling Score (LMS) by incorporating a neutral word semantics-based loss function.
GeoArena: Evaluating Open-World Geographic Reasoning in Large Vision-Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing evaluation paradigms for geographic reasoning are outcome-centric and focus on label matching, leaving the underlying linguistic reasoning chains as unexamined black boxes.
Approach: They propose a dynamic, human-preference-based evaluation framework for benchmarking open-world geographic reasoning.
Outcome: The proposed framework reframes evaluation as a pairwise reasoning alignment task on in-the-wild images, where human judges compare model-generated explanations based on reasoning quality, evidence synthesis, and plausibility.
Bridging Relevance and Reasoning: Rationale Distillation in Retrieval-Augmented Generation (2025.findings-acl)

Copied to clipboard

Challenge: Existing approaches to rerank and align documents based on reasoning capabilities of large language models (LLMs) . prior work shows that LLMs have exceptional reasoning and text generation capabilities .
Approach: They propose a rationale extraction method that leverages reasoning capabilities of large language models to extract the rationales necessary for answering a query.
Outcome: The proposed method is compared with baseline methods on two tasks across three datasets.
LLMs Trust Humans More, That’s a Problem! Unveiling and Mitigating the Authority Bias in Retrieval-Augmented Generation (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) generate outputs that stray from user input or contravene established knowledge.
Approach: They propose a new phenomenon, Authority Bias, where LLMs favor one knowledge source over the other . they propose atomic information that generates conflicts and a Conflict Detection Enhanced Query framework .
Outcome: The proposed framework reduces Authority bias in large language models . it detects conflicts, performs credibility assessment on conflicting paragraphs, and detects perturbed text .
Model Merging for Knowledge Editing (2025.acl-industry)

Copied to clipboard

Challenge: Existing knowledge editing approaches struggle with sequential editing scenarios and harm the general capabilities of the model.
Approach: They propose a framework that combines robust supervised fine-tuning and model merging for knowledge editing to combine supervised and supervised learning.
Outcome: The proposed approach outperforms existing methods in sequential editing while preserving the original performance of the model.
LLMTreeRec: Unleashing the Power of Large Language Models for Cold-Start Recommendations (2025.coling-main)

Copied to clipboard

Challenge: Lack of training data leads to the system cold-start problem in recommendation systems, making them struggle to provide effective recommendations.
Approach: They propose a tree-based LLM recommendation framework which structures all items into an item tree to improve the efficiency of LLM’s item retrieval.
Outcome: The proposed framework outperforms the baseline model in the A/B test on Huawei industrial system.
Mitigating Hallucinations of Large Language Models in Medical Information Extraction via Contrastive Decoding (2024.findings-emnlp)

Copied to clipboard

Challenge: Medical Information Extraction (MIE) tasks are a fundamental component of medical NLP.
Approach: They propose an alternative adaptive constraint strategy to adjust the scale and scope of contrastive tokens.
Outcome: The proposed approach selectively enhances the identification and classification capabilities while minimizing the influence of other inherent abilities in LLMs.
A Semi-Supervised Stable Variational Network for Promoting Replier-Consistency in Dialogue Generation (D19-1)

Copied to clipboard

Challenge: Existing methods favor uninformative and non replier-specific responses due to lack of relevant information guidance.
Approach: They propose to use a semi-supervised variable network to generate replier-specific responses . they use vMF as latent space to obtain stable KL performance .
Outcome: The proposed model outperforms baseline models on two large conversation datasets and generates diverse and replier-specific responses.
MILL: Mutual Verification with Large Language Models for Zero-Shot Query Expansion (2024.naacl-long)

Copied to clipboard

Challenge: Existing methods for query expansion lack corpus-specific knowledge and cost.
Approach: They propose a query-query-document generation method that leverages large language models for mutual verification to produce diverse sub-queries and corresponding documents.
Outcome: The proposed method is fully zero-shot and extensive experiments on three public benchmark datasets demonstrate its effectiveness over existing methods.
LoRA-drop: Efficient LoRA Parameter Pruning based on Output Evaluation (2025.coling-main)

Copied to clipboard

Challenge: Low-Rank Adaptation (LoRA) is currently the most commonly used PEFT method for fine-tuning models with billions of parameters.
Approach: They propose to use low-rank Adaptation to evaluate LoRA parameter features and then retain LoRA for important layers and the other layers share the same LoRA.
Outcome: The proposed method achieves comparable performance to full fine-tuning and LoRA while retaining 50% of the LoRA parameters on average.
AdapTime: Enabling Adaptive Temporal Reasoning in Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for temporal reasoning are limited and apply a fixed pipeline to all questions.
Approach: They propose an adaptive temporal reasoning method that dynamically executes reasoning steps based on context and task requirements.
Outcome: Experiments on two temporal QA benchmarks show the proposed method works.
LongAttn: Selecting Long-context Training Data via Token-level Attention (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods to select long-context data often rely on sentence-level analysis, which can be greatly optimized in both performance and efficiency.
Approach: They propose a token-level framework which quantifies long-range dependencies for LLMs by calculating token-based dependency strength and distribution uniformity of token scores.
Outcome: The proposed framework quantifies long-range dependencies, enabling more accurate and efficient data selection.
Tandem: Riding Together with Large and Small Language Models for Efficient Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have catalyzed the rise of reasoningintensive inference paradigms, where models perform explicit step-by-step reasoning before generating final answers.
Approach: They propose a large-small LLM collaboration framework that synergizes large and small language models to achieve high-quality reasoning with significantly reduced computational cost.
Outcome: The proposed framework outperforms the mentor LLM while preserving the benefits of the thinking paradigm of LLMs.
Learning How and What to Memorize: Cognition-Inspired Two-Stage Optimization for Evolving Memory (2026.acl-long)

Copied to clipboard

Challenge: Existing memory systems rely on static, hand-crafted update rules for personalization, but sparse outcome rewards provide weak supervision, resulting in unstable long-horizon optimization.
Approach: They propose a memory guideline optimization framework that learns how memory should be organized and what information to update.
Outcome: The proposed framework learns how memory should be organized and what information to update.
Can LLMs Hear the Dogwhistle? (2026.findings-acl)

Copied to clipboard

Challenge: Existing safety benchmarks focus on explicitly harmful content, but ignore context-dependent expressions such as dogwhistles.
Approach: They propose a benchmark for evaluating LLM safety under dogwhistle-driven prompts . their findings expose a blind spot in current safety evaluation practices .
Outcome: The proposed benchmark compared safety performance with toxic terms using dogwhistle-driven prompts.
UniFashion: A Unified Vision-Language Model for Multimodal Fashion Retrieval and Generation (2024.emnlp-main)

Copied to clipboard

Challenge: e-commerce tasks such as multimodal retrieval and multimodal generation are largely ignored due to the diversity of the multimodal fashion domain.
Approach: They propose a framework that integrates image generation with retrieval and text generation tasks.
Outcome: The proposed framework outperforms state-of-the-art models across fashion tasks.
MemSearch-o1: Empowering Large Language Models with Reasoning-Aligned Memory Growth in Agentic Search (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for memory management struggle to capture fine-grained semantic relations between queries and documents.
Approach: They propose a framework for reasoning and agentic search that grows fine-grained memory fragments from seed tokens from queries, then retraces and deep refines the memory via a contribution function.
Outcome: Experiments on eight benchmark datasets show that MemSearch-o1 significantly mitigates memory dilution and more effectively activates reasoning potential of diverse LLMs.
Regularized Attentive Capsule Network for Overlapped Relation Extraction (2020.coling-main)

Copied to clipboard

Challenge: Existing methods to extract relations from distant supervision contain low-quality instances with noisy words and overlapped relations.
Approach: They propose a Regularized Attentive Capsule Network to better identify overlapped relations in informal sentences . they embed multi-head attention into the capsule network as the low-level capsules .
Outcome: Extensive experiments show that the proposed model improves relation extraction.
PsychEthicsBench: Evaluating Large Language Models Against Australian Mental Health Ethics (2026.findings-acl)

Copied to clipboard

Challenge: Mental disorders affect nearly one in seven people worldwide, yet the vast majority do not receive adequate care.
Approach: They propose a framework to evaluate LLMs' ethical knowledge and behavioral responses through multiple-choice and open-ended tasks with fine-grained ethicality annotations.
Outcome: Empirical results across 14 models reveal that refusal rates are poor indicators of ethical behavior, revealing a significant divergence between safety triggers and clinical appropriateness.
PRIME: A Process-Outcome Alignment Benchmark for Verifiable Reasoning in Mathematics and Engineering (2026.acl-long)

Copied to clipboard

Challenge: Current outcome-centric verification paradigms neglect potential errors in the derivation process.
Approach: They propose a process-aware RLVR training paradigm utilizing verifiers selected via **PRIME**.
Outcome: The proposed approach outperforms the baseline verification paradigm on AIME24, AIME25, and Beyond-AIME models.
Training-free LLM Merging for Multi-task Learning (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated exceptional capabilities across diverse natural language processing tasks.
Approach: They propose a training-free method for unifying different specialized LLMs into a single model using model-wise and layer-wise pruning and scaling.
Outcome: The proposed method outperforms existing merging techniques and surpasses models fine-tuned on combined datasets in most scenarios.
RU22Fact: Optimizing Evidence for Multilingual Explainable Fact-Checking on Russia-Ukraine Conflict (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods to verify factuality of claims do not provide sufficient evidence for explainable fact-checking systems.
Approach: They propose a method to automatically retrieve and summarize evidence from the Web and a novel multilingual explainable fact-checking dataset on the Russia-Ukraine conflict in 2022.
Outcome: The proposed method can retrieve and summarize evidence from the Web and generate explanations in 16 languages.
OpticE: A Coherence Theory-Based Model for Link Prediction (2022.coling-1)

Copied to clipboard

Challenge: Knowledge representation learning is a key step required for link prediction tasks with knowledge graphs (KGs).
Approach: They propose a new embedding approach based on the physical phenomenon of optical interference to reduce the semantic ambiguity in KGs.
Outcome: The proposed model can compete with existing methods on KG benchmarks.
A Multi-Expert Structural-Semantic Hybrid Framework for Unveiling Historical Patterns in Temporal Knowledge Graphs (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods focus on graph structure learning or semantic reasoning, lacking the capability to capture the inherent differences between historical and non-historical events.
Approach: They propose a temporal knowledge graph reasoning framework that integrates both structural and semantic information to guide the reasoning process for different events.
Outcome: The proposed framework integrates structural and semantic information to predict future events . it can provide evidence for many downstream tasks, including situation analysis and political decision making .
Select Before Use: On the Importance of Reference Model Selection in Preference Alignment (2026.acl-long)

Copied to clipboard

Challenge: Supervised Fine-Tuning (SFT) is used as the initialization and reference model for subsequent preference alignment.
Approach: They propose to use RewardRank to estimate initial implicit alignment between reference model and preference objective to ensure LLMs generate safe, helpful, and instruction-aligned content.
Outcome: Empirical evidence shows that using the selected model as reference can gain up to 67.6% relative increase on length-controlled win rate compared to baselines.
EasyGen: Easing Multimodal Generation with BiDiffuser and LLMs (2024.acl-long)

Copied to clipboard

Challenge: Existing multimodal models that depend on encoders like CLIP or ImageBind need ample amounts of training data to bridge modalities.
Approach: They propose an efficient model that leverages bidirectional conditional diffusion model to foster more efficient modality interactions.
Outcome: The proposed model is able to train a projection layer linking an LLM and an adapter to align the LLM’s text space with the bidirectional diffusion model.
WISCA: A Lightweight Model Transition Method to Improve LLM Training via Weight Scaling (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in training optimization for Transformer-based large language models lack systematic optimization of weight patterns during training.
Approach: They propose a Weight Scaling method that rescales weights while preserving model outputs to improve model training efficiency and model quality.
Outcome: The proposed method significantly improves convergence quality and loss reduction in LLMs with Grouped Query Attention architectures and LoRA fine-tuning tasks.
MultiDx: A Multi-Source Knowledge Integration Framework towards Diagnostic Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches focus on diagnostic reasoning based on internal model knowledge or static knowledge bases.
Approach: They propose a two-stage diagnostic reasoning framework that integrates multi-perspective evidence to generate a diagnostic prediction.
Outcome: The proposed method generates suspected diagnoses and reasoning traces from web search, SOAP-formatted case, and clinical case database.
BalanceSFT: Improving LLM Function Calling with Balanced Training Signals and Data Hardness (2026.findings-acl)

Copied to clipboard

Challenge: Currently, Supervised Fine-Tuning (SFT) is the prevailing method for equipping Large Language Models (LLMs) with function calling capabilities, but its effectiveness is often compromised by two challenges: 1) lengthy Chain-of-Thought (CoT) reasoning tokens dominate training signals over concise function calls in the learning objective; 2) scarcity of hard training examples.
Approach: They propose a framework that uses a self-adjusted signal balancing loss and a hard data re-sampling strategy to selectively generate new, high-quality complex data guided by model errors.
Outcome: The proposed framework surpasses state-of-the-art models like GPT-5 in function calling performance.
Redundancy Principles for MLLMs Benchmarks (2025.acl-long)

Copied to clipboard

Challenge: Rapid growth of Multi-modality Large Language Models has led to significant redundancy among benchmarks.
Approach: They propose a framework to improve MLLM benchmark design by identifying redundancy at three levels: dimension, instance, and cross-benchmark redundancies.
Outcome: The proposed framework streamlines evaluations and enhances reliability.
T2R-BENCH: A Benchmark for Real World Table-to-Report Task (2025.emnlp-main)

Copied to clipboard

Challenge: Existing table benchmarks lack the capacity to adequately assess the practical application of table reasoning in industrial applications.
Approach: They propose a bilingual table-to-report task and a table-based benchmark to assess the quality of table reasoning.
Outcome: The proposed task is based on a bilingual benchmark with 457 industrial tables and evaluation criteria to measure the quality of report generation.
MirrorCAPTCHA: Wild CAPTCHA, Wild Distribution, Wild Web-based Platform Meet Multimodal LLM Agents (2026.acl-long)

Copied to clipboard

Challenge: Existing agent benchmarks fail to evaluate an agent's real-world capacity to handle CAPTCHA . Existing benchmarks ignore this practical challenge, failing to evaluate agents' ability to handle complex visual CAPTchas.
Approach: They propose a benchmark annotated with Weighted Pass Rate and a new metric to measure agent's ability to handle CAPTCHA.
Outcome: The proposed benchmark outperforms current state-of-the-art closed-source models on mirrorCAPTCHA and achieves 9.4% higher average weighted pass rate and 2.13% higher average Completion degree.
Stepwise Reasoning Disruption Attack of LLMs (2025.acl-long)

Copied to clipboard

Challenge: Existing attacks on LLM reasoning are constrained by specific settings or lack of imperceptibility, limiting their feasibility and generalizability.
Approach: They propose a stepwise rEasoning error disruption attack that subtly injects errors into prior reasoning steps to mislead the model into producing incorrect subsequent reasoning and final answers.
Outcome: The proposed attack is compatible with zero-shot and few-shot settings, maintains the natural reasoning flow, and ensures covert execution without modification of the instruction.
CHiRPE: A Step Towards Real-World Clinical NLP with Clinician-Oriented Model Explanations (2026.eacl-short)

Copied to clipboard

Challenge: Psychotic disorders are a major contributor to the global health burden due to their relatively high mortality risk.
Approach: They propose an NLP pipeline that takes semi-structured clinical interviews to predict psychosis risk and generate novel SHAP explanation formats.
Outcome: The proposed pipeline outperforms baseline models and achieves 90% accuracy across three BERT variants.
AI4Reading: Chinese Audiobook Interpretation System Based on Multi-Agent Collaboration (2025.acl-demo)

Copied to clipboard

Challenge: Interpretative audiobooks are becoming more popular, but their manual creation process remains time-consuming and resource-intensive.
Approach: They propose a multi-agent collaboration system that leverages large language models and speech synthesis technology to generate podcast-like audiobook interpretations.
Outcome: The proposed system is open source and open to the public.
Multi-perspective Improvement of Knowledge Graph Completion with Large Language Models (2024.lrec-main)

Copied to clipboard

Challenge: Knowledge graph completion (KGC) is a widely used method to tackle incompleteness in knowledge graphs (KGs).
Approach: They propose a general framework to compensate for the deficiency of contextualized knowledge by querying large language models from various perspectives.
Outcome: The proposed framework improves knowledge graph completion (KGC) by querying large language models from various perspectives.
Logic Jailbreak: Efficiently Unlocking LLM Safety Restrictions Through Formal Logical Expression (2026.findings-acl)

Copied to clipboard

Challenge: Despite advances in aligning LLMs with human values, current safety mechanisms remain vulnerable to jailbreak attacks.
Approach: They propose a black-box jailbreak method that uses logical expression translation to bypass LLM safety mechanisms.
Outcome: The proposed method exploits the distributional gap between alignment data and logic-expressed inputs while preserving the underlying semantic intent and readability while evading safety constraints.
SEARCH-R: Structured Entity-Aware Retrieval with Chain-of-Reasoning Navigator for Multi-hop Question Answering (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to multi-hop question answering lack effective control over reasoning paths, leading to astray results.
Approach: They propose a framework for multi-hop question answering that trains an end-to-end reasoning path navigator to provide a powerful sub-question decomposer by fine-tuning the Llama3.1-8B model.
Outcome: The proposed framework trains an end-to-end reasoning path navigator . it is able to provide a powerful sub-question decomposer by fine-tuning the Llama3.1-8B model .
OmniAlign-V: Towards Enhanced Alignment of MLLMs with Human Preference (2025.acl-long)

Copied to clipboard

Challenge: Existing open-source multi-modal large language models (MLLMs) focus on enhancing foundational capabilities, leaving a significant gap in human preference alignment.
Approach: They propose a dataset of 200K high-quality training samples featuring diverse images, complex questions, and varied response formats to improve MLLMs’ alignment with human preferences.
Outcome: The proposed dataset of 200K high-quality training samples improves human preference alignment while maintaining or enhancing performance on standard VQA benchmarks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations