Papers by Xiangyu Liu
Copied to clipboard
| Challenge: | Existing datasets often rely on synthetic data or figure-caption pairs, failing to capture the depth and complexity of geoscientific reasoning. |
| Approach: | They propose a multimodal scientific dataset and benchmark curated from open-access publications. |
| Outcome: | MSEarth features over 289K figures with captions enriched by contextual discussions and reasoning from original papers. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are increasingly integrated into our daily lives, raising ethical concerns, especially about perpetuating stereotypes. |
| Approach: | They propose a method that incorporates a neutral word semantics-based loss function to alleviate the deterioration of the LMS during debiasing. |
| Outcome: | The proposed method alleviates the deterioration of the Language Modeling Score (LMS) by incorporating a neutral word semantics-based loss function. |
Copied to clipboard
| Challenge: | Introducing **MARK**, a framework for cultural value survey simulation . based on type dynamics theory, it improves accuracy and interpretation of models . |
| Approach: | They propose a framework that integrates psychological theory into cultural value survey simulations. |
| Outcome: | The proposed framework outperforms baseline models on the World Values Survey by 10% accuracy and reduces divergence between model predictions and human preferences. |
Copied to clipboard
| Challenge: | Lunar Twins is the first LLM designed specifically for lunar exploration . Lunar GenData is a multi-agent collaborative workflow for generating lunar instructions . |
| Approach: | They propose a framework that combines both large and small LLMs and Lunar GenData, which integrates real data from Chang'e lunar missions. |
| Outcome: | Experimental validation shows that the proposed framework enhances domain expertise and reveals indications of embodied intelligence potential. |
Copied to clipboard
| Challenge: | Existing methods for generating Wikipedia articles do not utilize memory directly for outline generation. |
| Approach: | They propose a method to generate Wikipedia articles autonomously by leveraging a hierarchical memory architecture. |
| Outcome: | The proposed framework outperforms baseline methods in producing informative and reliable articles. |
Copied to clipboard
| Challenge: | Traditional phishing website detection relies on static heuristics or reference lists, which lag behind rapidly evolving attacks. |
| Approach: | They propose a memory-augmented multi-modal LLM agent that leverages episodic memories to guide decisions on recurring and novel threats. |
| Outcome: | The proposed agent outperforms state-of-the-art phishing detection tools on two public datasets and improves recall by 20%. |
Copied to clipboard
| Challenge: | Existing approaches to rerank and align documents based on reasoning capabilities of large language models (LLMs) . prior work shows that LLMs have exceptional reasoning and text generation capabilities . |
| Approach: | They propose a rationale extraction method that leverages reasoning capabilities of large language models to extract the rationales necessary for answering a query. |
| Outcome: | The proposed method is compared with baseline methods on two tasks across three datasets. |
Copied to clipboard
| Challenge: | Large language models (LLMs) generate outputs that stray from user input or contravene established knowledge. |
| Approach: | They propose a new phenomenon, Authority Bias, where LLMs favor one knowledge source over the other . they propose atomic information that generates conflicts and a Conflict Detection Enhanced Query framework . |
| Outcome: | The proposed framework reduces Authority bias in large language models . it detects conflicts, performs credibility assessment on conflicting paragraphs, and detects perturbed text . |
Copied to clipboard
| Challenge: | Existing models with statistical bias are prone to memorized correlations . large pre-trained models such as BERT have revolutionized the model development paradigm in natural language processing . |
| Approach: | They propose a framework to tackle the problem from a causal perspective using a latent space interpolation approach. |
| Outcome: | Extensive experiments show that CAT achieves substantial performance improvement over SOTA across different downstream tasks, including sentence classification, natural language inference and question answering. |
Copied to clipboard
| Challenge: | Existing studies neglect attribute correlations formed by the intertwining of different attributes. |
| Approach: | They propose a multi-aspect controllable text generation method with disentangled counterfactual augmentation that alleviates imbalanced attribute correlations during training by disentanglement. |
| Outcome: | The proposed method outperforms state-of-the-art methods in imbalanced and balanced attribute correlation scenarios. |
Copied to clipboard
| Challenge: | Medical Information Extraction (MIE) tasks are a fundamental component of medical NLP. |
| Approach: | They propose an alternative adaptive constraint strategy to adjust the scale and scope of contrastive tokens. |
| Outcome: | The proposed approach selectively enhances the identification and classification capabilities while minimizing the influence of other inherent abilities in LLMs. |
Copied to clipboard
| Challenge: | Existing methods for query expansion lack corpus-specific knowledge and cost. |
| Approach: | They propose a query-query-document generation method that leverages large language models for mutual verification to produce diverse sub-queries and corresponding documents. |
| Outcome: | The proposed method is fully zero-shot and extensive experiments on three public benchmark datasets demonstrate its effectiveness over existing methods. |
Copied to clipboard
| Challenge: | Existing methods for sentence-level event detection depend on manual annotations or domain expertise to design sophisticated templates and rules. |
| Approach: | They propose a dialogue-based explanation paradigm to enhance sentence semantics for event detection. |
| Outcome: | The proposed method can be applied to two event detection datasets. |
Copied to clipboard
| Challenge: | Existing methods for knowledge distillation use Chain-of-Thought (CoT) and answer pairs, but they lack appropriate supervision signals. |
| Approach: | They propose a framework that decouples CoT and answer supervision . the framework applies semantic similarity constraints while maintaining strict literal matching for the answer . |
| Outcome: | The proposed framework decouples CoT and answer supervision while maintaining strict literal matching for the answer. |
Copied to clipboard
| Challenge: | Large language models (LLMs) are used for depression detection but their application remains unexplored. |
| Approach: | They propose to integrate acoustic speech information into LLMs for depression detection by integrating aural landmarks into the framework. |
| Outcome: | The proposed method adds critical dimensions to speech transcripts and provides insights into the unique speech patterns of individuals. |
Copied to clipboard
| Challenge: | Existing memory systems rely on static, hand-crafted update rules for personalization, but sparse outcome rewards provide weak supervision, resulting in unstable long-horizon optimization. |
| Approach: | They propose a memory guideline optimization framework that learns how memory should be organized and what information to update. |
| Outcome: | The proposed framework learns how memory should be organized and what information to update. |
Copied to clipboard
| Challenge: | Existing methods for large-scale retrieval are trained with 0-1 hard labels that indicate whether a query is relevant to a document, ignoring rich information of the relevance degree. |
| Approach: | They propose to introduce label enhancement for the first time to characterize query-document relevance degree by embedding label distribution into contextual embeddables. |
| Outcome: | The proposed method significantly outperforms existing retrieval models and its counterparts equipped with two alternative methods on English and Chinese large-scale retrieval tasks. |
Copied to clipboard
| Challenge: | Existing safety benchmarks focus on explicitly harmful content, but ignore context-dependent expressions such as dogwhistles. |
| Approach: | They propose a benchmark for evaluating LLM safety under dogwhistle-driven prompts . their findings expose a blind spot in current safety evaluation practices . |
| Outcome: | The proposed benchmark compared safety performance with toxic terms using dogwhistle-driven prompts. |
Copied to clipboard
| Challenge: | Existing methods for memory management struggle to capture fine-grained semantic relations between queries and documents. |
| Approach: | They propose a framework for reasoning and agentic search that grows fine-grained memory fragments from seed tokens from queries, then retraces and deep refines the memory via a contribution function. |
| Outcome: | Experiments on eight benchmark datasets show that MemSearch-o1 significantly mitigates memory dilution and more effectively activates reasoning potential of diverse LLMs. |
Copied to clipboard
| Challenge: | Existing methods to extract relations from distant supervision contain low-quality instances with noisy words and overlapped relations. |
| Approach: | They propose a Regularized Attentive Capsule Network to better identify overlapped relations in informal sentences . they embed multi-head attention into the capsule network as the low-level capsules . |
| Outcome: | Extensive experiments show that the proposed model improves relation extraction. |
Copied to clipboard
| Challenge: | Mental disorders affect nearly one in seven people worldwide, yet the vast majority do not receive adequate care. |
| Approach: | They propose a framework to evaluate LLMs' ethical knowledge and behavioral responses through multiple-choice and open-ended tasks with fine-grained ethicality annotations. |
| Outcome: | Empirical results across 14 models reveal that refusal rates are poor indicators of ethical behavior, revealing a significant divergence between safety triggers and clinical appropriateness. |
Copied to clipboard
| Challenge: | Recent approaches to language model alignment assume homogeneous human preferences, but actual human preferences vary widely and are hard to satisfy with a single language model. |
| Approach: | They propose an RL-free extension of Direct Preference Optimization (DPO) that folds language modeling directly into reward modeling and trains language models as collective reward models that combine all objectives with specific weights. |
| Outcome: | The proposed method matches or outperforms existing methods in safety alignment and long-form question answering. |
Copied to clipboard
| Challenge: | Existing methods to verify factuality of claims do not provide sufficient evidence for explainable fact-checking systems. |
| Approach: | They propose a method to automatically retrieve and summarize evidence from the Web and a novel multilingual explainable fact-checking dataset on the Russia-Ukraine conflict in 2022. |
| Outcome: | The proposed method can retrieve and summarize evidence from the Web and generate explanations in 16 languages. |
Copied to clipboard
| Challenge: | Distantly supervised relation extraction is used in knowledge bases but its low quality and noisy sentences are present in sentence bags. |
| Approach: | They propose a multi-layer revision network which emphasizes inner-sentence correlations before extracting relevant information within sentences. |
| Outcome: | The proposed method improves on two New York Times datasets. |
Copied to clipboard
| Challenge: | Existing methods focus on graph structure learning or semantic reasoning, lacking the capability to capture the inherent differences between historical and non-historical events. |
| Approach: | They propose a temporal knowledge graph reasoning framework that integrates both structural and semantic information to guide the reasoning process for different events. |
| Outcome: | The proposed framework integrates structural and semantic information to predict future events . it can provide evidence for many downstream tasks, including situation analysis and political decision making . |
Copied to clipboard
| Challenge: | Existing pre-training frameworks for text-to-SQL parsing have shown inherent differences in distributions between tables and plain text. |
| Approach: | They propose a framework to improve context-dependent Text-to-SQL parsing by leveraging Linking information. |
| Outcome: | The proposed framework achieves state-of-the-art performance on two leading downstream benchmarks. |
Copied to clipboard
| Challenge: | C2Rust is a system programming language that enforces strict memory and type safety guarantees. |
| Approach: | They propose a raw pointer rewriting technique that lifts raw pointers in individual functions to appropriate Rust data structures. |
| Outcome: | The proposed technique eliminates 18.57% of local raw pointers and improves memory safety on 28 real-world C projects. |
Copied to clipboard
| Challenge: | Existing approaches allocate an equal number of rollouts to all questions during the RL process, which is inefficient. |
| Approach: | They propose a mechanism for dynamically allocating rollout budgets based on the difficulty of the problems, enabling more efficient RL training. |
| Outcome: | The proposed model improves response precision while preserving exploratory ability to uncover potential correct pathways. |
Copied to clipboard
| Challenge: | Empirical results show that ChainRAG consistently outperforms baselines in both effectiveness and efficiency. |
| Approach: | They propose a method which sequentially handles each sub-question by completing missing key entities and retrieving relevant sentences from a sentence graph for answer generation. |
| Outcome: | The proposed method outperforms baselines on three multi-hop QA datasets. |
Copied to clipboard
| Challenge: | Existing text mining models are trained with 0-1 hard label that indicates whether an instance belongs to a class, ignoring rich information of the relevance degree. |
| Approach: | They propose a keyword-based method to automatically generate soft labels from hard labels . they exploit relevance between labels and instances to incorporate them into models . |
| Outcome: | The proposed method improves models under balanced and unbalanced conditions. |
Copied to clipboard
| Challenge: | Supervised Fine-Tuning (SFT) is used as the initialization and reference model for subsequent preference alignment. |
| Approach: | They propose to use RewardRank to estimate initial implicit alignment between reference model and preference objective to ensure LLMs generate safe, helpful, and instruction-aligned content. |
| Outcome: | Empirical evidence shows that using the selected model as reference can gain up to 67.6% relative increase on length-controlled win rate compared to baselines. |
Copied to clipboard
| Challenge: | Existing multimodal models that depend on encoders like CLIP or ImageBind need ample amounts of training data to bridge modalities. |
| Approach: | They propose an efficient model that leverages bidirectional conditional diffusion model to foster more efficient modality interactions. |
| Outcome: | The proposed model is able to train a projection layer linking an LLM and an adapter to align the LLM’s text space with the bidirectional diffusion model. |
Copied to clipboard
| Challenge: | Recent efforts to classify unstructured texts into specific types have been limited in practical scenarios. |
| Approach: | They propose to use Chinese text conversations and phone conversations to expand event detection to the scenarios involving informal and heterogeneous texts. |
| Outcome: | The proposed dataset is based on user reviews, text conversations, and phone conversations in a leading e-commerce platform for food service. |
Copied to clipboard
| Challenge: | Pre-trained language models (e.g., BERT) have been proved vulnerable to adversarial texts. |
| Approach: | They propose to fuse Chinese phonetic and glyph features into pre-trained models by using a more comprehensive adversarial graph. |
| Outcome: | The proposed framework outperforms existing methods in significant ways on a wide range of tasks while remaining accurate on benign texts. |
Copied to clipboard
| Challenge: | Existing approaches to attack pre-trained language models suffer from low success rates or fail to search efficiently in the exponentially large perturbation space. |
| Approach: | They propose an efficient framework to generate natural adversarial text by constructing different semantic perturbation functions. |
| Outcome: | The proposed framework generates natural adversarial texts for different languages with high success rates. |
Copied to clipboard
| Challenge: | Rapid growth of Multi-modality Large Language Models has led to significant redundancy among benchmarks. |
| Approach: | They propose a framework to improve MLLM benchmark design by identifying redundancy at three levels: dimension, instance, and cross-benchmark redundancies. |
| Outcome: | The proposed framework streamlines evaluations and enhances reliability. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have been extensively utilized for health-related tasks, yet their performance in depression detection remains limited when relying solely on text input. |
| Approach: | They propose a system that leverages speech timing features for depression detection and reliable confidence estimation. |
| Outcome: | The proposed system outperforms text-based RAG systems in depression detection and confidence estimation. |
Copied to clipboard
| Challenge: | RAG implementations face challenges in addressing retrieved noise and redundant content . current RAG methods lack the ability to exploit fine-grained inter-document relationships . |
| Approach: | They propose a retrieval-augmented generation framework that exploits latent inter-document relationships while removing irrelevant information and redundant content. |
| Outcome: | The proposed framework achieves consistent performance improvements on knowledge-QA and hallucination-Detection datasets. |
Copied to clipboard
| Challenge: | Existing approaches to enhance inference speed and training require complex modifications to the model. |
| Approach: | They propose to double the training and inference speed of Denoising Diffusion Probabilistic Models by simply redirecting the generative target to the wavelet domain. |
| Outcome: | The proposed method doubles the training and inference speed of Speech DDPMs by redirecting the generative target to the wavelet domain. |
Copied to clipboard
| Challenge: | Existing attacks on LLM reasoning are constrained by specific settings or lack of imperceptibility, limiting their feasibility and generalizability. |
| Approach: | They propose a stepwise rEasoning error disruption attack that subtly injects errors into prior reasoning steps to mislead the model into producing incorrect subsequent reasoning and final answers. |
| Outcome: | The proposed attack is compatible with zero-shot and few-shot settings, maintains the natural reasoning flow, and ensures covert execution without modification of the instruction. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are a powerful tool for test-time scaling, but they are often used under time constraints. |
| Approach: | They propose to use LLMs to make models think before answering questions . they also use self-correction and best-of-N decoding to encourage deeper thinking . |
| Outcome: | The proposed models are able to achieve higher inference accuracy with extra inference computation under time constraints. |
Copied to clipboard
| Challenge: | Existing methods for knowledge editing fail to work in multi-hop question answering due to 'edit skipping' edit skipping occurs due to the mismatch between the granularity of LLMs in problem-solving and the facts in the edited memory. |
| Approach: | They propose a retrieval-augmented generation-based method that edits knowledge without modifying parameters without retraining LLMs. |
| Outcome: | The proposed method outperforms state-of-the-art methods for KE in multi-hop question answering. |
Copied to clipboard
| Challenge: | Psychotic disorders are a major contributor to the global health burden due to their relatively high mortality risk. |
| Approach: | They propose an NLP pipeline that takes semi-structured clinical interviews to predict psychosis risk and generate novel SHAP explanation formats. |
| Outcome: | The proposed pipeline outperforms baseline models and achieves 90% accuracy across three BERT variants. |
Copied to clipboard
| Challenge: | Existing generative models lack the capacity for explicit and controllable reasoning, a key advantage of LLMs. |
| Approach: | They propose a framework that integrates dialogue, reasoning, and personalized recommendation. |
| Outcome: | Experiments across public benchmarks show state-of-the-art performance. |
Copied to clipboard
| Challenge: | Existing approaches to multi-hop question answering lack effective control over reasoning paths, leading to astray results. |
| Approach: | They propose a framework for multi-hop question answering that trains an end-to-end reasoning path navigator to provide a powerful sub-question decomposer by fine-tuning the Llama3.1-8B model. |
| Outcome: | The proposed framework trains an end-to-end reasoning path navigator . it is able to provide a powerful sub-question decomposer by fine-tuning the Llama3.1-8B model . |