Papers by Yi Xie

46 papers
Effective and Efficient Query-aware Snippet Extraction for Web Search (2022.emnlp-main)

Copied to clipboard

Challenge: Existing methods to extract webpage snippets ignore contextual information of webpages, which may be sub-optimal.
Approach: They propose a query-aware webpage snippet extraction method called DeepQSE that captures contextual information of webpages.
Outcome: The proposed method can significantly improve the performance of DeepQSE without affecting its performance.
CharacterBox: Evaluating the Role-Playing Capabilities of LLMs in Text-Based Virtual Worlds (2025.naacl-long)

Copied to clipboard

Challenge: Evaluating role-playing capabilities in large language models is challenging due to complex dynamics involved in role-playering.
Approach: They propose a simulation sandbox that generates situational fine-grained character behavior trajectories to enhance LLM performance.
Outcome: The proposed model generates situational fine-grained character behavior trajectories to enhance performance.
MotiveBench: How Far Are We From Human-Like Motivational Reasoning in Large Language Models? (2025.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks for large language models lack information asymmetry with real-world situations.
Approach: They propose a benchmark to evaluate the human-like motivational and behavioral reasoning ability of LLMs with detailed, realistic situations.
Outcome: The proposed benchmark compared LLMs with real-world scenarios on seven model families and found that the most advanced models struggle with understanding "love & belonging" needs.
Agentic Memory: Learning Unified Long-Term and Short-Term Memory Management for Large Language Model Agents (2026.acl-long)

Copied to clipboard

Challenge: Existing methods handle long-term memory (LTM) and short-term (STM) as separate components, relying on heuristics or auxiliary controllers, which limits adaptability and end-to-end optimization.
Approach: They propose a framework that integrates LTM and STM management directly into the agent's policy and propose 'agentic memory' to train such unified behaviors.
Outcome: The proposed framework outperforms strong memory-augmented baselines on five long-horizon benchmarks and achieves higher-quality long-term memory and more efficient context usage.
On the Vulnerability of Safety Alignment in Open-Access LLMs (2024.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) are susceptible to malicious exploitation, but are often rejected and limited harmfulness is limited.
Approach: They propose two types of reverse alignment techniques: reverse supervised fine-tuning (RSFT) and reverse preference optimization (RPO).
Outcome: The proposed methods can significantly enhance the success rate and harmfulness of jailbreak attacks, but they face high rejection rates and limited harmfulness.
Structure Guided Retrieval-Augmented Generation for Factual Queries (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for RAG produce factually incorrect outputs, resulting in incorrect answers.
Approach: They propose a novel problem that explicitly incorporates structural information into RAG for factual questions to satisfy all query conditions.
Outcome: The proposed method significantly outperforms baselines on ERQA while maintaining reasonable computational overhead.
Can Persona-Prompted LLMs Emulate Subgroup Values? An Empirical Analysis of Generalisability and Fairness in Cultural Alignment (2026.acl-long)

Copied to clipboard

Challenge: Current alignment paradigms treat "human values" as a monolithic entity, ignoring the fact that many societies are a mosaic of diverse subgroups with distinct and sometimes conflicting values, preferences, and norms.
Approach: They examine whether Large Language Models can emulate distinct cultural values of subgroups . they use a global value survey to examine the value landscape of a multicultural society .
Outcome: The proposed model improves on unseen, out-of-distribution subgroups by 17.4% . the model widens the disparity between subgroup groups when measured by distance-aware metrics.
Knowledge Graph-Guided Retrieval Augmented Generation (2025.naacl-long)

Copied to clipboard

Challenge: Existing studies on RAG focus on semantic retrieval of isolated relevant chunks, which ignore their intrinsic relationships.
Approach: They propose a framework that utilizes knowledge graphs to provide fact-level relationships between chunks, improving the diversity and coherence of the retrieved results.
Outcome: Extensive experiments on the HotpotQA dataset and its variants demonstrate the advantages of KG2RAG compared to existing RAG-based approaches in terms of response quality and retrieval quality.
PERM: Psychology-grounded Empathetic Reward Modeling for Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing reward models evaluate empathy from a single perspective, overlooking bidirectional interaction nature of empathy.
Approach: They propose a reward model that evaluates empathy from a single perspective . they propose PERM to integrate a bystander perspective to monitor overall interaction quality .
Outcome: a new reward model outperforms state-of-the-art models on an emotional intelligence benchmark and an industrial daily conversation dataset.
Towards Database-Free Text-to-SQL Evaluation: A Graph-Based Metric for Functional Correctness (2025.coling-main)

Copied to clipboard

Challenge: Existing metrics for evaluating functional correctness of SQL queries are prone to false positives due to inadequately prepared test databases.
Approach: They propose a graph-based metric that uses a relational operator tree to extract rich semantic information from the logical execution plan of SQL queries and embed it into a diagram.
Outcome: The proposed method eliminates the need for extensive test database preparation and performs graph matching on unseen SQL queries.
Classic4Children: Adapting Chinese Literary Classics for Children with Large Language Model (2025.findings-naacl)

Copied to clipboard

Challenge: Recent large language models (LLMs) overlook children’s reading preferences, which poses challenges in CLA.
Approach: They propose a method that augments large language models with children's reading preferences for adaptation by obtaining characters' personalities and narrative structure as additional information for fine-grained instruction tuning.
Outcome: The proposed method significantly improves performance in automatic and human evaluation.
Unintended Harms of Value-Aligned LLMs: Psychological and Empirical Insights (2025.acl-long)

Copied to clipboard

Challenge: Value-aligned LLMs are more prone to harmful behavior than fine-tuned models . value-aligned models generate text according to the aligned values, which can amplify harmful outcomes.
Approach: They propose to use in-context alignment methods to enhance the safety of value-aligned LLMs.
Outcome: The proposed methods improve value alignment and safety, the authors say . value-aligned models are more prone to harmful behavior than fine-tuned models .
Reasoning under Uncertainty: Efficient LLM Inference via Unsupervised Confidence Dilution and Convergent Adaptive Sampling (2025.emnlp-main)

Copied to clipboard

Challenge: Large language models suffer from overconfidence and computational inefficiency due to fixed computation budgets and miscalibrated confidence estimates.
Approach: They propose a framework for computationally efficient, trustworthy reasoning under uncertainty using Diversity-Aware Self-Signal Dilution and Convergent Adaptive Weighted Sampling techniques.
Outcome: The proposed framework reduces inference cost by 70% while maintaining accuracy levels while reducing inference costs.
MMAC: A Multilingual, Multimodal Alignment Framework for Cultural Grounding Evaluation (2026.acl-long)

Copied to clipboard

Challenge: Existing models lack cultural alignment across modalities and languages . a new framework to assess cultural awareness across linguistics and languages is needed .
Approach: They propose a framework that integrates tri-modally aligned cultural benchmarks and a five-dimensional evaluation protocol to assess cross-country awareness disparities.
Outcome: The proposed framework assesses cultural awareness disparities across modalities and languages . it is the first dataset aligned at the input level across text, image, and speech .
Evade the Trap of Mediocrity: Promoting Diversity and Novelty in Text Generation via Concentrating Attention (2022.emnlp-main)

Copied to clipboard

Challenge: Recent studies have shown that powerful Transformer architectures produce dull high-frequency phrases, severely hurting the diversity and novelty of generated text.
Approach: They propose a method to control the sharpness of the attention distribution by python code and use it to learn a Bayesian approximation of posterior attention.
Outcome: The proposed method improves diversity and novelty while maintaining comparable quality on conditional and unconditional generation tasks.
Knowledge Context Modeling with Pre-trained Language Models for Contrastive Knowledge Graph Completion (2024.findings-acl)

Copied to clipboard

Challenge: Text-based knowledge graph completion methods neglect knowledge contexts in inferring process.
Approach: They propose a framework which models the knowledge context as additional prompts with pre-trained language models for knowledge graph completion.
Outcome: The proposed framework achieves state-of-the-art on FB15k-237, WN18RR and Wikidata5M datasets.
CADReview: Automatically Reviewing CAD Programs with Error Detection and Correction (2025.acl-long)

Copied to clipboard

Challenge: Computer-aided design (CAD) is crucial in prototyping 3D objects through geometric instructions.
Approach: They propose a CAD review task to automatically detect and correct potential errors . they propose CAD program repairer framework to provide helpful feedback on error correction .
Outcome: The proposed framework outperforms existing MLLMs in detecting errors and providing feedback on error correction.
Are You Copying My Model? Protecting the Copyright of Large Language Models for EaaS via Backdoor Watermark (2023.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated exceptional abilities in both text understanding and generation.
Approach: They propose an Embedding Watermark method that implants backdoors on embeddings to protect copyright of large language models.
Outcome: The proposed method protects the copyright of large language models without compromising service quality while minimizing the adverse impact on the original embeddings’ utility.
Value Compass Benchmarks: A Comprehensive, Generative and Self-Evolving Platform for LLMs’ Value Evaluation (2025.acl-demo)

Copied to clipboard

Challenge: Current evaluation methods for large language models face two key challenges: 1. evaluation validity and 2. Result interpretation reduce the pluralistic and incommensurable values to one-dimensional scores.
Approach: They propose a platform for comprehensive value diagnosis of large language models (LLMs) that provides a generative evaluation paradigm that automatically creates real-world test items co-evolving with ever-advancing LLMs.
Outcome: The proposed platform provides a framework for comprehensive value diagnosis of large language models (LLMs) with fine-grained scores and case studies across 27 value dimensions for 33 leading LLMs, customized comparisons, and visualized analysis of LLM’s alignment with cultural values.
DuNST: Dual Noisy Self Training for Semi-Supervised Controllable Text Generation (2023.acl-long)

Copied to clipboard

Challenge: Existing approaches to augment self-training (ST) in attribute-controllable language generation are limited and limited.
Approach: They propose a new ST framework that integrates self-generated pseudo text into attribute-controllable language generation.
Outcome: The proposed framework can be applied to semi-supervised controllable language generation.
Value FULCRA: Mapping Large Language Models to the Multidimensional Spectrum of Basic Human Value (2024.naacl-long)

Copied to clipboard

Challenge: Existing work specifies values as risk criteria formulated in the AI community, e.g., fairness and privacy protection, suffering from poor clarity, adaptability and transparency.
Approach: They propose a value alignment paradigm based on Schwartz's Theory of Basic Values as an instantiation and propose 'BaseAlign' to support this paradigm.
Outcome: The proposed model covers existing risks and anticipates unidentified ones with a low-data set.
CADMate: Generating CAD Assembly Plan with Geometric Chain-of-Thought and Spatial Physical Rewards (2026.acl-long)

Copied to clipboard

Challenge: Computer-aided design (CAD) is crucial in prototyping complex 3D objects . designers manually define assembly sequences for individual CAD parts .
Approach: They propose a framework for computer-aided design that predicts actions for CAD parts . they use a reference design image and disassembled parts to generate 6-DoF transformations .
Outcome: The proposed framework outperforms existing MLLMs in the design of CAD assemblies.
ToViLaG: Your Visual-Language Generative Model is Also An Evildoer (2023.emnlp-main)

Copied to clipboard

Challenge: Recent large-scale Visual-Language Generative Models (VLGMs) generate toxic content, e.g., offensive text and pornography images, raising significant ethical risks.
Approach: They propose a bottleneck-based detoxification method to reduce toxicity while maintaining comparable generation quality.
Outcome: The proposed method could reduce toxicity while maintaining comparable generation quality.
Three Minds, One Legend: Jailbreak Large Reasoning Model with Adaptive Stacked Ciphers (2026.findings-acl)

Copied to clipboard

Challenge: Existing jailbreak methods struggle to balance effectiveness with robustness against adaptive safety mechanisms.
Approach: They propose a novel approach that targets Large Reasoning Models through an adaptive encryption pipeline designed to overwhelm their reasoning capabilities.
Outcome: The proposed approach achieves an attack success rate of 85.6% on OpenAI GPT-o4-mini, outperforming state-of-the-art baselines by a significant margin of 17.2%.
MoVa: Towards Generalizable Classification of Human Morals and Values (2025.emnlp-main)

Copied to clipboard

Challenge: Identifying human morals and values embedded in language is essential to empirical studies of communication.
Approach: They propose a framework for generalizable classification of human morals and values . they recommend a classification strategy that scores all related concepts simultaneously .
Outcome: The proposed method outperforms fine-tuned models across domains and frameworks.
EDU-CIRCUIT-HW: Evaluating Multimodal Large Language Models on Real-World University-Level STEM Student Handwritten Solutions (2026.findings-acl)

Copied to clipboard

Challenge: Multimodal Large Language Models (MLLMs) are a promising tool for traditional education but lack authentic and domain-specific benchmarks to accurately interpret student handwritten solutions.
Approach: They propose to use MLLMs to interpret unconstrained STEM student handwritten solutions with intertwined mathematical formulas, diagrams, and textual reasoning to bridge this gap.
Outcome: The proposed model can detect and rectify recognition errors with minimal human intervention on unseen student solutions.
Knowledge-Guided Cross-Topic Visual Question Generation (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods for visual question generation use answers or question types as constraints to generate questions.
Approach: They propose a knowledge-guided cross-topic visual question generation task to generate unseen topics in cross-section scenarios.
Outcome: The proposed model outperforms baselines and can generate unseen topic-related questions in cross-topic scenarios.
Negating Negatives: Alignment with Human Negative Samples via Distributional Dispreference Optimization (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to steer LLMs towards human preference suffer from noisy positive-negative training pairs.
Approach: They propose a distributional preference optimization method which maximizes discrepancy between dispreferred responses and generated non-negative ones.
Outcome: The proposed method achieves comparable generation quality and surpasses the latest strong baselines in producing less harmful and more informative responses with better training stability and faster convergence.
Efficient-FedRec: Efficient Federated Learning Framework for Privacy-Preserving News Recommendation (2021.emnlp-main)

Copied to clipboard

Challenge: Existing news recommendation methods rely on centralized storage of user click behavior data, which may lead to privacy concerns and hazards.
Approach: They propose a federated learning framework for privacy-preserving news recommendation . they propose aggregation of news representations and user model by a client .
Outcome: The proposed framework reduces computation and communication cost on clients while keeping promising model performance.
Ask Again, Then Fail: Large Language Models’ Vacillations in Judgment (2024.acl-long)

Copied to clipboard

Challenge: Existing large language models often waver in their judgments when faced with follow-up questions . this is a challenge for generating reliable responses and building user trust .
Approach: They propose a Follow-up Questioning Mechanism and two metrics to quantify this inconsistency . they also develop a framework that teaches large language models to maintain original correct judgments .
Outcome: The proposed framework improves the general capabilities of large language models by allowing them to maintain original correct judgments.
Recurrence Boosts Diversity! Revisiting Recurrent Latent Variable in Transformer-Based Variational AutoEncoder for Diverse Text Generation (2022.findings-emnlp)

Copied to clipboard

Challenge: Variational Auto-Encoder (VAE) has been widely adopted in text generation due to its ability to learn flexible representations.
Approach: They propose a Transformer-based recurrent VAE structure that imposes recurrence on segment-wise latent variables with arbitrarily separated text segments and constructs the posterior distribution with residual parameterization.
Outcome: The proposed structure can deduce a non-zero lower bound of the KL term and enhance the entanglement of each segment and preceding latent variables, providing a theoretical guarantee of generation diversity.
Unveiling the Deficiencies of Pre-trained Text-and-Layout Models in Real-world Visually-rich Document Information Extraction (2026.findings-eacl)

Copied to clipboard

Challenge: PTLMs have shown remarkable success in multiple information extraction tasks . however, their performance in real-world scenarios falls short of expectations .
Approach: They propose to use an entity-centric dataset to evaluate PTLMs' performance . they find that inadequate annotations in benchmark datasets lead to spurious correlations .
Outcome: The proposed dataset disentangles the falsely-coupled segment and entity annotations that arises from the block-level annotation of FUNSD.
Influence-based Online Experience Selection for Effective RLHF (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for RL fail to establish an interpretable connection between data and optimization objectives.
Approach: They propose a data selection method that dynamically estimates the influence of individual training samples on policy optimization.
Outcome: The proposed method significantly improves training effectiveness with fewer optimization steps.
Regression Bugs Are In Your Model! Measuring, Reducing and Analyzing Regressions In NLP Model Updates (2021.acl-long)

Copied to clipboard

Challenge: Using negative flips, we quantify, reduce and analyze regression errors in deep neural networks.
Approach: They propose to quantify, reduce and analyze regression errors in NLP models by negative flips.
Outcome: The proposed model update regression has a prevalent presence across tasks in the GLUE benchmark.
Improving Prediction Backward-Compatiblility in NLP Model Upgrade with Gated Fusion (2023.findings-eacl)

Copied to clipboard

Challenge: a regression error during model upgrade often outweighs the benefits of accuracy gain . a novel method that promotes backward compatibility during model upgrades is proposed .
Approach: They propose a method that promotes backward compatibility via learning to mix predictions between old and new models.
Outcome: The proposed method outperforms existing methods and achieves negative flip rate reductions by 73.2% on two model upgrade scenarios.
Domain-Specific Data Generation Framework for RAG Adaptation (2026.findings-acl)

Copied to clipboard

Challenge: Retrieval-Augmented Generation (RAG) combines the language understanding and reasoning capabilities of large language models (LLMs) with external retrieval to produce domain-grounded responses.
Approach: They propose a scalable and modular data-centric framework for generating domain-grounded question–answer–context triples tailored to diverse RAG adaptation strategies.
Outcome: The proposed framework generates domain-grounded question–answer–context triples for multiple RAG adaptation strategies.
Fine-Grained Features-based Code Search for Precise Query-Code Matching (2025.coling-main)

Copied to clipboard

Challenge: Existing methods to locate code snippets from databases represent the semantics of code and query by averaging the features of each token and word.
Approach: They propose a fine-grained code search model that consists of a cross-modal encoder, mapping layer and classification layer to capture fine-granular interactions between code and query.
Outcome: The proposed model significantly outperforms existing methods across multiple programming language datasets.
Measuring Human Contribution in AI-Assisted Content Generation (2026.acl-long)

Copied to clipboard

Challenge: generative AI has created a new way to generate content with humans . varying degrees of human contribution in content generation poses significant challenges for the delineation of originality .
Approach: They propose a framework to measure human contribution in AI-assisted content generation by calculating mutual information between human input and AI-aided output relative to self-information of AI-assist output.
Outcome: The proposed measure discriminates between varying degrees of human contribution across multiple creative domains and is validated in real-world applications.
DroidCall: A Dataset for LLM-powered Android Intent Invocation (2025.findings-emnlp)

Copied to clipboard

Challenge: We present DroidCall, the first training and testing dataset for accurate Android intent invocation.
Approach: We introduce DroidCall, the first training and testing dataset for accurate Android intent invocation.
Outcome: The proposed dataset provides a training and testing pipeline for Android intent invocation.
SLIM: Subtrajectory-Level Elimination for More Effective Reasoning (2025.findings-emnlp)

Copied to clipboard

Challenge: Notable examples include OpenAI’s o1/o3/o4 series and DeepSeek-R1 .
Approach: They develop a framework to identify suboptimal subtrajectories based on human-established criteria . they also use a sampling algorithm to select data whose reasoning process is free from suboptimally subtravertories to the highest degree .
Outcome: The proposed method reduces the number of suboptimal subtrajectories by 25.9% during the inference process.
Fuse It More Deeply! A Variational Transformer with Layer-Wise Latent Variable Inference for Text Generation (2022.naacl-main)

Copied to clipboard

Challenge: Variational Auto-Encoders are often used for text generation tasks due to the sequential nature of the text.
Approach: They propose a variational Transformer framework that learns a series of layer-wise latent variables with each inferred from those of lower layers and tightly coupled with the hidden states by low-rank tensor product.
Outcome: The proposed framework can learn latent variables from lower layers and incorporate more information.
Learning Query Adaptive Anchor Representation for Inductive Relation Prediction (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods to infer the missing links between entities are limited to the transductive setting . Query Adaptive Anchor Representation (QAAR) model is based on entity-independent features .
Approach: They propose a query adaptive anchor representation model which extracts one opening subgraph and performs reasoning by one time for all candidate triples.
Outcome: The proposed model outperforms state-of-the-art models in relation prediction task.
Do Code Semantics Help? A Comprehensive Study on Execution Trace-Based Information for Code Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Code Large Language Models have limited ability to reason about runtime behavior and understand functionality . authors present a generic framework to support integrating semantic information to code task-relevant prompts .
Approach: a study examines the role of trace-based semantic information in boosting supervised fine-tuning and post-phase inference of Code LLMs.
Outcome: a new framework integrates semantic information to code task-relevant prompts . the proposed framework shows that trace-based semantic information boosts reasoning ability .
ReviewGrounder: Improving Review Substantiveness with Rubric-Guided, Tool-Integrated Agents (2026.acl-long)

Copied to clipboard

Challenge: Rapid rise in AI conference submissions has driven increasing exploration of large language models (LLMs) for peer review support.
Approach: They propose a peer review benchmarking tool based on paper-specific rubrics and a rubric-guided framework that decomposes reviewing into drafting and grounding stages.
Outcome: The proposed framework outperforms baselines with stronger/larger backbones in both alignment with human judgments and rubric-based review quality across 8 dimensions.
Towards Better Value Principles for Large Language Model Alignment: A Systematic Evaluation and Enhancement (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) show remarkable performance across tasks . alignment with human values is critical for their responsible development.
Approach: They propose a framework that evaluates value principles along three desirable properties . they propose supervised fine-tuning, reinforcement learning-based approaches .
Outcome: The proposed framework improves value principles along the three desirable properties of LLMs.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations