Papers by Yongxin Xu

17 papers
Span-level Aspect-based Sentiment Analysis via Table Filling (2023.acl-long)

Copied to clipboard

Challenge: Existing methods to analyze aspect-based sentiment analysis focus on word-level dependencies between aspect and opinion expressions.
Approach: They propose a span-level ABSA model which considers consistency of multi-word opinion expressions at the span- level.
Outcome: The proposed model can be used to identify the sentiment polarity of a given aspect . it is based on a table filling method and a regularizer to guarantee consistency .
TC–RAG: Turing–Complete RAG’s Case study on Medical LLM Systems (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to RAG neglect system state variables, resulting in poor performance and erroneous knowledge accumulation.
Approach: They propose a framework that incorporates a Turing Complete System to manage state variables and manage retrieval halting.
Outcome: The proposed framework improves on seven real-world healthcare datasets and shows that it is more accurate than existing methods.
Data Interpreter: An LLM Agent for Data Science (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) excel in various domains but face challenges when applied to data science workflows due to their complex, multi-stage nature.
Approach: They propose a hierarchical graph-based agent that represents complexity and a progressive strategy for step-by-step verification, refinement, and consistent context management.
Outcome: The proposed agent surpasses state-of-the-art baselines on the MATH dataset and performs better on InfiAgent-DABench.
3DS: Medical Domain Adaptation of LLMs via Decomposed Difficulty-based Data Selection (2025.emnlp-main)

Copied to clipboard

Challenge: Effective domain adaptation typically involves supervised fine-tuning on carefully selected instruction-tuned data.
Approach: They propose a model-centric data selection framework that aligns data selection with the model’s knowledge distribution to improve model performance.
Outcome: The proposed framework outperforms existing methods by up to 2.97% accuracy in the healthcare domain.
HyKGE: A Hypothesis Knowledge Graph Enhanced RAG Framework for Accurate and Reliable Medical LLMs Responses (2025.acl-long)

Copied to clipboard

Challenge: Recent approaches suffer from insufficient and repetitive knowledge retrieval, tedious and time-consuming query parsing, and monotonous knowledge utilization.
Approach: They propose a retrieval-augmented generation framework which leverages LLMs’ powerful reasoning capacity to compensate for the incompleteness of user queries.
Outcome: The proposed framework improves the accuracy and reliability of Large Language Models (LLMs) by combining the rich knowledge of LLMs with Hypothesis Outputs.
ITAKE: Interactive Unstructured Text Annotation and Knowledge Extraction System with LLMs and ModelOps (2024.acl-demos)

Copied to clipboard

Challenge: Unstructured text data contains a large amount of valuable knowledge, but there are many tools that do not meet the needs of actual business.
Approach: They propose an unstructured text annotation and knowledge extraction system that integrates Large Language Models and ModelOps to improve model supervision and performance.
Outcome: The proposed system integrates large language models and ModelOps to improve performance in low-resource contexts.
SOLAR: Serendipity Optimized Language Model Aligned for Recommendation (2025.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models have shown strong potential in recommendation tasks . however, their application to serendipity-oriented recommendations remains challenging .
Approach: They propose a domain-adaptive instruction tuning method that aligns Large Language Models with recommendation tasks.
Outcome: The proposed framework bridges the domain gap between LLMs and recommendation tasks.
Recurrent Knowledge Identification and Fusion for Language Model Continual Learning (2025.acl-long)

Copied to clipboard

Challenge: Continual learning (CL) is crucial for large language models without costly retraining.
Approach: They propose a framework for recurrent knowledge identification and fusion that enables dynamic estimation of parameter importance distributions to enhance knowledge transfer.
Outcome: The proposed framework mitigates catastrophic forgetting and enhances knowledge transfer.
Dynamic Prefix as Instructor for Incremental Named Entity Recognition: A Unified Seq2Seq Generation Framework (2025.findings-acl)

Copied to clipboard

Challenge: Named Entity Recognition (NER) is a fundamental problem in information extraction.
Approach: They propose a parameter-efficient method for Incremental Named Entity Recognition (INER) task aimed at updating a model to extract entities from an expanding set of entity type candidates by employing a dynamic prefix as a task instructor to guide the generative model.
Outcome: Empirical results show that the proposed method preserves task-invariant knowledge while adapting to new entities with minimal parameter updates.
DiffS2UT: A Semantic Preserving Diffusion Model for Textless Direct Speech-to-Speech Translation (2023.emnlp-main)

Copied to clipboard

Challenge: Existing models for speech generation are not efficient due to low information density of speech data.
Approach: They propose a method to integrate discrete diffusion models into speech generation tasks . they propose to apply diffusion forward process while employing diffusion backward process .
Outcome: The proposed model achieves comparable results to the auto-regressive baselines with significantly fewer decoding steps (50 steps).
Generative Pre-trained Speech Language Model with Efficient Hierarchical Transformer (2024.acl-long)

Copied to clipboard

Challenge: Experimental results indicate that GPST significantly outperforms the existing speech language models in terms of word error rate, speech quality, and speaker similarity.
Approach: They propose a hierarchical transformer that quantizes audio waveforms into two distinct types of discrete speech representations and integrates them within a transformer architecture.
Outcome: The proposed model outperforms existing speech language models in word error rate, speech quality, and speaker similarity.
Parenting: Optimizing Knowledge Selection of Retrieval-Augmented Language Models with Parameter Decoupling and Tailored Tuning (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for integrating internal and external knowledge lack effective control mechanisms for generating hallucinations and dealing with outdated knowledge.
Approach: They propose a framework that decouples, identifies, and purposefully optimizes parameter subspaces related to adherence and robustness.
Outcome: The proposed framework decouples, identifies, and purposefully optimizes parameter subspaces related to adherence and robustness.
Empowering Diffusion Models on the Embedding Space for Text Generation (2024.naacl-long)

Copied to clipboard

Challenge: Recent work adapts diffusion models to textual data by diffusing on the embedding space.
Approach: They propose an embedding diffusion model based on Transformer to solve the problem of embeddable space and denoising model.
Outcome: The proposed model is more efficient than previous methods on seminal text generation tasks and is superior to existing models.
TaSL: Continual Dialog State Tracking via Task Skill Localization and Consolidation (2024.acl-long)

Copied to clipboard

Challenge: Current methods for Continual Dialogue State Tracking (DST) struggle with catastrophic forgetting and knowledge transfer between tasks.
Approach: They propose a framework for task skill localization and consolidation that enables effective knowledge transfer without relying on memory replay.
Outcome: The proposed framework shows a 7.6% increase in Avg. JGA and 11% rise in BWT metrics over existing state-of-the-art methods.
DFAMS: Dynamic-flow guided Federated Alignment based Multi-prototype Search (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for ambiguous queries struggle to retrieve high-quality documents . DFAMS outperforms advanced FR methods by 14.37% in knowledge classification accuracy .
Approach: They propose a framework that leverages dynamic information flow to identify latent query intents and construct semantically aligned knowledge partitions for accurate retrieval across heterogeneous sources.
Outcome: The proposed framework outperforms existing methods in classification accuracy and retrieval recall tests.
Few-shot Temporal Pruning Accelerates Diffusion Models for Text Generation (2024.lrec-main)

Copied to clipboard

Challenge: Existing acceleration methods for text generation ignore the importance of the distribution of sampling steps, resulting in slow sampling rates.
Approach: They propose a technique to accelerate diffusion models for text generation without additional training by using a Bayesian optimization approach.
Outcome: The proposed technique achieves 400x acceleration even with minimal sampling steps after down to less than 1 minute of optimization yielding a competitive performance even with minimum sampling steps.
GeoEdit: Geometric Knowledge Editing for Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Existing training-based model editing methods struggle to incorporate new knowledge while preserving unrelated general knowledge.
Approach: They propose a framework that uses geometric relationships to differentiate between neurons associated with new knowledge updates and those related to general knowledge perturbations.
Outcome: The proposed framework avoids updating neurons with directions approximately orthogonal to existing knowledge, thus preserving the model’s generalization ability.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations