Papers by Hua Xu

41 papers
Consistent Representation Learning for Continual Relation Extraction (2022.findings-acl)

Copied to clipboard

Challenge: Existing methods to train relation extraction models overfit memory samples and perform poorly on imbalanced datasets.
Approach: They propose a method which uses contrastive learning and knowledge distillation to train a model on data with new relations while avoiding forgetting old ones.
Outcome: The proposed method significantly outperforms state-of-the-art baselines and yields strong robustness on the imbalanced datasets.
Lil: Less is Less When Applying Post-Training Sparse-Attention Algorithms in Long-Decode Stage (2026.findings-acl)

Copied to clipboard

Challenge: Prior work typically decomposes inference into prefill and decode stages, with the decode stage dominating total latency.
Approach: They propose an algorithm that detects threshold where information loss exceeds information gain during sparse decoding to reduce token consumption by up to 90% and a marginal accuracy degradation of less than 2%.
Outcome: The proposed algorithm reduces token consumption by 90% with a marginal accuracy degradation of less than 2% across reasoning-intensive benchmarks.
OpenVNA: A Framework for Analyzing the Behavior of Multimodal Language Understanding System under Noisy Scenarios (2024.acl-demos)

Copied to clipboard

Challenge: OpenVNA is an open-source framework for analyzing the behavior of multimodal language understanding systems under noisy conditions.
Approach: They propose to use OpenVNA to analyze behavior of multimodal language understanding systems under noisy conditions.
Outcome: The proposed framework provides high flexibility and extensibility, enabling customization with user-defined noise types and models.
Deep Unknown Intent Detection with Margin Loss (P19-1)

Copied to clipboard

Challenge: Existing methods for detecting unknown intents are difficult due to lack of examples.
Approach: They propose a method for detecting unknown intents using bidirectional long-term memory networks with the margin loss as the feature extractor.
Outcome: The proposed method can yield consistent improvements on two benchmark datasets.
SMiLE: Schema-augmented Multi-level Contrastive Learning for Knowledge Graph Link Prediction (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for linking knowledge graphs lack contextual information in entity neighborhoods, which leads to false prediction results.
Approach: They propose a Schema-augmented Multi-level contrastive LEarning framework to conduct knowledge graph link prediction using a knowledge graph schema.
Outcome: The proposed framework is based on a knowledge graph schema and is compared against state-of-the-art datasets.
Gentopia.AI: A Collaborative Platform for Tool-Augmented LLMs (2023.emnlp-demo)

Copied to clipboard

Challenge: Existing frameworks for Augmented Language Models lack flexibility, democratization, and holistic evaluation.
Approach: They propose a lightweight and extensible framework for Augmented Language Models called Gentopia.
Outcome: The proposed framework integrates language models, task formats, prompting modules, and plugins into a unified paradigm.
PLATO-Ad: A Unified Advertisement Text Generation Framework with Multi-Task Prompt Learning (2022.emnlp-industry)

Copied to clipboard

Challenge: Online advertisement text generation models have achieved remarkable success in generating high-quality text ads, but some challenges remain, such as low-resource scenarios and training efficiency for multiple ad tasks.
Approach: They propose a unified text ad generation framework with multi-task prompt learning to tackle low-resource ade generation problem and a multi-step prompt learning mechanism to efficiently solve multiple aed generation tasks.
Outcome: The proposed framework outperforms the state-of-the-art on offline and online metrics.
Conversational Graph Grounded Policy Learning for Open-Domain Conversation Generation (2020.acl-main)

Copied to clipboard

Challenge: Existing word-level policy models that learn dialog policy and language generation from dialog corpora often lead to degeneration issues where the utterances become ungrammatical or repetitive.
Approach: They propose to represent prior dialog transitions as a graph and learn a CG grounded dialog policy that can foster a more coherent and controllable dialog.
Outcome: The proposed framework is able to learn dialog policy in open-domain multi-turn conversation.
Improving Empathetic Dialogue Generation by Dynamically Infusing Commonsense Knowledge (2023.findings-acl)

Copied to clipboard

Challenge: Existing work on generating empathetic responses by utilizing the speaker's emotion has not been successful.
Approach: They propose an approach which incorporates an adaptive module for commonsense knowledge selection to ensure consistency between the generated empathetic responses and the speaker’s situation.
Outcome: The proposed approach outperforms baseline models in both automatic and human evaluations, exhibiting the generation of more coherent and empathetic responses.
MMAG: Multimodal Learning for Mucus Anomaly Grading in Nasal Endoscopy via Semantic Attribute Prompting (2025.emnlp-main)

Copied to clipboard

Challenge: Accurate grading of rhinitis severity relies heavily on the characterization of key secretions, notably clear nasal discharge (CND) and purulent nasal secretion (PUS).
Approach: They propose a framework that integrates structured prompts with rank-aware vision-language modeling for joint detection and grading.
Outcome: The proposed model improves AUC and F1 scores on CND and PUS datasets by 6.31% and 4.79%.
M-SENA: An Integrated Platform for Multimodal Sentiment Analysis (2022.acl-demo)

Copied to clipboard

Challenge: M-SENA is an open-source platform for multimodal sentiment analysis.
Approach: They propose to use a platform for multimodal sentiment analysis to facilitate advanced research by providing flexible toolkits, reliable benchmarks, and intuitive demonstrations.
Outcome: The proposed framework provides reliable benchmarks and baseline results of different modality features and MSA benchmarks.
LLM-Guided Semantic Relational Reasoning for Multimodal Intent Recognition (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for understanding intents from multimodal signals exhibit limitations in their modality-level reliance, constraining relational reasoning over fine-grained semantics for complex intent understanding.
Approach: They propose a method that harnesses the expansive knowledge of large language models to establish semantic foundations that boost smaller models’ relational reasoning performance.
Outcome: The proposed method outperforms state-of-the-art methods on multimodal intent and dialogue act recognition tasks and shows consistent performance gains across diverse semantic understanding scenarios.
Noise Stability Regularization for Improving BERT Fine-tuning (2021.naacl-main)

Copied to clipboard

Challenge: Recent studies show that fine-tuning pre-trained language models is unstable when there are only a small number of training samples available.
Approach: They propose to use a method to regularize noise in deep nets to improve fine-tuning on NLP tasks.
Outcome: The proposed method improves fine-tuning on natural language processing tasks by incorporating noise to the input and demonstrating generalizability and stability.
UP5: Unbiased Foundation Model for Fairness-aware Recommendation (2024.eacl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) are gaining a foothold in Recommender Systems (RS) but there is growing concern that LLMs perpetuate stereotypes and may result in unfair recommendations.
Approach: They propose a counterfactually-fair-prompt method for LLM-based recommendation that is based on unbiased foundation mOdels.
Outcome: The proposed method achieves better recommendation performance with a high level of fairness on two real-world datasets.
Discovering Dialog Structure Graph for Coherent Dialog Generation (2021.acl-long)

Copied to clipboard

Challenge: Existing studies on dialog structure graphs from open-domain dialogs have limited number of dialog states and can be laborious and costly to annotate manually.
Approach: They propose to use dialog structure graph as a model to discover hierarchical latent dialog states and their transitions from corpus to facilitate dialog management in a RL based dialog system.
Outcome: The proposed model can discover meaningful dialog structure graph and significantly improve multi-turn coherence on two benchmark corpora.
Where to Go for the Holidays: Towards Mixed-Type Dialogs for Clarification of User Goals (2022.acl-long)

Copied to clipboard

Challenge: a dialog system posits that users have figured out clear and specific goals . but in many real-world scenarios, users struggle to figure out specific goals by determining all the necessary slots.
Approach: They propose a mixed-type dialog model with a Prompt-based continual learning mechanism . they collect 5k dialog sessions and 168k utterances for 4 dialog types and 5 domains .
Outcome: The proposed model provides user-goal-related knowledge to help figure out clear and specific goals . it can be extended to any specific type by utilizing existing dialog corpora effectively.
PLATO-XL: Exploring the Large-scale Pre-training of Dialogue Generation (2022.findings-aacl)

Copied to clipboard

Challenge: Experimental results show PLATO-XL achieves state-of-the-art results across multiple conversational tasks.
Approach: They propose to train PLATO-XL models with up to 11 billion parameters, trained on Chinese and English social media conversations.
Outcome: The proposed model achieves state-of-the-art on multiple conversational tasks, verifying its potential as a foundation model of conversational AI.
Dynamic Prefix as Instructor for Incremental Named Entity Recognition: A Unified Seq2Seq Generation Framework (2025.findings-acl)

Copied to clipboard

Challenge: Named Entity Recognition (NER) is a fundamental problem in information extraction.
Approach: They propose a parameter-efficient method for Incremental Named Entity Recognition (INER) task aimed at updating a model to extract entities from an expanding set of entity type candidates by employing a dynamic prefix as a task instructor to guide the generative model.
Outcome: Empirical results show that the proposed method preserves task-invariant knowledge while adapting to new entities with minimal parameter updates.
QDMR-based Planning-and-Solving Prompting for Complex Reasoning Tasks (2024.lrec-main)

Copied to clipboard

Challenge: Existing Plan-and-Solve prompting methods are difficult to implement for complex questions.
Approach: They propose a plan-and-solve prompting method based on Question Decomposition Meaning Representation (QDMR) it allows LLM to generate a QDMR graph to represent problem-solving logic .
Outcome: The proposed method can represent and execute the problem-solving logic of complex questions more accurately than existing methods.
Enhancing Local Feature Extraction with Global Representation for Neural Text Classification (D19-1)

Copied to clipboard

Challenge: Existing methods for text classification learn long dependency by deeply stacking or hybrid modeling.
Approach: They propose a global-based local feature extraction architecture with global information incorporated into the local feature extractor.
Outcome: The proposed architecture outperforms the previous best models on eight benchmark datasets.
Leveraging Word-Formation Knowledge for Chinese Word Sense Disambiguation (2021.findings-emnlp)

Copied to clipboard

Challenge: Word sense disambiguation (WSD) methods have not explored word-formations in parataxis languages like Chinese.
Approach: They propose to leverage word-formation knowledge to enhance Chinese WSD by incorporating word-forms into sense disambiguation models.
Outcome: The proposed model improves on baselines in Chinese word sense disambiguation (WSD) with word-formation knowledge, the results show.
Unilaw-R1: A Large Language Model for Legal Reasoning with Reinforcement Learning and Iterative Inference (2025.emnlp-main)

Copied to clipboard

Challenge: Reasoning-focused large language models (LLMs) are rapidly evolving across various domains, yet their capabilities in handling complex legal problems remain underexplored.
Approach: They propose a large language model tailored for legal reasoning with a 7-billion parameter scale and a two-stage training strategy combining Supervised Fine-Tuning and Reinforcement Learning.
Outcome: The proposed model outperforms all models of similar scale on authoritative benchmarks and outperformed Qwen-2.5-7B-Instruct (46.6%) by an average margin of 6.6%.
Learning What Matters: Dynamic Dimension Selection and Aggregation for Interpretable Vision-Language Reward Modeling (2026.acl-long)

Copied to clipboard

Challenge: Existing multimodal reward models are interpretable but slow, while discriminative ones are opaque "black boxes."
Approach: They propose a framework that dynamically decomposes evaluation into granular, interpretable dimensions.
Outcome: The proposed framework outperforms open-source reward models on benchmarks like VL-RewardBench.
Lost in Execution: On the Multilingual Robustness of Tool Calling in Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) are increasingly deployed as agents that invoke external tools through structured function calls.
Approach: They introduce a diagnostic benchmark and conduct a systematic evaluation of multilingual tool calling across Chinese, Hindi, and the low-resource language Igbo.
Outcome: The proposed benchmarks show that multilingual tool calling fails despite correct intent understanding and tool selection.
HFT: Half Fine-Tuning for Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) with one or more fine-tuning phases can unlock various capabilities, but can be catastrophic forgetting during sequential training.
Approach: They propose a method to regularly reset partial parameters to mitigate forgetting issues by using half fine-tuning instead of full fine-uning.
Outcome: The proposed approach reduces the risk of catastrophic forgetting during training and the parametric knowledge lost during training may be overwhelmed by incoming training data.
CH-SIMS: A Chinese Multimodal Sentiment Analysis Dataset with Fine-grained Annotation of Modality (2020.acl-main)

Copied to clipboard

Challenge: Existing studies in multimodal sentiment analysis only use unified multimodal annotations, which do not reflect the independent sentiment of single modalities.
Approach: They propose a Chinese single- and multi-modal sentiment analysis dataset with multimodal and independent unimodal annotations that can be used to study the interaction between modalities.
Outcome: The proposed methods achieve state-of-the-art performance and learn more distinctive unimodal representations.
Long Time No See! Open-Domain Conversation with Long-Term Persona Memory (2022.findings-acl)

Copied to clipboard

Challenge: Existing persona dialogue datasets and models can build long-term relationships with humans . however, current open-domain dialogue systems cannot build long relationships with users .
Approach: They propose a long-term memory conversation dataset and a dialogue generation framework with long-Term memory mechanism to extract and continuously update long-time persona memory.
Outcome: The proposed system outperforms baselines in terms of long-term dialogue consistency . the proposed system can build long-lasting relationships between humans and bots .
The Strength of the Weakest Supervision: Topic Classification Using Class Labels (N19-3)

Copied to clipboard

Challenge: a topic classifier can understand only class labels when training for tasks that require a large amount of labeled documents.
Approach: They propose an algorithm that can initialize a topic classifier using only class labels . they propose a method that combines word embedding and naive Bayes classification .
Outcome: The proposed approach saves significant initial labeling effort by providing a "warm start" the proposed approach can be fine-tuned with more labeled documents to reach a certain performance level.
Icon2: Aligning Large Language Models Using Self-Synthetic Preference Data via Inherent Regulation (2025.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) require high quality preference datasets to align with human preferences.
Approach: They propose a framework that leverages inherent regulation of LLMs’ representation space for efficient and tailored preference dataset construction, named Icon2.
Outcome: The proposed framework improves performance on benchmarks like AlpacaEval 2.0 and Arena-Hard while reducing computational costs by up to 48.1%.
Unsupervised Multimodal Clustering for Semantics Discovery in Multimodal Utterances (2024.acl-long)

Copied to clipboard

Challenge: Existing methods for semantics discovery focus on text, video, and audio, failing to leverage the rich multimodal information in the real world.
Approach: They propose a method to construct augmentation views for multimodal data and use them to perform pre-training to establish well-initialized representations for subsequent clustering.
Outcome: The proposed method improves on benchmark multimodal intent and dialogue act datasets by 2-6% over state-of-the-art methods.
Exploring Chain-of-Thought for Multi-modal Metaphor Detection (2024.acl-long)

Copied to clipboard

Challenge: Metaphors are commonly found in advertising and internet memes, but lack of high-quality textual data is a challenge for language models . a new framework for multi-modal metaphor detection is being developed to address these challenges .
Approach: They propose a framework that extracts and integrates knowledge from Large Language Models into smaller ones to improve model performance.
Outcome: The proposed framework outperforms existing models on the MET-MEME dataset.
Watermarking PLMs on Classification Tasks by Combining Contrastive Learning with Weight Perturbation (2023.findings-emnlp)

Copied to clipboard

Challenge: Large pre-trained language models (PLMs) are highly valuable intellectual property due to their expensive training costs.
Approach: They propose to embed backdoors that can be triggered by specific inputs into models by model watermarking.
Outcome: The proposed method can be used to protect the intellectual property of large pre-trained language models without knowledge about downstream tasks.
TEXTOIR: An Integrated and Visualized Platform for Text Open Intent Recognition (2021.acl-demo)

Copied to clipboard

Challenge: TEXTOIR is the first integrated platform for text open intent recognition . currently, many dialogue systems are limited to handle the uncertain open intents .
Approach: TEXTOIR is the first integrated platform for text open intent recognition . it is composed of two main modules: open intent detection and open intent discovery . authors propose a framework to implement a complete process to identify known intents and discover open intents .
Outcome: TEXTOIR is the first integrated and visualized platform for text open intent recognition . it integrates state-of-the-art algorithms and benchmark intent datasets . however, there are still some issues, which bring difficulties for future research .
Golden Touchstone: A Comprehensive Bilingual Benchmark for Evaluating Financial Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing financial benchmarks suffer from limited language and task coverage, low-quality datasets, and inadequate adaptability for LLM evaluation.
Approach: They propose a bilingual benchmark for financial LLMs that assesses models’ language understanding and generation capabilities.
Outcome: The proposed bilingual benchmark assesses models’ language understanding and generation capabilities.
Causally Modeling the Linguistic and Social Factors that Predict Email Response (2025.naacl-long)

Copied to clipboard

Challenge: a key intent behind many emails is to get a reply from the recipient.
Approach: They propose to model the intents, expectations, and responsiveness in email exchanges by using a dataset containing 1800 emails annotated with nuanced types of intents and expectations.
Outcome: The proposed model is based on 1800 emails annotated with nuanced types of intents and expectations . it shows that social status, argumentation, and strength of social connection influence email response rates .
Geneverse: A Collection of Open-source Multimodal Large Language Models for Genomic and Proteomic Research (2024.findings-emnlp)

Copied to clipboard

Challenge: generative Large Language Models (LLMs) are a promising tool for biomedical and healthcare research.
Approach: They propose to use finetuned LLMs and multimodal LLM for genomic and proteomics tasks.
Outcome: The proposed models outperform closed-source models in genomic and proteomics tasks and are highly accurate.
Instructional Agents: Reducing Teaching Faculty Workload through Multi-Agent Instructional Design (2026.eacl-long)

Copied to clipboard

Challenge: Existing AI-assisted educational tools focus on isolated tasks, but lack end-to-end workflows for instructional design.
Approach: They propose a multi-agent large language model framework to automate end-to-end course material generation.
Outcome: The proposed framework reduces development time and human workload while reducing human involvement.
PLATO-2: Towards Building an Open-Domain Chatbot via Curriculum Learning (2021.findings-acl)

Copied to clipboard

Challenge: PLATO-2 is a high-quality open-domain chatbot that can generate one-to-many mappings and improve response quality.
Approach: They propose a curriculum learning process to build a high-quality open-domain chatbot . they use a coarse-grained generation model and latent variables to train a generative model .
Outcome: The proposed model improves on Chinese and English data and can generate diverse responses and select the best response.
One-Dimensional Object Detection for Streaming Text Segmentation of Meeting Dialogue (2025.findings-acl)

Copied to clipboard

Challenge: Current text segmentation models exhibit numerous limitations, such as imbalances in labels that affect the stability of model training and discrepancies between the model’s training tasks (sentence classification) and the actual text segmenting.
Approach: They implement a sliding window-based segmentation method and employ two different levels of sliding window based balanced label strategies to stabilize the training process of the streaming segmentation model.
Outcome: The proposed method is robust, controllable, and achieves state-of-the-art performance.
Continual Machine Reading Comprehension via Uncertainty-aware Fixed Memory and Adversarial Domain Adaptation (2022.findings-naacl)

Copied to clipboard

Challenge: Existing stationary-trained MRC systems are usually trained with in-domain data but are applied to new domain data.
Approach: They propose a continual machine reading comprehension model with uncertainty-aware fixed memory and adversarial domain adaptation that keeps a stable understanding by learning both memory and new domain data.
Outcome: The proposed model is superior to strong baselines and has a substantial incremental learning ability without catastrophically forgetting under two different continual MRC settings.
Towards Zero-Shot Persona Dialogue Generation with In-Context Learning (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods to improve persona consistency on high-quality human-labeled persona datasets face high cost and poor scalability.
Approach: They propose a method to improve zero-shot persona consistency via in-context learning by pre-training a persona-augmented dialogue generation model and then using in-constant prompting mechanism to realize zero- shot persona customization.
Outcome: The proposed method improves persona consistency without compromising coherence and informativeness in zero-shot settings.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations