Papers by Xiaojie Yuan
Incorporating Circumstances into Narrative Event Prediction (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies focus on mining the inter-events relationships while ignoring how the events happened. |
| Approach: | They propose to incorporate event circumstances into the narrative event prediction by combining two multi-head attention modules and regularizing attention weights. |
| Outcome: | The proposed model outperforms baseline models by 12.2%. |
From Alignment to Entailment: A Unified Textual Entailment Framework for Entity Alignment (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods encode the triples of entities as embeddings and learn to align the embeddables, which prevents the direct interaction between the original information of the cross-KG entities. |
| Approach: | They propose to transform the triples into unified textual sequences and model the EA task as a bi-directional textual entailment task between the sequences of cross-KG entities. |
| Outcome: | The proposed approach outperforms the state-of-the-art methods on five cross-lingual datasets and allows the mutual enhancement of the heterogeneous information. |
DTDES-KGE: Dual-Teacher Knowledge Distillation with Distinct Embedding Spaces for Knowledge Graph Embeddings (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing knowledge distillation methods rely on a single teacher embedding space . existing methods overlook valuable complementary knowledge from teachers in distinct embeddable spaces. |
| Approach: | They propose a knowledge distillation framework that leverages dual teachers in embedding spaces to enhance performance. |
| Outcome: | The proposed framework significantly improves knowledge distillation performance by leveraging dual teachers in distinct embedding spaces. |
PaddleSpeech: An Easy-to-Use All-in-One Speech Toolkit (2022.naacl-demo)
Copied to clipboard
Hui Zhang, Tian Yuan, Junkun Chen, Xintong Li, Renjie Zheng, Yuxin Huang, Xiaojie Chen, Enlei Gong, Zeyu Chen, Xiaoguang Hu, Dianhai Yu, Yanjun Ma, Liang Huang
| Challenge: | PaddleSpeech is an open-source speech toolkit that supports speech-to-text and text-to speech tasks. |
| Approach: | They describe the design philosophy and core architecture of PaddleSpeech to support several essential speech-to-text and text-to speech tasks. |
| Outcome: | The proposed framework achieves competitive or state-of-the-art performance on various speech datasets and implements the most popular methods. |
InstructGEC: Enhancing Unsupervised Grammatical Error Correction with Instruction Tuning (2025.coling-main)
Copied to clipboard
| Challenge: | Recent studies have proposed methods of generating synthetic data for unsupervised GEC . however, the cost of such methods is high and the quality of the data is poor . |
| Approach: | They propose a method to generate synthetic data automatically for unsupervised GEC . they use a masking strategy to mask an erroneous sentence and the instruction consistently . |
| Outcome: | The proposed method outperforms state-of-the-art unsupervised methods on English and Chinese GEC datasets. |
A Slot Is Not Built in One Utterance: Spoken Language Dialogs with Sub-Slots (2022.findings-acl)
Copied to clipboard
| Challenge: | Sub-Slot based task-oriented dialogs provide slot values segment by segment over multiple turns. |
| Approach: | They define a task called Sub-Slot based Task-Oriented Dialog (SSTOD) they build a Chinese dialog dataset SSD for boosting research on SSTOD. |
| Outcome: | The proposed task is called Sub-Slot based Task-Oriented Dialog (SSTOD) it includes 40K dialogs and 500K utterances from Chinese names, phone numbers, ID numbers and license plate numbers . the dataset is well annotated with sub-slot values, slot values, dialog states and actions . |
MCIL: Multimodal Counterfactual Instance Learning for Low-resource Entity-based Multimodal Information Extraction (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to perform multimodal information extraction only investigated entity-based tasks under supervised learning with adequate labeled data. |
| Approach: | They propose to investigate the entity-based MIE tasks under the low-resource settings by decomposing the features into image, entity, and context factors. |
| Outcome: | The proposed method is able to perform on two public MIE benchmark datasets and the experimental results confirm it. |
PM2F2N: Patient Multi-view Multi-modal Feature Fusion Networks for Clinical Outcome Prediction (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods focused on time series data but ignored clinical notes . fusion of multi-modal features of patients from different views is not feasible due to the time series and clinical notes data being stored as time series. |
| Approach: | They propose to combine time series and clinical notes to fuse multi-modal features of patients from different perspectives using graph neural networks. |
| Outcome: | The proposed method is superior to existing models on MIMIC-III benchmark. |
SafeInt: Shielding Large Language Models from Jailbreak Attacks via Safety-Aware Representation Intervention (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Jailbreak attacks exploit vulnerabilities in large language models to induce undesirable behavior . existing defenses cannot dynamically adjust representations based on harmfulness of queries . |
| Approach: | They propose a representation-aware representation method that shields LLMs from jailbreak attacks . SafeInt relocates jailbreak-related representations into the rejection region . |
| Outcome: | The proposed method outperforms baseline defenses while maintaining utility . it relocates jailbreak-related representations into the rejection region . |
Licon: A Diverse, Controllable and Challenging Linguistic Concept Learning Benchmark (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for Concept Learning focus on visual information, but visual information cannot present abstract concepts exactly, which struggles the introduction of novel concepts related to known concepts. |
| Approach: | They propose a benchmark where concepts in diverse forms are defined by linguistic descriptions and an entailment-based concept learning method to model the relationship among concepts. |
| Outcome: | The proposed benchmark is based on the existing visual concepts learning benchmarks and will be released to the public soon. |
SWAM: Adaptive Sliding Window and Memory-Augmented Attention Model for Rumor Detection (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for rumor detection on social media focus on static graphs, ignoring dynamic and incremental propagation . rumour detection on the social media platform is crucial to mitigating harmful effects of rumors. |
| Approach: | They propose a sliding window and memory-augmented attention model for rumor detection . they use a dynamic propagation graph and memory to capture the long-term dependency . |
| Outcome: | The proposed model is compared with the state-of-the-art models on two public datasets. |
Selecting Key Views for Zero-Shot Entity Linking (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Entity linking is a task of assigning ambiguous mentions in textual input to entities in knowledge bases. |
| Approach: | They propose a framework to align mentions in text to entities in knowledge bases . they use unsupervised clustering to select key views from descriptions . |
| Outcome: | The proposed framework achieves state-of-the-art on the zero-shot entity linking dataset. |
KAPALM: Knowledge grAPh enhAnced Language Models for Fake News Detection (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods of fake news detection focus on news entity information and ignore structured knowledge among news entities. |
| Approach: | They propose a model that fuses coarse- and fine-grained representations of entity knowledge from Knowledge Graphs (KGs) they identify entities in news content and link them to entities in KGs. |
| Outcome: | The proposed model outperforms state-of-the-art models on two benchmark datasets and is competitive in the few-shot scenario. |
Slot Transferability for Cross-domain Slot Filling (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing work on slot filling uses labeled data from source domains to train a model for target domains. |
| Approach: | They propose a model-agnostic Slot Transferability Measure (STM) to evaluate the transferability from a source slot to a target slot. |
| Outcome: | The proposed method outperforms state-of-the-art models on multiple datasets and models. |
Bring Invariant to Variant: A Contrastive Prompt-based Framework for Temporal Knowledge Graph Forecasting (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for temporal knowledge graph forecasting are insufficient structural contexts to learn effective representations. |
| Approach: | They propose a Contrastive Prompt-based framework with Entity background information for TKG forecasting that brings time-invariant entity background information to time-variant structural information. |
| Outcome: | The proposed framework is effective and stays competitive in inference with limited structural information. |
AoM: Detecting Aspect-oriented Information for Multimodal Aspect-Based Sentiment Analysis (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to extract aspects from text-image pairs and recognize their sentiments are noisy and coarsely establishing image-aspect alignment will interfere with aspect-relevant semantic and sentiment information. |
| Approach: | They propose an Aspect-oriented method to detect aspect-relevant semantic and sentiment information by selecting textual tokens and image blocks that are semantically related to the aspects. |
| Outcome: | The proposed method is superior to existing methods in the field of sentiment analysis. |
Look before You Leap: Dual Logical Verification for Knowledge-based Visual Question Generation (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for visual question generation focus on leveraging the semantics of inputs to propose questions, ignoring the logical coherence between generated questions and images. |
| Approach: | They propose a logical verification method that checks logical structure between Q, images, answers and acquired outside knowledge by incorporating logical coherence between Q and Q twice in the whole procedure. |
| Outcome: | The proposed method can generate diverse and insightful knowledge-based visual questions on two common datasets. |
Collab-Overcooked: Benchmarking and Evaluating Large Language Models as Collaborative Agents (2025.emnlp-main)
Copied to clipboard
Haochen Sun, Shuwen Zhang, Lujie Niu, Lei Ren, Hao Xu, Hao Fu, Fangkun Zhao, Caixia Yuan, Xiaojie Wang
| Challenge: | Large Language Models (LLMs) based agent systems have made great strides in real-world applications beyond traditional NLP tasks. |
| Approach: | They propose a new LLM-based Multi-Agent System benchmark, Collab-Overcooked, built on the popular Overcooked-AI game with more applicable and challenging tasks in interactive environments. |
| Outcome: | The proposed benchmark provides a multi-agent framework supporting diverse tasks and objectives and encourages collaboration through natural language communication. |
Explicit Alignment and Many-to-many Entailment Based Reasoning for Conversational Machine Reading (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Recent research has explored how to improve the abilities of decision-making and question generation. |
| Approach: | They propose a pipeline framework that aligns the document and user-provided information in an explicit way, makes decisions using a lightweight many-to-many entailment reasoning module and generates follow-up questions based on the document. |
| Outcome: | The proposed framework achieves state-of-the-art in micro-accuracy and ranks the first place on the public leaderboard of the CMR benchmark dataset ShARC. |
CoTD-PO: Chain-of-Thought Distillation with Preference Optimization (2025.findings-emnlp)
Copied to clipboard
Lujie Niu, Haochen Sun, Fangkun Zhao, Sheng Chen, Zimeng Bai, Jiawei Zhang, Caixia Yuan, Xiaojie Wang
| Challenge: | Existing methods for chain-of-thought distillation suffer from a distribution mismatch between teacher-generated training trajectories and the student model's own generative distribution. |
| Approach: | They propose a framework that shifts the training paradigm from passive imitation to active trajectory exploration by allowing students to sample their own answer paths. |
| Outcome: | The proposed method outperforms standard CoT distillation baselines while mitigating mode collapse and preserving semantic diversity. |
FGDGNN: Fine-Grained Dynamic Graph Neural Network for Rumor Detection on Social Media (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for detecting rumors on social media focus on coarse-grained temporal information and ignore fine-grain temporal dynamics. |
| Approach: | They propose a fine-grained dynamic graph neural network model which incorporates fine-grain temporal information into a unified framework for rumor detection. |
| Outcome: | The proposed model improves on three public real-world datasets. |
MELOV: Multimodal Entity Linking with Optimized Visual Features in Latent Space (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to multimodal entity linking focus on textual contexts but lack in social media vision modality. |
| Approach: | They propose a latent space vision feature optimization framework MELOV to address these challenges . they exploit variational autoencoder to mine shared information and generate text-based visual features . |
| Outcome: | The proposed framework is superior to existing methods on three benchmark datasets. |
TacoPrompt: A Collaborative Multi-Task Prompt Learning Method for Self-Supervised Taxonomy Completion (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for automating taxonomy completion use subtasks to learn subtask results, ignoring the effects of subtask on the final prediction. |
| Approach: | They propose a multi-task automatic taxonomy completion method that attaches emerging concepts to an appropriate pair of hypernym and hyponym in existing taxonomies. |
| Outcome: | The proposed method improves on three datasets and improves inference efficiency. |
Overcoming Language Priors in Visual Question Answering via Distinguishing Superficially Similar Instances (2022.coling-1)
Copied to clipboard
| Challenge: | Existing VQA models rely on the superficial correlation between question type and frequent answers to make predictions, without really understanding the input. |
| Approach: | They propose a training framework that explicitly encourages the VQA model to distinguish between superficially similar instances. |
| Outcome: | The proposed framework achieves state-of-the-art performance on VQA-CP v2 . it explicitly encourages the model to distinguish between the superficially similar instances . |
TEMP: Taxonomy Expansion with Dynamic Margin Loss through Taxonomy-Paths (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing taxonomies are unable to maintain coverage due to the rising of new concepts . TEMP uses pre-trained contextual encoders to predict the position of new ideas . |
| Approach: | They propose a self-supervised taxonomy expansion method that ranks taxonomies by ranking them . they use pre-trained contextual encoders to train the model with dynamic margin loss . |
| Outcome: | The proposed method outperforms state-of-the-art taxonomy expansion methods by 14.3% and 15.8% on public benchmarks. |
KG-Adapter: Enabling Knowledge Graph Integration in Large Language Models through Parameter-Efficient Fine-Tuning (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) are criticized for lack of expertise and knowledge conflict . KG-Adapter is a parameter-level KG integration method for decoder-only LLMs . |
| Approach: | They propose a parameter-level KG integration method based on parameter-efficient fine-tuning . they use KG-Adapter to integrate knowledge graphs with LLMs and perform joint reasoning . |
| Outcome: | The proposed method outperforms the current state-of-the-art method on four datasets for two different tasks. |
Controlled Low-Rank Adaptation with Subspace Regularization for Continued Training on Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to mitigate catastrophic forgetting can be broadly categorized into data-based, architecture-based and learning-based methods. |
| Approach: | They propose a subspace regularization method on LoRA structure that imposes constraints on direction of updating matrix’s null space. |
| Outcome: | The proposed method reduces scale of output change while introducing minimal constraint on model capacity. |
Bridging the Sensory Gap: Visual Injection for Taxonomy Completion (2026.acl-long)
Copied to clipboard
| Challenge: | Existing text-only methods suffer from a "Sensory Gap" in integrating new concepts into existing hierarchies. |
| Approach: | They propose a framework leveraging Visual Injection for Taxonomy Completion that maps synthesized images into intrinsic pseudo-tokens and decouples magnitude from selection to prevent visual signals from being drowned out. |
| Outcome: | Experiments on three datasets show that VITC achieves state-of-the-art performance . it delivers an average absolute gain of over 19% in Hit@1. |
BioFEG: Generate Latent Features for Biomedical Entity Linking (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to biomedical entity linking suffer from multiple types of errors due to the rarity of many biomedically relevant entities in real-world scenarios. |
| Approach: | They propose a latent feature generation framework to generate latent semantic features for unseen entities to capture fine-grained coherence information of unseened entities. |
| Outcome: | The proposed framework is superior to existing models on two benchmark datasets. |
Learn to Adapt for Generalized Zero-Shot Text Classification (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods for generalized zero-shot text classification generalize poorly since the learned parameters are only optimal for seen classes rather than for both classes. |
| Approach: | They propose a network that trains an adaptive classifier by using both seen and virtual unseen classes to simulate a generalized zero-shot learning scenario. |
| Outcome: | The proposed model outperforms several previous approaches on five text classification datasets. |
An End-to-End Progressive Multi-Task Learning Framework for Medical Named Entity Recognition and Normalization (2021.acl-long)
Copied to clipboard
| Challenge: | Existing models for medical named entity recognition and named entity normalization suffer from error propagation between the two tasks. |
| Approach: | They propose an end-to-end progressive multi-task learning model for jointly modeling medical named entity recognition and normalization in an effective way. |
| Outcome: | The proposed model reduces error propagation by exploiting the learnable features for both tasks to improve performance. |
Incorporating Object-Level Visual Context for Multimodal Fine-Grained Entity Typing (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Experimental results show that fine-grained entity typing is superior to text-based methods. |
| Approach: | They propose a task called fine-grained entity typing to classify entities . they propose combining textual and visual contexts to capture fine-granular semantic information . |
| Outcome: | The proposed approach achieves superior classification performance compared to previous text-based approaches. |
Improving Zero-Shot Entity Linking Candidate Generation with Ultra-Fine Entity Type Information (2022.coling-1)
Copied to clipboard
| Challenge: | Entity linking is a task of assigning entity mentions to referent entities in a knowledge base. |
| Approach: | They propose to use ultra-fine-grained type information to improve the generalization ability of EL models by utilizing a low-level task to extract ultra-finish entity type information. |
| Outcome: | The proposed model achieves state-of-the-art in the zero-shot entity linking task . |
TreeMAN: Tree-enhanced Multimodal Attention Network for ICD Coding (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods to automatically assign ICD codes ignore crucial information contained in structured medical data, which is hard to be captured from the noisy clinical notes. |
| Approach: | They propose to use a Tree-enhanced multimodal attention network to fuse tabular features and textual features into multimodal representations by enhancing the text representations with tree-based features. |
| Outcome: | The proposed method outperforms state-of-the-art methods on two MIMIC datasets. |
Multimodal Recommendation Dialog with Subjective Preference: A New Challenge and Benchmark (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing multimodal task-oriented dialog data fails to demonstrate the diverse expressions of user subjective preferences and recommendation acts in the real-life shopping scenario. |
| Approach: | They propose a multimodal task-oriented dialog dataset with subjective preferences and recommendation acts that is well-annotated with sales experts. |
| Outcome: | The proposed model is powered by a state-of-the-art multimodal model for these tasks. |
A Span-based Multimodal Variational Autoencoder for Semi-supervised Multimodal Named Entity Recognition (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for named entity recognition on social media are not efficient for semi-supervised MNER because of the mismatch between the posted text and image. |
| Approach: | They propose a novel method to fuse the text and image features for multimodal named entity recognition under semi-supervised setting by exploiting modal-specific VAEs. |
| Outcome: | The proposed method outperforms baselines under supervised setting and improves performance with less labeled data than existing semi-supervised methods. |
EvoMemKG: An Evolvable Memory Agent for Multi-hop Knowledge Graph Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for integrating knowledge graphs with large language models lack continuous learning capabilities. |
| Approach: | They propose an agent framework with a dynamic, evolvable memory mechanism specifically designed for KG reasoning. |
| Outcome: | EvoMemKG achieves state-of-the-art performance without training or tools . it achieves improvements of up to 20% over baseline on multi-hop queries . |
Task-Oriented Clustering for Dialogues (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for task-oriented dialogue clustering are difficult to apply directly due to inherent differences between them. |
| Approach: | They propose a Dialogue Task Clustering Network model for task-oriented clustering . they use context-aware utterance representations and cross-dialogue utterrance cluster representations . |
| Outcome: | The proposed model outperforms baselines on three public datasets on all metrics. |
Topic-Aware Contrastive Learning for Abstractive Dialogue Summarization (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to abstractly summarize dialogues are limited to two or more interlocutors. |
| Approach: | They propose to use existing document summarization models to capture the various topic information of a conversation and outline salient facts for the captured topics. |
| Outcome: | The proposed method significantly outperforms baselines and achieves new state-of-the-art performance on benchmark datasets. |