Papers by Hongyuan Xu
DTDES-KGE: Dual-Teacher Knowledge Distillation with Distinct Embedding Spaces for Knowledge Graph Embeddings (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing knowledge distillation methods rely on a single teacher embedding space . existing methods overlook valuable complementary knowledge from teachers in distinct embeddable spaces. |
| Approach: | They propose a knowledge distillation framework that leverages dual teachers in embedding spaces to enhance performance. |
| Outcome: | The proposed framework significantly improves knowledge distillation performance by leveraging dual teachers in distinct embedding spaces. |
Unveiling the Generalization Power of Fine-Tuned Large Language Models (2024.naacl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated exceptional multitasking abilities, but the comprehensive effects of fine-tuning on the LLMs’ generalization ability are not fully understood. |
| Approach: | They conduct extensive experiments across five distinct language tasks on different datasets to investigate whether fine-tuning affects the generalization ability intrinsic to LLMs. |
| Outcome: | The proposed model can generalize to different domains and tasks by integrating the in-context learning strategy during fine-tuning on generation tasks. |
Robustness of Learning from Task Instructions (2023.findings-acl)
Copied to clipboard
| Challenge: | traditional supervised learning mostly works on individual tasks and requires training on a large set of task-specific examples. |
| Approach: | a new study investigates the system robustness when instructions are manipulated and paraphrased . task instructions give the model the definition of the task and allow it to output the appropriate answer . |
| Outcome: | a new study shows that supervised learning is robust when instructions are manipulated, paraphrased or iii from different levels of conciseness. |
TacoPrompt: A Collaborative Multi-Task Prompt Learning Method for Self-Supervised Taxonomy Completion (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for automating taxonomy completion use subtasks to learn subtask results, ignoring the effects of subtask on the final prediction. |
| Approach: | They propose a multi-task automatic taxonomy completion method that attaches emerging concepts to an appropriate pair of hypernym and hyponym in existing taxonomies. |
| Outcome: | The proposed method improves on three datasets and improves inference efficiency. |
TEMP: Taxonomy Expansion with Dynamic Margin Loss through Taxonomy-Paths (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing taxonomies are unable to maintain coverage due to the rising of new concepts . TEMP uses pre-trained contextual encoders to predict the position of new ideas . |
| Approach: | They propose a self-supervised taxonomy expansion method that ranks taxonomies by ranking them . they use pre-trained contextual encoders to train the model with dynamic margin loss . |
| Outcome: | The proposed method outperforms state-of-the-art taxonomy expansion methods by 14.3% and 15.8% on public benchmarks. |
Bridging the Sensory Gap: Visual Injection for Taxonomy Completion (2026.acl-long)
Copied to clipboard
| Challenge: | Existing text-only methods suffer from a "Sensory Gap" in integrating new concepts into existing hierarchies. |
| Approach: | They propose a framework leveraging Visual Injection for Taxonomy Completion that maps synthesized images into intrinsic pseudo-tokens and decouples magnitude from selection to prevent visual signals from being drowned out. |
| Outcome: | Experiments on three datasets show that VITC achieves state-of-the-art performance . it delivers an average absolute gain of over 19% in Hit@1. |