Papers by Yushen Fang
GASE: Graph-Aware Semantic Embedding Learning with Frozen LLMs for Text-Attributed Graphs (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown strong potential for text-attributed graph (TAG) learning, yet effectively integrating LLM semantics with graph structural information remains challenging. |
| Approach: | They propose a framework for learning Graph-Aware Semantic Embeddings using frozen LLMs. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on node classification and achieves a 5 speedup over fine-tuning-based methods. |
MARD: Module-Aware Reasoning Distillation for Language Models with Adaptive Supervision (2026.acl-long)
Copied to clipboard
| Challenge: | Multi-step reasoning remains challenging for language models with limited capacity . et al., 2025) demonstrate remarkable reasoning capabilities across diverse tasks . |
| Approach: | They propose a module-aware reasoning distillation framework that explicitly targets key Transformer components for effective reasoning transfer. |
| Outcome: | The proposed framework targets key components for effective reasoning transfer . it adopts an offline distillation setting, where a strong teacher model provides reasoning trajectories in advance . |