Papers by Yaqing Zhang
Unity in Diversity: Collaborative Pre-training Across Multimodal Medical Sources (2024.acl-long)
Copied to clipboard
Xiaochen Wang, Junyu Luo, Jiaqi Wang, Yuan Zhong, Xiaokun Zhang, Yaqing Wang, Parminder Bhatia, Cao Xiao, Fenglong Ma
| Challenge: | Current pre-training techniques rely on a limited scope of medical data, limiting the range of downstream tasks. |
| Approach: | They propose a pre-training strategy that unifies patient data within individual sources and captures explicit and implicit correlations between patients across different sources. |
| Outcome: | The proposed strategy bridges the gap between multimodal medical sources by aggregating patient data within individual sources and capturing explicit and implicit correlations between patients across sources. |
Learning from Language Description: Low-shot Named Entity Recognition via Decomposed Framework (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Named entity recognition (NER) is a language understanding task that requires large amounts of in-domain labeled data to perform well. |
| Approach: | They propose a framework which learns from natural language supervision and enables the identification of never-seen entity classes without using in-domain labeled data. |
| Outcome: | The proposed method brings 10%, 23% and 26% improvements over baselines in few-shot learning, domain transfer and zero-shot settings respectively. |
VFA: Empowering Multilingual MLLMs via Vision-Free Adaptation (2026.acl-long)
Copied to clipboard
Yixia Li, Yaqing Shi, Zhiwen Ruan, Dongdong Zhang, Lingjie Jiang, Shaohan Huang, Yun Chen, Guanhua Chen, Furu Wei
| Challenge: | Multimodal large language models have advanced rapidly, yet most remain English-centric . scaling multilingual multimodal instruction tuning is limited by the scarcity and high cost of non-English image–text supervision. |
| Approach: | They propose a framework that decouples multilingual language enhancement from visual alignment by composing complementary task vectors over a shared LLM backbone. |
| Outcome: | The proposed framework achieves competitive performance with a fully multimodally trained model using less than 2% of the text data. |
PanoramaRAG: Enabling Consistent Global Topic Awareness in Graph-Based RAG (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing graph-based methods for enhancing Large Language Models (LLMs) with external knowledge are focusing on local relationships, resulting in suboptimal performance for tasks that require global context. |
| Approach: | They propose a "panorama"-guided paradigm that integrates a light yet comprehensive "panoramic" of the corpus to guide all stages of the retrieval process. |
| Outcome: | The proposed paradigm performs well across five datasets and a variety of tasks. |