Papers by Hanjing Yan
MedKInstruct: A Multimodal Knowledge Graph Based Framework for Multi-Hop and Hard-Negative Instruction Data Synthesis in MedVQA (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for medical visual question answering focus on image–caption pairs, limiting the model’s ability to learn relevant medical knowledge during training. |
| Approach: | They propose to synthesize instruction data from image–caption pairs and incorporate a multimodal medical knowledge graph to assist LVLMs in synthesizing knowledge-intensive instruction data. |
| Outcome: | The proposed model outperforms existing methods on the public datasets Slake and VQA-RAD by 4.16% and 4.50%. |