Papers by Huimin Xiong
VPL: Visual Proxy Learning Framework for Zero-Shot Medical Image Diagnosis (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Insufficient medical text precision and the modal disparity between text and vision spaces pose challenges for vision-language models like CLIP. |
| Approach: | They propose a visual proxy learning framework that combines a text refinement module and a stable Sinkhorn algorithm to enhance the diagnostic performance. |
| Outcome: | The proposed model outperforms the state-of-the-art CLIP inference by 1.69% to 15.31% on five datasets covering various diseases. |