Papers by Yuchen Mo
Combo of Thinking and Observing for Outside-Knowledge VQA (2023.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to visual question answering use external knowledge to acquire and use knowledge beyond images. |
| Approach: | They propose to constrain the cross-modality space into the same space of natural-language space . they propose a multimodal encoder, textual encoder and answer decoder to introduce more types of knowledge . |
| Outcome: | The proposed framework outperforms the state-of-the-art by 6.17% accuracy on a cross-modal space and natural-language space. |