Papers by Nikita Bhalla
Multi-Modal Image Captioning for the Visually Impaired (2021.naacl-srw)
Copied to clipboard
| Challenge: | Current captioning models for blind people do not use textual data present in the image when generating captions. |
| Approach: | They propose to use text detected in the image as an input feature in captions . they also use a pointer-generator network to copy detected text to the caption . |
| Outcome: | The proposed system outperforms existing models on the VizWiz dataset, showing a 35% and 16.2% performance improvement. |