Papers by Oded Hupert
Describing Sets of Images with Textual-PCA (2022.findings-emnlp)
Copied to clipboard
| Challenge: | a new method to describe images using a common theme is needed to describe the images . a grammatical phrase is not sufficient to describe an image set, since captioning engines are not general enough. |
| Approach: | They propose a method to capture attributes of images and variations within a set . they use a pretrained vision-language model to generate a centroid phrase with the largest average similarity . |
| Outcome: | The proposed method captures the essence of image sets and describes them in a semantically meaningful way . it is easy for humans to identify and describe a common theme, but it is not generic enough . |