Papers by Sofia Jamil
Poetry in Pixels: Prompt Tuning for Poem Image Generation via Diffusion Models (2025.coling-main)
Copied to clipboard
Sofia Jamil, Bollampalli Areen Reddy, Raghvendra Kumar, Sriparna Saha, Joseph K. J, Koustava Goswami
| Challenge: | Poems are a distinct form of literature, with meanings that transcend beyond the literal words. |
| Approach: | They propose a framework to generate images that visually represent the meanings of poems using prompt tuning and a PoeKey algorithm to extract emotions, visual elements, and themes from poems. |
| Outcome: | The proposed framework generates images that visually represent the meanings of poems and their images. |
Do It Yourself (DIY): Modifying Images for Poems in a Zero-Shot Setting Using Weighted Prompt Manipulation (2025.emnlp-main)
Copied to clipboard
| Challenge: | a novel method to enhance imagery in poetic language is proposed . weighted prompt manipulation is a new approach to enhance poetry images . current diffusion models struggle to interpret metaphorical language, symbolism, and nuanced themes. |
| Approach: | They propose a weighted prompt manipulation technique that modifies attention weights and text embeddings within diffusion models to enhance or suppress specific words' influence in the final generated image. |
| Outcome: | The proposed technique enhances or suppresses the influence of specific words in the final generated image, leading to semantically richer and more contextually accurate visualizations. |