Papers by Seokhoon Jeong
Sound of Story: Multi-modal Storytelling with Audio (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies on storytelling with sound have focused on visuals and sounds, but little attention has been given to sound. |
| Approach: | They propose to establish a new component called background sound which is story context-based audio without any linguistic information. |
| Outcome: | The proposed dataset is the largest well-curated dataset for storytelling with sound . it contains 27,354 stories with 19.6 images per story and 984 hours of speech-decoupled audio . |