Papers by Julia Koch
»textklang« – Towards a Multi-Modal Exploration Platform for German Poetry (2022.lrec-1)
Copied to clipboard
Nadja Schauffler, Toni Bernhart, Andre Blessing, Gunilla Eschenbach, Markus Gärtner, Kerstin Jung, Anna Kinder, Julia Koch, Sandra Richter, Gabriel Viehhauser, Ngoc Thang Vu, Lorenz Wesemann, Jonas Kuhn
| Challenge: | »textklang« aims to explore the relationship between written text and its potential and actual sonic realisation in lyric poetry . the platform will combine three modalities: the poetic text, the audio signal of a recorded recitation and, at a later stage, music scores of . musical setting of lyrical poetry. |
| Approach: | They propose to combine a multi-modal corpus of German lyric poetry from the Romantic era with a platform for systematic exploration. |
| Outcome: | The platform will combine the poetic text, the audio signal of a recorded recitation and, at a later stage, music scores of . a musical setting of lyric poetry. |
Low-Resource Multilingual and Zero-Shot Multispeaker TTS (2022.aacl-main)
Copied to clipboard
| Challenge: | Currently, the amount of data needed for TTS is limited to the vast majority of the spoken languages. |
| Approach: | They propose to use language agnostic meta learning procedure to learn speaking a new language with just 5 minutes of training data while retaining the ability to infer the voice of even unseen speakers. |
| Outcome: | The proposed approach is able to learn speaking a new language using just 5 minutes of training data while retaining the ability to infer the voice of even unseen speakers in the newly learned language. |