Papers by Zofia Malisz
Bringing Order to Chaos: A Non-Sequential Approach for Browsing Large Sets of Found Audio Data (L18-1)
Copied to clipboard
| Challenge: | a new approach to search for sound in large archives is being developed . speech and speech technology researchers struggle to access large amounts of data . |
| Approach: | They propose a method for fast and efficient non-sequential browsing of sound in large archives that we know little about . they combine audio browsing through massively multi-object sound environments and an unsupervised dimensionality reduction algorithm to search for sound in public archives. |
| Outcome: | The proposed method is shown to combine well, resulting in rapid and interpretable observations. |
PRODIS - a Speech Database and a Phoneme-based Language Model for the Study of Predictability Effects in Polish (2024.lrec-main)
Copied to clipboard
| Challenge: | acoustic predictability is operationalised by surprisal in Polish, but cross-linguistic differences depend on prosodic system. |
| Approach: | They present a speech database and a phoneme-level language model of Polish . they aim to study contextual predictability effects on acoustic distinctiveness . |
| Outcome: | The proposed model is the first large, publicly available speech database of Polish . it is based on a light GPT architecture and can be expanded to other languages . |
FARMI: A FrAmework for Recording Multi-Modal Interactions (L18-1)
Copied to clipboard
Patrik Jonell, Mattias Bystedt, Per Fallgren, Dimosthenis Kontogiorgos, José Lopes, Zofia Malisz, Samuel Mascarenhas, Catharine Oertel, Eran Raveh, Todd Shore
| Challenge: | a new framework for recording multi-modal data is needed to capture multi-party, richly recorded corpora and perform real-time processing of such data. |
| Approach: | They propose an open-source processing architecture for corpora and real-time processing . they deploy the architecture in a multi-party deception game with six humans and one robot . |
| Outcome: | The proposed architecture is agnostic to hardware and programming languages, although it's mostly written in Python. |