Papers by Clara Rivera

8 papers
Multimodal Pretraining for Dense Video Captioning (2020.aacl-main)

Copied to clipboard

Challenge: a billion hours of videos are being watched on YouTube every day . videos are difficult to skim through, making it harder to quickly target the relevant part(s) of a video.
Approach: They propose to use a video timeline tag dataset to generate time-stamped annotations for videos . they propose to pretrain and finetune captioning models using YouCook2 and ViTT .
Outcome: The proposed model generalizes well and is robust over a wide variety of instructional videos.
Connecting Language Technologies with Rich, Diverse Data Sources Covering Thousands of Languages (2024.lrec-main)

Copied to clipboard

Challenge: Existing data sources for many thousands of languages are rich and diverse . Efforts are ongoing to extend technology to many more of the world's languages .
Approach: They provide an overview of some of the major online data sources available for thousands of languages.
Outcome: The proposed language technologies are based on the data available for thousands of languages.
TaTA: A Multilingual Table-to-Text Dataset for African Languages (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing data-to-text generation datasets are limited to English and a small number of other languages.
Approach: They create the first large multilingual table-to-text dataset with a focus on African languages.
Outcome: The proposed dataset includes 8,700 examples in nine languages including four African languages and a zero-shot test language.
Open-source Multi-speaker Corpora of the English Accents in the British Isles (2020.lrec-1)

Copied to clipboard

Challenge: Using a dataset of high-quality audio, the authors examine the accents of 120 volunteers in the British Isles.
Approach: They present a dataset of high-quality audio of English sentences recorded by volunteers with different accents of the British Isles.
Outcome: The transcribed audio includes pronunciations of global locations, major airlines and common personal names in different accents.
Open-source Multi-speaker Speech Corpora for Building Gujarati, Kannada, Malayalam, Marathi, Tamil and Telugu Speech Synthesis Systems (2020.lrec-1)

Copied to clipboard

Challenge: We present free high quality multi-speaker speech corpora for Gujarati, Kannada, Malayalam, Marathi, Tamil and Telugu . the datasets are primarily intended for use in text-to-speech applications, such as constructing multilingual voices or language adaptation.
Approach: They present a free high quality multi-speaker speech corpora for Gujarati, Kannada, Malayalam, Marathi, Tamil and Telugu . they use it to build a multilingual text-to-speech model that can be scaled to other languages of interest.
Outcome: The proposed model produces good quality voices with MOS > 3.6 for all the languages tested.
Writing System and Speaker Metadata for 2,800+ Language Varieties (2022.lrec-1)

Copied to clipboard

Challenge: Currently, language technologies are easily available in only a small minority of the world's 7,000+ language varieties.
Approach: They propose to use an open-source dataset to provide the writing system(s) for each of the 2,800+ languages used in the world today and an estimated speaker count for each.
Outcome: The dataset provides the attested writing system(s) for each of these 2,800+ varieties, as well as an estimated speaker count for each variety.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations