Papers by Aditya Yadavalli
Exploring the Effect of Dialect Mismatched Language Models in Telugu Automatic Speech Recognition (2022.naacl-srw)
Copied to clipboard
| Challenge: | Existing studies have found that the ASR system is susceptible to dialect variations within a language, thereby adversely affecting the APR. |
| Approach: | They propose to build a dialect-specific AM while keeping the Language Model constant for all the dialects and to reduce the degradation by 9% and 15%. |
| Outcome: | The proposed model can be built for three different Telugu regional dialects while keeping the Language Model constant for all the dialects. |
X-RiSAWOZ: High-Quality End-to-End Multilingual Dialogue Datasets and Few-shot Agents (2023.findings-acl)
Copied to clipboard
Mehrad Moradshahi, Tianhao Shen, Kalika Bali, Monojit Choudhury, Gael de Chalendar, Anmol Goel, Sungkyun Kim, Prashant Kodali, Ponnurangam Kumaraguru, Nasredine Semmar, Sina Semnani, Jiwon Seo, Vivek Seshadri, Manish Shrivastava, Michael Sun, Aditya Yadavalli, Chaobin You, Deyi Xiong, Monica Lam
| Challenge: | X-RiSAWOZ dataset has more than 18,000 human-verified dialogue utterances for each language . Xiaoping and Xinhui are the main challenges for task-oriented dialogue research . |
| Approach: | They develop a toolkit to accelerate the post-editing of a new language dataset after translation . their dataset, code, and toolkit are released open-source . |
| Outcome: | The proposed toolkit accelerates the post-editing of a new language dataset after translation. |
SLABERT Talk Pretty One Day: Modeling Second Language Acquisition with BERT (2023.acl-long)
Copied to clipboard
| Challenge: | NLP literature has not given enough attention to the phenomenon of negative transfer . positive transfer refers to the facilitating effects of one language in acquiring another and negative transfer refer to the negative effects between the learner's native [L1] and target [L2] languages. |
| Approach: | They build a Mutlilingual Age Ordered CHILDES dataset to understand the degree to which native Child-Directed Speech (CDS) can help or conflict with English language acquisition. |
| Outcome: | The proposed model enables us to understand the degree to which native Child-Directed Speech (CDS) can help or conflict with English language acquisition. |
What Do Prosody and Text Convey? Characterizing How Meaningful Information is Distributed Across Multiple Channels (2026.acl-long)
Copied to clipboard
| Challenge: | Prosody—the melody of speech—conveys critical information often not captured by the words or text of a message. |
| Approach: | They propose an information-theoretic approach to quantify how much is conveyed by prosody that is not recoverable from text alone. |
| Outcome: | The proposed framework can quantify how much is conveyed by prosody that is not recoverable from text alone and crucially, what prosody conveys. |
PARIKSHA: A Large-Scale Investigation of Human-LLM Evaluator Agreement on Multilingual and Multi-Cultural Data (2024.emnlp-main)
Copied to clipboard
| Challenge: | Evaluation of multilingual Large Language Models is challenging due to a variety of factors including the lack of benchmarks with sufficient linguistic diversity, contamination of popular benchmarks into LLM pre-training data and lack of local, cultural nuances in translated benchmarks. |
| Approach: | They evaluate 30 models across 10 Indic languages by conducting 90K human evaluations and 30K LLM-based evaluations. |
| Outcome: | The proposed models perform best in most Indic languages, while the agreement drops for direct assessment especially for Bengali and Odia. |
AccentFold: A Journey through African Accents for Zero-Shot ASR Adaptation to Target Accents (2024.findings-eacl)
Copied to clipboard
| Challenge: | AccentFold uses spatial relationships to improve speech recognition for accented speech . existing methods for accent recognition have been limited due to data scarcity and budget constraints . |
| Approach: | They propose a method that exploits spatial relationships between learned accent embeddings to improve downstream automatic speech recognition. |
| Outcome: | The proposed method outperforms baseline methods in accented speech training. |