Papers by Ankur Gandhe
Align-SLM: Textless Spoken Language Models with Reinforcement Learning from AI Feedback (2025.acl-long)
Copied to clipboard
Guan-Ting Lin, Prashanth Gurunath Shivakumar, Aditya Gourav, Yile Gu, Ankur Gandhe, Hung-yi Lee, Ivan Bulyko
| Challenge: | Textless Spoken Language Models lag behind text-based Large Language Model (LLM) in semantic coherence and relevance. |
| Approach: | They propose a framework that leverages preference optimization inspired by Reinforcement Learning with Human Feedback to enhance the semantic understanding of SLMs. |
| Outcome: | The proposed framework achieves state-of-the-art performance of SLMs for most benchmarks . it leverages preference optimization inspired by Reinforcement Learning with Human Feedback . |
Multi-Modal Retrieval For Large Language Model Based Speech Recognition (2024.findings-acl)
Copied to clipboard
Aditya Gourav, Jari Kolehmainen, Prashanth Shivakumar, Yile Gu, Grant Strimel, Ankur Gandhe, Ariya Rastrow, Ivan Bulyko
| Challenge: | kNN-LM and cross-attention techniques are used to extend text based retrieval to other modalities . wide adoption of large language models has driven new application areas leveraging this technology . |
| Approach: | They propose to use kNN-LM and cross-attention techniques to extend text retrieval methods to other modalities. |
| Outcome: | The proposed methods outperform text-based retrieval and improve word error rate on a speech recognition dataset. |
Attention-based Contextual Language Model Adaptation for Speech Recognition (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing language models do not incorporate utterance level contextual information . however, for some domains like voice assistants, additional context provides a rich input signal . |
| Approach: | They propose a method for training neural speech recognition models on text and contextual data. |
| Outcome: | The proposed model reduces perplexity by 7.0% relative over a standard LM . it also improves perxicity by 2.8% relative to a state-of-the-art model for contextual LM. |
Neural Text Normalization with Subword Units (N19-2)
Copied to clipboard
| Challenge: | Text normalization (TN) is an important step in conversational systems. |
| Approach: | They frame text normalization as a machine translation task and tackle it with sequence-to-sequence models. |
| Outcome: | The proposed model normalizes written text to its spoken form to facilitate speech recognition and text-to-speech synthesis. |