Papers by Hira Dhamyal
R-BASS : Relevance-aided Block-wise Adaptation for Speech Summarization (2024.findings-naacl)
Copied to clipboard
| Challenge: | End-to-end speech summarization on long recordings is challenging because of the high computational cost. |
| Approach: | They propose a new relevance-aware block-wise adaptation method that automatically estimates block relevance based on lexical and semantic similarity between transcript and summary. |
| Outcome: | The proposed method can drop 86.3 % of blocks while maintaining comparable performance. |
On the Evaluation of Speech Foundation Models for Spoken Language Understanding (2024.findings-acl)
Copied to clipboard
Siddhant Arora, Ankita Pasad, Chung-Ming Chien, Jionghao Han, Roshan Sharma, Jee-weon Jung, Hira Dhamyal, William Chen, Suwon Shon, Hung-yi Lee, Karen Livescu, Shinji Watanabe
| Challenge: | Spoken language understanding evaluation (SLUE) benchmarks are used to benchmark complex spoken language understanding tasks on natural speech. |
| Approach: | They propose a set of benchmark tasks to evaluate spoken language understanding on natural speech . they use pre-trained speech foundation models to evaluate the utility of different SFMs . |
| Outcome: | The proposed framework outperforms pre-trained speech foundation models on natural speech . the proposed framework also outperformed self-supervised SFMs on the sequence generation tasks . |