Papers by Balaji Darur
Visual-Aware Speech Recognition for Noisy Scenarios (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing audio-only models that use visual cues for transcription struggle in noisy environments. |
| Approach: | They propose a method that correlates visual cues with noise sources to improve transcription by filtering speech from noise and predicting noise labels in video inputs. |
| Outcome: | The proposed model improves transcription by correlating noise sources to visual cues in audio inputs. |