Papers by Hyeongseop Rha
MMS-LLaMA: Efficient LLM-based Audio-Visual Speech Recognition with Minimal Multimodal Speech Tokens (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent Large Language Model (LLM) based AVSR systems incur high computational costs due to high temporal resolution of audio-visual speech. |
| Approach: | They propose an efficient multimodal speech LLM framework that minimizes token length while preserving essential linguistic content. |
| Outcome: | The proposed approach reduces token usage by 86% while using only 3.5 tokens per second. |