Papers by Hoi-Rin Kim
Two Heads Are Better Than One: Audio-Visual Speech Error Correction with Dual Hypotheses (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent advances have introduced GER frameworks that utilize LLMs to refine ASR outputs. |
| Approach: | They propose a framework that allows a large language model to compose independent N-best hypotheses from separate automatic speech recognition (ASR) and visual speech recognition models. |
| Outcome: | The proposed framework achieves 57.7% error rate gain over standard ASR baseline, compared to single-stream approaches that achieve only 10% gain. |