Papers by Insung Lee
Omni-Embed-Audio: Leveraging Multimodal LLMs for Robust Audio-Text Retrieval (2026.acl-long)
Copied to clipboard
| Challenge: | Experiments with AudioCaps, Clotho, and MECAT show that OEA achieves comparable text-to-text retrieval performance to state-of-the-art M2D-CLAP. |
| Approach: | They propose a retrieval-oriented encoder leveraging multimodal LLMs with native audio understanding that allows users to express their queries in five different ways. |
| Outcome: | Experiments on AudioCaps, Clotho, and MECAT show that OEA achieves comparable text-to-audio retrieval performance to state-of-the-art M2D-CLAP while demonstrating clear advantages in two critical areas. |
Diagnosis of Dysarthria Severity and Explanation Generation Using XAI-Enhanced CLINIC-GENIE on Diadochokinetic Tasks (2026.findings-eacl)
Copied to clipboard
| Challenge: | Recent deep learning approaches for dysarthria impairment severity lack interpretability essential for clinical applications. |
| Approach: | They propose a deep neural network classifier that integrates acoustic and speech embeddings with Clinically Explainable Acoustic Features (CEAFs) and a module that transforms CEAFs and their Shapley values into intuitive natural language explanations. |
| Outcome: | The proposed model achieves a balanced accuracy of 0.952 (17.3% improvement over using CEAFs alone) and certified speech-language pathologists rated explanations with an average fidelity score of 4.94, confirming enhanced clinical utility. |