Papers by Duc Le
Crossing Linguistic Horizons: Finetuning and Comprehensive Evaluation of Vietnamese Large Language Models (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing open-source LLMs exhibit limited effectiveness in processing Vietnamese . lack of systematic benchmark datasets and metrics tailored for Vietnamese LLM evaluation exacerbates these issues. |
| Approach: | They propose to fine tune LLMs specifically for Vietnamese and develop a framework for evaluation . they find that larger models introduce more biases and uncalibrated outputs . |
| Outcome: | The proposed framework finetunes LLMs specifically for Vietnamese and provides a framework for evaluation . |
PRoDeliberation: Parallel Robust Deliberation for End-to-End Spoken Language Understanding (2024.findings-emnlp)
Copied to clipboard
Trang Le, Daniel Lazar, Suyoun Kim, Shan Jiang, Duc Le, Adithya Sagar, Aleksandr Livshits, Ahmed Aly, Akshat Shrivastava
| Challenge: | End-to-end models for Spoken Language Understanding have been autoregressive, resulting in higher latencies. |
| Approach: | They propose a method that uses Connectionist Temporal Classification to train robust non-autoregressive deliberation models. |
| Outcome: | The proposed method achieves 10x latency reduction over autoregressive models while preserving ability to correct ASR mistranscriptions. |
Joint Audio/Text Training for Transformer Rescorer of Streaming Speech Recognition (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies have shown that streaming end-to-end speech recognition models suffer from higher word error rates (WER) compared to non-streaming models, streaming endto-ended ASR models are limited to short audio context or not use future context to satisfy low latency constraints. |
| Approach: | They propose a 2nd-pass rescoring model on top of the 1st-pass streaming model to improve recognition accuracy while keeping latency low. |
| Outcome: | The proposed method improves word error rate significantly compared to the existing model without adding any additional parameters or latency. |