Papers by EngSiong Chng
GenTranslate: Large Language Models are Generative Multilingual Speech and Machine Translators (2024.acl-long)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have stepped forward the development of multilingual speech and machine translation by its reduced representation errors and incorporated external knowledge. |
| Approach: | They propose a generative paradigm for translation tasks that integrates the diverse translation versions in N-best list. |
| Outcome: | The proposed model outperforms the state-of-the-art model on speech and machine translation benchmarks on various languages. |
DiaSynth: Synthetic Dialogue Generation Framework for Low Resource Dialogue Applications (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing research is limited by general or niche datasets that lack sufficient scale for training dialogue systems. |
| Approach: | They propose a synthetic dialogue generation framework that uses Large Language Models and Chain of Thought reasoning to generate dynamic, domain-specific dialogues with simulated personas and diverse conversational features. |
| Outcome: | The proposed framework outperforms existing frameworks on dialogue summarization and quality increases as the size of the LLM increases from 3B to 8B. |
Listen Again and Choose the Right Answer: A New Paradigm for Automatic Speech Recognition with Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have promoted generative error correction (GER) for automatic speech recognition (ASR). |
| Approach: | They propose a multimodal LLM to receive source speech as extra input and reformat it as a cloze test with logits calibration to remove input information redundancy and simplify GER with clear instructions. |
| Outcome: | The proposed model improves on 9 popular ASR datasets and is faster than vanilla GER. |
Speaking in Wavelet Domain: A Simple and Efficient Approach to Speed up Speech Diffusion Model (2024.emnlp-main)
Copied to clipboard
Xiangyu Zhang, Daijiao Liu, Hexin Liu, Qiquan Zhang, Hanyu Meng, Leibny Paola Garcia Perera, EngSiong Chng, Lina Yao
| Challenge: | Existing approaches to enhance inference speed and training require complex modifications to the model. |
| Approach: | They propose to double the training and inference speed of Denoising Diffusion Probabilistic Models by simply redirecting the generative target to the wavelet domain. |
| Outcome: | The proposed method doubles the training and inference speed of Speech DDPMs by redirecting the generative target to the wavelet domain. |