Papers by Xuedong Zhang
DOC-RAG: ASR Language Model Personalization with Domain-Distributed Co-occurrence Retrieval Augmentation (2024.lrec-main)
Copied to clipboard
| Challenge: | Extensive experiments on three user-specific speech-to-text tasks show that DOC-RAG significantly outperforms strong baselines with an 8-15% improvement in terms of perplexity and a 4-7% reduction in terms in terms . of Word Error Rates. |
| Approach: | They propose a domain-distributed co-occurrence augmentation approach to improve automatic speech recognition of rare word patterns in unseen domains by using n-gram co-existence distributions. |
| Outcome: | Experiments on three user-specific speech-to-text tasks show that DOC-RAG outperforms baselines with an 8-15% improvement in terms of perplexity and a 4-7% reduction in terms in terms . of Word Error Rates. |
PersonaLM: Language Model Personalization via Domain-distributed Span Aggregated K-Nearest N-gram Retrieval Augmentation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing language modeling tools for automatic speech recognition (ASR) are difficult to personalize. |
| Approach: | They propose a domain-distributed Span-Aggregated K-nearest N-gram retrieval augmentation to improve language modeling for automatic speech recognition (ASR) personalization. |
| Outcome: | The proposed model outperforms baselines on Wikitext-103, UserLibri, and ASAP datasets with a 10-16% improvement in perplexity and a 5-8% reduction in word error rates. |