Papers by Xueyao Zhang
Advancing Zero-shot Text-to-Speech Intelligibility across Diverse Domains via Preference Alignment (2025.acl-long)
Copied to clipboard
| Challenge: | Existing zero-shot text-to-speech systems struggle in challenging scenarios such as tongue twisters, repeated words, code-switching, and cross-lingual synthesis. |
| Approach: | They propose a dataset that leverages preference alignment techniques to improve performance . they also extend the Direct Preference Optimization framework to accommodate diverse TTS architectures . |
| Outcome: | The proposed dataset improves intelligibility, similarity, and audio quality for multiple models across domains. |
Article Reranking by Memory-Enhanced Key Sentence Matching for Detecting Previously Fact-Checked Claims (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods to detect false claims ignore the characteristics of FC-articles . claims are often quoted to describe checked events, providing lexical information . sentence templates to introduce or debunk claims are common across articles, providing pattern information. |
| Approach: | They propose a model to rerank FC-articles using key sentences and pattern information. |
| Outcome: | The proposed model outperforms existing methods on two real-world datasets showing that key sentences can be used to predict if an article fact-checks the given claim. |
MUCH: A Multimodal Corpus Construction for Conversational Humor Recognition Based on Chinese Sitcom (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing multimodal corpora for conversational humor are coarse-grained and insufficient to support the conversational comprehension task. |
| Approach: | They constructed a multimodal humor corpus based on a Chinese sitcom and used both unimodal and multimodal methods to test the corpus. |
| Outcome: | The proposed method outperforms unimodal and multimodal methods in the evaluation of a Chinese sitcom for conversational humor recognition. |
MimicLM: Zero-Shot Voice Imitation through Autoregressive Modeling of Pseudo-Parallel Speech Corpora (2026.findings-acl)
Copied to clipboard
Tao Feng, Yuxiang Wang, Yuancheng Wang, Xueyao Zhang, Dekun Chen, Chaoren Wang, Xun Guan, Zhizheng Wu
| Challenge: | Existing approaches to voice imitation use complex model design and a quality ceiling when synthetic speech is used as training *sources*. |
| Approach: | They propose a model that uses synthetic speech as training *sources* while retaining real recordings as *targets*. |
| Outcome: | The proposed model outperforms existing methods in naturalness while maintaining competitive similarity scores across speaker identity, accent, and emotion dimensions. |
Zoom Out and Observe: News Environment Perception for Fake News Detection (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods for fake news detection "zoom in" to verify content with knowledge sources or check readers’ replies to posts but neglect information in the external news environment where a fake news post is created and disseminated. |
| Approach: | They propose a framework to capture news environment signals and a module to perceive useful signals and assist final prediction. |
| Outcome: | The proposed framework can improve the performance of basic fake news detectors by capturing the environmental signals of news posts and analyzing the results. |
Closing the Modality Reasoning Gap for Speech Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Recent advances in Speech Large Language Models have a modality reasoning gap that is not addressed by prior work. |
| Approach: | They propose a reinforcement-learning framework that aligns text-conditioned and speech-conditioned trajectories through an asymmetric reward design. |
| Outcome: | Experiments on MMSU and OBQA show that the proposed framework narrows the modality reasoning gap and achieves state-of-the-art performance among 7B-scale Speech LLMs. |