Papers by Yuhan Zhou

8 papers
SDiaReward: Modeling and Benchmarking Spoken Dialogue Rewards with Modality and Colloquialness (2026.acl-long)

Copied to clipboard

Challenge: SDiaReward is an end-to-end spoken dialogue system that integrates paralinguistic nuances and spontaneous nature of human conversation.
Approach: They propose an end-to-end multi-turn reward model trained on SDiaReward-Dataset . it is a collection of episode-level preference pairs targeting modality and colloquiality gaps .
Outcome: The proposed model outperforms general-purpose audio LLMs in episode-level evaluation.
A-TASC: Asian TED-Based Automatic Subtitling Corpus (2025.acl-long)

Copied to clipboard

Challenge: Existing AS corpora and primary metric SubER focus on European languages.
Approach: They propose an Asian TED-based automatic subtitling corpus derived from English TED Talks and a modification of SubER to enable reliable evaluation of subtitle quality for languages without explicit word boundaries.
Outcome: The proposed corpus is based on TED Talks audio segments, transcripts, and subtitles in Chinese, Japanese, Korean, and Vietnamese.
Is He Extroverted? Identifying Missing Relevant Personas for Faithful User Simulation (2026.eacl-srw)

Copied to clipboard

Challenge: Existing user simulation approaches focus on generating user-like responses in dialogue without verifying whether critical personas are supplied.
Approach: They propose a task of identifying persona dimensions that are relevant but missing in simulating a user's reply for a given dialogue context.
Outcome: The proposed model identifies persona dimensions that are relevant but missing in simulating a user’s response for a given dialogue context.
Beyond Transcription: Unified Audio Schema for Perception-Aware AudioLLMs (2026.findings-acl)

Copied to clipboard

Challenge: Recent Audio Large Language Models (AudioLLMs) excel at reasoning tasks, but struggle at elementary auditory perception.
Approach: They propose a framework that organizes audio information into three explicit components in a unified JSON format.
Outcome: The proposed framework boosts fine-grained perception by 10.9% on MMSU over state-of-the-art models while preserving robust reasoning capabilities.
TCSinger 2: Customizable Multilingual Zero-shot Singing Voice Synthesis (2025.findings-acl)

Copied to clipboard

Challenge: Existing zero-shot singing voice synthesis models depend on phoneme and note boundary annotations, limiting their robustness and producing poor transitions between phonemes and notes.
Approach: They propose a multi-task multilingual zero-shot SVS model with style transfer and style control based on various prompts.
Outcome: Experimental results show that TCSinger 2 outperforms baseline models in subjective and objective metrics across multiple related tasks.
Deputy: Accelerating Large Language Model Inference with Dynamic Low-Rank Substitution (2026.findings-acl)

Copied to clipboard

Challenge: Existing dynamic schemes such as early-exit and layer-drop reduce FLOPs but break batch processing or introduce KV-cache inconsistency.
Approach: They propose a dynamic low-rank substitution framework that employs a lightweight decision module at each layer to dynamically determine the execution branch for different tokens.
Outcome: The proposed model reduces computation by approximately 40% compared to the original dense model while outperforming existing baseline methods.
RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have paved the way for complex tasks such as role-playing.
Approach: They propose a framework to benchmark, elicit, and enhance role-playing abilities in Large Language Models.
Outcome: The proposed framework improves role-playing abilities with 168,093 samples.
ShieldHead: Decoding-time Safeguard for Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Recent advances in LLM-based moderation methods have demonstrated remarkable promise in identifying safety risks associated with both inputs and outputs in human-AI interactions.
Approach: They propose to learn a classification head on the last-layer hidden states of a dialogue model and use it to detect harmful content.
Outcome: The proposed framework is 300 faster (**1ms**) than previous LLM-based moderation models with 99% less parameters than LlamaGuard.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations