Papers by Tianle Liang

6 papers
Dual-Axis Generative Reward Model Toward Semantic and Turn-taking Robustness in Interactive Spoken Dialogue Models (2026.acl-long)

Copied to clipboard

Challenge: Reinforcement learning (RL) has improved text- and vision-language models, but its application in SDMs is hindered.
Approach: They propose a dual-axis Generative Reward Model that provides semantic quality and interaction timing for SDMs.
Outcome: The proposed model achieves state-of-the-art performance on interaction-quality assessment across a wide spectrum of datasets.
SDiaReward: Modeling and Benchmarking Spoken Dialogue Rewards with Modality and Colloquialness (2026.acl-long)

Copied to clipboard

Challenge: SDiaReward is an end-to-end spoken dialogue system that integrates paralinguistic nuances and spontaneous nature of human conversation.
Approach: They propose an end-to-end multi-turn reward model trained on SDiaReward-Dataset . it is a collection of episode-level preference pairs targeting modality and colloquiality gaps .
Outcome: The proposed model outperforms general-purpose audio LLMs in episode-level evaluation.
Dual-Reasoner: Bridging Interleaved Atomicity and Streaming Latency via Thinking-while-Talking (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods to integrate Chain-of-Thought into spoken dialogue models incur prohibitive latency.
Approach: They propose a Streaming Masking Mechanism to ensure uninterrupted audio streaming . they use a quadruple-constraint system to reconstruct logical atomicity .
Outcome: Experimental results show that Dual-Reasoner improves speech generation performance with low latency.
VoxMind: An End-to-End Agentic Spoken Dialogue System (2026.acl-long)

Copied to clipboard

Challenge: Existing research on end-to-end spoken dialogue models has focused on core perception and generation, with limited exploration of tool-augmented extensions.
Approach: They propose a framework to equip end-to-end spoken dialogue models with comprehensive agentic abilities by leveraging a 470-hour AgentChat dataset.
Outcome: The proposed framework outperforms Gemini-2.5-Pro on spoken agent tasks while maintaining general conversational quality.
ESC-Eval: Evaluating Emotion Support Conversations in Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Emotion Support Conversation (ESC) is a crucial application for reducing stress and providing emotional guidance.
Approach: They re-organize 2,801 role-playing cards to define roles of role-players . they train a specific role- playing model called ESC-Role which behaves more like a confused person than GPT-4 .
Outcome: The proposed model behaves more like a confused person than GPT-4, and the model performs better than GPLs.
WavAlign: Enhancing Intelligence and Expressiveness in Spoken Dialogue Models via Adaptive Hybrid Post-Training (2026.findings-acl)

Copied to clipboard

Challenge: End-to-end spoken dialogue models have higher potential ceiling in expressiveness and perceptual ability than cascaded systems.
Approach: They propose a modality-aware adaptive post-training recipe that constrains preference updates to the semantic channel and improves acoustic behavior via explicit anchoring.
Outcome: The proposed model improves speech quality and expressiveness across spoken dialogue benchmarks and architectures.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations