Papers with Spoken-LLM
Advancing Large Language Models to Capture Varied Speaking Styles and Respond Properly in Spoken Conversations (2024.acl-long)
Copied to clipboard
| Challenge: | In spoken dialogue, even if two current turns are the same sentence, their responses might differ when they are spoken in different styles. |
| Approach: | They propose a language-to-speech dataset that can model linguistic content and speaking styles. |
| Outcome: | The proposed framework outperforms text-only baselines and prior speech LLMs methods. |