Papers by Ryo Ishii
No Gestures Left Behind: Learning Relationships between Spoken Language and Freeform Gestures (2020.findings-emnlp)
Copied to clipboard
| Challenge: | a study of spoken language and co-speech gestures shows that it is important to model the long tail of the language-gesture distribution. |
| Approach: | They propose a method that combines adversarial learning with importance sampling to strike a balance between precision and coverage. |
| Outcome: | The proposed method outperforms state-of-the-art methods for gesture generation. |
Predicting Nods by using Dialogue Acts in Dialogue (L18-1)
Copied to clipboard
| Challenge: | Existing studies have generated nods from the final morphemes at the end of an utterance. |
| Approach: | They propose to generate head nods from Japanese dialogues using morphemes . they compile a corpus of 24 dialogues including utterance and nod information . |
| Outcome: | The proposed model outperforms a model using morpheme information in the Japanese language and shows that dialog acts can predict nods. |
Learning Language and Multimodal Privacy-Preserving Markers of Mood from Mobile Data (2021.acl-long)
Copied to clipboard
Paul Pu Liang, Terrance Liu, Anna Cai, Michal Muszynski, Ryo Ishii, Nick Allen, Randy Auerbach, David Brent, Ruslan Salakhutdinov, Louis-Philippe Morency
| Challenge: | Mental health conditions remain underdiagnosed in many countries despite access to advanced medical care . a new approach to learn mood markers from mobile data is needed to improve accuracy and improve learning from typed text. |
| Approach: | They propose to use mobile data to learn mood markers without identifying users through personal or protected attributes. |
| Outcome: | The proposed model obfuscates user identities while remaining predictive . future directions include better models and pre-learning from typed text . |
A Comparison of Praising Skills in Face-to-Face and Remote Dialogues (2022.lrec-1)
Copied to clipboard
Toshiki Onishi, Asahi Ogushi, Yohei Tahara, Ryo Ishii, Atsushi Fukayama, Takao Nakamura, Akihiro Miyata
| Challenge: | praising behavior is considered to be an important method of communication in daily life and social activities. |
| Approach: | They develop corpuses for face-to-face and remote two-party dialogues with ratings of praising skills and evaluate praising skills. |
| Outcome: | The proposed corpus clarifies how to use verbal and nonverbal behaviors for praise. |