Papers by Yasutomo Kawanishi
J-CRe3: A Japanese Conversation Dataset for Real-world Reference Resolution (2024.lrec-main)
Copied to clipboard
Nobuhiro Ueda, Hideko Habe, Akishige Yuguchi, Seiya Kawano, Yasutomo Kawanishi, Sadao Kurohashi, Koichiro Yoshino
| Challenge: | Existing studies have ground referential expressions in language to real-world objects for cooperative action generation. |
| Approach: | They propose a Japanese Conversation dataset for real-world reference resolution that ground referential expressions to visual information observed in egocentric views. |
| Outcome: | The proposed dataset contains egocentric video and dialogue audio of real-world conversations between two people acting as a master and assistant robot at home. |
A Gaze-grounded Visual Question Answering Dataset for Clarifying Ambiguous Japanese Questions (2024.lrec-main)
Copied to clipboard
| Challenge: | Visual question answering (VQA) tasks are often based on directives, which can cause ambiguities in human utterances. |
| Approach: | They propose a method that clarifies ambiguous questions using gaze information . they propose combining gaze information with gaze information to improve accuracy . |
| Outcome: | The proposed method improves performance in some cases of a GazeVQA system on Gaze. |