Papers by Suzushi Tomori
Visual Grounding Annotation of Recipe Flow Graph (2020.lrec-1)
Copied to clipboard
Taichi Nishimura, Suzushi Tomori, Hayato Hashimoto, Atsushi Hashimoto, Yoko Yamakata, Jun Harashima, Yoshitaka Ushiku, Shinsuke Mori
| Challenge: | Existing studies have ground visual observations with procedural texts with graphs to understand which objects are aligned with textual descriptions. |
| Approach: | They propose to provide visual grounding annotations to recipe flow graphs by adding bounding boxes to image sequences of recipes and annotating two types of event attributes with each bounding box. |
| Outcome: | The proposed dataset gives visual grounding with workflow’s contextual information between procedural text and visual observation in an indirect manner. |