Papers by Xiaoxue Zang
PhotoChat: A Human-Human Dialogue Dataset With Photo Sharing Behavior For Joint Image-Text Modeling (2021.acl-long)
Copied to clipboard
| Challenge: | PhotoChat contains 12k dialogues, each of which is paired with a user photo that is shared during the conversation. |
| Approach: | They propose to use PhotoChat to facilitate research on image-text modeling by combining a photo-sharing intent prediction task and a picture retrieval task to retrieve the most relevant photo according to the dialogue context. |
| Outcome: | The proposed tasks achieve 10.4% recall@1 and 58.1% F1 scores, indicating that the proposed dataset presents interesting yet challenging real-world problems. |
Translating Navigation Instructions in Natural Language to a High-Level Plan for Behavioral Robot Navigation (D18-1)
Copied to clipboard
Xiaoxue Zang, Ashwini Pokle, Marynel Vázquez, Kevin Chen, Juan Carlos Niebles, Alvaro Soto, Silvio Savarese
| Challenge: | Existing models for translating free-form natural language instructions to a high-level plan for behavioral robot navigation are difficult due to the variability in the way people describe routes. |
| Approach: | They propose an end-to-end deep learning model for translating free-form natural language instructions to a high-level plan for robot navigation. |
| Outcome: | The proposed model significantly outperforms baseline approaches on a new dataset containing 10,050 pairs of navigation instructions. |