Papers by Roozbeh Mottaghi
PIGLeT: Language Grounding Through Neuro-Symbolic Interaction in a 3D World (2021.acl-long)
Copied to clipboard
Rowan Zellers, Ari Holtzman, Matthew Peters, Roozbeh Mottaghi, Aniruddha Kembhavi, Ali Farhadi, Yejin Choi
| Challenge: | PIGLeT model learns physical commonsense knowledge through interaction, then uses this knowledge to ground language. |
| Approach: | They propose a model that learns physical commonsense knowledge through interaction . they factorize PIGLeT into a physical dynamics model and a separate language model . |
| Outcome: | The proposed model outperforms a 100x larger, text-to-text approach in forecasting language . it can read a sentence, simulate neurally what might happen next, and communicate that result through a literal symbolic representation, or natural language. |