Papers by Brad Myers
Interactive Task Learning from GUI-Grounded Natural Language Instructions and Demonstrations (2020.acl-demos)
Copied to clipboard
| Challenge: | SUGILITE is an intelligent task automation agent that can learn new tasks and relevant associated concepts interactively from the user’s natural language instructions and demonstrations using GUIs. |
| Approach: | They propose to use third-party mobile apps to teach new tasks and concepts using verbal instructions and demonstrations. |
| Outcome: | The proposed system can learn new tasks and relevant concepts from user's natural language instructions and demonstrations, and it generalizes taught concepts to different contexts and task domains. |