Papers by Qingao Dong

GenGO

Omakase Read Later

Search

Papers by Qingao Dong

EMNLP

2025.emnlp-main

UI Map
structured representation of target app’s UI information
UI Map-guided LLM-based approach UICompass
UICompass
SOTA approaches
APK
Mobile task automation
general mobile tasks
mobile tasks
task execution

2025

1 papers

UICOMPASS: UI Map Guided Mobile Task Automation via Adaptive Action Generation (2025.emnlp-main)

Copied to clipboard

Yuanzhang Lin, Zhe Zhang, He Rui, Qingao Dong, Mingyi Zhou, Jing Zhang, Xiang Gao, Hailong Sun

Challenge:	Mobile task automation is an emerging technology that leverages AI to automatically execute routine tasks by users’ commands on mobile devices like Android.
Approach:	They propose a UI Map-guided LLM-based approach to automate mobile tasks using static analysis and LLMs.
Outcome:	The proposed approach achieves a 15.87% higher task execution success rate than SOTA approaches even when only APK is available.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations