Papers by Yuntao Liu
MINED: Probing and Updating with Multimodal Time-Sensitive Knowledge for Large Multimodal Models (2026.findings-acl)
Copied to clipboard
Kailin Jiang, Ning Jiang, Yuntao Du, Yuchen Ren, Yuchen Li, Yifan Gao, Jinhe Bi, Yunpu Ma, Bin Li, Lei Liu, Qing Li
| Challenge: | Existing benchmarks for Large Multimodal Models (LMMs) are constrained by static representations, inadequately evaluating their ability to understand time-sensitive knowledge. |
| Approach: | They propose a benchmark containing 2,104 time-sensitive knowledge samples spanning six knowledge types to evaluate temporal awareness along 6 key dimensions and 11 challenging tasks. |
| Outcome: | The proposed benchmark measures temporal awareness along 6 key dimensions and 11 tasks, while most open-source LMMs still lack time understanding ability. |
M2PA: A Multi-Memory Planning Agent for Open Worlds Inspired by Cognitive Theory (2025.findings-acl)
Copied to clipboard
YanfangZhou YanfangZhou, Xiaodong Li, Yuntao Liu, Yongqiang Zhao, Xintong Wang, Zhenyu Li, Jinlong Tian, Xinhai Xu
| Challenge: | Open-world planning poses a challenge due to complex environments and task diversity . recent work shows that large language models (LLMs) lack the ability to connect to agents' experiences . |
| Approach: | They propose an open-world multi-memory planning agent that combines large language models with human-like multi-mesh systems to leverage their strengths. |
| Outcome: | The proposed agent outperforms state-of-the-art agents on 50 Minecraft tasks in zero-shot learning. |
“What Do You Mean by That?” A Parser-Independent Interactive Approach for Enhancing Text-to-SQL (2020.emnlp-main)
Copied to clipboard
| Challenge: | In Natural Language Interfaces to Databases systems, text-to-SQL parsers allow users to query databases by using natural language questions. |
| Approach: | They propose a parser-independent interactive approach that interacts with users using multi-choice questions and can easily work with arbitrary parsers. |
| Outcome: | The proposed approach improves performance with limited interaction turns by using simulation and human evaluation on two cross-domain datasets with five state-of-the-art parsers. |
Structural Reward Model: Enhancing Interpretability, Efficiency, and Scalability in Reward Modeling (2025.emnlp-industry)
Copied to clipboard
Xiaoyu Liu, Di Liang, Hongyu Shan, Peiyang Liu, Yonghao Liu, Muling Wu, Yuntao Li, Xianjie Wu, Li Miao, Jiangrong Shen, Minlong Peng
| Challenge: | Generative RMs (GRMs) lack contextual and background information during inference, leading to incomplete evaluations. |
| Approach: | They propose a modular and interpretable framework that integrates side-branch models as auxiliary feature generators. |
| Outcome: | The proposed framework outperforms scalar and saline reward models in robustness and alignment with human preferences. |
GraphDx: A Cost-Aware Knowledge-Enhanced Multi-Agent Framework for Sequential Diagnosis (2026.findings-acl)
Copied to clipboard
Shaoting Tan, Ning Liu, Yuntao Du, Shuyue Wei, Wu Shuai, Qian Li, Yanyu Xu, Wei Zhang, Lizhen Cui, Haitao Yuan
| Challenge: | Existing Large Language Models struggle to reason systematically under cost constraints . Existing approaches lack the knowledge-reasoning capability to reason under cost . |
| Approach: | They propose a knowledge-enhanced framework that leverages large language models to construct MDKGs . they propose three collaborative agents that handle language understanding and generation . |
| Outcome: | GraphDx improves diagnostic success rates from 50–68% to 79–93% while reducing test costs by 20–54%. |
Metagent-P: A Neuro-Symbolic Planning Agent with Metacognition for Open Worlds (2025.findings-acl)
Copied to clipboard
YanfangZhou YanfangZhou, Yuntao Liu, Xiaodong Li, Yongqiang Zhao, Xintong Wang, Jinlong Tian, Zhenyu Li, Xinhai Xu
| Challenge: | Recent advances in large language models (LLMs) show promising potential through their world knowledge and language processing capabilities in open-world planning. |
| Approach: | They propose a framework that integrates the world knowledge of large language models, symbolic reasoning capabilities of cognitive architectures, and metacognition to improve experience utilization. |
| Outcome: | The proposed framework outperforms current state-of-the-art methods in Minecraft and reduces the average replanning counts by 34% and exceeds the human success rate by 18.96%. |