Papers by Deheng Ye
VistaWise: Building Cost-Effective Agent with Cross-Modal Knowledge Graph for Minecraft (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have shown significant promise in embodied decision-making tasks within virtual open-world environments, but lack domain-specific knowledge. |
| Approach: | They propose a cost-effective agent framework that integrates cross-modal domain knowledge and finetunes a dedicated object detection model for visual analysis. |
| Outcome: | The proposed framework reduces the requirement for domain-specific training data from millions of samples to a few hundred. |
LLM-Based Agent Society Investigation: Collaboration and Confrontation in Avalon Gameplay (2024.emnlp-main)
Copied to clipboard
Yihuai Lan, Zhiqiang Hu, Lei Wang, Yang Wang, Deheng Ye, Peilin Zhao, Ee-Peng Lim, Hui Xiong, Hao Wang
| Challenge: | Existing studies on LLM agents' social behaviors are lacking . previous studies focused on positive social behaviors, leaving research on negative social behaviors relatively scarce. |
| Approach: | They propose a framework that features a multi-agent system facilitating efficient communication and interaction with LLM agents. |
| Outcome: | The proposed framework is based on Avalon and evaluates on game success and analyzes agents’ social behaviors. |
CausalMACE: Causality Empowered Multi-Agents in Minecraft Cooperative Tasks (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work on multi-agent collaborative tasks in Minecraft is limited due to inefficiency and limited fault tolerance. |
| Approach: | They propose a framework that incorporates causality to manage dependencies among subtasks. |
| Outcome: | The proposed framework achieves state-of-the-art performance in multi-agent cooperative tasks of Minecraft. |
Language Model Adaption for Reinforcement Learning with Natural Language Action Space (2024.acl-long)
Copied to clipboard
| Challenge: | Previous research has focused on reducing the size of the natural language action space due to the combinatorial nature of the language. |
| Approach: | They propose mutual-information regularized policy optimization to reduce the action space by dynamically adjusting the prior provided by the pretrained model. |
| Outcome: | The proposed method improves monotonically on the mutual-information regularized RL objective. |
Boosting Vulnerability Detection of LLMs via Curriculum Preference Optimization with Synthetic Reasoning Data (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) are capable of detecting software vulnerabilities, but lack of reasoning data hinders their ability to capture underlying vulnerability patterns. |
| Approach: | They propose a framework that excels at mining vulnerability patterns through reasoning data synthesizing and vulnerability-specific preference optimization. |
| Outcome: | The proposed framework improves on SVEN and PrimeVul datasets and improves 12.24%-22.77% accuracy. |
The Stackelberg Speaker: Optimizing Persuasive Communication in Social Deduction Games (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches focus on information processing and strategy selection, overlooking the significance of persuasive communication in social deduction games. |
| Approach: | They propose a reinforcement learning framework that trains agents to optimize influential utterances for persuasive impact by formalizing turn-based dialogue as a Stackelberg competition . |
| Outcome: | The proposed framework outperforms baselines across four social deduction benchmarks and shows that it is effective in persuasive communication. |