| Challenge: | Alympics provides a framework for simulating human-like strategic interactions with Large Language Model (LLM) agents. |
| Approach: | They propose a framework utilizing Large Language Models (LLM) agents for empirical game theory research. |
| Outcome: | The proposed framework can be used to study human-like strategic interactions with large language model (LLM) agents in a game on the multi-round auction of scarce survival resources. |
Similar Papers
LLMsPark: A Benchmark for Evaluating Large Language Models in Strategic Gaming Contexts (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) are increasingly important for their intelligence evaluation. |
| Approach: | They propose a game theory-based evaluation platform that measures LLMs’ decision-making strategies and social behaviors in classic game-theoretic settings. |
| Outcome: | The proposed system cross-evaluates 15 leading LLMs using leaderboard rankings and scoring mechanisms. |
Towards Effective and Efficient Multi-Agent Language Model Systems: Foundations, Prospects, and Applications (2026.acl-tutorials)
Copied to clipboard
| Challenge: | Multi-agent systems powered by large language models still face challenges . tutorial focuses on three core components to build effective and efficient systems . |
| Approach: | This tutorial introduces recent advances in building effective and efficient multi-agent LLM systems . it focuses on three core components: model distillation, dynamic routing, memory- and compute efficient serving . |
| Outcome: | This tutorial introduces state-of-the-art techniques for building efficient and efficient multi-agent LLM systems . it covers coordination and communication among agents, crucial for collective performance . |
Is this the real life? Is this just fantasy? The Misleading Success of Simulating Social Interactions With LLMs (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in large language models have enabled richer social simulations . however, the role of information asymmetry in these simulations has been overlooked . |
| Approach: | They develop an evaluation framework to simulate social interactions with LLMs in different settings. |
| Outcome: | The proposed framework performs better in unrealistic, omniscient simulation settings but struggles in those with information asymmetry. |
LLM-Based Explicit Models of Opponents for Multi-Agent Games (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing approaches to model adversarial and cooperative interactions often focus on treating other agents as separate entities with their own intentions and strategies. |
| Approach: | They propose a model of opponents based on Large Language Models (LLMs) that constructs an individual model for each opponent and aligns these models working in synergy through a bi-level feedback-refinement framework. |
| Outcome: | The proposed model outperforms single-model approaches in multi-player deduction games, showing that it significantly enhances agents’ decision-making. |
AgentGym: Evaluating and Training Large Language Model-based Agents across Diverse Environments (2025.acl-long)
Copied to clipboard
Zhiheng Xi, Yiwen Ding, Wenxiang Chen, Boyang Hong, Honglin Guo, Junzhe Wang, Xin Guo, Dingwen Yang, Chenyang Liao, Wei He, Songyang Gao, Lu Chen, Rui Zheng, Yicheng Zou, Tao Gui, Qi Zhang, Xipeng Qiu, Xuanjing Huang, Zuxuan Wu, Yu-Gang Jiang
| Challenge: | Large language models (LLMs) are promising foundations to build generally-capable agents . however, the community lacks a unified interactive framework that covers diverse environments for comprehensive evaluation of agents. |
| Approach: | They propose a framework that features 7 real-world scenarios, 14 environments, and 89 tasks for unified, real-time, and concurrent agent interaction. |
| Outcome: | The proposed framework features 7 real-world scenarios, 14 environments, and 89 tasks for unified, real-time, and concurrent agent interaction. |
Dynamic Personality in LLM Agents: A Framework for Evolutionary Modeling and Behavioral Analysis in the Prisoner’s Dilemma (2025.findings-acl)
Copied to clipboard
| Challenge: | Current models rely on static personality traits but lack natural selection processes and direct psychological metrics, failing to accurately capture authentic dynamic personality variations. |
| Approach: | They propose a framework that uses game payoffs as environmental feedback to drive adaptive personality evolution and analyze correlations between personality metrics and behavior. |
| Outcome: | The proposed framework reveals new behavioral patterns of agents and evaluates personality-behavior relationships, advancing agent-based social simulations and human-AI symbiosis research. |
Learning to Play Like Humans: A Framework for LLM Adaptation in Interactive Fiction Games (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches prioritize task-specific performance metrics over human-like comprehension of narrative context and gameplay logic. |
| Approach: | They propose a framework that guides Large Language Models to learn and play IF games systematically. |
| Outcome: | The proposed framework aligns LLMs-based agents’ behavior with narrative intent and commonsense constraints to deliver more interpretable, human-like performance. |
LLMArena: Assessing Capabilities of Large Language Models in Dynamic Multi-Agent Environments (2024.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks for evaluating large language models use static datasets, leading to data leakage or overlooking the complexities of multi-agent interactions. |
| Approach: | They propose a framework that evaluates the diverse capabilities of LLM agents in multi-agent dynamic environments. |
| Outcome: | The proposed framework assesses the diverse capabilities of LLM agents in multi-agent dynamic environments. |
LLM-Based Human-Agent Collaboration and Interaction Systems: A Survey (2026.findings-acl)
Copied to clipboard
Henry Peng Zou, Wei-Chieh Huang, Yaozu Wu, Jizhou Guo, Yankai Chen, Chunyu Miao, Hoang H Nguyen, Yue Zhou, Weizhi Zhang, Liancheng Fang, Hanrong Zhang, Fangxin Wang, Pengfei Zhang, Langzhou He, Yangning Li, Dongyuan Li, Renhe Jiang, Philip S. Yu
| Challenge: | Recent advances in large language models (LLMs) have sparked growing interest in building fully autonomous agents. |
| Approach: | They propose to integrate human-provided information, feedback, or control into the agent system to enhance system performance, reliability, and safety. |
| Outcome: | The proposed systems improve system performance, reliability, and safety by integrating human-provided information, feedback, or control into the agent system. |
Theory of Mind for Multi-Agent Collaboration via Large Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent large language models (LLMs) have demonstrated impressive accomplishments in reasoning and planning, but their abilities in multi-agent collaborations remain unexplored. |
| Approach: | They propose to use explicit belief state representations to enhance task performance and the accuracy of ToM inferences for LLM-based agents. |
| Outcome: | The proposed model improves performance and accuracy of ToM inferences for LLM-based agents. |