More Victories, Less Cooperation: Assessing Cicero’s Diplomacy Play (2024.acl-long)
Copied to clipboard
Wichayaporn Wongkamjan, Feng Gu, Yanze Wang, Ulf Hermjakob, Jonathan May, Brandon Stewart, Jonathan Kummerfeld, Denis Peskoff, Jordan Boyd-Graber
| Challenge: | Diplomacy is a boardgame that offers a challenge for communicative and cooperative AI. |
| Approach: | They run two dozen games with Cicero and annotate in-game communication with abstract meaning representation to separate in- game tactics from general language. |
| Outcome: | The proposed method can outperform Cicero in communicating with humans, but it's difficult to deceive and persuade AI. |
Similar Papers
Personalized Help for Optimizing Low-Skilled Users’ Strategy (2025.naacl-short)
Copied to clipboard
Feng Gu, Wichayaporn Wongkamjan, Jordan Lee Boyd-Graber, Jonathan K. Kummerfeld, Denis Peskoff, Jonathan May
| Challenge: | a natural language agent generates moves and messages based on player intentions . a dozen games with novice and experienced players generate useful advice . |
| Approach: | a team of researchers augment a natural language agent to generate move and message advice . they use a game to simulate the intentions of novice and experienced players . |
| Outcome: | The enhanced agent generates move and message advice based on player intentions . the agent helps novices compete with experienced players and even surpass them . |
ASTRO: Automatic Strategy Optimization For Non-Cooperative Dialogues (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for optimizing dialogues require substantial human effort for strategy optimization. |
| Approach: | They propose a fully automated solution that leverages large language models’ self-envolving capabilities to optimize dialogue strategies. |
| Outcome: | The proposed solution significantly improves on baseline models across non-cooperative dialogue tasks, highlighting the potential for autonomously developing such agents without human intervention. |
Human Alignment: How Much Do We Adapt to LLMs? (2025.acl-short)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are becoming a common part of our lives, yet few studies have examined how they influence our behavior. |
| Approach: | They propose a cooperative language game in which players aim to converge on a word and play a game in a group. |
| Outcome: | The proposed game shows that humans notice and adapt to differences regardless of whether they are aware they are interacting with an LLM. |
Communication Enables Cooperation in LLM Agents: A Comparison with Curriculum-Based Approaches (2026.eacl-short)
Copied to clipboard
| Challenge: | a "cheap talk" channel increases cooperation in 4-player Stag Hunt, but a complex curriculum can induce "learned pessimism" in agents. |
| Approach: | They investigate whether a direct communication channel can elicit cooperation in multi-agent LLMs. |
| Outcome: | The proposed curriculum reduces agent payoffs by 27.4% in a 4-player Stag Hunt simulation. |
Should I Trust You? Detecting Deception in Negotiations using Counterfactual RL (2025.findings-acl)
Copied to clipboard
Wichayaporn Wongkamjan, Yanze Wang, Feng Gu, Denis Peskoff, Jonathan K. Kummerfeld, Jonathan May, Jordan Lee Boyd-Graber
| Challenge: | Future human-AI interaction tools can build on our methods for deception detection by triggering friction to give users a chance to interrogate suspicious proposals. |
| Approach: | They propose to use CTRL-D to detect deception in a board game called Diplomacy . CTRL is a counterfactual RL that has a good recall and almost perfect precision . future tools could build on this to reevaluate trust in suspicious negotiations . |
| Outcome: | The proposed method detects human deception with a high precision when compared to a Large Language Model approach that flags many true messages as deceptive. |
LinguaGame: A Linguistically Grounded Game-Theoretic Paradigm for Multi-Agent Dialogue Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have enabled Multi-Agent Systems (MASs) where agents interact through natural language to solve complex tasks or simulate multi-party dialogues. |
| Approach: | They propose a linguistically-grounded game-theoretic paradigm for multi-agent dialogue generation that uses a training-free equilibrium approximation algorithm to model dialogue over communicative intents and strategies. |
| Outcome: | The proposed framework improves agents’ communication efficiency by helping them convey their intended meaning more effectively through language. |
Let’s Negotiate! A Survey of Negotiation Dialogue Systems (2024.findings-eacl)
Copied to clipboard
Haolan Zhan, Yufei Wang, Zhuang Li, Tao Feng, Yuncheng Hua, Suraj Sharma, Lizhen Qu, Zhaleh Semnani Azad, Ingrid Zukerman, Reza Haf
| Challenge: | Recent research has focused on negotiation dialogue systems, but no systematic review of this task has been conducted. |
| Approach: | They propose to provide a systematic review of negotiation dialogue systems and to provide an overview of current research. |
| Outcome: | The proposed systems are based on the literature and are compared against existing systems. |
LUMINA: Long-horizon Understanding for Multi-turn Interactive Agents (2026.findings-acl)
Copied to clipboard
Amin Rakhsha, Thomas Hehn, Pietro Mazzaglia, Fabio Valerio Massoli, Arash Behboodi, Tribhuvanesh Orekondy
| Challenge: | Large language models struggle on multi-turn, long-horizon agentic problems that require skills such as planning, state tracking, and long context processing. |
| Approach: | They propose an oracle counterfactual framework for multi-turn problems that asks: how would an agent perform if it could leverage an or acle to execute a specific skill? |
| Outcome: | The proposed framework allows for precise oracle interventions without confounding effects present in real-world benchmarks. |
Emergence of Hierarchical Reference Systems in Multi-agent Communication (2022.coling-1)
Copied to clipboard
| Challenge: | a hierarchical reference system allows the selection of the most appropriate level of specificity for a given context. |
| Approach: | They propose a hierarchical reference game to study the emergence of hierarchic reference systems in artificial agents. |
| Outcome: | The proposed game shows that agents can generalize to new concepts . the hierarchical reference game is based on a simplified world . |
It Takes Two to Lie: One to Lie, and One to Listen (2020.acl-main)
Copied to clipboard
Denis Peskov, Benny Cheng, Ahmed Elgohary, Joe Barrow, Cristian Danescu-Niculescu-Mizil, Jordan Boyd-Graber
| Challenge: | Deception is a powerful tool for predicting when a lie occurs in long-lasting relationships . a functioning society is impossible without trust, but deception can be betrayed through false identities, spearphishing attacks and disinformation campaigns. |
| Approach: | They propose a dataset to analyze the use of deception in online negotiation-based game Diplomacy . it captures deceptions in long-lasting relationships where interlocutors combine truth with lies to advance objectives. |
| Outcome: | The proposed model predicts when a lie occurs nearly as well as human players. |