Benjamin Kolb, Leon Lang, Henning Bartsch, Arwin Gansekoele, Raymond Koopmanschap, Leonardo Romor, David Speck, Mathijs Mul, Elia Bruni
| Challenge: | Previous research into agent communication has shown that a pre-trained guide can speed up the learning process of an imitation learning agent. |
| Approach: | They extend one-directional communication by a one-bit communication channel from the learner back to the guide and limit the guidance by penalizing the learners for these requests. |
| Outcome: | The proposed guide can speed up the learning process of an imitation learning agent by providing the learner with discrete messages in an emerged language about how to solve the task. |
Similar Papers
Emergent Language-Based Coordination In Deep Multi-Agent Systems (2022.emnlp-tutorials)
Copied to clipboard
| Challenge: | Pre-trained deep networks are the standard building blocks of modern AI applications. |
| Approach: | This tutorial will introduce deep net emergent communication and discuss current shortcomings . participants will implement and analyze two emergentic communication setups from the literature . |
| Outcome: | The presentation will cover various topics from the present and recent past, as well as discussing current shortcomings and suggest future directions. |
Improving Natural Language Interaction with Robots Using Advice (N19-1)
Copied to clipboard
| Challenge: | Recent studies focus on learning models for physically grounded language understanding tasks such as the blocks world domain. |
| Approach: | They propose a protocol for including advice, high-level observations about the task, which can help constrain the agent’s prediction. |
| Outcome: | The proposed approach can be extended to include advice, high-level observations about the task, and reduce the effort involved in supplying the advice. |
Countering Language Drift via Visual Grounding (D19-1)
Copied to clipboard
| Challenge: | Emergent multi-agent communication protocols are different from natural language . a long-standing goal of artificial intelligence research is to develop agents that can cooperate with other agents . |
| Approach: | They propose to use syntactic and semantic constraints to improve communication . they propose to combine these constraints with auxiliary training constraints to reduce language drift . |
| Outcome: | a new study shows that pre-trained agents retain English syntax while learning to convey intended meaning . the proposed training constraints can be used to mitigate language drift . |
Language Guided Exploration for RL Agents in Text Environments (2024.findings-naacl)
Copied to clipboard
| Challenge: | Real-world sequential decision making is characterized by sparse rewards and large decision spaces. |
| Approach: | They introduce a language-based framework that provides decision-level guidance to an RL agent. |
| Outcome: | The proposed framework outperforms vanilla RL agents on ScienceWorld in 2022. |
Context Shapes Emergent Communication about Concepts at Different Levels of Abstraction (2024.lrec-main)
Copied to clipboard
| Challenge: | Concept-level reference game allows speakers to communicate concepts at different levels of abstraction and in different contexts. |
| Approach: | They use a symbolic dataset that disentangles concept type and context to study the influence of these factors on the emerging language. |
| Outcome: | The proposed model disentangles concept type and context to study the communication of concepts at different levels of abstraction and in different contexts. |
Emergent Communication Pretraining for Few-Shot Machine Translation (2020.coling-main)
Copied to clipboard
| Challenge: | state-of-the-art models that rely on multilingual pretrained encoders achieve sample efficiency in downstream applications, but lack abundant amounts of unlabelled text. |
| Approach: | They propose a method to pretrain neural networks via emergent communication from referential games by grounding communication on images as a crude approximation of real-world environments. |
| Outcome: | The proposed method significantly improves machine translation in few-shot settings and provides an evaluation protocol to probe the properties of emergent languages ex vitro. |
Co-evolution of language and agents in referential games (2021.eacl-main)
Copied to clipboard
| Challenge: | Referential games allow neural agents to learn language, but they do not take into account the learning biases of the learners. |
| Approach: | They propose to model cultural and architectural evolution in a population of agents to take into account learning biases of the language learners and let them co-evolve. |
| Outcome: | The proposed model outperforms cultural transmission in a population of agents and takes into account learning biases of the learners. |
Communicating in Emergent Language with an Induced Morphological Phrasebook (2026.acl-long)
Copied to clipboard
| Challenge: | a major challenge in studying emergent languages is interpreting how they convey meaning-neural networks may invent communication systems lacking features of human language. |
| Approach: | They build rule-based emergent language agents using form-meaning mappings induced from ELs and test their communicative performance in the EL environment. |
| Outcome: | The proposed model shows that EL agents rely on repetition and morpheme ordering to convey meaning. |
Communication Drives the Emergence of Language Universals in Neural Agents: Evidence from the Word-order/Case-marking Trade-off (2023.tacl-1)
Copied to clipboard
| Challenge: | Existing models of language learning with neural agents lack appropriate cognitive biases in artificial learners. |
| Approach: | They propose a framework where speaking and listening agents learn a miniature language via supervised learning and optimize it for communication via reinforcement learning. |
| Outcome: | The proposed framework replicates the word-order/case-marking trade-off without hard-coding biases in the agents. |
EGG: a toolkit for research on Emergence of lanGuage in Games (D19-3)
Copied to clipboard
| Challenge: | Existing approaches to simulating language emergence among deep neural agents are challenging due to the discrete nature of communication. |
| Approach: | They propose a toolkit that greatly simplifies the implementation of emergent-language communication games. |
| Outcome: | The proposed toolkit simplifies the implementation of emergent-language communication games. |