Concept-Best-Matching: Evaluating Compositionality In Emergent Communication (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluation methods do not expose compositionality of emergent communication . compositionality is a trait that enables the construction of complex meanings from the meaning of parts. |
| Approach: | They propose to find best-match between emergent words and natural language concepts to assess compositionality of emergentic communication. |
| Outcome: | The proposed algorithm provides a global score and translation-map between emergent words and natural language concepts. |
Similar Papers
Compositionality and Generalization In Emergent Languages (2020.acl-main)
Copied to clipboard
| Challenge: | a new study examines whether emergent languages possess compositionality . compositionality is a core concept in linguistics, but linguists' definitions assume full knowledge of primitive expressions and their combination rules. |
| Approach: | They propose to use compositionality to combine expressions according to systematic rules to refer to composite concepts. |
| Outcome: | The proposed language has compositionality, but it is not generalized, the authors show . they show that the more compositional a language is, the more easily it will be picked up by new learners . |
On the Correspondence between Compositionality and Imitation in Emergent Neural Communication (2023.findings-acl)
Copied to clipboard
| Challenge: | a study examining compositionality and imitation learning in a Lewis game demonstrates that it is difficult to imitate compositional languages. |
| Approach: | They explore the link between compositionality and imitation in a Lewis game . they show that the learning algorithm used to imitate is crucial . |
| Outcome: | The proposed model improves compositionality and imitation in a Lewis game . the study shows that compositional languages are easier to imitate . |
Defending Compositionality in Emergent Languages (2022.naacl-srw)
Copied to clipboard
| Challenge: | a recent paper has suggested that compositionality is a key factor in language productivity, but some research has questioned this. |
| Approach: | They argue that compositionality is essential for successful generalization . they run a two-agent communication game to test this hypothesis . |
| Outcome: | The proposed results show that ANNs can generalize well even without compositional behavior . authors argue that the results are incomplete and weak . |
Frequency & Compositionality in Emergent Communication (2025.emnlp-main)
Copied to clipboard
| Challenge: | Natural languages exhibit a universal tendency to resist regular patterns, developing idiosyncratic forms. |
| Approach: | They investigate the relationship between frequency and compositionality in emergent languages . they use a referential game setting to manipulate input frequency through Zipfian distributions . |
| Outcome: | The proposed method shows that the frequency distributions of the most frequent words resist regular patterns, resulting in less compositional structure. |
One-to-Many Communication and Compositionality in Emergent Communication (2024.emnlp-main)
Copied to clipboard
| Challenge: | Compositional languages leverage rules that derive meaning from combinations of simpler constituents. |
| Approach: | They investigate the effects of one-to-many communication environment on emergent languages where a single speaker broadcasts its message to multiple listeners to cooperatively solve a task. |
| Outcome: | The proposed model shows that broadcasting the speaker’s message to multiple listeners does not induce more compositional languages. |
Discovering Properties of Inflectional Morphology in Neural Emergent Communication (2026.acl-long)
Copied to clipboard
| Challenge: | Emergent communication studies protocols developed between two or more deep neural network-based agents . common evaluation metrics for large-vocabulary setting are overly simplified . |
| Approach: | They propose to reinterpret an EmCom setting by imposing a small-vocabulary constraint to simulate double articulation and formulating a novel setting analogous to naturalistic inflectional morphology. |
| Outcome: | The proposed model favors protocols that represent attributes with unique characters and compose them syntactically. |
The Emergence of Compositional Languages in Multi-entity Referential Games: from Image to Graph Representations (2024.emnlp-main)
Copied to clipboard
| Challenge: | Language Emergence research uses jointly trained artificial agents to solve a task. |
| Approach: | They propose a multi-entity game in which targets include multiple entities that are spatially related. |
| Outcome: | The proposed multi-entity game shows that the emergent languages exhibit a considerable degree of compositionality, but not over all features. |
Miss Tools and Mr Fruit: Emergent Communication in Agents Learning about Object Affordances (P19-1)
Copied to clipboard
| Challenge: | Recent research studies communication emergence in communities of deep network agents assigned a joint task . authors propose a game meeting many desiderata for a natural communication environment . |
| Approach: | They propose a task capturing aspects of the human environment and human conversation . they propose 'game' meeting many desiderata for a natural communication environment . |
| Outcome: | The proposed task captures aspects of human environment and human conversation, but the agents develop multiple idiolects, resulting in a common language. |
Searching for the Most Human-like Emergent Language (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing work on emergent communication systems to generate languages with high statistical similarity to human languages has not been done. |
| Approach: | They propose to optimize a signalling game-based emergent communication environment to generate state-of-the-art emergentic languages with a high degree of similarity to human language. |
| Outcome: | The proposed language generates state-of-the-art on XferBench benchmark, demonstrating its similarity to human language and entropy-minimization properties. |
Quantifying Compositionality of Classic and State-of-the-Art Embeddings (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Static word embeddings make strong claims about compositionality, but the SOTA generative models go too far in the other direction. |
| Approach: | a new study evaluates the compositionality of word embeddings by canonical correlation analysis . strong compositional signals are observed in later training stages across data modalities . |
| Outcome: | a new evaluation of compositional models shows that they exploit access meanings when justified . strong compositional signals are observed in later training stages and in deeper layers of the transformer-based model before a decline at the top layer. |