| Challenge: | In order for robots to collaborate with humans, it is important to share and understand their experiences through language. |
| Approach: | They propose a hierarchical Dirichlet Process-Spectral Mixture Latent Dirichlets Allocation model which learns the relationship between human motions and adverbs by capturing frequency kernels that represent motion characteristics and shared topics of a given aadverts. |
| Outcome: | The proposed model outperforms representative neural network models in terms of perplexity score and predicts more appropriate adverbs. |
Similar Papers
Do Trajectories Encode Verb Meaning? (2022.naacl-main)
Copied to clipboard
| Challenge: | Distributional models learn representations of words from text but lack grounding or the linking of text to the non-linguistic world. |
| Approach: | They investigate the extent to which trajectories naturally encode verb semantics . they build a procedurally generated agent-object-interaction dataset and compare methods . |
| Outcome: | The proposed model can capture verb semantics by tracing trajectories and self-supervised pretraining. |
Do Neural Language Models Inferentially Compose Concepts the Way Humans Can? (2024.lrec-main)
Copied to clipboard
| Challenge: | a new study shows that language models and humans may rely on different approaches to represent and compose lexical items across sentence structure. |
| Approach: | They propose to use a dataset to test the performance of neural language models and humans on inferentially driven conceptual compositions. |
| Outcome: | The proposed model elicits probability estimates for a noun in a minimally composed phrase . RoBERTa, BERT-large, and GPT-2 exhibited the closest resemblance to human responses . |
Predicting Reference: What do Language Models Learn about Discourse Models? (2020.emnlp-main)
Copied to clipboard
| Challenge: | a growing literature that probes neural language models to assess their latent acquisition of grammatical knowledge has not investigated their acquisition of discourse modeling ability. |
| Approach: | They draw on a psycholinguistic literature that has established how different contexts affect referential biases concerning who is likely to be referred to next. |
| Outcome: | The proposed models do not resemble human language users, the authors show . their models capture the linguistic knowledge required to perform discourse modeling . |
Deep Dungeons and Dragons: Learning Character-Action Interactions from Role-Playing Game Transcripts (N18-2)
Copied to clipboard
| Challenge: | a novel approach to understanding narratives involves modelling the interaction between characters and actions . we propose role-playing games as a testbed for inferring interactions between characters in narratives . |
| Approach: | They propose role-playing games as a testbed for learning latent ties between characters and actions . they propose to combine character and action descriptions from online discussion forums . |
| Outcome: | The proposed model can capture interactions between characters and actions in narratives . it can predict actions better when character attributes are taken into account . |
Referring Expressions in Human-Robot Common Ground: A Thesis Proposal (2024.naacl-srw)
Copied to clipboard
| Challenge: | PhD examines the processes through which common ground shapes the pragmatic use of referring expressions in human-robot interaction. |
| Approach: | They investigate the processes through which common ground shapes the pragmatic use of referring expressions in human-robot interaction. |
| Outcome: | The proposed model can model linguistic processes and resolve referring expressions using pragmatic inference. |
A Laypeople Study on Terminology Identification across Domains and Task Definitions (N18-2)
Copied to clipboard
| Challenge: | Existing studies on term annotation show that even experts differ in their understanding of termhood . |
| Approach: | They propose a new dataset of term annotation that examines the common understanding of what constitutes a term. |
| Outcome: | The proposed datasets show that even experts differ in their understanding of termhood . the findings suggest that there is a common understanding of what constitutes a term . |
Discourse Representation Structure Parsing (P18-1)
Copied to clipboard
| Challenge: | Existing semantic parsers are data-driven using annotated examples consisting of utterances and their meaning representations. |
| Approach: | They propose a method which transforms Discourse Representation Structures (DRSs) to trees and develop a structure-aware model which decomposes the decoding process into three stages. |
| Outcome: | The proposed model outperforms baseline models on the Groningen Meaning Bank (GMB) by a wide margin. |
MSCode: Advancing Human Motion-Language Understanding via Modality-Shared Codebook (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for motion understanding lack precise alignment between motion and modalities . existing methods lack precise semantics and a mismatch between motion, text . |
| Approach: | They propose a modality-shared codebook that enables unified representation learning and precise alignment between motion and linguistic modalities. |
| Outcome: | The proposed model surpasses current state-of-the-art methods in many areas . it enables unified representation learning and precise alignment of motion and modalities . |
Dissecting Generation Modes for Abstractive Summarization Models via Ablation and Attribution (2021.acl-long)
Copied to clipboard
| Challenge: | Abstractive summarization models have made great strides in recent years, but little is known about how they actually form summaries and how to understand where their decisions come from. |
| Approach: | They propose a two-step method to interpret summarization model decisions by categorizing each decoder decision into one of several generation modes. |
| Outcome: | The proposed method can identify phrases the summarization model has memorized and determine where in the training pipeline this memorization happened, and study complex generation phenomena on a per-instance basis. |
Cooperative Learning of Disjoint Syntax and Semantics (N19-1)
Copied to clipboard
| Challenge: | Existing models that learn to jointly infer an expression’s syntactic structure and its semantics fail to learn the correct parsing strategy on mathematical expressions generated from a simple context-free grammar. |
| Approach: | They propose a recursive model that learns to jointly infer an expression’s syntactic structure and its semantics without requiring a formal supervision. |
| Outcome: | The proposed model performs competitively on several natural language tasks, such as Natural Language Inference and Sentiment Analysis. |