Representations of Meaning in Neural Networks for NLP: a Thesis Proposal (2021.naacl-srw)
Copied to clipboard
| Challenge: | Neural networks are the state-of-the-art method of machine learning for many problems in NLP. |
| Approach: | They propose to examine the distribution of meaning in the vector space representation of words in neural networks trained for NLP tasks. |
| Outcome: | The proposed method would be compatible with distributional hypothesis, structuralism, and semantic holism. |
Similar Papers
On learning and representing social meaning in NLP: a sociolinguistic perspective (2021.naacl-main)
Copied to clipboard
| Challenge: | linguistic variation allows for the expression of social meaning, information about the social background and identity of the language user. |
| Approach: | They introduce the concept of social meaning to NLP and discuss how sociolinguistics can inform work on representation learning in NLP. |
| Outcome: | The proposed model can be used to learn social meaning in NLP and identify key challenges. |
Meaning Representations for Natural Languages: Design, Models and Applications (2024.lrec-tutorials)
Copied to clipboard
| Challenge: | a tutorial reviews the design of common meaning representations and SoTA models for predicting meaning representation. |
| Approach: | This tutorial reviews the design of common meaning representations and SoTA models for predicting meaning representation. authors propose a cutting-edge, full-day tutorial for all stakeholders in the AI community. |
| Outcome: | This tutorial reviews the design of common meaning representations and SoTA models for predicting meaning representation models . it also reviews the applications of meaning representation in downstream NLP tasks and real-world applications . |
Implicit Representations of Meaning in Neural Language Models (2021.acl-long)
Copied to clipboard
| Challenge: | Neural language models (NLMs) encode lexical relations and syntactic structure, but their effectiveness is still unclear. |
| Approach: | They propose to use text as a model to model entities and situations as they evolve throughout a discourse. |
| Outcome: | The proposed models have functional similarities to linguistic models of dynamic semantics and can be learned with only text as training data. |
A Survey of Meaning Representations – From Theory to Practical Utility (2024.naacl-long)
Copied to clipboard
| Challenge: | Symbolic meaning representations of natural language text have been studied since at least the 1960s . with the availability of large annotated corpora, the field has recently seen several new developments . |
| Approach: | They propose a framework for expressing meaning in natural language text using annotated corpora and a set of tools for machine learning. |
| Outcome: | The frameworks are based on a set of theoretical and practical problems and their applications. |
Meaning Representations for Natural Languages: Design, Models and Applications (2022.emnlp-tutorials)
Copied to clipboard
| Challenge: | This tutorial reviews the design of common meaning representations and SoTA models for predicting meaning representation models. |
| Approach: | This tutorial reviews the design of common meaning representations and SoTA models for predicting meaning representation models. |
| Outcome: | This tutorial reviews the design of common meaning representations and SoTA models for predicting meaning representation models . it also reviews the applications of meaning representation in downstream NLP tasks and real-world applications . |
Climbing towards NLU: On Meaning, Form, and Understanding in the Age of Data (2020.acl-main)
Copied to clipboard
| Challenge: | a priori, large neural language models are described as understanding or capturing meaning on tasks that are ostensibly meaningsensitive. |
| Approach: | They argue that a system trained only on form has no way to learn meaning . they argue that this is due to a misunderstanding of the relationship between form and meaning - which is a misconception in NLP . |
| Outcome: | The proposed model can't learn meaning because it only uses form as training data, the authors argue . they argue that a clear understanding of the distinction between form and meaning will guide the field towards better science around natural language understanding. |
On the Importance of Distinguishing Word Meaning Representations: A Case Study on Reverse Dictionary Mapping (N19-1)
Copied to clipboard
| Challenge: | Sense representations target meaning conflation deficiency but their potential impact has not been investigated in downstream NLP applications. |
| Approach: | They propose to use a reverse dictionary system to address meaning conflation deficiency . they propose to integrate senses into the system to improve semantic understanding . |
| Outcome: | The proposed approach can improve the performance of a downstream NLP application. |
Exploiting Semantics in Neural Machine Translation with Graph Convolutional Networks (N18-2)
Copied to clipboard
| Challenge: | Semantic representations have long been argued as potentially useful for enforcing meaning preservation and improving generalization performance of machine translation methods. |
| Approach: | They propose to integrate semantic representations into neural machine translation by injecting a semantic bias into sentence encoders and achieving improvements in BLEU scores. |
| Outcome: | The proposed representations achieve better BLEU scores over the linguistic-agnostic and syntax-aware versions on the English–German language pair. |
The Emergence of Semantics in Neural Network Representations of Visual Information (N18-2)
Copied to clipboard
| Challenge: | Convolutional neural networks learn about semantics through corpora, but they must be shared . a recent study shows that concepts exist independently of language . |
| Approach: | They employ techniques previously used to detect semantic representations in the human brain to detect representations of CNNs. |
| Outcome: | The proposed techniques could be used to combat adversarial attacks on CNNs, the authors say . |
Interpretability and Analysis in Neural NLP (2020.acl-tutorials)
Copied to clipboard
| Challenge: | a tutorial aims to introduce the nascent field of interpretability and analysis of neural networks in NLP . |
| Approach: | This tutorial will introduce the nascent field of interpretability and analysis of neural networks in NLP. |
| Outcome: | This tutorial will introduce the nascent field of interpretability and analysis of neural networks in NLP. |