Bridging the Defined and the Defining: Exploiting Implicit Lexical Semantic Relations in Definition Modeling (D19-1)
Copied to clipboard
| Challenge: | Existing definition modeling methods do not utilize lexical semantic relations between defined words and defining words. |
| Approach: | They propose definition modeling methods that use lexical semantic relations . they use unsupervised pattern-based word-pair embeddings that represent semantic relations of word pairs . |
| Outcome: | The proposed methods improve definition generation and learning embeddings from definitions. |
Similar Papers
Automatically Generated Definitions and their utility for Modeling Word Meaning (2024.emnlp-main)
Copied to clipboard
| Challenge: | Modern language models generate semantic representations for words based on context and context based models. |
| Approach: | They propose to use dictionary-like sense definitions to generate sentence embeddings . they evaluate the quality of the generated definitions on existing English benchmarks based on the results of their study . |
| Outcome: | The proposed model sets new state-of-the-art results on lexical semantics tasks compared to baselines . |
Explicit Semantic Decomposition for Definition Generation (2020.acl-main)
Copied to clipboard
| Challenge: | Existing definition generation methods rely on decoding to extract semantic components of words. |
| Approach: | They propose a method which explicitly decomposes meaning of words into semantic components and models them with discrete latent variables for definition generation. |
| Outcome: | The proposed method outperforms existing methods on WordNet and Oxford benchmarks. |
AMenDeD: Modelling Concepts by Aligning Mentions, Definitions and Decontextualised Embeddings (2024.lrec-main)
Copied to clipboard
| Challenge: | Contextualised Language Models (LMs) improve on word embeddings by encoding meaning of words in context. |
| Approach: | They propose to learn a unified embedding space in which all three types of representations can be integrated. |
| Outcome: | The proposed model outperforms existing approaches in ontology completion tasks. |
VCDM: Leveraging Variational Bi-encoding and Deep Contextualized Word Representations for Improved Definition Modeling (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches for definition modeling combine distributional and lexical semantics in an implicit rather than direct way. |
| Approach: | They propose a model that introduces a continuous latent variable to model the relationship between a phrase and its definition. |
| Outcome: | The proposed model achieves state-of-the-art performance on four challenging benchmarks and the first non-English corpus. |
Language Models and Semantic Relations: A Dual Relationship (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies on language models for the extraction of semantic relations have focused on injecting semantic knowledge into these models to enhance them. |
| Approach: | They propose to extract lexical semantic relations from a BERT model and inject them into it using unsupervised methods based on semantic similarity at word and sentence levels. |
| Outcome: | The proposed method allows to enrich a BERT model without using any external semantic resource. |
A Self-Supervised Integration Method of Pretrained Language Models and Word Definitions (2023.findings-acl)
Copied to clipboard
| Challenge: | DefBERT integrates word definition modeling with word semantics in dictionaries. |
| Approach: | They propose a method that integrates pretrained models with word semantics in dictionaries. |
| Outcome: | The proposed method is effective on word similarity and short text classification tasks. |
A Survey on Automatically-Constructed WordNets and their Evaluation: Lexical and Word Embedding-based Approaches (L18-1)
Copied to clipboard
| Challenge: | WordNets are lexical databases in which groups of synonyms are stored according to the semantic relationships between them. |
| Approach: | This paper describes various approaches to constructing WordNets automatically by leveraging traditional lexical resources and newer trends such as word embeddings. |
| Outcome: | The proposed methods leverage traditional lexical resources and newer trends such as word embeddings to build and evaluate WordNets. |
Implicit Representations of Meaning in Neural Language Models (2021.acl-long)
Copied to clipboard
| Challenge: | Neural language models (NLMs) encode lexical relations and syntactic structure, but their effectiveness is still unclear. |
| Approach: | They propose to use text as a model to model entities and situations as they evolve throughout a discourse. |
| Outcome: | The proposed models have functional similarities to linguistic models of dynamic semantics and can be learned with only text as training data. |
Open Relation Modeling: Learning to Define Relations between Entities (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing systems identify related entities but do not provide features for exploring relations between entities. |
| Approach: | They propose to teach machines to generate definition-like relation descriptions by letting them learn from defining entities. |
| Outcome: | The proposed model can generate definition-like relation descriptions that capture the representative characteristics of entities. |
How to represent a word and predict it, too: Improving tied architectures for language modelling (D18-1)
Copied to clipboard
| Challenge: | Recent state-of-the-art models use word embeddings as input and output mappings instead of tied models. |
| Approach: | They propose to decouple hidden state from word embedding prediction . they extend their proposed modification to word2vec models . |
| Outcome: | The proposed architectures achieve comparable or better results compared to previous models without tying . the proposed architecture reduces parameters, enabling more compact models and faster learning. |