Challenge: Existing definition generation methods rely on decoding to extract semantic components of words.
Approach: They propose a method which explicitly decomposes meaning of words into semantic components and models them with discrete latent variables for definition generation.
Outcome: The proposed method outperforms existing methods on WordNet and Oxford benchmarks.

Similar Papers

Automatically Generated Definitions and their utility for Modeling Word Meaning (2024.emnlp-main)

Copied to clipboard

Challenge: Modern language models generate semantic representations for words based on context and context based models.
Approach: They propose to use dictionary-like sense definitions to generate sentence embeddings . they evaluate the quality of the generated definitions on existing English benchmarks based on the results of their study .
Outcome: The proposed model sets new state-of-the-art results on lexical semantics tasks compared to baselines .
Factorising AMR generation through syntax (N19-1)

Copied to clipboard

Challenge: Abstract Meaning Representation (AMR) is a semantic annotation framework which abstracts away from the surface form of text to capture the core 'who did what to whom' structure.
Approach: They propose to decompose the generation process into two steps: first generate a syntactic structure, and then generate the surface form.
Outcome: The proposed approach generates meaning-preserving syntactic paraphrases of the same graph, as judged by humans.
Bridging the Defined and the Defining: Exploiting Implicit Lexical Semantic Relations in Definition Modeling (D19-1)

Copied to clipboard

Challenge: Existing definition modeling methods do not utilize lexical semantic relations between defined words and defining words.
Approach: They propose definition modeling methods that use lexical semantic relations . they use unsupervised pattern-based word-pair embeddings that represent semantic relations of word pairs .
Outcome: The proposed methods improve definition generation and learning embeddings from definitions.
Definition generation for lexical semantic change detection (2024.findings-acl)

Copied to clipboard

Challenge: a number of studies have attempted to bridge the gap between lexical semantic change detection and sense-based LSCD methods.
Approach: They propose a sense distribution based LSCD method which uses contextualized word definitions as 'senses' they argue that the method preserves interpretability and allows to inspect the reasons behind a specific shift in terms of discrete definitions-as-sense.
Outcome: The proposed method outperforms previous sense-based methods on five datasets and three languages and preserves interpretability and allows to inspect the reasons behind a specific shift in terms of discrete definitions-as-senses.
Explaining novel senses using definition generation with open language models (2025.findings-emnlp)

Copied to clipboard

Challenge: We apply definition generators based on open-weights large language models to create explanations of novel senses.
Approach: They apply open-weights large language models to create explanations of novel senses using target word usages as input.
Outcome: The proposed definition generators perform on par with decoder-only models.
Definition Modelling for Appropriate Specificity (2021.emnlp-main)

Copied to clipboard

Challenge: Existing definition generation techniques have faced various problems such as the out-of-vocabulary problem and over/under-specificity problems.
Approach: They propose to leverage a pre-trained encoder-decoder model and introduce a re-ranking mechanism to model specificity in definitions.
Outcome: The proposed method significantly outperforms the state-of-the-art method on standard evaluation datasets and shows that it addresses the over/under-specificity problems.
Definition Generation for Automatically Induced Semantic Frame (2024.findings-acl)

Copied to clipboard

Challenge: Semantic frames are conceptual structures that describe specific types of situations or events.
Approach: They propose to generate frame definitions from a set of frame-evoking words using a large language model.
Outcome: The proposed task incorporates frame element reasoning as chain-of-thought to enhance the inclusion of correct frame elements in the generated definitions.
Decompose, Fuse and Generate: A Formation-Informed Method for Chinese Definition Generation (2021.naacl-main)

Copied to clipboard

Challenge: Existing definition generation methods take the source word as an indecomposable semantic unit, but in parataxis languages like Chinese, word meanings can be composed using the word formation process.
Approach: They propose to use word formation features to enhance Definition Generation (DG) in Chinese to generate an explanatory text.
Outcome: The proposed model enhances Definition Generation (DG) in Chinese by decomposing the word meaning into different semantic components.
Natural Language Generation: Recently Learned Lessons, Directions for Semantic Representation-based Approaches, and the Case of Brazilian Portuguese Language (P19-2)

Copied to clipboard

Challenge: Natural Language Generation (NLG) is a promising area in Natural Language Processing (NLP) .
Approach: They present a review of the literature on Natural Language Generation in Brazilian Portuguese.
Outcome: The proposed approaches are based on the Abstract Meaning Representation formalism and have potential future directions.
Definition Generation for Word Meaning Modeling: Monolingual, Multilingual, and Cross-Lingual Perspectives (2025.emnlp-main)

Copied to clipboard

Challenge: Recent advances in text generation have opened up new opportunities for word meaning modeling.
Approach: They extend definition generation task beyond English to a suite of 22 languages . they use Llama-based models to evaluate models in monolingual, multilingual, cross-lingual settings .
Outcome: The proposed model outperforms pretrained models in monolingual, multilingual, and cross-lingual settings.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations