Inferring Concept Hierarchies from Text Corpora via Hyperbolic Embeddings (P19-1)
Copied to clipboard
| Challenge: | Using hyperbolic embeddings, we can infer concept hierarchies from distributional contexts while also being able to predict missing “is-a”-relationships and correct wrong extractions. |
| Approach: | They propose a method combining hyperbolic embeddings and Hearst patterns to set appropriate constraints for inferring “is-a” relationships from large text corpora and improve taxonomic consistency. |
| Outcome: | The proposed method achieves state-of-the-art performance on a variety of hypernymy benchmarks. |
Similar Papers
When Hearst Is not Enough: Improving Hypernymy Detection from Corpus with Distributional Models (2020.emnlp-main)
Copied to clipboard
| Challenge: | a taxonomy is a semantic hierarchy of words or concepts organized w.r.t. their hypernymy relationships. |
| Approach: | They propose a framework for hypernymy detection using large textual corpora . they quantify the non-negligible existence of specific sparsity cases . |
| Outcome: | The proposed framework quantifies the non-negligible existence of specific sparsity cases on several benchmark datasets. |
Knowledge Association with Hyperbolic Knowledge Graph Embeddings (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for knowledge graphs (KGs) depend on high embedding dimensions and hierarchical structures to achieve expressiveness. |
| Approach: | They propose a hyperbolic relational graph neural network for KG embedding and capture knowledge associations with a high-dimensional transformation. |
| Outcome: | Experiments on entity alignment and type inference show the proposed method is effective and efficient. |
Multi-Relational Hyperbolic Word Embeddings from Natural Language Definitions (2024.eacl-long)
Copied to clipboard
| Challenge: | a fundamental characteristic of natural language definitions is that they are widely abundant, pos-1. |
| Approach: | They propose a multi-relational model that explicitly leverages definitions' semantic structure to derive word embeddings. |
| Outcome: | The proposed model can preserve the semantic mapping required for interpretable traversal while imposing constraints on definitions while maintaining the recursive semantic structure. |
HyILR: Hyperbolic Instance-Specific Local Relationships for Hierarchical Text Classification (2025.acl-srw)
Copied to clipboard
| Challenge: | Hierarchical text classification models rely on capturing global label hierarchy, which contains static and redundant relationships. |
| Approach: | They propose a method which captures hierarchical relationships without encoding global hierarchy . they use hyperbolic geometry to model instance-specific local relationships using Lorentz model . |
| Outcome: | The proposed model captures hierarchical relationships without encoding global hierarchy . the proposed model is superior to baseline methods on four benchmark datasets . |
Extracting Event Temporal Relations via Hyperbolic Geometry (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent neural approaches to event temporal relation extraction map events to embeddings in the Euclidean space and train a classifier to detect temporal relations between event pairs. |
| Approach: | They propose to embed events into hyperbolic spaces to model hierarchical structures . they propose to use hyperbolical embeddings to directly infer event relations . |
| Outcome: | The proposed architecture is based on two approaches to encode events and their temporal relations in hyperbolic spaces. |
A supervised approach to taxonomy extraction using word embeddings (L18-1)
Copied to clipboard
| Challenge: | a recent evaluation of a method for organizing texts into a hierarchy showed that it did not outperform a baseline. |
| Approach: | They propose a method that uses supervised learning to combine multiple features with a support vector machine classifier including the baseline features. |
| Outcome: | The proposed method outperforms the baseline method and provides stronger method for identifying taxonomic relations than previous methods. |
Building Static Embeddings from Contextual Ones: Is It Useful for Building Distributional Thesauri? (2022.lrec-1)
Copied to clipboard
| Challenge: | contextual language models are dominant in the field of Natural Language Processing, but they are not suitable for all uses. |
| Approach: | They propose a method for building word or type-level embeddings from contextual models . they evaluate a large set of English nouns from the perspective of extracting semantic similarity relations . |
| Outcome: | The proposed method can be used to build word or type embeddings from contextual models . it can be exploited for a wide set of English nouns, showing it can improve distributional thesauri . |
Incorporating Global Contexts into Sentence Embedding for Relational Extraction at the Paragraph Level with Distant Supervision (L18-1)
Copied to clipboard
| Challenge: | Existing approaches to relation extraction (RE) only extract relations from sentences that contain two target entities. |
| Approach: | They propose to incorporate global contexts from paragraph-into-sentence embedding into RE . they propose to use a knowledge base to extract relations between pairs of entities . |
| Outcome: | The proposed approach can learn an exact RE from sentences without syntactic parsing. |
HyperExpan: Taxonomy Expansion with Hyperbolic Representation Learning (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing taxonomies have limited coverage due to expensive manual curation process. |
| Approach: | They propose an algorithm that expands existing taxonomies to preserve their structure in a more expressive hyperbolic embedding space and learns to represent concepts and their relations with a hyperbolical Graph Neural Network. |
| Outcome: | The proposed algorithm outperforms baseline models with representation learning in a Euclidean feature space and achieves state-of-the-art performance on the taxonomy expansion benchmarks. |
Identifying Emerging Concepts in Large Corpora (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing methods for text analysis are not specifically designed for identifying emergent concepts, instead applying general-purpose techniques that do not account for distinct temporal patterns associated with conceptual emergence. |
| Approach: | They propose a method to identify emerging concepts in large text corpora by analyzing changes in the heatmaps of the underlying embedding space. |
| Outcome: | The proposed method outperforms existing methods by analyzing speeches in the U.S. Senate from 1941 to 2015. |