Fully Hyperbolic Neural Networks (2022.acl-long)

Copied to clipboard

Challenge: Existing hyperbolic neural networks encode features in the hyperbolical space yet formalize most of their operations in the tangent space.
Approach: They propose a fully hyperbolic framework to build hyperbolical networks based on the Lorentz model by adapting Lorentzer transformations to formalize essential operations of neural networks.
Outcome: The proposed framework has better performance on four NLP tasks compared with existing hyperbolic models .

Similar Papers

Lˆ2GC:Lorentzian Linear Graph Convolutional Networks for Node Classification (2024.lrec-main)

Copied to clipboard

Challenge: Existing linear GCNs perform neural network operations in Euclidean space, which do not capture tree-like hierarchical structure of graphs.
Approach: They propose a Lorentzian linear GCN framework that maps features into hyperbolic space and performs a feature transformation to capture the underlying tree-like structure of data.
Outcome: The proposed framework achieves state-of-the-art accuracy on standard citation networks datasets and 81.3% on PubMed datasets.
Neural Networks in a Product of Hyperbolic Spaces (2022.naacl-srw)

Copied to clipboard

Challenge: Recent advances in the use of hyperbolic spaces have been reported in natural language processing and graph embedding.
Approach: They propose to extend hyperbolic neural networks to a product of hyperbolical spaces by using a single hyperbolically spaced hyperbole.
Outcome: The proposed method improves graph node classification accuracy on tree-like datasets.
Enhancing Hyperbolic Knowledge Graph Embeddings via Lorentz Transformations (2024.findings-acl)

Copied to clipboard

Challenge: Existing methods for knowledge graph embedding rely on tangent approximation and are not fully hyperbolic.
Approach: They propose a fully hyperbolic KGE method that represents entities as points in the Lorentz model and represents relations as the intrinsic transformation.
Outcome: The proposed method captures various types of relations including hierarchical structures.
Knowledge Association with Hyperbolic Knowledge Graph Embeddings (2020.emnlp-main)

Copied to clipboard

Challenge: Existing methods for knowledge graphs (KGs) depend on high embedding dimensions and hierarchical structures to achieve expressiveness.
Approach: They propose a hyperbolic relational graph neural network for KG embedding and capture knowledge associations with a high-dimensional transformation.
Outcome: Experiments on entity alignment and type inference show the proposed method is effective and efficient.
A Fully Hyperbolic Neural Model for Hierarchical Multi-Class Classification (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing models for fine-grained entity typing have a hierarchical structure . prior work has integrated only explicit hierarchic information by formulating a hierarchy-aware loss or by representing instances and labels in a joint Euclidean embedding space.
Approach: They propose a fully hyperbolic model for multi-class multi-label classification that performs all operations in hyperbolical space.
Outcome: The proposed model performs all operations in hyperbolic space on two challenging datasets and shows it is comparable to state-of-the-art methods on fine-grained classification with remarkable reduction of parameter size.
HyperKGR: Knowledge Graph Reasoning in Hyperbolic Space with Graph Neural Network Encoding Symbolic Path (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for linking knowledge graphs are incomplete and rely on Euclidean embeddings . a hyperbolic GNN framework embeds recursive learning trees in hyperbolical space .
Approach: They propose a hyperbolic GNN framework that embeds recursive learning trees in hyperbolical space and generates query-specific embeddings.
Outcome: The proposed framework outperforms state-of-the-art methods on multiple benchmark datasets.
HyperExpan: Taxonomy Expansion with Hyperbolic Representation Learning (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing taxonomies have limited coverage due to expensive manual curation process.
Approach: They propose an algorithm that expands existing taxonomies to preserve their structure in a more expressive hyperbolic embedding space and learns to represent concepts and their relations with a hyperbolical Graph Neural Network.
Outcome: The proposed algorithm outperforms baseline models with representation learning in a Euclidean feature space and achieves state-of-the-art performance on the taxonomy expansion benchmarks.
Hyperbolic Geometry is Not Necessary: Lightweight Euclidean-Based Models for Low-Dimensional Knowledge Graph Embeddings (2021.findings-emnlp)

Copied to clipboard

Challenge: Recent knowledge graph embedding models based on hyperbolic geometry are complicated than Euclidean operations.
Approach: They propose to use hyperbolic geometry to generate high-fidelity and parsimonious representations of hierarchical patterns in knowledge graphs.
Outcome: The proposed models achieve state-of-the-art performance on two widely-used datasets and cost less than RotH.
Hyperbolic Graph Neural Network for Temporal Knowledge Graph Completion (2024.lrec-main)

Copied to clipboard

Challenge: Existing knowledge graph models are inefficient at capturing complex temporal dynamics and hierarchical relations within TKGs.
Approach: They propose to use hyperbolic geometry to effectively model temporal knowledge graphs . they use the hyperbolical gated Graph Neural Network and the hyperbipolar convolutional neural network .
Outcome: The proposed model achieves state-of-the-art performance on four benchmark datasets . it is compared with previous models and is expected to be useful in real-world applications .
Extracting Event Temporal Relations via Hyperbolic Geometry (2021.emnlp-main)

Copied to clipboard

Challenge: Recent neural approaches to event temporal relation extraction map events to embeddings in the Euclidean space and train a classifier to detect temporal relations between event pairs.
Approach: They propose to embed events into hyperbolic spaces to model hierarchical structures . they propose to use hyperbolical embeddings to directly infer event relations .
Outcome: The proposed architecture is based on two approaches to encode events and their temporal relations in hyperbolic spaces.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations