Grouping Entities with Shared Properties using Multi-Facet Prompting and Property Embeddings (2025.emnlp-main)
Copied to clipboard
| Challenge: | Methods for learning taxonomies from data are well-studied, but it is difficult to use them in large domains. |
| Approach: | They propose to use LLMs to describe the different properties that are satisfied by each entity individually and then use pre-trained embeddings to cluster these properties. |
| Outcome: | The proposed model can be used to describe the properties of the entities and group them into clusters. |
Similar Papers
Modelling Commonsense Commonalities with Multi-Facet Concept Embeddings (2024.findings-acl)
Copied to clipboard
| Challenge: | Concept embeddings are a useful and efficient mechanism for injecting commonsense knowledge into downstream tasks. |
| Approach: | They propose to model commonalities in concepts by capturing a more diverse range of commonsense properties. |
| Outcome: | The proposed model captures a more diverse range of commonsense properties and improves ontology completion and ultra-fine entity typing tasks. |
A Mixture-of-Experts Model for Learning Multi-Facet Entity Embeddings (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for learning entity embeddings from text descriptions leave it to downstream applications to identify these different facets and to select the most relevant ones. |
| Approach: | They propose a model that instead learns several vectors for each entity, each of which captures a different aspect of the considered domain. |
| Outcome: | The proposed model learns several vectors for each entity, each of which intuitively captures a different aspect of the considered domain. |
Controllable Clustering with LLM-driven Embeddings (2025.emnlp-industry)
Copied to clipboard
Kerria Pang-Naylor, Shivani Manivasagan, Aitong Zhong, Mehak Garg, Nicholas Mondello, Blake Buckner, Jonathan P. Chang, Khyati Mahajan, Masoud Hashemi, Fabio Casati
| Challenge: | Unsupervised text clustering is unlikely to produce groupings that work across use cases . authors present techniques to effectively control text embeddings with minimal human input . |
| Approach: | They propose techniques to control text embeddings with minimal human input . they evaluate clustering performance for datasets with multiple independent labels . |
| Outcome: | The proposed techniques improve clustering for one perspective or use case, but at a tradeoff in performance for another use case. |
What do Deck Chairs and Sun Hats Have in Common? Uncovering Shared Properties in Large Concept Vocabularies (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing work on decontextualised concept embeddings from language models has focused on capturing taxonomic structure in concepts. |
| Approach: | They propose a strategy for identifying what different concepts have in common with others and representing them in terms of their properties. |
| Outcome: | The proposed approach improves the performance of state-of-the-art models for a multi-label classification problem. |
Multifaceted Domain-Specific Document Embeddings (2021.naacl-demos)
Copied to clipboard
| Challenge: | Current document embeddings require large training corpora but fail to learn high-quality representations when confronted with a small number of domain-specific documents and rare terms. |
| Approach: | They propose a faceted domain encoder that transforms each document into a single embedding vector . they use a Siamese neural network architecture to leverage knowledge graphs to enhance the embeddables . |
| Outcome: | The proposed model achieves the same embedding quality as state-of-the-art models while requiring only a tiny fraction of training data. |
A supervised approach to taxonomy extraction using word embeddings (L18-1)
Copied to clipboard
| Challenge: | a recent evaluation of a method for organizing texts into a hierarchy showed that it did not outperform a baseline. |
| Approach: | They propose a method that uses supervised learning to combine multiple features with a support vector machine classifier including the baseline features. |
| Outcome: | The proposed method outperforms the baseline method and provides stronger method for identifying taxonomic relations than previous methods. |
Entity or Relation Embeddings? An Analysis of Encoding Strategies for Relation Extraction (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to relation extraction use concatenating embeddings of head and tail entities . however, such representations capture the types of the entities involved, leading to false positives and confusion between relations involving entities of the same type. |
| Approach: | They propose a model which combines [MASK] embeddings with entity embedds to learn relation embeddations. |
| Outcome: | The proposed model outperforms the state-of-the-art on several benchmarks . it uses a self-supervised pre-training strategy which further improves the results. |
Group, Embed and Reason: A Hybrid LLM and Embedding Framework for Semantic Attribute Alignment (2025.emnlp-industry)
Copied to clipboard
Shramona Chakraborty, Shashank Mujumdar, Nitin Gupta, Sameep Mehta, Ronen Kat, Itay Etelis, Mohamed Mahameed, Itai Guez, Rachel Tzoref-Brill
| Challenge: | a framework to align attributes that refer to the same concept but differ across schemas is challenging in schema only settings where no instance data is available due to ambiguous names, inconsistent descriptions, and domain-specific terminologies. |
| Approach: | They propose a framework that combines contextual reasoning and embedding-based similarity to address token limitations and hallucinations. |
| Outcome: | The proposed framework scales to large schemas and shows strong performance on healthcare schemas. |
DOCENT: Learning Self-Supervised Entity Representations from Large Document Collections (2021.eacl-main)
Copied to clipboard
Yury Zemlyanskiy, Sudeep Gandhe, Ruining He, Bhargav Kanagal, Anirudh Ravula, Juraj Gottweis, Fei Sha, Ilya Eckstein
| Challenge: | Using pre-trained models, we learn to jointly predict words and entities from multiple text sources without any human supervision. |
| Approach: | They propose to learn rich self-supervised entity representations from large amounts of associated text. |
| Outcome: | The proposed models outperform baseline models on downstream tasks in the TV-Movies domain, and scale to very large corpora. |
Co-Evolving LLMs and Embedding Models via Density-Guided Preference Optimization for Text Clustering (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for text clustering use static pseudo-oracles, i.e., unidirectionally querying them for similarity assessment or data augmentation. |
| Approach: | They propose a training framework that enables bidirectional refinement between LLMs and embedding models by using task-aware prompts to guide the LLM in generating interpretations for the input texts. |
| Outcome: | Experiments on 14 benchmark datasets across 5 tasks demonstrate the effectiveness of the proposed training framework. |