R-Bind: Unified Enhancement of Attribute and Relation Binding in Text-to-Image Diffusion Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to improve semantic binding require costly retraining or focus on only correctly generating attributes of entities. Existing methods focus on correctly generating attributes, ignoring the cruciality of correctly forming relations between entities. |
| Approach: | They propose a training-free method that improves both entity-attribute and entity-relation-entity binding by introducing three inference-time optimization losses that adjust attention maps during generation. |
| Outcome: | The proposed method improves both entity-attribute and entity-relation-entity binding without additional training. |
Similar Papers
Entity or Relation Embeddings? An Analysis of Encoding Strategies for Relation Extraction (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to relation extraction use concatenating embeddings of head and tail entities . however, such representations capture the types of the entities involved, leading to false positives and confusion between relations involving entities of the same type. |
| Approach: | They propose a model which combines [MASK] embeddings with entity embedds to learn relation embeddations. |
| Outcome: | The proposed model outperforms the state-of-the-art on several benchmarks . it uses a self-supervised pre-training strategy which further improves the results. |
Ameli: Enhancing Multimodal Entity Linking with Fine-Grained Attributes (2024.eacl-long)
Copied to clipboard
| Challenge: | Experimental results show that understanding attributes of mentions from text descriptions and visual images plays a vital role in multimodal entity linking. |
| Approach: | They propose to integrate attributes into multimodal entity linking using a text-image-based knowledge base. |
| Outcome: | The proposed approach integrates attributes into disambiguation. |
Grasping the Essentials: Tailoring Large Language Models for Zero-Shot Relation Extraction (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing Relation extraction models require extensive annotated training data, which is costly and labor-intensive to collect. |
| Approach: | They propose a new zero-shot RE task where only relation definitions are provided instead of seen-unseen relation instances. |
| Outcome: | The proposed task significantly improves cost-effective zero-shot performance by large margins. |
Improving Entity Linking through Semantic Reinforced Entity Embeddings (2020.acl-main)
Copied to clipboard
| Challenge: | Existing entity embeddings are effective, but too distinctive for linking models to learn contextual commonality. |
| Approach: | They propose a method to inject fine-grained semantic information into entity embeddings . they use word embedds of type words to generate semantic embeddngs based on existing embeddables a sample of semantic information is injected into the embedded entities . |
| Outcome: | The proposed method reduces the distinctiveness of existing embeddings and improves performance. |
Improving Entity Linking by Modeling Latent Relations between Mentions (P18-1)
Copied to clipboard
| Challenge: | Entity linking systems often exploit relations between textual mentions to decide if the linking decisions are compatible. |
| Approach: | They treat relations as latent variables while optimizing the neural entity-linking model without supervision. |
| Outcome: | The proposed model outperforms its relation-agnostic version and significantly outperformed its relational version. |
Rethinking Multimodal Entity and Relation Extraction from a Translation Point of View (2023.acl-long)
Copied to clipboard
| Challenge: | Special attention is paid to the cross-modal misalignment in text-image datasets which may mislead the learning. |
| Approach: | They propose a multimodal back-translation method which uses diffusion-based generative models for pseudo-paralleled pairs and a divergence estimator to construct a high-resource corpora as a bridge for low-ressource learners. |
| Outcome: | The proposed method outperforms 14 state-of-the-art methods in both entity and relation extraction tasks. |
Boosting Textural NER with Synthetic Image and Instructive Alignment (2024.findings-acl)
Copied to clipboard
| Challenge: | Named entity recognition (NER) is a key task reliant on textual data. |
| Approach: | They propose a method to transform NER into a multimodal task by using images from the internet as auxiliaries. |
| Outcome: | The proposed method surpasses all text-only baselines and improves F1 score by 1.4% to 2.3% on prominent MNER datasets. |
Guidance-Based Prompt Data Augmentation in Specialized Domains for Named Entity Recognition (2024.acl-short)
Copied to clipboard
| Challenge: | specialized fields such as science and biology face significant challenges due to the scarcity of quality data. |
| Approach: | They propose a guidance data augmentation technique that abstracts context and sentence structure and maintains context-entity relationships for DA. |
| Outcome: | The proposed method enhances the training performance of named entity recognition tasks while maintaining context-entity relationships. |
SDA: Semantic Discrepancy Alignment for Text-conditioned Image Retrieval (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for textconditioned image retrieval are limited due to the scale of training and the complexity of attributes in modification texts. |
| Approach: | They propose a general boosting framework to address these issues by employing semantic discrepancy alignment by formulating distance consistency and neighbor consistency between the image and text domains. |
| Outcome: | The proposed framework improves retrieval performance on three prominent datasets with state-of-the-art results. |
Tailor: A Soft-Prompt-Based Approach to Attribute-Based Controlled Text Generation (2023.acl-long)
Copied to clipboard
| Challenge: | Existing work focuses on generating sentences satisfying pre-specified attributes such as topic and sentiment, yet suffers from increases in storage and inference time. |
| Approach: | They propose a method that uses a pre-trained continuous vector to generate a fixed pre-trainable language model to satisfy a specified attribute. |
| Outcome: | The proposed model can achieve improvements on eleven attribute-specific generation tasks with 0.08% extra training parameters. |