Challenge: Existing approaches to cross-modal image-text retrieval struggle with nuanced cross-modal relationships.
Approach: They propose a set-based approach that represents each sample with multiple embeddings to capture nuanced and diverse relationships.
Outcome: The proposed method achieves state-of-the-art performance on MS-COCO and Flickr30k without external data.

Similar Papers

Retrieve Fast, Rerank Smart: Cooperative and Joint Approaches for Improved Cross-Modal Retrieval (2022.tacl-1)

Copied to clipboard

Challenge: Current approaches to cross-modal retrieval process text and visual input jointly . current approaches are pretrained from scratch and suffer from huge retrieval latency and inefficiency issues .
Approach: They propose a cooperative retrieve-and-rerank framework that turns pretrained text-image multi-modal models into efficient retrieval models.
Outcome: The proposed framework improves retrieval performance over current approaches . it uses twin networks to encode all items of a corpus and a cross-encoder component for a more nuanced ranking .
A Strong and Robust Baseline for Text-Image Matching (P19-2)

Copied to clipboard

Challenge: Text-image matching is one of the most popular methods for training text-image embeddings.
Approach: They propose to use a kNN-margin loss that utilizes hard negatives and is robust to noise . they advocate using Inverted Softmax and Cross-modal Local Scaling during inference .
Outcome: The proposed loss function is robust to noise and pseudo negatives are tolerable . the proposed loss functions improve scores of all metrics by a large margin .
Pre-training Cross-Modal Retrieval by Expansive Lexicon-Patch Alignment (2024.lrec-main)

Copied to clipboard

Challenge: Recent large-scale vision-language pre-training relies on image-text global alignment by contrastive learning and is further boosted by fine-grained alignment in a weakly contrastive manner for cross-modal retrieval.
Approach: They propose expansive lexicon-patch alignment (ELA) to align image patches with a vocabulary rather than only the words explicitly in the text for annotation-free alignment and information augmentation.
Outcome: The proposed method outperforms state-of-the-art methods on cross-modal retrieval and can learn representative fine-grained information.
CART: A Generative Cross-Modal Retrieval Framework With Coarse-To-Fine Semantic Modeling (2025.acl-long)

Copied to clipboard

Challenge: Cross-modal retrieval tasks are used to retrieve data from one modality or another based on a query from another modality.
Approach: They propose a generative cross-modal retrieval framework based on coarse-to-fine semantic modeling . they propose combining K-Means and RQ-VAE to discretize multimodal data into token sequences that support autoregressive generation.
Outcome: The proposed framework achieves excellent performance and efficiency in multimodal retrieval tasks.
Cross-Modal Discrete Representation Learning (2022.acl-long)

Copied to clipboard

Challenge: a new framework for learning representations from multimodal data is proposed . the proposed framework uses discretized embedding vectors to capture finer levels of granularity .
Approach: They propose a self-supervised representation learning framework that captures finer levels of granularity across different modalities.
Outcome: The proposed representation can capture finer levels of granularity across different modalities . it can be used on cross-modal retrieval tasks without direct supervision .
Text-to-Multimodal Retrieval with Bimodal Input Fusion in Shared Cross-Modal Transformer (2024.lrec-main)

Copied to clipboard

Challenge: Multimodal video retrieval systems are needed for multimodal content retrieval . multimodal video search systems are sub-optimal for multi-modal content representations .
Approach: They propose a model that learns retrieval cues for the textual query from multiple modalities and a shared embedding space with task-specific contrastive loss functions.
Outcome: The proposed model outperforms state-of-the-art methods on the MSR-VTT and YouCook2 datasets and shows significant improvements from baseline.
Cross-Modal Retrieval Augmentation for Multi-Modal Classification (2021.findings-emnlp)

Copied to clipboard

Challenge: Recent advances in using retrieval components over external knowledge sources have shown impressive results for a variety of downstream tasks in natural language processing.
Approach: They propose a retrieval-augmented multi-modal transformer architecture for embedding images and captions in the same space.
Outcome: The proposed approach improves visual question answering over strong baselines and hot-swapping indices.
Cross-Modal Attribute Insertions for Assessing the Robustness of Vision-and-Language Learning (2023.acl-long)

Copied to clipboard

Challenge: Existing approaches to model multimodal data do not leverage cross-modal information . augmenting input text using cross-module attribute insertions results in poor performance .
Approach: They propose a multimodal deep learning approach that adds visual attributes to inputs to enhance model robustness.
Outcome: The proposed approach is modular, controllable, and task-agnostic.
Beyond Single Representations: Multi-Model Embedding Fusion for Stable Text Classification (2026.acl-long)

Copied to clipboard

Challenge: Existing studies on embedding fusion have not evaluated the effectiveness of individual layers or the impact of combining embeddables from multiple models.
Approach: They propose to combine embeddings from multiple models to improve performance across NLP tasks.
Outcome: The proposed method improves performance on low-resource datasets and reduces the impact of any single model as the number of integrated models increases.
IDC: Boost Text-to-image Retrieval via Indirect and Direct Connections (2024.lrec-main)

Copied to clipboard

Challenge: Dual Encoders (DE) and Cross Attention (CA) frameworks for image and text retrieval are more accurate but slower.
Approach: They propose a dual encoders-based approach to map image and text inputs into a coordinated representation space and calculate their similarity directly.
Outcome: Extensive experiments on the MSCOCO and Flickr30K datasets validate the effectiveness of the proposed methods.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations