Papers with CIR
Modeling Uncertainty in Composed Image Retrieval via Probabilistic Embeddings (2025.acl-long)
Copied to clipboard
Haomiao Tang, Jinpeng Wang, Yuang Peng, GuangHao Meng, Ruisheng Luo, Bin Chen, Long Chen, Yaowei Wang, Shu-Tao Xia
| Challenge: | Composed Image Retrieval (CIR) combines text and reference images to search for images . metric learning methods that focus on point embeddings fail to capture uncertainty in input data . |
| Approach: | They propose a framework that captures uncertainty in images and queries by Gaussian distributions in latent space rather than fixed points. |
| Outcome: | Experiments show that the proposed framework quantifies quality and semantic uncertainties . it can handle polysemy and ambiguity in search intentions, authors say . |
Exploring Compositional Image Retrieval with Hybrid Compositional Learning and Heuristic Negative Mining (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing CIR models are pre-trained on uni-modal data, resulting in unimodal data. |
| Approach: | They propose a CIR model HyCoLe-HNM with CLIP as the backbone . they use a gated fusion mechanism from a question answering model to perform compositional learning . |
| Outcome: | The proposed model achieves state-of-the-art performance on three CIR datasets . it borrows a gated fusion mechanism from a question answering model to perform compositional fusion . |
MLLM-I2W: Harnessing Multimodal Large Language Model for Zero-Shot Composed Image Retrieval (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for combining image retrieval are supervised and zero-shot . however, the challenge of mapping pseudo-words to images within the joint image-text embedding space is still a challenge. |
| Approach: | They propose a novel image-text mapping network which converts description-related image information into pseudo-word markers for precise ZS-CIR. |
| Outcome: | The proposed model improves on COCO, CIRR, and Fashion-IQ benchmarks. |
CSMCIR: CoT-Enhanced Symmetric Alignment with Memory Bank for Composed Image Retrieval (2026.findings-acl)
Copied to clipboard
Zhipeng Qian, Zihan Liang, Yufei Ma, Ben Chen, Huangyu Dai, Yiwei Ma, Jiayi Ji, Chenyi Lei, Han Li, Xiaoshuai Sun
| Challenge: | Existing approaches to search for images using single-modality are limited by representation space fragmentation. |
| Approach: | They propose a unified representation framework that achieves efficient query-target alignment . they introduce a multi-level Chain-of-Thought prompting strategy that guides MLMs to generate discriminative, semantically compatible captions for target images . |
| Outcome: | The proposed framework achieves efficient query-target alignment through synergistic components. |
Reduce Human Labor On Evaluating Conversational Information Retrieval System: A Human-Machine Collaboration Approach (2023.emnlp-main)
Copied to clipboard
| Challenge: | Evaluating conversational information retrieval systems requires a significant amount of human labor for annotation. |
| Approach: | They propose to use human annotation to calibrate evaluation results to eliminate evaluation biases. |
| Outcome: | The proposed method consumes less than 1% of human labor and achieves a consistency rate of 95%-99% with human evaluation results. |
MegaPairs: Massive Data Synthesis for Universal Multimodal Retrieval (2025.acl-long)
Copied to clipboard
Junjie Zhou, Yongping Xiong, Zheng Liu, Ze Liu, Shitao Xiao, Yueze Wang, Bo Zhao, Chen Jason Zhang, Defu Lian
| Challenge: | despite the growing demand for multimodal retrieval, there is a lack of training data. |
| Approach: | They propose a data synthesis method that leverages vision language models and open-domain images to generate high-quality data. |
| Outcome: | The proposed method outperforms baseline models on 70 more datasets and can scale up. |
TEMA: Anchor the Image, Follow the Text for Multi-Modification Composed Image Retrieval (2026.acl-long)
Copied to clipboard
| Challenge: | Composed Image Retrieval (CIR) is an image retrieval paradigm that enables users to retrieve a target image using a multimodal query that consists of a reference image and modification text. |
| Approach: | They propose a text-oriented entity mapping architecture that allows users to use a reference image and modification text to retrieve a target image. |
| Outcome: | The proposed framework is superior in both original and multi-modification scenarios while maintaining an optimal balance between retrieval accuracy and computational efficiency. |
Rethinking Composed Image Retrieval Evaluation: A Fine-Grained Benchmark from Image Editing (2026.acl-long)
Copied to clipboard
Tingyu Song, Yanzhao Zhang, Mingxin Li, Zhuoning Guo, Dingkun Long, Pengjun Xie, Siyue Zhang, Yilun Zhao, Shu Wu
| Challenge: | Composed Image Retrieval (CIR) is a complex task in multimodal understanding . current CIR benchmarks lack a robust evaluation pipeline and limited query categories . |
| Approach: | They construct a fine-grained CIR benchmark that allows for precise control over modification types and content. |
| Outcome: | The proposed benchmark covers 5,000 high-quality queries structured across five main categories and fifteen subcategories. |