DMSD: Dual-Modal Semantic Disentanglement for Compositional Zero-Shot Learning (2026.findings-acl)
Copied to clipboard
| Challenge: | Compositional Zero-Shot Learning (CZSL) is a new research paradigm that learns sub-concepts from seen compositions and recognizes unseen novel combinations. |
| Approach: | They propose a Dual-Modal Semantic Disentanglement framework that integrates visual and textual information to achieve effective sub-concept disentangling. |
| Outcome: | The proposed framework achieves state-of-the-art performance on three benchmark datasets . it integrates a class-centroid bridge module to guide class centroids toward the textual space . |
Similar Papers
Graph-guided Cross-composition Feature Disentanglement for Compositional Zero-shot Learning (2025.findings-acl)
Copied to clipboard
Yuxia Geng, Runkai Zhu, Jiaoyan Chen, Jintai Chen, Xiang Chen, Zhuo Chen, Shuofei Qiao, Yuxiang Wang, Xiaoliang Xu, Sheng-Jun Huang
| Challenge: | Disentanglement of visual features of primitives (i.e., attributes and objects) has shown exceptional results in Compositional Zero-shot Learning (CZSL). |
| Approach: | They propose a solution that takes multiple compositions as inputs and constrains disentangled primitive features to be general across compositions. |
| Outcome: | The proposed architecture significantly improves performance on three popular CZSL benchmarks and has been verified by solid ablation studies. |
Preserving Multi-Modal Capabilities of Pre-trained VLMs for Improving Vision-Linguistic Compositionality (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing fine-tuning approaches for compositional understanding compromise performance in zero-shot multi-modal tasks. |
| Approach: | They propose a method to enhance compositional understanding in pre-trained vision and language models without sacrificing performance in zero-shot multi-modal tasks. |
| Outcome: | The proposed method achieves compositionality on par with state-of-the-art models and retains strong multi-modal capabilities. |
SEQZERO: Few-shot Compositional Semantic Parsing with Sequential Prompts and Zero-shot Models (2022.findings-naacl)
Copied to clipboard
| Challenge: | Recent research shows promising results on combining pretrained language models with canonical utterance for few-shot semantic parsing. |
| Approach: | They propose a few-shot semantic parsing method that decomposes a problem into a sequence of sub-problems, which correspond to the sub-clauses of the formal language. |
| Outcome: | The proposed method achieves SOTA performance of BART-based models on GeoQuery and EcommerceQuery, which are two few-shot datasets with compositional data split. |
Zero-Shot Learners for Natural Language Understanding via a Unified Multiple Choice Perspective (2022.emnlp-main)
Copied to clipboard
Ping Yang, Junjie Wang, Ruyi Gan, Xinyu Zhu, Lin Zhang, Ziwei Wu, Xinyu Gao, Jiaxing Zhang, Tetsuya Sakai
| Challenge: | Existing approaches to zero-shot learning are format-agnostic and can address new learning tasks without additional training. |
| Approach: | They propose a new paradigm for zero-shot learning that is format agnostic and compatible with any format and applicable to a list of language tasks. |
| Outcome: | The proposed model shows state-of-the-art performance on several benchmarks and produces satisfactory results on tasks such as text classification and commonsense reasoning. |
Cross-Modal Masked Compositional Concept Modeling for Enhancing Visio-Linguistic Compositionality (2026.acl-long)
Copied to clipboard
| Challenge: | a contrastive learning approach for vision-language models is needed to capture compositional information. |
| Approach: | They propose a framework that masks compositional concepts in one modality and reconstructs them conditioned on full contextual information from the other . |
| Outcome: | The proposed framework enhances compositionality in visual language models and improves their ability to capture syntactic structure and linguistic information. |
Bridging Semantic and Modality Gaps in Zero-Shot Captioning via Retrieval from Synthetic Data (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for zero-shot image captioning fail to bridge the semantic gap between images and textual inputs. |
| Approach: | They propose a retrieval-based framework that leverages only existing synthetic image-text pairs as its search corpus to bridge the gap when using synthetic data for captioning. |
| Outcome: | The proposed method bridges the semantic gap between a synthetic image and its input text . it extracts image-related textual descriptions to mitigate the modality gap during decoding . |
VisLingInstruct: Elevating Zero-Shot Learning in Multi-Modal Language Models with Autonomous Instruction Optimization (2024.naacl-long)
Copied to clipboard
Dongsheng Zhu, Daniel Tang, Weidong Han, Jinghui Lu, Yukun Zhao, Guoliang Xing, Junfeng Wang, Dawei Yin
| Challenge: | Current MMLMs show impressive zero-shot abilities in multi-modal tasks, but their performance depends heavily on the quality of instructions. |
| Approach: | They propose a novel approach to advancing multi-modal language models in zero-shot learning by evaluating and optimizing instructional texts through In-Context Learning. |
| Outcome: | The proposed approach improves zero-shot performance in multi-modal tasks by evaluating and optimizing instructional texts. |
Spectral Disentanglement: Rank-Aware Task Adaptation for Rehearsal-free Continual Learning in LLMs (2026.acl-long)
Copied to clipboard
| Challenge: | Continual Learning (CL) for Large Language Models faces a fundamental Stability-Plasticity Dilemma . Rank-Blindness enforces a single rank constraint across diverse tasks, leading to catastrophic forgetting of earlier tasks and underfitting on complex new ones. |
| Approach: | They propose a rank-spectrum-based rehearsal-free framework that explicitly disentangles knowledge into two orthogonal subspaces. |
| Outcome: | The proposed framework achieves a superior stability-plasticity balance compared to single-rank baselines. |
On The Ingredients of an Effective Zero-shot Semantic Parser (2022.acl-long)
Copied to clipboard
| Challenge: | Recent studies have performed zero-shot learning by synthesizing training examples of canonical utterances and programs from a grammar, and further paraphrasing these utterrances to improve linguistic diversity. |
| Approach: | They propose to bridge gaps between canonical and real-world user-issued examples by using stronger paraphrasers and improved grammars. |
| Outcome: | The proposed model achieves strong performance on two semantic parsing benchmarks with zero labeled data. |
UniFine: A Unified and Fine-grained Approach for Zero-shot Vision-Language Understanding (2023.findings-acl)
Copied to clipboard
| Challenge: | supervised methods for vision-language tasks have been well-studied, but they lack the fine-grained information needed for semantics understanding. |
| Approach: | They propose a framework to take advantage of fine-grained information for zero-shot vision-language learning, covering multiple tasks such as VQA, SNLI-VE, and VCR. |
| Outcome: | The proposed framework outperforms previous zero-shot methods on VQA and achieves substantial improvement on SNLI-VE and VCR. |