CityVG: Contrastive Fine-Tuning and Reward-Based Chain-of-Thought Reasoning for Zero-Shot City-Scale 3D Visual Grounding (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for 3D visual grounding are limited to small-scale indoor data or require heavy supervision. |
| Approach: | They propose a contrastive fine-tuning strategy to align textual queries with urban scene graphs. |
| Outcome: | The proposed framework achieves strong zero-shot localization performance and generalizes effectively to unseen urban environments. |
Similar Papers
Z3D: Zero-Shot 3D Visual Grounding from Images (2026.acl-short)
Copied to clipboard
Nikita Drozdov, Andrey Lemeshko, Nikita Gavrilov, Anton Konushin, Danila Rukhovich, Maksim Kolodiazhnyi
| Challenge: | 3D visual grounding (3DVG) aims to localize objects in a 3D scene based on natural language queries. |
| Approach: | They propose a zero-shot 3D visual grounding pipeline that operates on multi-view images without geometric supervision and without object priors. |
| Outcome: | Experiments on ScanRefer and Nr3D show that the proposed method outperforms existing methods. |
Read Before Grounding: Scene Knowledge Visual Grounding via Multi-step Parsing (2025.coling-main)
Copied to clipboard
| Challenge: | Existing VG datasets use simple textual descriptions with limited attribute and spatial information between images and text. |
| Approach: | They propose a method that transforms visual knowledge into concise, information-dense visual descriptions. |
| Outcome: | The proposed method significantly improves performance of multimodal grounding models. |
ViGiL3D: A Linguistically Diverse Dataset for 3D Visual Grounding (2025.acl-long)
Copied to clipboard
| Challenge: | 3D visual grounding models localize entities in a scene referred to by natural language text . recent studies focused on LLM-based scaling of 3DVG datasets, but these do not capture the full range of potential prompts which could be specified in the English language. |
| Approach: | They propose a framework for linguistically analyzing 3DVG prompts and introduce a diagnostic dataset for evaluating 3D visual grounding methods against a diverse set of language patterns. |
| Outcome: | The proposed framework scales up and tests against a representative set of prompts in the english language. |
Language-to-Space Programming for Training-Free 3D Visual Grounding (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for 3D visual grounding have been proposed, but they are limited by the scarcity of 3D vision-language datasets and the high cost of annotations. |
| Approach: | They propose a method for training-free 3D visual grounding that uses LLM-generated codes to analyze 3D spatial relations among objects. |
| Outcome: | The proposed method achieves 52.9% accuracy on the Nr3D benchmark and significantly reduces grounding time and token costs. |
Revealing the Seen, Imagining the Beyond: A Survey of Image-Grounded Chain-of-Thought Reasoning in Multimodal LLMs (2026.acl-long)
Copied to clipboard
| Challenge: | Recent advances in Multimodal Large Language Models (MLLMs) have shifted visual reasoning from tool-calling to end-to-end perceptionreasoning. |
| Approach: | They synthesize the emerging paradigm of Image-Grounded Chain-of-Thought (IG-CoT) they propose a method-centric taxonomy covering prompting, supervised fine-tuning, and reinforcement learning . |
| Outcome: | The proposed model is based on a method-centric taxonomy and benchmarks. |
Datasets and Recipes for Video Temporal Grounding via Reinforcement Learning (2025.emnlp-industry)
Copied to clipboard
Ruizhe Chen, Tianze Luo, Zhiting Fan, Heqing Zou, Zhaopeng Feng, Guiyang Xie, Hansheng Zhang, Zhuochen Wang, Zuozhu Liu, Zhang Huaijian
| Challenge: | Existing methods for video temporal grounding suffer from limited temporal awareness and poor generalization. |
| Approach: | They propose a two-stage training framework that integrates supervised fine-tuning with reinforcement learning to improve both the accuracy and robustness of VTG models. |
| Outcome: | The proposed training framework outperforms existing models on multiple benchmarks on open-domain and challenging scenarios. |
CARFT: Boosting LLM Reasoning via Contrastive Learning with Annotated Chain-of-Thought-based Reinforced Fine-Tuning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to improve the reasoning performance of Large Language Models (LLMs) ignore annotated Chain-of-Thought (CoT) and incorporate unstable reasoning path sampling. |
| Approach: | They propose a Contrastive learning with annotated CoT-based Reinforced Fine-Tuning approach to enhance the reasoning performance of Large Language Models. |
| Outcome: | The proposed approach exploits annotated CoT and stabilizes the fine-tuning procedure by incorporating an additional unsupervised learning signal. |
Lexicon-Level Contrastive Visual-Grounding Improves Language Modeling (2024.findings-acl)
Copied to clipboard
| Challenge: | Neural language models (LMs) are trained on orders of magnitude more language data than human language learners receive, but without supervision from other sensory modalities that play a crucial role in human learning. |
| Approach: | They propose a grounded language learning procedure that leverages visual supervision to improve textual representations. |
| Outcome: | The proposed procedure outperforms standard language-only models in terms of learning efficiency in small and developmentally plausible data regimes and improves perplexity by around 5% on multiple language modeling tasks compared to other models trained on the same amount of text data. |
Beyond Literal Descriptions: Understanding and Locating Open-World Objects Aligned with Human Intentions (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for visual grounding rely on the assumption that the given expression must be literal . this impedes the practical deployment of agents in real-world scenarios. |
| Approach: | They propose a visual grounding task that uses intention expressions to locate foreground entities . they build a large-scale IVG dataset with free-form intention expression to promote VG . |
| Outcome: | The proposed method is based on a large-scale intention-driven visual-language (V-L) dataset with free-form intention expressions. |
AnchorSeg: Language Grounded Query Banks for Reasoning Segmentation (2026.acl-long)
Copied to clipboard
Rui Qian, Chuanhang Deng, Qiang Huang, Jian Xiong, Mingxuan Li, Yingbo Zhou, Wei Zhai, Jintao Chen, Dejing Dou
| Challenge: | Existing models rely on a single segmentation token whose hidden state implicitly encodes both semantic reasoning and spatial localization . Existing methods rely only on SEG>, which encodes semantic reasoning, limiting the model's ability to explicitly disentangle what to segment from where to segment. |
| Approach: | They propose a method which reformulates reasoning segmentation as a structured conditional generation process over image tokens conditioned on language grounded query banks. |
| Outcome: | The proposed model bridges token-level predictions and pixel-level supervision by decoupling spatial grounding from semantic reasoning through structured language grounded query banks. |