AnchorSeg: Language Grounded Query Banks for Reasoning Segmentation (2026.acl-long)
Copied to clipboard
Rui Qian, Chuanhang Deng, Qiang Huang, Jian Xiong, Mingxuan Li, Yingbo Zhou, Wei Zhai, Jintao Chen, Dejing Dou
| Challenge: | Existing models rely on a single segmentation token whose hidden state implicitly encodes both semantic reasoning and spatial localization . Existing methods rely only on SEG>, which encodes semantic reasoning, limiting the model's ability to explicitly disentangle what to segment from where to segment. |
| Approach: | They propose a method which reformulates reasoning segmentation as a structured conditional generation process over image tokens conditioned on language grounded query banks. |
| Outcome: | The proposed model bridges token-level predictions and pixel-level supervision by decoupling spatial grounding from semantic reasoning through structured language grounded query banks. |
Similar Papers
Towards Better Context-aware Lexical Semantics:Adjusting Contextualized Representations through Static Anchors (2020.emnlp-main)
Copied to clipboard
| Challenge: | Recent research has shown that contextualized models generate dynamic embeddings for words in context, but static embedds are often overlooked in this trend towards contextualized modeling. |
| Approach: | They propose a method that learns a transformation through static anchors and requires only another pre-trained model. |
| Outcome: | The proposed method improves a range of benchmark tasks that test contextual variations of meaning across different usages of a word and across different words as they are used in context. |
Exploring morphology-aware tokenization: A case study on Spanish language modeling (2025.emnlp-main)
Copied to clipboard
| Challenge: | a recent study shows that subword tokenization improves performance of neural language models. |
| Approach: | They propose a linguistically grounded approach to train a tokenizer on morphologically segmented data. |
| Outcome: | The proposed tokenizer improves on a Spanish language model with morphological information. |
Awakening Latent Grounding from Pretrained Language Models for Semantic Parsing (2021.findings-acl)
Copied to clipboard
| Challenge: | Recent years pretrained language models (PLMs) have shown their power on modeling language . however, few efforts have been made to explore grounding capabilities of PLMs . |
| Approach: | They propose to use pretrained language models to explore syntactic structures . they propose to combine their approach with an erasingthen-awakening approach . their results show that the approach can awaken latent grounding, which is understandable to humans . |
| Outcome: | Empirical studies show that the proposed approach can awaken latent grounding . it shows great potential to benefit downstream semantic parsing models, it says . |
Out-of-Context Reasoning in Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a lightweight technique trains only new token embeddings on axioms and evaluates them on unseen tasks. |
| Approach: | They propose a lightweight technique that trains only new token embeddings on axioms . they train only new embeddables and evaluate them on unseen tasks . |
| Outcome: | The proposed technique trains only new token embeddings on axioms and evaluates them on unseen tasks. |
Fixing Semantic Blind Spots in Anchor Tokens of dMLLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Autoregressive models (ARMs) are prone to hallucinations due to their sequential text generation and high latency. |
| Approach: | They propose a training-free decoding strategy that augments the attention key space with a static, distance-aware matrix to reduce the attention sink effect on semantic anchors. |
| Outcome: | The proposed method reduces the attention sink effect on semantic anchors while enhancing their ability to aggregate global visual information. |
Visually Grounded Compound PCFGs (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing work on visual groundings for language understanding has been drawing much attention. |
| Approach: | They propose to use an extension of probabilistic context-free grammar model to do fully-differentiable end-to-end visually grounded learning. |
| Outcome: | The proposed model outperforms the previous grounded model and significantly outperformed the previous model on the MSCOCO test captions. |
Lexically Grounded Subword Segmentation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Statistical word segmentation algorithms have remained a thorn in the side of many researchers. |
| Approach: | They propose to use unsupervised morphological analysis with Morfessor as pre-tokenization and an algebraic method for obtaining subword embeddings grounded in a word embeddable space. |
| Outcome: | The proposed methods improve morphological plausibility and Rényi efficiency on part-of-speech tagging and machine translation tasks. |
Towards Parameter-Efficient Integration of Pre-Trained Language Models In Temporal Video Grounding (2023.findings-acl)
Copied to clipboard
Erica Kido Shimomoto, Edison Marrese-Taylor, Hiroya Takamura, Ichiro Kobayashi, Hideki Nakayama, Yusuke Miyao
| Challenge: | Recent studies have improved query inputs with pre-trained language models, but the effects of this integration are unclear. |
| Approach: | They propose to integrate query sentences with pre-trained language models to train TVG models. |
| Outcome: | The proposed model integrates query sentences with pre-trained language models at cost of more expensive training. |
How to Understand “Support”? An Implicit-enhanced Causal Inference Approach for Weakly-supervised Phrase Grounding (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies on Weakly-supervised Phrase Grounding (WPG) largely ignore the implicit phrase-region matching relations, rendering it arduous to explore the semantic nature of phrases. |
| Approach: | They propose an Implicit-Enhanced Causal Inference approach to address the challenges of modeling the implicit relations and highlighting them beyond the explicit. |
| Outcome: | The proposed approach outperforms the state-of-the-art baselines on an implicit-enhanced dataset. |
Lexicon-Level Contrastive Visual-Grounding Improves Language Modeling (2024.findings-acl)
Copied to clipboard
| Challenge: | Neural language models (LMs) are trained on orders of magnitude more language data than human language learners receive, but without supervision from other sensory modalities that play a crucial role in human learning. |
| Approach: | They propose a grounded language learning procedure that leverages visual supervision to improve textual representations. |
| Outcome: | The proposed procedure outperforms standard language-only models in terms of learning efficiency in small and developmentally plausible data regimes and improves perplexity by around 5% on multiple language modeling tasks compared to other models trained on the same amount of text data. |