Challenge: Existing models rely on a single segmentation token whose hidden state implicitly encodes both semantic reasoning and spatial localization . Existing methods rely only on SEG>, which encodes semantic reasoning, limiting the model's ability to explicitly disentangle what to segment from where to segment.
Approach: They propose a method which reformulates reasoning segmentation as a structured conditional generation process over image tokens conditioned on language grounded query banks.
Outcome: The proposed model bridges token-level predictions and pixel-level supervision by decoupling spatial grounding from semantic reasoning through structured language grounded query banks.

Similar Papers

Towards Better Context-aware Lexical Semantics:Adjusting Contextualized Representations through Static Anchors (2020.emnlp-main)

Copied to clipboard

Challenge: Recent research has shown that contextualized models generate dynamic embeddings for words in context, but static embedds are often overlooked in this trend towards contextualized modeling.
Approach: They propose a method that learns a transformation through static anchors and requires only another pre-trained model.
Outcome: The proposed method improves a range of benchmark tasks that test contextual variations of meaning across different usages of a word and across different words as they are used in context.
Exploring morphology-aware tokenization: A case study on Spanish language modeling (2025.emnlp-main)

Copied to clipboard

Challenge: a recent study shows that subword tokenization improves performance of neural language models.
Approach: They propose a linguistically grounded approach to train a tokenizer on morphologically segmented data.
Outcome: The proposed tokenizer improves on a Spanish language model with morphological information.
Awakening Latent Grounding from Pretrained Language Models for Semantic Parsing (2021.findings-acl)

Copied to clipboard

Challenge: Recent years pretrained language models (PLMs) have shown their power on modeling language . however, few efforts have been made to explore grounding capabilities of PLMs .
Approach: They propose to use pretrained language models to explore syntactic structures . they propose to combine their approach with an erasingthen-awakening approach . their results show that the approach can awaken latent grounding, which is understandable to humans .
Outcome: Empirical studies show that the proposed approach can awaken latent grounding . it shows great potential to benefit downstream semantic parsing models, it says .
Out-of-Context Reasoning in Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: a lightweight technique trains only new token embeddings on axioms and evaluates them on unseen tasks.
Approach: They propose a lightweight technique that trains only new token embeddings on axioms . they train only new embeddables and evaluate them on unseen tasks .
Outcome: The proposed technique trains only new token embeddings on axioms and evaluates them on unseen tasks.
Fixing Semantic Blind Spots in Anchor Tokens of dMLLMs (2026.findings-acl)

Copied to clipboard

Challenge: Autoregressive models (ARMs) are prone to hallucinations due to their sequential text generation and high latency.
Approach: They propose a training-free decoding strategy that augments the attention key space with a static, distance-aware matrix to reduce the attention sink effect on semantic anchors.
Outcome: The proposed method reduces the attention sink effect on semantic anchors while enhancing their ability to aggregate global visual information.
Visually Grounded Compound PCFGs (2020.emnlp-main)

Copied to clipboard

Challenge: Existing work on visual groundings for language understanding has been drawing much attention.
Approach: They propose to use an extension of probabilistic context-free grammar model to do fully-differentiable end-to-end visually grounded learning.
Outcome: The proposed model outperforms the previous grounded model and significantly outperformed the previous model on the MSCOCO test captions.
Lexically Grounded Subword Segmentation (2024.emnlp-main)

Copied to clipboard

Challenge: Statistical word segmentation algorithms have remained a thorn in the side of many researchers.
Approach: They propose to use unsupervised morphological analysis with Morfessor as pre-tokenization and an algebraic method for obtaining subword embeddings grounded in a word embeddable space.
Outcome: The proposed methods improve morphological plausibility and Rényi efficiency on part-of-speech tagging and machine translation tasks.
Towards Parameter-Efficient Integration of Pre-Trained Language Models In Temporal Video Grounding (2023.findings-acl)

Copied to clipboard

Challenge: Recent studies have improved query inputs with pre-trained language models, but the effects of this integration are unclear.
Approach: They propose to integrate query sentences with pre-trained language models to train TVG models.
Outcome: The proposed model integrates query sentences with pre-trained language models at cost of more expensive training.
How to Understand “Support”? An Implicit-enhanced Causal Inference Approach for Weakly-supervised Phrase Grounding (2024.lrec-main)

Copied to clipboard

Challenge: Existing studies on Weakly-supervised Phrase Grounding (WPG) largely ignore the implicit phrase-region matching relations, rendering it arduous to explore the semantic nature of phrases.
Approach: They propose an Implicit-Enhanced Causal Inference approach to address the challenges of modeling the implicit relations and highlighting them beyond the explicit.
Outcome: The proposed approach outperforms the state-of-the-art baselines on an implicit-enhanced dataset.
Lexicon-Level Contrastive Visual-Grounding Improves Language Modeling (2024.findings-acl)

Copied to clipboard

Challenge: Neural language models (LMs) are trained on orders of magnitude more language data than human language learners receive, but without supervision from other sensory modalities that play a crucial role in human learning.
Approach: They propose a grounded language learning procedure that leverages visual supervision to improve textual representations.
Outcome: The proposed procedure outperforms standard language-only models in terms of learning efficiency in small and developmentally plausible data regimes and improves perplexity by around 5% on multiple language modeling tasks compared to other models trained on the same amount of text data.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations