GeoLM: Empowering Language Models for Geospatially Grounded Language Understanding (2023.emnlp-main)
Copied to clipboard
| Challenge: | Pretrained language models do not utilize valuable geospatial information in large databases, e.g., OpenStreetMap. |
| Approach: | They propose a geospatially grounded language model that connects linguistic and geospheric contexts. |
| Outcome: | The proposed model bridges the gap between natural language processing and geospatial sciences. |
Similar Papers
Representation, Learning and Reasoning on Spatial Language for Downstream NLP Tasks (2020.emnlp-tutorials)
Copied to clipboard
| Challenge: | In this tutorial, we discuss the cutting-edge research results and existing challenges related to spatial language understanding including semantic annotations, existing corpora, symbolic and sub-symbolic representations, qualitative spatial reasoning, spatial common sense, deep and structured learning models. |
| Approach: | This tutorial presents cutting-edge research results and current challenges related to spatial language understanding including semantic annotations, existing corpora, symbolic and sub-symbolic representations, qualitative spatial reasoning, spatial common sense, deep and structured learning models. |
| Outcome: | This paper reviews the cutting-edge research results and current challenges related to spatial language understanding including semantic annotations, existing corpora, symbolic and sub-symbolic representations, qualitative spatial reasoning, spatial common sense, deep and structured learning models. |
Language in a (Search) Box: Grounding Language Learning in Real-World Human-Machine Interaction (2021.naacl-main)
Copied to clipboard
| Challenge: | Scholarly work in this area uses toy worlds and synthetic linguistic data, but grounded language learning offers several practical and scientific advantages. |
| Approach: | They propose to model teacher-learner dynamics through natural interactions occurring between users and search engines. |
| Outcome: | The proposed model is better than non-grounded models on compositionality and zero-shot inference tasks. |
Into the Unknown: Generating Geospatial Descriptions for New Environments (2024.findings-acl)
Copied to clipboard
| Challenge: | Similar to vision-and-language navigation tasks, the Rendezvous (RVS) task requires reasoning over allocentric spatial relationships using non-sequential navigation instructions and maps. |
| Approach: | They propose a large-scale augmentation method for generating high-quality synthetic data for new environments using readily available geospatial data. |
| Outcome: | The proposed method improves accuracy on unseen and seen environments by 45.83% on the Rendezvous (RVS) task. |
GER-LLM: Efficient and Effective Geospatial Entity Resolution with Large Language Model (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for integrating spatial data from diverse sources are limited by their reliance on large amounts of training data and their inability to incorporate commonsense knowledge. |
| Approach: | They propose a framework that integrates large language models into the GER pipeline. |
| Outcome: | The proposed framework improves on real-world geospatial datasets and shows that it is more efficient than state-of-the-art methods. |
GeoArena: Evaluating Open-World Geographic Reasoning in Large Vision-Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing evaluation paradigms for geographic reasoning are outcome-centric and focus on label matching, leaving the underlying linguistic reasoning chains as unexamined black boxes. |
| Approach: | They propose a dynamic, human-preference-based evaluation framework for benchmarking open-world geographic reasoning. |
| Outcome: | The proposed framework reframes evaluation as a pairwise reasoning alignment task on in-the-wild images, where human judges compare model-generated explanations based on reasoning quality, evidence synthesis, and plausibility. |
Grounding Meaning Representation for Situated Reasoning (2022.aacl-tutorials)
Copied to clipboard
| Challenge: | a tutorial aims to build agents that understand language using a simulated environment . situated reasoning is a critical aspect of human language understanding . |
| Approach: | This tutorial combines a synthesis of multimodal grounding and meaning representation techniques with formal and computational models of situated reasoning. |
| Outcome: | This tutorial combines multimodal grounding and meaning representation techniques with formal and computational models of embodied reasoning. |
Probing Contextual Language Models for Common Ground with Visual Representations (2021.naacl-main)
Copied to clipboard
| Challenge: | Contextual language models have attracted great interest in probing what is encoded in their representations. |
| Approach: | They propose a probing model that evaluates how effective are text-only representations in distinguishing between matching and non-matching visual representations. |
| Outcome: | The proposed model outperforms text-only language models in instance retrieval, but underperform humans. |
Compositional Generalization with Grounded Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for combining language models with knowledge graphs struggle with generalization to sequences of unseen lengths and novel combinations of seen base components. |
| Approach: | They propose a procedure for generating natural language questions paired with knowledge graphs that targets different aspects of compositionality and avoids grounding models in information already encoded in their weights. |
| Outcome: | The proposed method fails to generalize to unseen lengths and to novel combinations of seen base components. |
Pretraining and Finetuning Language Models on Geospatial Networks for Accurate Address Matching (2024.emnlp-industry)
Copied to clipboard
| Challenge: | Existing approaches to address matching and building authoritative address catalogues are limited in data quality and require labeling effort to develop accurate models. |
| Approach: | They propose to view addresses as an address graph and curate inputs by placing geospatially linked addresses in the same context. |
| Outcome: | The proposed framework improves address matching and fine-tuning language models. |
Don’t Generate, Discriminate: A Proposal for Grounding Language Models to Real-World Environments (2023.acl-long)
Copied to clipboard
| Challenge: | Existing language models lack grounding to real-world environments . a missing piece is the connection between LMs and the environment . |
| Approach: | They propose a generic framework for grounded language understanding that capitalizes on discriminative ability of LMs instead of their generative ability. |
| Outcome: | The proposed framework capitalizes on discriminative ability of LMs instead of their generative ability. |