MapQaTor: An Extensible Framework for Efficient Annotation of Map-Based QA Datasets (2025.acl-demo)
Copied to clipboard
| Challenge: | Mapping and navigation services struggle to handle natural language geospatial queries. |
| Approach: | They introduce an extensible open-source framework that streamlines the creation of reproducible, traceable map-based QA datasets. |
| Outcome: | a new open-source framework streamlines the creation of reproducible, traceable map-based QA datasets. |
Similar Papers
MapAgent: A Hierarchical Agent for Geospatial Reasoning with Dynamic Map Tool Integration (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing frameworks for large language models are tailored to domains such as mathematics, coding, or web automation. |
| Approach: | They propose a hierarchical multi-agent plug-and-play framework with customized toolsets and agentic scaffolds for map-integrated geospatial reasoning. |
| Outcome: | The proposed framework decouples planning from execution and reduces cognitive load on users. |
ComQA: A Community-sourced Dataset for Complex Factoid Question Answering with Paraphrase Clusters (N19-1)
Copied to clipboard
| Challenge: | ComQA dataset captures question phenomena and the diverse ways in which they are formulated. |
| Approach: | They propose a large dataset of real user questions that captures question phenomena and the diverse ways in which they are formulated. |
| Outcome: | The proposed dataset can be a driver of future research on factoid question answering (QA). |
SpatialWebAgent: Leveraging Large Language Models for Automated Spatial Information Extraction and Map Grounding (2025.acl-demo)
Copied to clipboard
| Challenge: | Understanding and extracting spatial information from text is vital for a wide range of applications, says nielsen . inherent complexity of geographic expressions in natural language presents significant hurdles for traditional extraction methods. |
| Approach: | They propose a system that leverages large language models to extract spatial information from natural language. |
| Outcome: | SpatialWebAgent is designed to extract, standardize, and ground spatial information from natural language text directly onto maps. |
GeoAgent: To Empower LLMs using Geospatial Tools for Address Standardization (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to address address standardization are lacking in the current field. |
| Approach: | They propose a framework that incorporates spatial knowledge into address texts and achieves efficient address standardization. |
| Outcome: | The proposed framework incorporates spatial knowledge into address texts and achieves efficient address standardization. |
Spatial-Agent: Agentic Geo-spatial Reasoning with Scientific Core Concepts (2026.acl-long)
Copied to clipboard
| Challenge: | Existing LLM-based agents lack inherent spatial awareness, relying on web search or text matching while hallucinating spatial relationships. |
| Approach: | They propose a spatial-based agent that can perform real-world geospatial computations . they use natural-language questions to parse into executable workflows based on geoFlow Graphs - directed acyclic graphs with nodes corresponding to spatial concepts and edges representing transformations. |
| Outcome: | The proposed agent outperforms existing baselines on MapEval-API and MapQA benchmarks while producing interpretable and executable geospatial workflows. |
Effective QA-Driven Annotation of Predicate–Argument Relations Across Languages (2026.eacl-long)
Copied to clipboard
| Challenge: | Explicit representations of predicate-argument relations are a cornerstone of natural language understanding. |
| Approach: | They propose a cross-linguistic projection approach that reuses an English QA-SRL parser within a constrained translation and word-alignment pipeline to automatically generate question-answer annotations aligned with target-language predicates. |
| Outcome: | The proposed approach outperforms strong multilingual LLMs in Hebrew, Russian, and French. |
LocalRQA: From Generating Data to Locally Training, Testing, and Deploying Retrieval-Augmented QA Systems (2024.acl-demos)
Copied to clipboard
| Challenge: | Existing tools for augmented question-answering do not support researchers and developers to customize the training, testing, and deployment process. |
| Approach: | They propose an open-source toolkit that features a wide selection of model training algorithms, evaluation methods, and deployment tools curated from the latest research. |
| Outcome: | The proposed framework trains and deploys 7B-models with the same performance as OpenAI’s text-ada-002 and GPT-4-turbo. |
QA Analysis in Medical and Legal Domains: A Survey of Data Augmentation in Low-Resource Settings (2025.acl-srw)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have revolutionized natural language processing, but their success remains limited to high-resource domains. |
| Approach: | They analyze the coverage and representativeness of specialized-domain QA datasets against large-scale reference datasets. |
| Outcome: | The proposed methods and evaluations highlight the challenges faced by LLMs in low-resource domains. |
NeuralQA: A Usable Library for Question Answering (Contextual Query Expansion + BERT) on Large Datasets (2020.emnlp-demos)
Copied to clipboard
| Challenge: | Existing tools for Question Answering (QA) have challenges that limit their use in practice. |
| Approach: | They propose a library that integrates with existing infrastructure and offers helpful defaults for QA subtasks. |
| Outcome: | NeuralQA integrates well with existing infrastructure and offers helpful defaults for QA subtasks. |
GameQA: Gamified Mobile App Platform for Building Multiple-Domain Question-Answering Datasets (2023.eacl-demo)
Copied to clipboard
Njall Skarphedinsson, Breki Gudmundsson, Steinar Smari, Marta Kristin Larusdottir, Hafsteinn Einarsson, Abuzar Khan, Eric Nyberg, Hrafn Loftsson
| Challenge: | a common problem with question-answering datasets is that they require annotators to source answers from the internet . a crowd-sourcing platform is available for low-resource languages, but it is limited in terms of information available. |
| Approach: | They propose a crowd-sourcing platform to gather multiple-domain QA data for low-resource languages. |
| Outcome: | The proposed platform rivals large QA datasets for high-resource languages in size and answerability. |