Skip to content

GS-QA2: A Benchmark for Question Answering over Raster–Vector Data [Experiment]

· 0 citations · 22 references

TL;DR

A new benchmark for geospatial question answering over both vector and raster data is presented, which integrates OpenStreetMap vector features with a U.S. Digital Elevation Model (DEM) to enable controlled evaluation of combined raster and vector reasoning.

View source

Similar papers

#edge computing Open access Aug 2026

A Systematic Comparison of RAG Architectures for Geographic POI Question Answering Using OpenStreetMap Data

It is suggested that, in dense-urban POI settings where coordinates are reliable, the marginal benefit of explicit graph edges shrinks for coordinate-computable relationships, while structured spatial processing complements vector retrieval.

Noboru Otsuka · 0 citations
Open access Sep 2026

When RAG Meets Query Planning: Logical Query Trees for Exploratory Reasoning Problems

Retrieval-Augmented Generation (RAG) effectively grounds large language models (LLMs) in external knowledge but struggles with exploratory reasoning problems (ERPs) that are the complex queries involving high uncertainty and ambiguity. Resolving ERPs requires complex reasoning with unclear paths, tending to result...

Gan-Lin Xu, Ling-Hao Zhang, Zhi-Tao Yin et al. · 0 citations
Open access Aug 2026

CGD-QCSF: A Code Generation-Driven Query–Computation Separation Framework for Natural Language Geospatial Analysis

Geospatial data provide an important basis for urban governance, resource management, disaster assessment, and public health analysis by linking spatial locations, attribute information, and dynamic processes. However, complex geospatial analysis still requires substantial expertise in spatial databases, spatial SQL, a...

Zhi-Yuan Le, Hao Li, Yuan-Xun Mei et al. · 0 citations
#machine learning Preprint Sep 2026

Network-based Spatial Context Retrieval for Open-weight LLMs: A Faithfulness Benchmark for Grounded Geographic Reasoning

Large language models (LLMs) encode substantial latent geographic knowledge, yet they reason poorly over space and are unreliable when queried from coordinates alone. Useful behaviour emerges only when structured spatial context is supplied in the prompt. This raises a question geographic evaluation has left unexamined...

Joan Perez · 0 citations
Conference Open access Sep 2026

NaVQA: Mitigating Silent Failures in Question Answering over Virtual Knowledge Graph

This paper studies the VKG-QA task, which enables users to interact with the VKGs through a natural language (NL) interface by translating their questions into SPARQL queries, and pro-poses NaVQA (Navigation-based VKG Question Answering), a framework leveraging Large Language Models.

Guohui Xiao, Haohan Xue, Lin Ren et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.