Skip to content
Book Open access

Corpus-Centric Learning for Zero-Shot Table Retrieval

Jul 2026 · Annual International ACM SIGIR Conference on Research and Development in Information Retrieval · pp. 515-525 · 0 citations · 44 references
Computer Science

TL;DR

GeCo-TR is proposed, a zero-shot table retrieval framework that eliminates the need for supervised QA data by shifting from direct query-to-table learning to modeling the intrinsic structural semantics of the table corpus, resulting in high-precision and high-recall retrieval for implicit queries in a zero-shot setting.

Abstract

Tabular data represents a major source of structured knowledge for open-domain question answering (QA) and enterprise data lakes, yet effective table retrieval remains challenging due to the structure–semantics gap imposed by tabular layouts. Heuristic table linearization often leads to semantic loss, particularly for implicit queries, while recent supervised retrieval models (e.g., Birdie, Contr) rely heavily on large-scale query logs and labeled QA pairs, limiting their applicability in Day-0 cold-start scenarios. We propose GeCo-TR (Generative Schema and Contrastive Table Retrieval), a zero-shot table retrieval framework that eliminates the need for supervised QA data by shifting from direct query-to-table learning to modeling the intrinsic structural semantics of the table corpus. GeCo-TR introduces UHMI, a unified hybrid representation that integrates table structure with linked knowledge graph entities, and employs a hybrid neural–symbolic retrieval mechanism that dynamically combines dense semantic retrieval, symbolic graph traversal, and sparse lexical matching. This design enables robust semantic generalization while enforcing explicit structural constraints, resulting in high-precision and high-recall retrieval for implicit queries in a zero-shot setting. Extensive experiments on public benchmarks demonstrate the effectiveness of GeCo-TR; notably, on Open-WikiTable, it achieves 97.5% Recall@5 in the zero-shot setting, ranking second among all evaluated methods despite requiring no query-level supervision.

Read PDF

Similar papers

Aug 2026

STaR: a soft-labeling and triplet-aware retriever for efficient retrieval-augmented QA

This study proposes STaR, a novel retriever fine-tuning framework that integrates BM25 similarity graph-based soft labeling with a triplet similarity learning strategy based on Sentence-BERT (SBERT), and introduces a triplet-aware SBERT training architecture that explicitly models relative semantic distances between queries and candidate passages, significantly enhancing retrieval ranking precision and semantic robustness.

Jiali Jiang, Chih-Yung Chang, Youxi Li et al. · 0 citations
Open access Aug 2026

Multi-Granular Demonstration Retrieval via Syntax-Derived Representations for Few-Shot NL2GQL

MGDR-SDR is proposed, a training-free approach that applies constituency parsing to derive three complementary representations of the utterance that drive a multi-granular retrieval procedure that aggregates evidence across dense and sparse channels, yielding broader and more precise demonstration coverage.

Tong Li, Zhipeng Du, Xinyu Hu et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Bridging the Semantic-Utility Gap in Multimodal RAG via Generator-in-the-Loop Alignment

Vision-language models (VLMs) augmented with retrieval-augmented generation (RAG) benefit from access to external evidence. However, standard retrievers and rerankers optimize for semantic similarity rather than answer utility, creating a preference gap: documents that appear relevant may not help the generator produce a correct answer. Motivated by this, we propose a two-stage generator-in-the-loop alignment framework that closes this gap without human document-level relevance annotations. Our framework consists of two stages: in Stage 1, a VLM generates a hypothetical text passage from the image-query pair, which is used as the retrieval query for dense text search, bridging the image-to-text modality gap. In Stage 2, a cross-encoder reranker adapted with low-rank adaptation (LoRA) is fine-tuned using answer-supervised preference pairs mined from the frozen VLM: given the dataset answer label, a candidate document is labeled positive if the VLM produces the correct answer when given that document as context, and negative otherwise. This generator-guided signal is compatible with multiple alignment loss functions, including contrastive (triplet) loss, pairwise direct preference optimization (DPO), and supervised fine-tuning (SFT), and supports periodic re-mining to refresh preference pairs as the reranker improves. Experiments on VQA-X and A-OKVQA with Qwen3.5-2B and Qwen3-VL-4B-Instruct show that our proposed framework consistently outperforms rank-order, random, and REPLUG-style likelihood baselines under various alignment losses and pool size settings, suggesting that answer-level generator feedback is an effective supervision signal for preference alignment.

Zhan-Lun Chang, Dong-Jun Han, Seyyedali Hosseinalipour et al. · 0 citations
Jul 2026

The Case Against Generation for Retrieval: Discriminative Language Models as Effective Retrievers

Large Language Models (LLMs) have emerged as powerful assets for recommender systems. However, deploying them as generative recommenders or zero-shot rankers at web-scale remains bottlenecked by prohibitive computational overhead and grounding challenges. In this paper, we revitalize the classic, highly efficient two-tower retrieval architecture by adapting LLMs as semantic representation backbones rather than generative engines. We introduce an LLM-native two-tower framework engineered for high-throughput, large-scale retrieval. Our architecture introduces several key innovations: a shared LLM encoder for joint user-item modeling, End-Of-Sentence (EOS) token pooling for compact sequence embedding, cross-dataset transfer learning, knowledge distillation from powerful cross-encoder teachers, and latent reasoning within the user tower. Extensive evaluation across three public benchmarks demonstrates that cross-encoder architecture outperforms current state-of-the-art (SoTA) models, while the efficient two-tower student achieves SoTA-comparable retrieval performance. Furthermore, experiments on internal large-scale production systems yield substantial topline retrieval improvements along with high resilience to model staleness and superior data scaling. Our findings demonstrate that when augmented with modern representation learning, the traditional two-tower paradigm remains an exceptionally competitive and practical solution for industrial retrieval systems.

Zhe Xu, Prachi Agrawal, Kavosh Asadi et al. · 0 citations
#artificial intelligence Preprint Aug 2026

Efficient GPU Retrieval for Semantic Search

A policy-aligned retrieval framework that improves offline relevance over a matched-capacity baseline, with gains broadly distributed across facet combinations, and serves this framework with a two-stage GPU architecture.

Dhritiman Das, Chujie Zheng, Ronak Kaoshik et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.