Skip to content

Large Language Models as Digital Libraries: A Multi-Benchmark and Multi-Model Study

· 0 citations · 29 references

TL;DR

Querying LLMs as digital libraries is feasible, but its effectiveness depends on model strength, deployment conditions, dataset structure, and execution strategy, and Galois remains valuable when relational discipline and controlled query execution are required.

View source

Similar papers

Preprint Jul 2026

MORE: A Multilingual Document Parsing Benchmark and Evaluation

Multilingual documents encapsulate rich regional cultures, scientific discoveries, and historical records. Parsing this content into structured, machine-readable formats is critical for unlocking global knowledge. However, existing benchmarks predominantly focus on high-resource languages like English and Chinese, creating an evaluation blind spot concerning model performance on other languages. While recent Vision-Language Models (VLMs) claim support for hundreds of languages, the lack of ground truth makes it impossible to empirically verify these capabilities. To bridge this gap, we introduce MORE, a large-scale benchmark designed for multilingual document parsing evaluation. MORE distinguishes itself through three key dimensions: (1) Unprecedented Scale: It covers 149 languages, making it the most linguistically diverse benchmark to date; (2) Structural Complexity: Unlike previous works, it extends evaluation beyond plain text to include structural elements such as code blocks, tables, and catalogs; and (3) Data Authenticity: All samples are curated from real-world documents via a model-assisted, human-refined annotation pipeline. We evaluate state-of-the-art models using MORE, establishing new performance baselines for long-tail languages and validating the benchmark's effectiveness in diagnosing model capabilities in realistic, diverse scenarios. The MORE dataset will be available at https://github.com/zimoqingfeng/MORE.

Long Xu, Binghong Wu, Ting-Ting Yu et al. · 3 citations
Preprint Jul 2026

Finding the Right Tables and Columns: A Benchmark and Corpus-Adaptive Embeddings for SQL Schema Retrieval

This work recast five text-to-SQL datasets as retrieval tasks at both table and column granularity, covering realistic and enterprise-scale schemas under two document representations, and proposes corpus-adaptive fine-tuning, establishing schema linking as a standalone retrieval task and lightweight, label-free corpus adaptation as a practical route to deploying it at enterprise scale.

Qingcheng Zeng, Puxuan Yu, Aman Mehta et al. · 0 citations

XML, MCP, and Language Models

A “separation of concerns” (between the generative model and the structured data it consults) is proposed as a principled, declarative approach to AI-assisted XML work.

E. Beshero-Bondar, M. Wright, M. R. Simons · 0 citations
Jun 2026

Database Context Compression for Text-to-SQL on Real-World Large Databases

DBCC is a database-side middleware that performs offline structural and semantic compression together with lightweight online evidence purification and is model-agnostic and can be integrated into existing Text-to-SQL pipelines.

Jingwen Liu, Weibin Liao, Xin Gao et al. · 0 citations