Semantic query engines evaluate natural-language filters with a large language model, and every evaluation is a costly oracle call. Optimizers that reduce these calls face a dilemma: cascades that trust a cheap proxy miss their precision and recall targets on many queries, methods with finite-sample guarantees save lit...
SQL systems increasingly expose AI functions for tasks such as classification, extraction, filtering, ranking, retrieval, joining, and summarization. Despite their diverse APIs, these functions play only three relational roles: transforming individual rows, aggregating groups, or generating relationships between row pa...
Xiangqi Wang, Nhan H. Pham, Oktie Hassanzadeh et al.· 0 citations
This work demonstrates Text2SQL-Eval, an open-source, modular framework for rigorous evaluation of text-to-SQL systems, which provides a comprehensive suite of over twelve metrics, spanning execution accuracy, SQL syntactic equivalence, and LLM-as-judge scoring.
Oktie Hassanzadeh, Yotam Perlitz, Nhan H. Pham et al.· Proceedings of the VLDB Endo...· 0 citations
It is demonstrated that ORM-based verification provides a simple, effective, and scalable alternative to heuristic test-time selection strategies for Text-to-SQL, and that ORMs scale effectively with larger candidate sets and yield stronger improvements on complex queries.
M. Tritto, G. Farano, Dario Di Palma et al.· arXiv.org· 1 citation· ⚡1
As Large Language Models (LLMs) become foundational to next-generation Intelligent Information Systems, the bridge between natural language interfaces and structured database systems remains a critical bottleneck. While Text-to-SQL generation enables cooperative support for complex query formulation, ensuring the rel...
M. Tritto, G. Farano, Dario Di Palma et al.· Journal of Intelligence and...· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.