The Stochastic Shift: A New Evaluation Paradigm for Text-to-SQL with AI Operators
A Multilayered Evaluation Framework is introduced that decouples deterministic database logic from flexible AI semantics and achieves state-of-the-art overall accuracy across both platforms, proposing a reliable standard for benchmarking AI-powered SQL generators.
Tarfah Alrashed, Fatma Ozcan, Per Jacobsson et al.
· 0 citations