Aug 2026· Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2· pp. 10020-10031· 0 citations· 7 references
Abstract
The proliferation of IoT and real-time monitoring has established Time-Series Databases (TSDBs) like InfluxDB as critical infrastructure. However, their functional query languages (e.g., Flux) present a steep learning curve, hindering data accessibility for non-experts. While Natural Language Interfaces (NLIs) offer a potential solution, the domain of Text-to-Flux is stalled by a critical bottleneck: the complete absence of diverse, high-quality paired benchmarks. To address this, we introduce the Text-to-Flux task and propose FluxEngine, a novel automated pipeline for dataset construction. Unlike static generation methods used in Text-to-SQL, our framework features a Self-Sustaining Live Data Context that utilizes background tasks to perpetually generate fresh data, ensuring that queries involving relative time windows (e.g., ''past hour'') remain executable and valid indefinitely. Using this framework, we construct and release TEFD (Text-to-Flux Dataset), the first large-scale benchmark for this task. We further define execution-based evaluation metrics tailored for time-series validity. This work provides the essential infrastructure to foster future research in NLI for TSDBs. To facilitate reproducibility and future research, our dataset and benchmark code are publicly available at https://github.com/gta886/TEFD-Benchmark.
Hybrid queries—natural language questions over structured data that require both database capabilities and LLM reasoning—have recently emerged as a prominent research topic. However, existing solutions remain overly dependent on manual workflows, and current benchmarks are limited in scale and diversity. To bridge this gap, we present (1) HyQBench \xspace, a large-scale benchmark with 60\sim 90× more queries than prior work, built on 3× more databases; (2) AutoHyQ \xspace, an automated pipeline that can execute existing methods without manual intervention; (3) multi-dimensional, fine-grained evaluation metrics for comprehensive assessment. Through extensive experiments across multiple hybrid query approaches on diverse LLM backbones, we reveal their strengths and limitations, and identify research opportunities for advancing this emerging field. Our code and data are available at https://github.com/XMUDM/HyQBench.
Bo Li, Chenzhan Wang, Long-Kang Lin et al.· Proceedings of the 32nd ACM...· 0 citations
DBLifeBench is introduced, the first benchmark to evaluate LLMs across five critical lifecycle phases: Design, Implementation, Operation, Debugging, and Maintenance, and a novel task utilizing structured reasoning graphs to mimic human iterative problem-solving is proposed.
Shunfan Zheng, Dongsheng Shi, Yue Li et al.· 0 citations
This work revisits generation-target IRs under the BIRD regime and proposes HyMIR, a typed JSON IR designed for enterprise-scale schemas, indicating comparable representational coverage across the two benchmarks and quantifying a hard upper bound on attainable model performance under this IR and compiler stack.
AssistEM, a framework for efficient LLM adaptation to EM via principled data selection, demonstrates that selective fine-tuning not only accelerates adaptation but also improves training efficiency (requiring fewer GPU hours), enabling open-source LLMs to rival–and in some cases outperform–closed-source models.
John Bosco Mugeni, Steven J. Lynden, Toshiyuki Amagasa et al.· International Journal of Dat...· 0 citations