DI-Bench: Systematically Generating In-Domain Data Intelligence Benchmarks for Enterprise Agents
DI-Bench is presented, a pipeline for generating realistic benchmarks for data intelligence (DI), the practice of extracting insights from large volumes of enterprise data, and four models are evaluated, revealing a substantial finding: models achieve only 32% accuracy when doing computational tasks where retrieved bus...
Jiang-Yun Zhang, K. Surrao, Torpong Nitayanont et al.
· 0 citations