QVAC Genesis III: A Large-Scale, High-Quality Open Synthetic STEM Corpus for Efficient Language Model Pre-Training
This work introduces QVAC Genesis III, a 191.43B-token, STEM-focused multi-domain synthetic corpus covering 19 domains across several difficulty levels and different educational styles, and introduces an LLM-as-a-parser evaluation protocol that extracts final answers from free-form outputs and tracks both accuracy and...
Davide Vitabile, N. Ranjan, Akshay Nambiar et al.
· 0 citations