ufakzeka-1: Building and Evaluating a 151M-Parameter Turkish Language Model from Scratch
We describe ufakzeka-1, a 151M-parameter (182M with embeddings) decoder-only Turkish language model pretrained from scratch on 13.5B tokens of openly licensed text and instruction-tuned for chat, at a total cost of about \$286 in cloud GPU, API and notebook time. The contribution is not the model's capability, which is...
Sait Furkan Teke
· 0 citations