A comprehensive study of Tatar text classification methods: from corpus creation and Tatar2Vec embeddings to benchmark establishment
The experiments demonstrate that BPE subword tokenization does not improve, but consistently degrades, topic classification performance for an agglutinative language, and developed open resources and reproducible benchmarks provide a foundation for future comparative studies, including the evaluation of transformer-bas...