FinetextPL-Edu: A High-Quality Polish Corpus for Large Language Model Pretraining via Educational Quality Filtering
This paper presents FinetextPL-Edu, a newly developed Polish pretraining corpus filtered for educational value, constructed from the Polish slices of FineWeb2 and FinePDFs. We train a language-specific quality classifier to score the full corpus, allowing for aggressive educational filtering. We show that the removal-r...