Evaluating Subword Tokenization Algorithms for Kapampangan Natural Language Processing
Effective tokenization is a foundational component of Large Language Model (LLM) development, yet it remains an open challenge for morphologically rich, lowresource languages such as Kapampangan. This paper presents a systematic evaluation of Byte-Pair Encoding (BPE) and the Unigram Language Model for Kapampangan, an u...