SinLlama - A Large Language Model for Sinhala
This research extends an existing multilingual LLM (Llama-3-8B) to get a better coverage for Sinhala and enhances the LLM tokenizer with Sinhala specific vocabulary and performs continual pre-training on a 10 million sentence Sinhala corpus, resulting in the SinLlama model.
H.W.K. Aravinda, Rashad Sirajudeen, Samith Karunathilake et al.
· Moratuwa Engineering Researc... · 10 citations
· ⚡1