Development and Empirical Validation of an AI-enhanced Cultural Learning Dashboard for Measuring Samskara, Cesta, and Krtya in Balinese Vocational Students

Abstract

An Artificial Intelligence (AI) cultural learning dashboard was designed and validated for measuring and assessing Balinese vocational students’ competencies in Samskara, Cesta, and Krtya. Using the Borg and Gall R&D model, the study was divided into three steps: (1) Information Research and Gathering, where relevant and contextual theories, including a needs analysis, were developed; (2) Preparation, where cultural constructs were operationalized into measurable AI-assessment metrics; and (3) First Production Cycle, where the initial User Interface (UI) prototypes were developed. A mixed-methods empirical study was conducted with 12 teachers and 45 students from three Tourism Vocational High Schools in Bali. The validation study comprised a usability study (System Usability Scale = 82.4), a cultural relevance study (positive response = 87%), and a content expert pedagogical alignment review. Although the dashboard operationalizes Balinese philosophical constructs, the AI-driven behavioral analytics are still in the early stages, as evidenced by the statistically significant AI assessment/teacher assessment correlation (r = 0.76, p < 0.01). Culturally responsive e-assessment design is a contribution vocational education scholars can derive from the study, as it is based on a theory and an empirical validation.