Developing and Validating an AI Literacy Instrument for Elementary School Students: A Psychometric Study Using the ADDIE Framework

Abstract

AbstractArtificial intelligence (AI) literacy has emerged as a critical competency in elementary education as learners increasingly engage with AI-mediated and technology-rich learning environments. This study developed and validated a multidimensional AI literacy instrument for elementary school students using a research and development approach grounded in the ADDIE framework and informed by AI literacy, constructivist learning, and digital citizenship theories. The instrument comprised five dimensions: AI recognition, conceptual understanding, functional application, evaluation and creation, and AI ethics. Content validation by four experts demonstrated strong theoretical relevance across all dimensions. Empirical testing involving 250 Indonesian elementary school students examined the instrument’s psychometric properties. Exploratory factor analysis supported a five-factor structure with acceptable factor loadings and sampling adequacy (KMO > .80; Bartlett’s test, p < .001), explaining a substantial proportion of total variance. Reliability analysis indicated satisfactory internal consistency across retained subscales (Cronbach’s α > .70), although conceptual understanding required minor item revision. Descriptive findings revealed stronger competencies in ethical AI use and functional application than in conceptual understanding of AI processes. The study contributes a psychometrically grounded and developmentally appropriate instrument supporting AI literacy assessment, curriculum innovation, instructional evaluation, and responsible AI integration within primary education contexts for early twenty-first-century educational transformation. Author BiographiesMhel Cedric D. Bendo, Polytechnic University of the Philippines-Maragondon CampusMhel Cedric D. Bendo is an active researcher and academic writer pursuing a Bachelor of Science in Entrepreneurship at the Polytechnic University of the Philippines–Maragondon Campus. His research focuses on digital and mobile learning environments, artificial intelligence in education, educational psychology, educational assessment, psychometrics, and financial technology (FinTech), with emphasis on technology-mediated learning, learner engagement, digital participation, and emerging educational innovations. He has authored several studies published and forthcoming in international and Scopus-indexed journals. He serves on the editorial boards of the SIAR-Global Journal of Humanities, Management & Educational Review, the SIAR-Global Journal of Literatures & Educational Review, the International Journal of Multidisciplinary Research and Exploration (IJMRE), the International Journal of Advanced Multidisciplinary Application (IJAMA), and the International Journal of Educational and Psychological Sciences (IJEPS). He also serves as a technical editor and peer reviewer for several international scholarly journals, including the Online Learning Journal (OLJ), Journal of Learning for Development (JL4D), International Journal of Management and Human Sciences (IJMHS), and Journal of Economics Education (JEE). Beyond academic research, he writes research-informed commentaries and essays exploring education, technology, media literacy, culture, and social development, with works published in regional and national Philippine publications, including BusinessMirror, Manila Bulletin, and the Philippine Daily Inquirer.Torang Siregar, Department of Mathematics Education, Faculty of Tarbiyah and Teacher Training (FTIK), UIN Syekh Ali Hasan Ahmad Addary Padangsidimpuan, Padangsidimpuan, North Sumatra, IndonesiaTorang Siregar is a lecturer and researcher in Mathematics Education at UIN Syekh Ali Hasan Ahmad Addary Padangsidimpuan. He earned his Master’s degree in Mathematics Education from UIN Syekh Ali Hasan Ahmad Addary Padangsidimpuan and is currently pursuing a doctoral degree in Educational Science with a concentration in Mathematics Education at Universitas Negeri Padang. His research interests include mathematics education, STEM education, problem-based learning, mathematical reasoning, ethnomathematics, digital learning, artificial intelligence in education, and assessment for learning. He has teaching experience at both secondary and higher education levels and actively contributes to academic publications, conferences, and peer review activities. Torang Siregar is also involved in developing innovative learning models and educational resources to enhance students’ critical thinking and problem-solving skills in mathematics.