Skip to content
#explainable ai Open access

Development and structural validation of the Artificial Intelligence Competency Scale for Nurse Educators (AI-CSNE): a three-domain measure of perceived AI competency

Oct 2026 · BMC Nursing
Artificial Intelligence in Healthcare and Education

Abstract

The rapid integration of artificial intelligence (AI) into healthcare and nursing education has created new competency requirements for nurse educators. Despite this growing demand, there is a notable lack of rigorously developed and psychometrically validated instruments specifically designed to assess AI-related competencies among nursing faculty. This gap limits the ability to systematically evaluate nurse educators’ perceived preparedness for AI integration and hinders evidence-based curriculum development in nursing education. This study aimed to develop and psychometrically validate the Artificial Intelligence Competency Scale for Nurse Educators (AI-CSNE). A methodological cross-sectional study was conducted among 470 nurse educators from multiple nursing faculties in Egypt between mid-October 2025 and February 2026. The scale was developed based on the UNESCO Artificial Intelligence Competency Framework for Teachers and relevant literature. Content validity was established through expert evaluation and pilot testing. The total sample ( N = 470) was randomly divided into two independent subsamples. Exploratory factor analysis (EFA) was conducted using the first subsample ( n = 235) to identify the underlying factor structure, followed by confirmatory factor analysis (CFA) using the second independent subsample ( n = 235) to validate the proposed measurement model. Internal consistency reliability was assessed using Cronbach’s alpha coefficients. Exploratory factor analysis supported a three-factor structure representing Foundational AI Knowledge and Instructional Application, Ethical and Human-Centered AI Use, and AI-Supported Professional Growth. Factor loadings ranged from 0.661 to 0.822, and the three factors explained 56.10% of total variance. Internal consistency reliability was satisfactory, with Cronbach’s alpha coefficients of 0.842 for Foundational AI Knowledge and Instructional Application, 0.810 for Ethical and Human-Centered AI Use, and 0.697 for AI-Supported Professional Growth in the EFA subsample, with comparable estimates in the CFA subsample. Confirmatory factor analysis supported the three-factor structure of the AI-CSNE, with excellent model fit (CFI = 0.989, TLI = 0.986, RMSEA = 0.023, SRMR = 0.046). The Foundational AI Knowledge and Instructional Application domain demonstrated the highest standardized factor loadings (ranging from 0.626 to 0.785), while the Ethical and Human-Centered AI Use domain showed comparatively lower but still acceptable loadings (0.570 to 0.734). The near-zero inter-domain correlations indicate that the three subscales are empirically distinct and should be interpreted separately. The AI-CSNE demonstrates initial evidence of structural validity and internal consistency as an instrument comprising three distinct subscales for assessing perceived AI competency among nurse educators. The near-zero inter-domain correlations indicate that the three subscales should be interpreted separately rather than combined into a single total score. As the scale measures perceived rather than objectively demonstrated competency, it is best suited for exploratory group-level needs assessment, research comparisons, program evaluation, and self-reflective development rather than for individual appraisal, certification, or high-stakes evaluation. Convergent, criterion, and known-groups validity were assessed and demonstrated no significant differences across subgroups, though further validation is required. The scale provides a foundation for research and self-reflective faculty development but should be used with appropriate caution until comprehensive validation is established. Not applicable.

View source

Similar papers

#artificial intelligence Conference Open access Apr 2020

ECCOLA - a Method for Implementing Ethically Aligned AI Systems

The method, ECCOLA, is presented, which aims at making the high-level AI ethics principles more practical, making it possible for developers to more easily implement them in practice.

Ville Vakkuri, Kai-Kristian Kemell, P. Abrahamsson · 64 citations · ⚡6
#computer vision Review Apr 2024

AI-powered Code Review with LLMs: Early Results

The goal is to not only refine the accuracy of the LLM-based tool but also to underscore its potential in streamlining the software development lifecycle through proactive code improvement and education.

Z. Rasheed, Malik Abdul Sami, Muhammad Waseem et al. · 62 citations · ⚡3
#computer vision Open access Mar 2024

LLM-based agents for automating the enhancement of user story quality: An early report

The use of large language models to automatically improve the user story quality in Austrian Post Group IT agile teams is explored, with a reference model for an Autonomous LLM-based Agent System developed and implemented at the company.

Zheying Zhang, M. Rayhan, Tomas Herda et al. · 48 citations · ⚡4
#computer vision Review Mar 2024

System for systematic literature review using multiple AI agents: Concept and an empirical evaluation

This paper introduces a novel multi-AI-agent system designed to fully automate SLRs, and demonstrates how it substantially reduces the time and effort traditionally required for SLRs while maintaining comprehensiveness and precision.

Abdul Malik Sami, Z. Rasheed, Kai-Kristian Kemell et al. · 44 citations · ⚡2
#computer vision Feb 2024

Can Large Language Models Serve as Data Analysts? A Multi-Agent Assisted Approach for Qualitative Data Analysis

The proposed LLM-based multi-agent system automates qualitative data analysis process, creating opportunities for researchers and practitioners, and future improvements focus on enhancing multilingual performance and integrating continuous expert feedback.

Z. Rasheed, Muhammad Waseem, Aakash Ahmad et al. · 41 citations
#artificial intelligence Conference Open access Jun 2018

The Key Concepts of Ethics of Artificial Intelligence

It is suggested that the focus on finding keywords is the first step in guiding and providing direction for future research in the AI ethics field.

Ville Vakkuri, P. Abrahamsson · 39 citations · ⚡2

Related blog posts

Microsoft Research Blog Oct 7, 2026

Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses

Training AI agents with reinforcement learning can be challenging because their tools, context, and decision-making are managed by complex frameworks. Agent Lightning connects existing agents to RL training, making it easier to improve them without rebuilding them. The post Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.