Critical Success Factors for Programmatic Assessment of Communication and Teamwork in Aircraft Maintenance Engineering Education

Abstract

The aviation sector is currently facing a growing shortage of aircraft maintenance engineers, further complicated by outdated training and assessment regulations focusing on theory and time requirements rather than competencies. In response, the industry is moving towards Competency-Based Training and Assessment, which introduces a significant shift by including transversal competencies that hold strong attitudinal elements requiring assessment through direct observation of performance. This study seeks to identify the critical success factors for training and assessing these transversal competencies within aircraft maintenance vocational education and training, leveraging principles of programmatic assessment. A five-month action research study was conducted involving 21 students and three instructors, utilizing a previously developed training and assessment programme validated by industry stakeholders. The findings demonstrate that a programmatic assessment approach, integrating peer, self, and instructor assessments within individual assessment portfolios, is perceived as effective to develop and evaluate competence. Students report enhanced reflection, self-awareness, and competency performance. Key factors for success included the adoption of a coaching approach, the use of simulation and role-play, and the implementation of iterative assessments with formative feedback in supportive environments. Additionally, instructors benefited from applying the ORCA (Observe, Record, Classify, Assess) method and undertaking further training in holistic group assessment.