Skip to content
Open access

The Role of Safety Management Systems (SMS) in the implementation of Human - AI teaming in Aviation Ecosystem.

2026 · AHFE International · Vol 224 · 0 citations

TL;DR

The paper argues that SMS frameworks must evolve beyond compliance-driven practices to embrace dynamic, data-rich safety monitoring capable of detecting emergent patterns of human–AI interaction, and proposes a strengthened SMS framework tailored to human–AI teaming.

Abstract

The integration of Human–AI teaming within the aviation ecosystem represents a transformative evolution in safety-critical operations, demanding robust organisational frameworks capable of managing emerging risks, validating new operational concepts, and sustaining human performance. As artificial intelligence becomes increasingly embedded in flight operations, maintenance, training, and safety analytics, the role of Safety Management Systems (SMS) becomes central to ensuring that human–AI collaboration is introduced, monitored, and governed in a manner consistent with international safety expectations. This paper examines how contemporary SMS principles support—and in many cases must be adapted to support—the safe and effective implementation of human–AI teaming across the aviation industry.The analysis begins by framing AI integration as a socio-technical challenge that profoundly alters hazard identification, risk modelling, and safety assurance processes. AI-enabled systems introduce unique characteristics—opacity, non-determinism, continuous learning, and probabilistic behaviour—that challenge conventional safety assumptions. SMS, traditionally grounded in predictable system performance, must expand to accommodate risks arising from algorithmic drift, data quality variability, automation bias, and human–machine misalignment. The paper argues that SMS frameworks must evolve beyond compliance-driven practices to embrace dynamic, data-rich safety monitoring capable of detecting emergent patterns of human–AI interaction.The study further explores how each component of SMS—Safety Policy, Safety Risk Management, Safety Assurance, and Safety Promotion—contributes to the governance of human–AI teaming. Within Safety Policy, organisational commitments must reflect a human-centric philosophy ensuring that AI systems complement, not replace, human cognitive strengths. Safety Risk Management must incorporate new methodologies for identifying hazards associated with collaborative automation, including unintended consequences of predictive algorithms, mismatches between AI intent and pilot expectation, and reduced redundancy in single-pilot or high-automation environments. Safety Assurance processes must evolve to include continuous performance monitoring of AI agents, explainability audits, validation of training effectiveness, and mechanisms for detecting shifts in human–AI trust relationships.Safety Promotion is examined as a crucial enabler of cultural readiness. The introduction of AI into safety-critical operations requires transparent communication, cross-disciplinary literacy, and training programmes that cultivate both confidence and critical scepticism toward AI-generated outputs. Emphasis is placed on building a safety culture that encourages reporting of anomalies involving AI systems, fosters shared understanding between technical and operational personnel, and supports learning from human–AI interaction events. The Turkish Airlines, Lufthansa Group, and FAA/EASA regulatory developments are referenced as indicative of industry movement toward SMS-driven oversight of intelligent systems.The paper concludes by proposing a strengthened SMS framework tailored to human–AI teaming. This enhanced model integrates explainable AI within risk assessment processes, adopts resilience engineering principles to manage uncertainty, incorporates AI-specific safety indicators, and emphasises adaptive training frameworks aligned with CBTA/EBT approaches. The findings suggest that the long-term success of human–AI teaming in aviation will depend not solely on technological capability but on the ability of SMS to anticipate, govern, and continuously validate the evolving dynamics of human–AI collaboration.

Read PDF

Similar papers

2026

Human Authority in the Age of Intelligent Systems: A Sociotechnical Framework for Decision Assurance and Psychosocial Safety

The rapid integration of intelligent systems into high-risk industries is reshaping how work is performed, decisions are made, and responsibility is distributed. While automation and artificial intelligence promise gains in efficiency, safety, and productivity, they also introduce under-recognised sociotechnical risks, including degraded human decision authority, cognitive overload, loss of practical expertise, and increasing psychosocial strain associated with uncertainty and workforce transition. This paper argues that current approaches to human factors engineering and system design are insufficient to address these conditions. While technical assurance frameworks for AI-enabled systems continue to mature, equivalent structures for ensuring the integrity, clarity, and sustainability of human decision-making remain underdeveloped. This gap presents a critical risk in high-reliability environments where human judgment is essential for managing variability, uncertainty, and system failure. Drawing on applied experience in automation-intensive operations and informed by an emerging global research agenda, this research introduces the Human Authority Index (HAI) as a novel sociotechnical framework developed by the author for assessing and designing decision-making in human–machine systems. The HAI positions human authority as a safety-critical variable across three dimensions: Decision Clarity, Cognitive Sustainability, and Psychosocial Safety. Together, these dimensions extend traditional human factors approaches by integrating organisational psychology, sociotechnical systems theory, and resilience engineering into a unified model. Through conceptual analysis and industry-informed scenarios, the paper demonstrates how poorly integrated automation can create hidden system fragility, while systems designed with clear human authority exhibit greater resilience and workforce engagement. This research contributes a practical framework to support safe, effective, and meaningful human participation in increasingly autonomous environments.

Peta Chirgwin · 0 citations
Open access Aug 2026

On AI operational alignment and misalignment for high-risk AI systems: case study

AI alignment is generally associated with ethics and social aspects. For high-risk AI systems, principles such as safety, stability and performance are crucial for their adoption in real-world application, to build trust and increase efficiency of a process. By safety it is meant both safety of the system itself but also safety of the process and environment. Any decision taken by a high-risk AI system should preserve safety, ensure continuous operation, real-time functioning, smooth control, and improve process efficiency. Human oversight needs to be continuously ensured, both to preserve safety of the process in case of transition from autonomous to manual mode in case of failures, but also to allow for contextual knowledge of the decisions. All these objectives are included in the AI operational alignment. High-risk AI systems designed to automatize complex processes in critical environments are continuously adapting to dynamic contexts, thus a static alignment might not be sufficient to properly assess their behaviour. The paper describes an approach to automated dynamic operational alignment in a complex high-risk process, exemplified by a case study on autonomous drilling. Possible sources of AI misalignments in this case are discussed and their potential implications.

Rodica Mihai, B. Daireaux, E. Cayeux · 0 citations
Open access Jul 2026

Is it safe to deploy AI in safety-critical systems?

The reality of deploying artificial intelligence in safety-critical systems, such as autonomous vehicles, medical diagnoses and weather forecasting, is considered, including how an AI's mathematical properties relate to its benefit and risk profile.

T. Kolda · 1 citation
Preprint Aug 2026

Agentic AI for Safety-critical Multi-drone Systems: Challenges and Opportunities

It is argued that agentic AI should be approached as a socio-technical design problem, where interfaces, oversight mechanisms, and evaluation practices are as critical as algorithms.

Timothy Merritt, Alejandro Jarabo-Peñas, Juan Bravo-Arrabal et al. · 0 citations
Review Open access Aug 2026

Integrated management systems in aviation: insights from case study research

Integrated Management Systems (IMS) have gained increasing attention within the aviation industry as organisations seek to manage multiple, often fragmented, management systems more effectively. Despite this interest, empirical research and regulatory guidance on IMS implementation in aviation remain limited, with much of the existing literature focusing on conceptual models rather than practical application. Recent studies emphasize the importance of incorporating risk as a unifying element within IMS, given its central role across all management systems. This paper presents a case study evaluating the practical applicability of an IMS model developed by Meeûs, which aims to bridge the gap between theoretical integration frameworks and operational implementation. The model is derived from an analysis of the International Civil Aviation Organization’s Safety Management System components and their alignment with various management systems, resulting in a standardized integration “language.” This language consists of a shared risk component and two classification mechanisms designed to identify events and underlying causes across multiple systems. The model further introduces the IMS Cube concept, enabling reported events to be reviewed holistically rather than in isolation within individual management systems. Using empirical data, this study analyses the feasibility of implementing the proposed IMS language and integrated process in an operational aviation context. The findings provide insights into the model’s behaviour in practice and contribute empirical evidence to support the advancement of risk-based integrated management systems in aviation.

Joeri Meeûs, Wouter Dewulf, Rosário Macário · 0 citations
Review Open access Jul 2026

A Systems-Based Safety Innovation Framework for Occupational Risk Management in Electrical Power Systems

The rapid digitalization and decarbonization of electrical power systems have brought increased operational complexity and new occupational risk dynamics. This transition renders traditional compliance-based safety models inadequate for managing the emerging complexities of cyber–physical and socio-technical systems. This paper develops a conceptual socio-technical safety architecture for occupational risk management in electrical power systems, grounded in the concepts of systems innovation and socio-technical modeling. A structured narrative review of international standards, accident investigations, and emerging technologies is conducted to reinterpret hazards as interacting subsystems within a dynamic, adaptive framework. The proposed framework synthesizes technical safety controls, human reliability factors, and artificial intelligence-driven predictive maintenance within a single architecture, supported by dynamic feedback loops. The model addresses nonlinear risk propagation across smart grid applications, hydrogen systems, and battery energy storage systems. By transitioning from a reactive to a proactive, adaptive approach to safety governance, the architecture enhances the resilience of electrical power systems, reduces the potential for cascading failures, and aligns occupational safety with infrastructure modernization strategies for electrical power systems. The framework provides a conceptual basis for integrating technology innovation with occupational risk management across complex energy infrastructures undergoing digital transformation.

H. Smadi, S. Albatran, Yazan M. Alsmadi · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.