Aug 2026· International Journal of Creative and Open Research in Engineering and Management· Vol 02, pp. 1-9· 0 citations
TL;DR
A unified drift-aware framework for explainable diagnostics in deployed machine learning systems is proposed that can support proactive model monitoring and assist practitioners in deciding whether continued monitoring, investigation, recalibration, or model retraining is required.
Abstract
Machine learning (ML) models are increasingly deployed in real-world environments where data characteristics, user behaviour, and operating conditions may change over time. Such changes can lead to data or concept drift and may gradually reduce model reliability. Existing monitoring approaches can identify distributional changes or performance degradation, but they often provide limited information about why the changes occur. Similarly, Explainable Artificial Intelligence (XAI) methods can explain model predictions but are frequently treated separately from continuous drift monitoring. This paper proposes a unified drift-aware framework for explainable diagnostics in deployed machine learning systems. The framework integrates data-drift detection, model-performance monitoring, explainability, and diagnostic decision-making into a continuous monitoring pipeline. Statistical drift detection methods are used to identify changes between reference and production data, while XAI techniques such as SHAP and LIME are used to identify important features associated with changes in model behaviour. The framework combines drift indicators and performance information to generate interpretable diagnostic reports and recommend suitable maintenance actions. The proposed approach aims to improve the transparency, reliability, and maintainability of deployed ML systems by connecting drift detection with actionable explanations. The framework can support proactive model monitoring and assist practitioners in deciding whether continued monitoring, investigation, recalibration, or model retraining is required.
Keywords: Explainable AI,Machine Learning Deployment, Model Monitoring,Drift Detection
Model performance monitoring is a standard practice in machine learning deployments. Detection performance is tracked continuously, and model decay is expected as the relationship between the feature and target variables degrades, a phenomenon known as concept drift. Explanation fidelity, however, is rarely monitored w...
The Real-time Drift Detection Method (RTDDM) detects drift by integrating supervised and unsupervised learning: the authors simultaneously train a classifier and fit a clustering model on the same dataset, thereby linking classifier accuracy to cluster purity.
The Stream Cruise Control Method (SCCM) is presented, a comprehensive framework for drift detection and adaptation in online regression and adopts an in-memory design for real-time adaptability, unlike purely reactive methods that typically activate adaptation only after performance degradation is observed.
Mohammad Abu-Shaira, Wei-Shi Shi· Information Sciences· 0 citations
Time-series anomaly detection (TSAD) identifies deviations from patterns learned from historical data. In non-stationary settings, distribution drift and true anomalies can cause similar local changes, making it difficult to tell whether a deviation reflects abnormality or evolving context. Existing methods typically a...
Xu-Dong Mou, Tie-Jun Wang, Rui Wang et al.· 0 citations
This work proposes a novel MLaaS Performance Drift Detection framework for IoT environments that employs an MLaaS extraction model that learns service behavior from input-output pairs and identifies prediction-influenced features, and designs an Adaptive-Temporal Performance Drift Detection Mechanism that dynamically a...
Deepak Kanneganti, Sajib Mistry, S. Fattah et al.· IEEE Transactions on Network...· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.