Comparing Machine and Deep Learning for Electricity Theft Detection from Monthly Billing Data in an Emerging Energy Market

Abstract

This study addresses a regime-conditioned question in electricity theft detection: when only monthly billing series and inspection-confirmed labels are available, which supervised model families recover irregular consumption without relying on the temporal resolution of advanced metering infrastructure (AMI)? The working sample comprises 4000 utility customers and 864 confirmed theft cases, each represented by 53 monthly kWh values from January 2021 to May 2025. After majority-class undersampling that retains all theft observations and construction of a balanced 1:1 learning set, eight classifiers are compared under an 80/20 stratified split: K-Nearest Neighbors, Decision Tree, Support Vector Machine, Random Forest, two dense multilayer perceptrons, Long Short-Term Memory, and a one-dimensional Convolutional Neural Network. Performance is assessed through threshold-optimized accuracy together with precision, recall, F1-score, the area under the receiver operating characteristic curve (AUC), and confusion matrices. On the hold-out test set, Random Forest and the compact dense network both reach an accuracy of 0.685; Random Forest attains the highest AUC (0.748) and F1-score (0.677). Even so, these models miss about one-third of the hold-out theft accounts (59 and 65 false negatives out of 173). Sequential deep models underperform on this short monthly regime. The results support ensembles and compact dense networks for monthly theft screening and indicate that AMI-oriented sequential gains do not transfer automatically to 53-point billing vectors under the present protocol.