AI-Enhanced SaaS Reliability: LLM-Based Log Parsing, OOV Detection, and Early Failure Prediction

Abstract

Modern Software-as-a-Service (SaaS) environments generate voluminous, heterogeneous logs that exhibit rapid schema drift and semantic sparsity, rendering traditional template-based detection methods ineffective. This paper presents LLM-EP, a unified framework that utilizes Large Language Models (LLMs) for proactive error prediction via semantic log analysis. Unlike existing heuristics, LLM-EP employs a drift resilient semantic parser and an embedding driven normalization engine to maintain accuracy amidst evolving log formats. We propose a hybrid offline-online architecture that balances deep semantic understanding with real-time inference requirements, incorporating a robust outof-vocabulary (OOV) mechanism for zero-shot generalization to unseen log patterns. Evaluation on production SaaS datasets indicates that LLM-EP achieves a 25% gain in parsing accuracy and a 12% improvement in F1-score over state-of-the-art baselines. Most notably, LLM-EP reduces Mean Time to Detect (MTTD) by up to 60%, demonstrating its efficacy as a scalable foundation for automated site reliability engineering.