Skip to content
#small language model Open access

Construction of a Small Model Based on Large Model Knowledge Distillation in Anomaly Behaviour Recognition for Intelligent Connected Vehicles

Aug 2026 · 電腦學刊 · 0 citations · 13 references

TL;DR

Experimental results validate the feasibility of transferring knowledge from large models under low-computational-power constraints and provide a new technical pathway and engineering reference for recognising anomalies at the edge of intelligent connected vehicles.

Abstract

This paper proposes an end-to-end “large model annotation—small model distillation—onboard inference” framework to address a critical engineering bottleneck in the field of anomaly detection for intelligent connected vehicles: the tension between the strong reasoning capabilities of large language models and the severe resource constraints of edge computing. Specifically, the LongCat-Flash-Lite model (68.5 billion total parameters, approximately 3 billion activated parameters) is used as the teacher model, which performs three-level semantic annotation (Level 0: normal driving, Level 1: suspicious behaviour, Level 2: anomalous behaviour) on a balanced sample set pre-filtered by a TabNet coarse classifier, using few-shot prompting. Subsequently, the annotations serve as supervised signals to efficiently fine-tune the lightweight Qwen3-1.7B student model via Low-Rank Adaptation (LoRA), thereby transferring the large model’s anomaly-discrimination knowledge to the compact student model. Ultimately, the distilled student model performs inference independently on the onboard side without invoking a cloud-based large model API. In simulation experiments based on real vehicle telemetry data (originally 82.82 million records, downsampled to 1 million records), the proposed method achieved the following key results: (1) In the TabNet coarse-filtering stage, the binary classification accuracy reached 98.62% with a macro-average F1 score of 97.15%; (2) The LongCat-Flash-Lite teacher model annotated 120,000 balanced samples with an average confidence of 0.9174, and the distribution of the three annotation levels was 26.3%, 39.2%, and 34.6%, respectively; (3) After LoRA distillation, the student model’s accuracy improved from 27.50% to 32.10% (an absolute improvement of 4.60 percentage points), the macro-average F1 score increased from 0.1624 to 0.2468 (a relative improvement of 52.0%), and precision and recall improved by 7.49 and 2.83 percentage points, respectively. These experimental results validate the feasibility of transferring knowledge from large models under low-computational-power constraints and provide a new technical pathway and engineering reference for recognising anomalies at the edge of intelligent connected vehicles.

Read PDF

Similar papers

Open access Aug 2026

Myriad: a large multimodal model applying vision experts for industrial anomaly detection

A novel large multimodal model applying vision experts for industrial anomaly detection (abbreviated as Myriad), which treats conventional IAD models as VEs and converts their anomaly maps into lightweight prompts that steer a frozen Q-Former toward suspicious regions, while a compact low-rank adapter shapes features for IAD.

Yuanze Li, Haolin Wang, Shihao Yuan et al. · 0 citations
Preprint Aug 2026

An Explainable LLM Agent Layer for Open-World Anomaly Detection in Oil Wells

Open-World Learning (OWL) pipelines for oil well anomaly detection have recently been shown to combine autoencoder-based detection, multiclass classification, and Mahalanobis-based novelty detection on the public 3W dataset. These pipelines answer \textit{what happened}, but they do not explain \textit{why the model believes it} or \textit{what the operator should do next}, and they do not put a human-readable name on the novelty clusters they discover. This paper evaluates a Large Language Model (LLM) agent layer placed downstream of the OWL pipeline, designed as a \textbf{companion} to the published upstream methods rather than a replacement. Using the Qwen3.5-397B-A17B Mixture-of-Experts model served via NVIDIA NIM, the agent receives structured sensor metrics and upstream classification or novelty assertions, and returns natural-language justifications, confidence-ranked critiques, and consolidated names for detected novelties. Across three studies spanning 989 real well-file segments from the 3W dataset, the agent achieved $35.1\%$ top-1 / $63.9\%$ top-3 (95\% CI [56.9, 70.4]) classification on all nine classes, $71.7\%$ top-2 validation [64.8, 77.6] with precision $0.91$ [0.84, 0.95] across 7 probed classes, and $89.7\%$ novelty detection [87.0, 91.9] with stable cluster naming on 5 of 7 hidden classes. The agent is not a standalone classifier. Its role is to: (1) confirm upstream decisions when sensor evidence supports them, (2) justify decisions in sensor-grounded language operators can audit, (3) flag disagreement when upstream labels are implausible, and (4) name novelties so that clustered unlabeled events arrive at the engineer with a consolidated human-readable label. The goal is to close the explainability gap that currently blocks deployment of OWL pipelines in operational settings.

L. G. O. Lopes, Thales Miranda de Almeida Vieira, E. T. de Lima et al. · 0 citations
Conference Jul 2026

A Self-Contained Traffic Anomaly Detection System based on Distillation Learning for Resource Constrained Edge Deployment

Road traffic anomalies pose a critical threat to public safety, with fatality risk increasing by approximately 2.6% per minute of delayed medical response. While deep learning-based detection systems have shown promise, prevailing approaches either depend on computationally intensive architectures or cloud-based inference pipelines, rendering them unsuitable for resource-constrained deployments. Edge-capable alternatives, where they exist, typically demand relatively powerful dedicated hardware. This paper presents a fully self-contained traffic anomaly detection system deployed on a Raspberry Pi Zero 2W (based on a microprocessor operating at 1GHz and no specialized processing unit), without reliance on any external compute resources. The system is built on a lightweight spatiotemporal architecture trained via knowledge distillation, compressing a transformer-based teacher into a compact convolution-based student. The deployed model achieves a Top-1 accuracy of 76.23%, operating at 16.74FPS with an inference latency of 59.75ms on the target hardware.

A. V, M. Subash, Maheshwaran Athirstakumar et al. · 0 citations
Open access Aug 2026

Multi domain neural fusion for adaptive anomaly detection in connected and automated vehicles

Connected and Automated Vehicles (CAVs) rely on high-dimensional, multimodal sensor data and Vehicle-to-Everything (V2X) communication to support autonomous driving functions. This strong dependence exposes CAV systems to anomalies arising from sensor faults, environmental disturbances, and coordinated cyber–physical attacks. To address these challenges, this paper proposes a real-time hybrid anomaly detection framework that integrates multiple domain-specific models. The framework combines an LSTM-based time-domain model for sequential behavior analysis, an FFT-based frequency-domain model for spectral anomaly detection, and a context-aware multilayer perceptron (MLP) for incorporating environmental factors. To overcome data scarcity and improve robustness, synthetic anomalies are generated and integrated with benchmark datasets, including NGSIM, CAN-ID, and nuScenes. A learned fusion layer aggregates the outputs of the individual models into a unified anomaly score, while an online learning module dynamically adapts detection thresholds using sliding-window percentile recalibration. In addition, a Deep Q-Network (DQN)–based reinforcement learning agent supports adaptive decision-making under changing conditions. Model interpretability is enhanced through SHAP-based explanations and Human-in-the-Loop feedback, enabling continuous refinement of the detection process. Experimental results show that the proposed system achieves an accuracy of 98.10% before adaptation and improves to 98.91% after online learning and feedback. These results demonstrate that the proposed framework offers strong robustness, adaptability, and real-time suitability for safety-critical CAV environments.

Kumar Dorthi, Ravi Kanth Kotha, Neelima Bayyapu · 0 citations
Jul 2026

OPD-IAD: From Language Judgment to Industrial Anomaly Detection via On-Policy Self-Distillation

Large vision-language models (LVLMs) have recently shown strong potential for industrial anomaly detection (IAD) by providing image-level anomaly judgments and interpretable defect reasoning. However, current LVLM-based IAD methods still struggle to produce precise pixel-level anomaly maps from generated language judgments. We aim to achieve precise pixel-level localization while using language as guidance rather than letting it dominate the visual response. Specifically, we propose \textbf{OPD-IAD}, an evidence-privileged dense on-policy self-distillation framework for LVLM-based IAD. OPD-IAD distills privileged defect evidence onto the model's own on-policy judgment trajectory, enabling the final generated judgment to be learned under dense supervision rather than treated only as a textual answer. The resulting judgment serves as a semantic condition for dense anomaly perception. To turn this condition into dense visual evidence, we introduce \textbf{Language-guided Visual Anchoring}, which uses a judgment reforward to re-encode the image and question under the final-judgment condition into semantic anchors and contrasts them with dense visual features through a contrastive heatmap head to generate anomaly maps. The language judgment therefore provides compact semantic guidance, while dense visual features remain the basis for pixel-level scoring, allowing language to guide anomaly localization without letting language quality directly dictate the pixel-level response. Extensive experiments show that OPD-IAD achieves the best overall performance among LVLM-based IAD methods, leading on most image-level, pixel-level, and QA metrics.

Shuimu Chen, Jing Jin, Nan Su et al. · 1 citation

Related blog posts

MIT News · Artificial Intelligence Sep 14, 2026

New method enables AI for safety-critical situations

The “HardFlow” algorithm could help generative AI models produce high-quality outputs that obey strict requirements when “pretty close” doesn’t cut it.

GPT-Lab Sep 10, 2026

Responsible AI Must Consider Its Afterlife

AI may appear weightless, but every model depends on physical infrastructure. To understand responsible AI, we need to look beyond algorithms and consider the entire lifecycle of the hardware behind them. The post Responsible AI Must Consider Its Afterlife appeared first on GPT-Lab.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.