The results support TriCLE as a practical prototype for interpretable, edge-feasible aircraft grouping, while emphasizing the need for further validation on real aligned thermal and LiDAR sensor streams.
Abstract
Edge platforms used for aerial observation must interpret aircraft imagery under limited memory, limited compute, and intermittent connectivity. This setting is difficult for standard RGB-only recognition models and general-purpose vision-language models, especially when calibrated thermal and LiDAR aircraft data are unavailable. We present TriCLE, an application-oriented tri-modal vision-language system for aircraft taxonomic grouping under edge constraints. From a single RGB aircraft image, TriCLE generates a structure-preserving FLIR-style thermal view and a pseudo-LiDAR depth projection, then fuses the aligned views with task instructions in a compact Qwen3-VL backbone. The model is aligned to an expert aircraft taxonomy based on propulsion, airframe family, size, design era, and configuration, so its outputs reflect engineering-relevant similarity rather than only surface appearance. We evaluate supervised fine-tuning, rotation-preserving SFT, and three policy-alignment strategies: GRPO, GSPO, and DAPO. Sequence-level GSPO gives the strongest validation performance, reaching 88.33\% validation accuracy and 0.91 weighted F1 on valid aircraft outputs. On a held-out aircraft test partition, GSPO achieves 78.00\% accuracy and 0.793 weighted F1 while preserving 94.00\% parseable output formatting. After 4-bit quantization and attention-memory optimization, the aligned 4B model fits an 8GB deployment target and processes each tri-modal triplet in 1.48 seconds. These results support TriCLE as a practical prototype for interpretable, edge-feasible aircraft grouping, while emphasizing the need for further validation on real aligned thermal and LiDAR sensor streams.
Unmanned aerial vehicles (UAVs) are used for a wide range of tasks, many of which are autonomous. Since UAVs operate in three-dimensional space, visual data presents a rich source of input for them. Meanwhile, the rapid development of artificial intelligence has given rise to vision-language models (VLMs). These models...
Elena Wachtler, Antonella Barisic Kulas, Tamara Petrović et al.· International Conference on...· 0 citations
To address the inherent limitations of Vision-Language Models in long-tail object retrieval for autonomous driving, this paper proposes a Dual-Granularity Structured Scene Retrieval (DG-SSR) architecture. By decoupling text queries and visual features, we introduce a parameter-free mechanism that fuses local semantic s...
Nan Jiang, Tongxuan Xu, Yu-Jin Wang et al.· 2026 IEEE International Conf...· 0 citations
This work proposes ARIES-Mission2, a zero-shot Vision-Language-Action (VLA) framework that decouples visual-semantic perception from physical route optimization in low-altitude Unmanned Aerial Vehicle (UAV) mission generation and indicates that the TSP module maintains lower growth in computation time as the number of...
Jun-Hao Wei, Yan-Xiao Li, Hao-Chen Li et al.· 1 citation
A single consumer-grade GPU running a vision-language model (VLM) is used to supply missing guidance on pixel-level segmentation, improving segmentation while producing structured, auditable evidence that drives the result and can be inspected on its own.
Teresa DiMeola, Charles Walter, Hong Xiao· 0 citations
MoRAL (Multimodal Reasoning for Autonomous Language Models), a two-stage fine-tuning pipeline that teaches Cosmos-Reason2-2B to first read a physics-encoded Bird's Eye View (BEV) representation and then reason over it for driving decisions, establishes a reproducible foundation for compact, physics-grounded VLM reasoni...
Ambarish Govindarajulu Kaliamurthi, Kai Liu· 0 citations
A structured evaluation protocol is proposed that assesses the deployment readiness of LiDAR semantic segmentation models along three complementary dimensions: coarse-label evaluation aligned with autonomous driving safety priorities, revealing how label granularity affects different methods; robustness under eight typ...
Samir Abou Haidar, Alexandre Chariot, Mehdi Darouich et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.