Skip to content
Open access

Accelerator-Free Thermal Pose Estimation: Accuracy–Efficiency Trade-Offs on the Raspberry Pi 5

Aug 2026 · Italian National Conference on Sensors · Vol 26, pp. 5188 · 0 citations · 43 references
Medicine

TL;DR

The findings indicate that, unlike GPU-based edge deployment where precision reduction is the dominant efficiency driver, export-format optimization governs the latency–power–energy trade-off on CPU-only hardware, and that NCNN-based deployment on low-cost, widely available single-board computers offers a practical alternative for smart home thermal pose estimation.

Abstract

Deploying human pose estimation on low-cost, accelerator-free hardware remains a key open question for smart home activity recognition, where affordability and wide availability often matter as much as raw inference speed. This work addresses that question by evaluating thermal-image pose estimation on a Raspberry Pi 5, a CPU-only single-board computer with no dedicated neural-network accelerator. Building on a previously collected single-person thermal dataset of 2500 images annotated with 17 body keypoints, YOLOv8-pose, YOLO11-pose, and YOLO26-pose models were trained across five model scales (n–x) at three input resolutions (640×512, 320×256, and 160×128 px) and deployed on the Raspberry Pi 5. Models were evaluated in native PyTorch, ONNX, and NCNN export formats, with per-image latency, power consumption, energy per frame, and pose mAP50–95 measured for each configuration. Pose accuracy scaled consistently with model size and input resolution, reaching up to 95.6% pose mAP50–95 for YOLO26-x at 640×512 px, with diminishing returns for the largest model scales. Export-format conversion to ONNX or NCNN preserved pose accuracy almost exactly relative to native PyTorch, with mean degradation below 0.6 percentage points, in contrast to the accuracy loss associated with numerical-precision reduction on GPU-accelerated platforms. NCNN consistently achieved the lowest per-image latency and energy consumption among the three formats, delivering up to 2.1–4.3× speed-up over PyTorch while keeping power draw up to 10 W across all configurations. The findings indicate that, unlike GPU-based edge deployment where precision reduction is the dominant efficiency driver, export-format optimization governs the latency–power–energy trade-off on CPU-only hardware, and that NCNN-based deployment on low-cost, widely available single-board computers offers a practical alternative for smart home thermal pose estimation.

Read PDF

Similar papers

Preprint Oct 2026

ZTA-Q: an Open-source RISC-V Platform for Accurate Quantized CNN Inference

Low-precision inference is widely adopted in edge AI to reduce computational cost and memory footprint. However, existing open-source accelerator platforms provide limited end-to-end support for CNNs following the standard TensorFlow Lite integer inference scheme. This paper presents ZTA-Q, an open-source RISC-V-based...

Yi-Ke Li, M. AjayKumar, PS Vishnu et al. · 0 citations
#machine learning Preprint Sep 2026

Is INT8 Portable? A Cross-Platform Measurement Study of Quantized Inference on Embedded and Automotive Accelerators

Eight-bit integer (INT8) post-training quantization is the default recipe for edge deployment, under a widely held assumption: INT8 makes inference faster at a small, predictable accuracy cost, and a model quantized once can be carried to any target. We test that assumption with a controlled measurement study across se...

Yu-Len T. Shin · 0 citations
#artificial intelligence Preprint Oct 2026

The Operator Mismatch Problem: Deploying BEV Perception with Portable GPU Compute

Modern autonomous driving systems rely on bird's-eye-view (BEV) perception models that fuse camera and LiDAR inputs to detect objects in 3D space. These models are accurate, but they cannot be deployed through standard inference runtimes. The reason is an operator mismatch between dense convolutions (which runtimes han...

Rohit Verma, Anand V. Bodas · 0 citations

vidax: A Unified JAX Framework for Video Generative Models on Accelerator Meshes

Open-source video generative models ship almost exclusively as PyTorch/CUDA reference implementations. This leaves Cloud TPU pods without a production-ready inference path, despite offering large, cost-effective accelerator memory pools ideal for long-sequence spatiotemporal attention. We present vidax, an open-source...

Cong-Yue Deng · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.