Skip to content
#edge computing Open access

Vision Transformers under TinyML Constraints in AIoT: A Systematic Review of Deployment Evidence

Sep 2026 · Zenodo (CERN European Organization for Nuclear Research)

Abstract

Background. Vision Transformers (ViTs) lead many visual-recognition benchmarks, but their memory and compute demands exceed the budgets of Artificial Intelligence of Things (AIoT) devices by orders of magnitude. Work claiming to close that gap reports latency, energy and memory on incomparable hardware and under unstated conditions. Objectives. To map which ViT architectures and efficiency techniques are deployed on which classes of constrained hardware (RQ1–RQ2), which domains and modalities they serve (RQ3), and how completely deployment evidence is reported (RQ4). Methods. Eight publisher platforms were searched for peer-reviewed work from January 2020 to September 2026, supplemented by two OpenAlex queries that repaired recall defects found during piloting. Of 4,182 records, 3,883 were screened at title–abstract level by a large language model under a fixed, published guide; an independent blinded second pass measured agreement and bounded the false-exclusion rate. Evidence was mapped against five hardware classes defined by the processor that executes inference. Results. Screening excluded 2,867 records and forwarded 1,016 to full text, 180 of which met every criterion at abstract level. Agreement between passes was κ = 0.93 (n = 382); after adjudication, the 95% upper bound on records wrongly excluded was 8.3% of those retained (11.5% before adjudication). Microcontroller deployment is nearly absent: 3 of the 180 records (1.7%) target an MCU, against 68 (38%) on FPGA/ASIC accelerators, 40 (22%) on embedded GPUs and 36 (20%) on application-processor CPUs; 26 (14%) name no target at all. Only 16 abstracts (9%) report memory and 61 (34%) report energy, whereas 124 (69%) report latency. Medical (174 of 1,016) and agricultural (115) applications dominate the applied work; thermal, depth and event-camera sensing together account for 27 records. Conclusions. The literature labelled "ViT at the edge" is overwhelmingly accelerator- and GPU-class work; the TinyML class that motivates it is almost unoccupied, memory — the binding constraint on a microcontroller — is the least reported metric, and energy appears in only a third of abstracts. A full-text audit of deployment evidence with DERS, a 12-criterion instrument introduced here, is the next stage.

View source

Similar papers

#computer vision Review Sep 2017

Agile Software Development Methods: Review and Analysis

This publication proposes a definition and a classification of agile software development approaches and analyses ten software development methods that can be characterized as being "agile" against the defined criterion.

P. Abrahamsson, O. Salo, Jussi Ronkainen et al. · 727 citations · ⚡54
#computer vision Jun 2008

The impact of agile practices on communication in software development

The study shows that agile practices improve both informal and formal communication, but indicates that, in larger development situations involving multiple external stakeholders, a mismatch of adequate communication mechanisms can sometimes even hinder the communication.

M. Pikkarainen, Jukka Haikara, O. Salo et al. · 401 citations · ⚡48
#machine learning Review Open access Oct 2014

Software development in startup companies: A systematic mapping study

The results indicate that software engineering work practices are chosen opportunistically, adapted and configured to provide value under the constrains imposed by the startup context.

Nicolò Paternoster, Carmine Giardino, M. Unterkalmsteiner et al. · 394 citations · ⚡54

Related blog posts

Microsoft Research Blog Oct 6, 2026

What AI gets wrong and what failure teaches us

Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity.  The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.