Skip to content
Open access

AlamViT: A Lightweight Spatiotemporal Facial Expression Model for Automated Pain Recognition

Sep 2026 · Mathematics · Vol 14, pp. 3376 · 0 citations · 28 references

TL;DR

AlamViT is presented, a computationally efficient video model that integrates Swin-style windowed spatial attention into a MobileViT backbone and appends a one-dimensional Swin temporal encoder and appends a one-dimensional Swin temporal encoder.

Abstract

Automated facial pain recognition could support future monitoring tools for patients who cannot reliably self-report pain. Existing approaches either neglect temporal dynamics by processing single frames or employ computationally demanding models. This paper presents AlamViT, a computationally efficient video model that integrates Swin-style windowed spatial attention into a MobileViT backbone and appends a one-dimensional Swin temporal encoder. To the best of the authors’ knowledge, this particular compact spatial–temporal integration has not previously been evaluated for facial pain recognition. The model is evaluated independently on the BioVid Heat Pain Database and AI4PAIN using subject-disjoint partitions. A three-seed BioVid experiment using consistently reconstructed preprocessing achieved 54.07%±4.62% hold-out test accuracy. For context, the original finalized single-run BioVid experiment reported 60.13% test accuracy. On AI4PAIN, the binary model attained 90.97% on the validation set after epoch and threshold selection on that set; this value is not a hold-out test or generalization estimate because binary test labels were unavailable. A three-class variant achieved 51.33% test accuracy on AI4PAIN. The baseline contains 3.11 M parameters and requires approximately 2.2 GFLOPs per frame. These measurements characterize algorithmic efficiency; deployment performance on clinical or edge hardware was not evaluated.

Read PDF

Similar papers

Open access Sep 2026

Model Capacity for Small-Sample Facial Expression Recognition

A stability-oriented convolutional study that rethinks model capacity for seven-class small-sample FER and combines stratified partitioning, grayscale normalization, compact VGG-style representation learning, global average pooling, label smoothing, dropout, L2 regularization, and momentum-based optimization to control...

Yang-Xuan Xie · 0 citations
#machine learning Preprint Oct 2026

GM-GReFEL: Geometry-Guided Spatiotemporal State-Space Learning for Robust Dynamic Facial Expression Recognition

Recognizing facial expressions in unconstrained video suffers from two coupled problems: self-attention grows quadratically in cost with clip length, and crowdsourced labels are noisy. We present GM-GReFEL, a spatiotemporal state-space network with a geometry-aware decision stage. Its Modulated GroupMamba backbone repl...

Yudhistira Arditya Pratama, Yi-Zeng Hsieh · 0 citations
Open access Oct 2026

TCAV-Based Cross-Representation Explainability for Facial Emotion Recognition

Deep learning has achieved strong predictive performance in facial emotion recognition (FER), but interpreting the internal representations underlying model decisions remains challenging. In this study, we propose a cross-representation concept-based explainability framework that extends TCAV analysis beyond a single v...

Simona Moldovanu, Sanda Florentina Mihalache, Cătălin Anghel et al. · 0 citations
Sep 2026

Hybrid convolutional neural network with attention mechanism to provide robust face expression recognition

A hybrid model which uses several ResNet50 mixed with VGG16 backbones to improve the local facial features with the global context for a robust FER solu-tion, and shows superior robustness to occlusions and pose, even under cross-dataset testing.

A. Ouza, Mohamed El Ghmary, A. Choukri · 0 citations
Open access Sep 2026

Cloud-Based Facial Expression Recognition Using Squeeze Vision Transformer

Purpose: This paper presents and evaluates a cloud-oriented facial expression recognition (FER) system built on a compact, squeeze-style Vision Transformer, and assesses its suitability as an accurate, resource-efficient modelling layer for cloud and edge-cloud deployment. Design/Methodology/Approach: A pretrained ViT-...

S. Al-darraji, A. J. Jalil · 0 citations
Book Open access Oct 2026

Self-Supervised Dual-Stream Temporal Learning for Neonatal Pain Estimation

Neonatal pain estimation from video is clinically important but challenging due to limited labelled data and the reliance of existing automated methods on facial appearance alone. Current approaches use handcrafted features or single-frame deep representations, overlooking the temporal body dynamics (such as limb flexi...

Muhammad Suhaib Shahid, M. Valstar, D. Sharkey et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.