Skip to content
#explainable ai Open access

ORDINAL-EVIDENTIAL DYNAMIC HYPERGRAPH STATE-SPACE LEARNING FOR RELIABLE CHILD ENGAGEMENT RISK PREDICTION

Oct 2026 · World Journal of Advanced Engineering Technology and Sciences · 0 citations
Emotion and Mood Recognition

Abstract

The recognition of children's engagement and behavioural risk is critical to building a trusted AI-based approach to education and mental health support. However, current work shows that common engagement-recognition methods lack modelling of complex facial–temporal interactions, do not capture the ordering of engagement states, are prone to class imbalance, and often yield overconfident predictions in ambiguous behavioural settings. This study introduces OE-DHSSNet and the ER-MOBH optimisation strategy for uncertainty-aware and explainable engagement assessment. A selective state-space temporal encoder models long-range behavioural dependencies at low computational cost, and the framework establishes dynamic hypergraph relationships among behaviour-related, facial, and motion cues. An ordinal-evidential prediction head jointly estimates engagement levels and predictive uncertainty, while ER-MOBH jointly optimises predictive performance, calibration, and inference latency under constraints. The framework is built around the DAiSEE dataset, which provides four-level engagement labels, and also includes an EmotiW-based branch for out-of-distribution reliability analysis. In an illustrative, simulation-based evaluation designed to exercise the intended experimental protocol, the optimised OE-DHSSNet configuration reached an accuracy of 95.81%, a macro-F1 score of 94.45%, and a quadratic weighted kappa of 0.947, with an expected calibration error of 0.023 and an expected latency of approximately 32.6 ms per video sample. Explainability analysis further indicated that, for the 'Very High' engagement category, the eye/upper-face contribution (44%) was higher than for the 'Very Low' engagement condition (19%), whereas the head-pose/motion contribution was lower for 'Very High' (14%) than for 'Very Low' (42%). Evidential uncertainty correspondingly grew from 0.06 to 0.24, the expected direction for increasingly ambiguous behaviour. The proposed framework can thus help future educational-monitoring and early behavioural-risk-support AI systems, which must be trustworthy, by offering a unified approach to ordinal engagement recognition, uncertainty quantification and calibration, multi-objective optimisation, and interpretable behavioural assessment.

Read PDF

Similar papers

#artificial intelligence Conference Open access Apr 2020

ECCOLA - a Method for Implementing Ethically Aligned AI Systems

The method, ECCOLA, is presented, which aims at making the high-level AI ethics principles more practical, making it possible for developers to more easily implement them in practice.

Ville Vakkuri, Kai-Kristian Kemell, P. Abrahamsson · 64 citations · ⚡6
#computer vision Review Apr 2024

AI-powered Code Review with LLMs: Early Results

The goal is to not only refine the accuracy of the LLM-based tool but also to underscore its potential in streamlining the software development lifecycle through proactive code improvement and education.

Z. Rasheed, Malik Abdul Sami, Muhammad Waseem et al. · 62 citations · ⚡3
#computer vision Open access Mar 2024

LLM-based agents for automating the enhancement of user story quality: An early report

The use of large language models to automatically improve the user story quality in Austrian Post Group IT agile teams is explored, with a reference model for an Autonomous LLM-based Agent System developed and implemented at the company.

Zheying Zhang, M. Rayhan, Tomas Herda et al. · 48 citations · ⚡4
#computer vision Review Mar 2024

System for systematic literature review using multiple AI agents: Concept and an empirical evaluation

This paper introduces a novel multi-AI-agent system designed to fully automate SLRs, and demonstrates how it substantially reduces the time and effort traditionally required for SLRs while maintaining comprehensiveness and precision.

Abdul Malik Sami, Z. Rasheed, Kai-Kristian Kemell et al. · 44 citations · ⚡2
#computer vision Feb 2024

Can Large Language Models Serve as Data Analysts? A Multi-Agent Assisted Approach for Qualitative Data Analysis

The proposed LLM-based multi-agent system automates qualitative data analysis process, creating opportunities for researchers and practitioners, and future improvements focus on enhancing multilingual performance and integrating continuous expert feedback.

Z. Rasheed, Muhammad Waseem, Aakash Ahmad et al. · 41 citations
#artificial intelligence Conference Open access Jun 2018

The Key Concepts of Ethics of Artificial Intelligence

It is suggested that the focus on finding keywords is the first step in guiding and providing direction for future research in the AI ethics field.

Ville Vakkuri, P. Abrahamsson · 39 citations · ⚡2

Related blog posts

Microsoft Research Blog Oct 7, 2026

Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses

Training AI agents with reinforcement learning can be challenging because their tools, context, and decision-making are managed by complex frameworks. Agent Lightning connects existing agents to RL training, making it easier to improve them without rebuilding them. The post Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.