This work aims to establish a unified perspective on vision-based mistake analysis in procedural activities, highlighting its potential across diverse domains and aspects and categorizing approaches based on their use of procedural structure, supervision levels and learning strategies.
This paper provides a comprehensive survey of the current state of action recognition, focusing specifically on three open-world challenges: the integration of multimodalities, the ethical and social implications of these technologies, and the utilization of feedback mechanisms to enhance model performance.
An overview of Vision LLM architectures, their applications and the challenges they face and case study of how building of AI Models through visionLLM may help IndoAI AI camera system are provided.
Rohit Yadav· Journal of Artificial Intell...· 0 citations
RegulAR models task instructions as a hierarchical dependency graph and combines this structure with a Multimodal Large Language Model (MLLM) to interpret egocentric observations during execution and enables RegulAR to track progress, identify deviations by error type, estimate their impact on later steps, and deliver...
Yi-Lin Ye, Jindu Wang, Hiu-Tung Wong et al.· 1 citation
IMBENCH is introduced, a benchmark designed to evaluate intuitive manipulation as an integrated capability spanning perception, physical reasoning, action generation, and iterative execution, and position IMBENCH as a step toward evaluating and enabling more integrated, adaptive physical intelligence.
A vision-guided robotic action generation framework that explicitly models the data flow from visual perception to robotic action execution and introduces a structured visual data extraction mechanism that interprets raw visual outputs into type-consistent, constraint-aware, and physically feasible motion parameters, e...
Longxiang Huang, Jiaxin Dai, Tao Wang et al.· International Conference on...· 0 citations
ALVA (Action- and Language-Conditioned Video Assessment), a trajectory evaluator that conditions its assessment on visual observations, the executed action sequence, and the natural language instruction, provides more effective feedback than the evaluated static image and embedding-based visual baselines and reduces th...
Hwanhee Kim, Jaehyun Jang, Seung-Min Cha et al.· Italian National Conference...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
