Video understanding is increasingly performed by multi-stage LLM agents that separate temporal grounding, visual observation, and reasoning. Yet these stages are typically evaluated on different benchmarks and distributions, making it difficult to determine where hallucinations originate. We first organize existing ben...
M$^2$PFN is proposed, an end-to-end framework that turns this tabular foundation model into a multimodal AD predictor, and transfers even when the cognitive instrument changes.
Lu-Jia Zhong, Shuo Huang, Jian-Wei Zhang et al.· 0 citations
Current automated gait analysis for clinical applications relies on uninterpretable black-box classifiers. Although Vision-Language Models (VLMs) offer strong reasoning capabilities, applying them directly to gait videos often leads to hallucinations, because they struggle to measure subtle geometric deviations from ra...
Xiang-Yu Yin, Shi-Qi Wang, Abrar Alamri et al.· 0 citations
Results characterize agent reasoning as dynamic working state rather than permanent interaction history, and suggest that historical reasoning becomes more replaceable once task relevant derived state has been reliably externalized into code, files, tool outputs, or environmental feedback.
Ming-Xuan Wang, Fei Luo, Bo Wang et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
C3M is presented, a cross-session multimodal memory organization that maintains a bounded active index over persistent source text-image evidence in a bounded, query-blind memory budget for cross-session long-horizon tasks.
Xue-Shu Chen, Yan Wang, Zi-Hao Xue et al.· 0 citations
Chest radiographs are routinely used to verify the position of catheters, tubes, and other support devices. Existing image models often return labels or segmentations, while report-processing systems structure text without access to image geometry. We present an uncertainty-aware clinical knowledge graph that represent...
This work introduces WROP (World Reasoning with Object Permanence), a data infrastructure of 150 hand-designed cognitive science inspired tasks, divided into six cognitive categories, and builds Blender generators that randomize speed, lighting, camera angle, and other nuisance parameters while preserving each task's c...
Hao-Tian Zhang, Feng-Yuan Yu, Dezhi Luo et al.· 0 citations
We introduce the Pistis model family, comprising 27B- and 9B-parameter multimodal large language models built on Qwen3.6 and Qwen3.5, respectively, and developed through a general and scalable post-training framework. The framework first establishes a strong foundation through large-scale multimodal supervised fine-tun...
Heyu Chen, Xiao-Han Lan, Jia-Xin Li et al.· 0 citations
ART is a tool-injection framework that tunes any VLA model to leverage off-the-shelf tool modules for low-level vision, high-level affordance, and embodiment enhancement, and ART reduces the complexity of the action solution space through tool-use, which improves generalizability across different tasks but also reduces...
Ding-Ge Yi, Yanzhao Yu, Xi-Li Dai et al.· 1 citation
While large-scale text-to-image generative models have achieved unprecedented visual performance, their inherent reliance on multi-step iterative solvers incurs severe inference latency. Few-step distillation targeting the Classifier-Free Guidance (CFG) trajectory has emerged as the prevalent dual-dimensional compressi...
Yiting Wang, Jingyi Zhang, Wenhu Zhang et al.· 0 citations
Pretrained video diffusion models provide powerful spatiotemporal generative priors, making them a natural foundation for robotic world models. While recent world-action models jointly optimize future videos and actions, they predominantly treat video generation as an auxiliary representation for policy learning. Conse...
Zhaoyang Yang, Yurun Jin, Lizhe Qi et al.· 0 citations
A Target-Aware Frequency-Spatial Collaborative Enhancement (FSCE) framework for noise-resilient SAR ATR, which integrates frequency-spatial modeling for early feature stabilization with semantic regularization and an Adaptive Policy-driven Semantic Alignment mechanism.
Yan-Song Lin, Zi-Han Cheng, Zi-Yue Yang et al.· IEEE transactions on circuit...· 0 citations
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.
Computer scientist, entrepreneur, and philanthropist will collaborate with the MIT Schwarzman College of Computing to advance AI and scientific discovery.