Preliminary evidence is presented that reinforcement learning with verifiable rewards can elicit some latent multi-view competence in the base model, pointing to training-time approaches as a promising direction for future work.
Hyungjin Chung, Byeongjun Park, Joonseok Lee et al.· 0 citations
Action-conditioned video world models aim to predict scene evolution under different actions, a capability that is essential for reliable planning, decision-making, and interaction in dynamic environments. However, futures generated independently from the same initial scene may each appear plausible while implying inco...
Single-image novel view synthesis (NVS) enables photorealistic rendering of un- observed viewpoints from a single input. Practical NVS systems require two key capabilities: robust reconstruction of occluded regions and high inference effi- ciency. While hybrid decoupled frameworks combining feedforward 3D Gaussian Spla...
Xuan-Zhi Liu, Yu-He Zhou, Xinyi Wu et al.· 0 citations
This work proposes UltraG-Agent, which combines the semantic reasoning capabilities of a VLM with the ultrasound-specific segmentation capability of UltraSAM3, and shows that UltraG-Agent substantially improves both semantic prediction and pixel-level visual grounding.
Quan-Hao Zhu, Bo Xu, Rui Lin et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Reasoning segmentation aims to interpret implicit textual queries and enable fine-grained visual perception, which is critical for applications such as human-computer interaction and embodied agents. Existing methods typically generate explicit Chain-of-Thought (CoT) by multimodal large language models (MLLMs) before l...
Tian-Hang Guo, Yu-Lin He, Wei Chen et al.· 0 citations
TrafficImag is introduced, the first benchmark for counterfactual roadside traffic video generation, which combines a large-scale roadside dataset with an executable protocol that supports behavior reasoning, intervention-aware image editing, and conditional video generation.
Xiang-Yu Li, Tian-Yi Wang, Zhi-Hao Dou et al.· 0 citations
VLALight is proposed, a lightweight end-to-end vision-language-action framework that directly maps intersection observations and signal-phase information to discrete signal actions and enables direct action prediction with a compact 0.5 B-parameter model.
Ke-Mou Jiang, Mao-Nan Wang, Xingchen Zou et al.· 0 citations
A key challenge in medical image analysis is the scarcity of large annotated datasets for specific populations and diseases. As deep learning models rely heavily on labeled data, effective transfer learning strategies are needed to reduce the dependence on manual annotations. Self-supervised learning has emerged as a p...
Tasneem Nasser, Susanne Schmid, Roberto Souza et al.· 0 citations
Spatial misregistration and cross-modal discrepancies often cause ghosting, structural blurring, and content imbalance in RGB-T fusion. Existing methods typically decouple appearance adaptation, geometric alignment, and information fusion, limiting dependency propagation across stages. We propose Source-Anchored Guidan...
Timing Li, Yiming Sun, Boan Tao et al.· 0 citations
Dermoscopy classifiers built on Vision Transformers process all image patches uniformly, although diagnostic evidence is concentrated in the lesion region. Existing token pruning methods reduce tokens using generic saliency or similarity signals, but rarely ask whether the retained subset still contains the lesion. Thi...
Synchronised action annotations are needed to train controllable world models and these datasets remain elusive. Existing approaches make use of instrumented platforms with calibrated sensors, costly manual annotation, or latent-action models which lack grounding. We instead turn ordinary unlabelled video into action-s...
Ashish Sundar, Tiankuo Hou, Zhong Fan et al.· 0 citations
Multimodal misinformation is increasingly crafted to look convincing by pairing a textual claim with an image that appears to"prove"it. Yet in practice, building effective detectors often hinges on a small set of design choices that are rarely examined in a controlled way. In this paper, we conduct a large-scale study...
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.
Computer scientist, entrepreneur, and philanthropist will collaborate with the MIT Schwarzman College of Computing to advance AI and scientific discovery.