MUSE decouples image annotation from question generation, enabling diverse tasks with controllable difficulty while reducing annotation effort, and it is hoped MUSE will serve as a standardized benchmark for advancing multi-modal understanding in situated educational applications.
ERPBench is introduced, a benchmark that evaluates screenshot-only agents on a live and reproducible system and scores each task against ground-truth values in its database and presents a production-grade harness that gates agent actions behind human approval for safe deployment.
Kratika Bhagtani, K. Sridhar, M. B. Pouyan et al.· 1 citation
Results support the effectiveness of caption memory for episodic reasoning over long egocentric video in wearable assistants with bounded frame budgets, growing visual-token costs, and long-context retrieval failures.
Dingli Liang, Yi Xie, Yu-Kai Huang et al.· 0 citations
UAV on-board vision systems are widely used for different activities, including monitoring in no-fly zones. In this case, the vision-equipped UAV streams a video to a ground server where an operator assists its activities. The latency of video transmission has a profound impact on the effectiveness of the operator assi...
Alam Noor, Luis Almeida, Kai Li et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Visual in-context learning (VICL) solves visual tasks by conditioning on a few input-output demonstrations without any model training. Recent advances in large vision-language models (VLMs) have shown promising VICL capability when the demonstration pair and the query belong to the same vision task, but real use cases...
A novel edge-aware transformer-based network, named RoofSeg, is developed for segmenting roof planes from LiDAR point clouds in a truly end-to-end manner and an Edge-Aware Mask Module (EAMM) is designed that sufficiently incorporates planar geometric prior of edges to enhance its discriminability for plane instance mas...
Si-Yuan You, Guo-Zheng Xu, Peng-Wei Zhou et al.· Isprs Journal of Photogramme...· 0 citations
This work investigates whether CLIP embeddings inherently contain information indicative of AI generation, and proposes a proposed pipeline that extracts visual embeddings using a frozen CLIP model, feeds its embeddings to lightweight networks, and fine-tunes only the final classifier.
A representation-aware and frequency-aware evaluation framework that measures internal embedding drift, spectral sensitivity, and structural smoothness (spatial consistency of vision tokens), alongside standard label-based metrics is introduced.
Farooq Ahmad Wani, Alessandro Suglia, Rohit Saxena et al.· arXiv.org· 2 citations
PhysStream is an autoregressive model for physics-grounded image-to-video synthesis that incorporates structured scene memory and supports fine-grained motion control via sparse velocity-increment signals that encode physical quantities, letting the model learn the underlying dynamics.
Chuhao Chen, Peter Wonka, Chao-Yang Wang et al.· 2 citations
Det‐LIME is proposed, a detector‐aware, multi‐instance adaptation of Local Interpretable Model Agnostic Explanations that produced instance‐specific, box‐aligned explanations by combining per‐detection weighting, a proximity kernel that emphasizes regions near each box, and Intersection‐over‐Union‐based matching to tra...
Jia-Yi Zhou, David W. Johnston, Brinnae Bent· Marine mammal science· 0 citations
An occlusion-robust target tracking framework that maintains target identity and trajectory continuity through the integration of YOLOv11n object detection, Kalman Filter motion prediction, and occlusion-aware appearance-based re-identification is proposed.
Mais.M Mohammed, Sharifa Mohammed, Hanan Awadh et al.· 0 citations
Oracle bone script (OBS), one of the earliest Chinese writing systems, plays an important role in the study of Chinese etymology. Traditional decipherment relies heavily on domain experts who analyze characters through semantic context and structural evolution. To assist this labor-intensive process, we formulate OBS d...
Yanbin Hou, Biao Xiong, Guojun Xu et al.· 0 citations
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.
Computer scientist, entrepreneur, and philanthropist will collaborate with the MIT Schwarzman College of Computing to advance AI and scientific discovery.