While the proposed method outperforms many state-of-the-art competitors, all methods remain below a micro-averaged frame-level AUC threshold of 70% in the most challenging evaluation setup, confirming the difficulty of the proposed benchmark.
Alexandru-Bogdan Dura, Sebastian Balmuş, Radu Tudor Ionescu· 0 citations
QT is introduced, a Quantum-inspired Transformer for vision tasks with three components: angle-inspired encoding that maps image tokens to learned trigonometric Hilbert-space features analogous to quantum rotation-based state encoding; self-attention over these periodic features, inducing a classical cosine kernel appr...
This work formalizes update promotion as certified paired risk-difference auditing as well as building DISCERN, a sequential two-tier protocol that proves finite-sample validity and matching label-complexity bounds of order rho^2/eps^2 at the rate level.
MUSE decouples image annotation from question generation, enabling diverse tasks with controllable difficulty while reducing annotation effort, and it is hoped MUSE will serve as a standardized benchmark for advancing multi-modal understanding in situated educational applications.
Lu-Yao Zhu, X. Yee, Wei Li et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
ERPBench is introduced, a benchmark that evaluates screenshot-only agents on a live and reproducible system and scores each task against ground-truth values in its database and presents a production-grade harness that gates agent actions behind human approval for safe deployment.
Kratika Bhagtani, K. Sridhar, M. B. Pouyan et al.· 1 citation
Results support the effectiveness of caption memory for episodic reasoning over long egocentric video in wearable assistants with bounded frame budgets, growing visual-token costs, and long-context retrieval failures.
Dingli Liang, Yi Xie, Yu-Kai Huang et al.· 0 citations
UAV on-board vision systems are widely used for different activities, including monitoring in no-fly zones. In this case, the vision-equipped UAV streams a video to a ground server where an operator assists its activities. The latency of video transmission has a profound impact on the effectiveness of the operator assi...
Alam Noor, Luis Almeida, Kai Li et al.· 0 citations
Visual in-context learning (VICL) solves visual tasks by conditioning on a few input-output demonstrations without any model training. Recent advances in large vision-language models (VLMs) have shown promising VICL capability when the demonstration pair and the query belong to the same vision task, but real use cases...
A novel edge-aware transformer-based network, named RoofSeg, is developed for segmenting roof planes from LiDAR point clouds in a truly end-to-end manner and an Edge-Aware Mask Module (EAMM) is designed that sufficiently incorporates planar geometric prior of edges to enhance its discriminability for plane instance mas...
Si-Yuan You, Guo-Zheng Xu, Peng-Wei Zhou et al.· Isprs Journal of Photogramme...· 0 citations
This work investigates whether CLIP embeddings inherently contain information indicative of AI generation, and proposes a proposed pipeline that extracts visual embeddings using a frozen CLIP model, feeds its embeddings to lightweight networks, and fine-tunes only the final classifier.
A representation-aware and frequency-aware evaluation framework that measures internal embedding drift, spectral sensitivity, and structural smoothness (spatial consistency of vision tokens), alongside standard label-based metrics is introduced.
Farooq Ahmad Wani, Alessandro Suglia, Rohit Saxena et al.· arXiv.org· 2 citations
PhysStream is an autoregressive model for physics-grounded image-to-video synthesis that incorporates structured scene memory and supports fine-grained motion control via sparse velocity-increment signals that encode physical quantities, letting the model learn the underlying dynamics.
Chuhao Chen, Peter Wonka, Chao-Yang Wang et al.· 2 citations
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.
Computer scientist, entrepreneur, and philanthropist will collaborate with the MIT Schwarzman College of Computing to advance AI and scientific discovery.