Keyframe selection (KFS) has long produced compact video summaries for browsing and retrieval, and representative frames for thumbnails. More recently, when conditioned on a question, KFS provides an alternative to uniform sampling for long-video question answering by selecting frames that are more relevant to the ques...
Weitai Kang, Hanieh Deilamsalehy, Yumo Xu et al.· 0 citations
Developing label-efficient models is a central challenge in surgical AI due to the high cost and scarcity of expert annotation. While self-supervised foundation models adapt well to new tasks with minimal data, how label efficiency varies across different surgical tasks remains largely unexplored. Here, we introduce SU...
F. Stilz, L. Arboit, V. Srivastav et al.· 0 citations
Video-to-music models have advanced considerably in the last few years, particularly in film and music video applications. In this paper, we investigate this problem in the video game domain, which introduces new challenges for these models: video frames are rendered graphics, music is mostly synthetic audio, and sound...
Felipe Marra, Lucas N. Ferreira· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
A practical way to build general-purpose manipulation experiments around GPT-6-Astra is suggested: supply machine-readable body descriptions and synchronized demonstrations, and turn useful agent-generated feedback routines into reusable skills, while the agent adapts actions from current images.
Si-Da He, Ling-Xi Xie, Yun-Ning Cao et al.· 0 citations
Acute Lymphoblastic Leukemia (ALL) patients require early, accurate detection to enable timely treatment and effective patient management. A Convolutional Neural Network (CNN) is well-suited for creating an end-to-end enabling environment for ALL detection and classification. However, most CNN-based ALL detection syste...
Experimental results demonstrate that GERIS outperforms existing instance selection methods in terms of classification accuracy and robustness, and offers a transparent, theoretically grounded mechanism for data filtering.
S. Shani, Rouhollah Ahmadian, Amin Rahmani et al.· 0 citations
Collaborative medical AI platforms allow researchers to train models on sensitive imaging data while restricting data export. However, trained models can serve as covert carriers of patient information: medical images may be encoded within model parameters and reconstructed outside the secure environment. Existing defe...
Elie Thellier, Hui-Yu Li, Nicholas Ayache et al.· 0 citations
This paper proposes self-supervised VOS with Sliding window, Wavelet transform and optimal Transport (SWT), a self-supervised VOS framework entirely trained on static dataset using contrastive learning that achieves excellent results on five VOS datasets as well as an additional body part propagation dataset.
Zheng Zhu, Jia-Qing Fan, Han-Wen Qian et al.· 0 citations
This work uses Fast Fourier Transform (FFT) representation with EfficientNet-B0 for AI-generated image detection and investigates ECA, U-Net, and Attention U-Net as alternatives to this direct encoder-to-classifier approach.
Images often carry recommendation constraints that text metadata only hints at. A movie may need to look dark, a product may need a minimal style, and a visually impossible request should be rejected. Agentic multimodal recommenders must reason over text-image evidence, decide when visual evidence is decisive, and abst...
This survey reviews video understanding agents: systems that use video as the primary information source and solve understanding tasks through adaptive state construction and action selection, and identifies open directions toward agentic-native temporal modeling and video-native agents.
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.
Computer scientist, entrepreneur, and philanthropist will collaborate with the MIT Schwarzman College of Computing to advance AI and scientific discovery.