We present TropicalCycloneNext (TC-Next), a multimodal deep learning model that forecasts tropical cyclone track and intensity at $6$-$24$ h leads by leveraging a foundation model's forecast fields of atmospheric kinematic and thermodynamic fields and GridSat infrared satellite imagery. Trained only on GraphCast foreca...
Zhe Wang, Si-Jie Chen, Yi-Ming Luo et al.· 0 citations
The Relearning Score (RS), which jointly measures forget-class recovery and retain-accuracy preservation, and report class-matched $\Delta$RS relative to a retrained reference, is introduced.
Zahra Dehghani, Pablo Piantanida, Mohammadhadi Shateri· 0 citations
This work addresses open-world semantic segmentation, the joint task of segmenting known classes while detecting and grouping novel or anomalous content without additional supervision, by extending a dual-decoder baseline with a third, complementary decoder within a unified encoder-decoder design.
Anastasios Romanos Varvarigos, Nikos Giakoumoglou, Tania Stathaki· 0 citations
To better handle multiple visual inputs, Segment-Aware 3D Rotary Positional Embedding (SA-3D RoPE) is introduced, and chain-of-thought reasoning in the planner is incorporated to better transfer understanding into generation.
Chenchen Liu, Junying Chen, Lei Li et al.· arXiv.org· 10 citations· ⚡2
Reach audiences
Advertise in front of researchers, engineers, and readers.
FlatLands provides a rigorous testbed for uncertainty-aware indoor mapping and generative completion for embodied navigation and is instantiate the task as an end-to-end monocular RGB-to-floormaps pipeline.
Subhransu S. Bhattacharjee, Dylan Campbell, Rahul Shome· arXiv.org· 0 citations
Shiva-DiT, based on Residual-Based Differentiable Top-k Selection, provides four fidelity-latency operating points and reaches a 1.54x wall-clock speedup with competitive fidelity.
Experiments demonstrate that ContextAnyone improves both identity and fine-grained appearance consistency over existing reference-conditioned baselines while maintaining motion characteristics close to the underlying text-to-video generator.
MT2IE is presented, an evaluation framework in which a single multimodal large language model (MLLM) acts as an evaluator agent, iteratively generating the evaluation prompts and scoring the resulting images, showing that MT2IE's image-text consistency scores have higher correlation with human judgment than metrics pre...
This work constructs DaTikZ-V4, a dataset more than four times larger and substantially higher in quality than DaTikZ-V3, enriched with LLM-generated figure descriptions, and trains TikZilla, a family of small open-source Qwen models with a two-stage pipeline of SFT followed by reinforcement learning (RL).
RVSD is proposed, a training-free and plug-and-play decoding framework that unifies token sparsification and Semantic-Space Visual Retrieval (SSVR) within a single decoding pass, and asemantics-directed token selection is introduced within RVSD, which selectively sparsifies redundant tokens while preserving critical vi...
Can-Jie Liu, Jia-Wen Kang, Jin-Bo Wen et al.· 0 citations
Image enhancement and restoration have become standard back-end operations on short-video and social media platforms to boost UGC visual experience. Yet these processes inevitably introduce visual anomalies--especially in faces, texts, and textures--that directly undermine perceptual fidelity and viewer trust. While ex...
Yan Zhong, Gefei Chen, Qiufang Ma et al.· 0 citations
VMetaphor-Bench, the first benchmark for evaluating visual metaphor generation in T2I models, is introduced, combining a multiple-choice question (MCQ) based protocol of 9,594 questions across four levels of metaphorical fidelity with a dimension-based scoring protocol along three perceptual dimensions.
Chuer Chen, Zi-Chen Wang, Yi He et al.· 0 citations
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.
Computer scientist, entrepreneur, and philanthropist will collaborate with the MIT Schwarzman College of Computing to advance AI and scientific discovery.