Ptychographic imaging at synchrotron and X-ray free-electron laser sources requires densely overlapping scans, which limits throughput and increases dose; extending coherent diffractive imaging to overlap-free operation on extended samples remains an open problem. We present a self-supervised inverse-mapping network fo...
O. Hoidn, Steven Henke, A. Vong et al.· Optics Express· 1 citation
This work explores post-training to achieve fully unified text-image generation, where a model autonomously transitions from textual reasoning to visual synthesis within a single inference process, and enables improvements in multimodal image generation across four diverse, independent T2I benchmarks.
Jiahui Chen, Philippe Hansen-Estruch, Xiao-Chuang Han et al.· arXiv.org· 1 citation
A novel online test-time domain generalization framework for CTTA, dubbed TestDG, which aims to learn features invariant to both current and previous test domains on the fly during testing, improving the potential for effective generalization to future domains.
Sohyun Lee, Nayeong Kim, Juwon Kang et al.· 0 citations
It is demonstrated that separately encoding text and visual instructions, combined with co-training using shallow feature control, is essential to mitigate task ambiguity and enhance multi-task generalization and pave the way for more robust and generalizable low-level vision systems.
Yuandong Pu, Le Zhuo, Kaiwen Zhu et al.· arXiv.org· 19 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
A unified 3D pancreas segmentation framework that applies domain-adversarial learning to 4,604 heterogeneous CT and MRI scans to learn anatomical representations is developed and demonstrated that a unified anatomical representation can support both cross-modality pancreas segmentation and label-efficient downstream tr...
Zi-Liang Hong, Hong-Yi Pan, H. Aktas et al.· 0 citations
Label-Guided Knowledge Distillation (LGKD) is proposed to guide the distillation of student model features using ground truth labels to enhance the student's ability to learn higher-dimensional semantic information and improving model generalization.
Flat roofs are among the most influential components of the building envelope, governing both structural performance and thermal efficiency, and thereby contributing directly to household energy consumption, carbon emissions, and long-term environmental sustainability. Timely detection of roof defects is essential for...
Samuel Dunthorne, Hashim A. Hashim· Journal of Safety Science an...· 1 citation
This paper explores unsupervised TBPS, with only unlabeled images, and proposes GTR, a two-stage generation-then-retrieval framework for text-based person search, and contributes LargeFine-Person, a large-scale TBPS dataset with high-quality, fine-grained, and diverse textual annotations.
Mang Ye, Yucheng Ji, Yang Bai et al.· IEEE Transactions on Pattern...· 0 citations
UniPart, a feed-forward cross-modal 3D Transformer that conditions CLIP text embedding, is introduced, a feed-forward cross-modal 3D Transformer that achieves strong zero-shot results on open-vocabulary part benchmarks and transfers to language-conditioned part grasping in real world.
Xinqiang Yu, Zekun Qi, Jia-Wei He et al.· 0 citations
Datasets are a crucial element in the development of perception algorithms. They relate sensor measurement data to annotated reference information and allow for the deduction of sensor and object characteristics. In autonomous driving, the reference data commonly consist of semantic image segmentation, point-wise assoc...
Philipp Berthold, Bianca Forkel, Mirko Maehlisch· 0 citations
Computed tomography (CT) and positron emission tomography (PET) provide complementary anatomical and functional information for cancer diagnosis and treatment planning. However, the widespread use of PET is limited by high radiation exposure, elevated costs, and restricted availability. To address these limitations, de...
Sarita Mourya, Francesco Di Feola, Pierangelo Veltri et al.· 0 citations
This work presents VideoXAgent, a purely online video-agent harness for long video understanding that starts from the given video file and user query, plans and decomposes the task, invokes specialized expert tools on demand, and aggregates multimodal evidence to produce a final answer while resolving conflicts among o...
Sen Yang, Bo-Qiang Duan, Jing Yang et al.· 2 citations
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.
Computer scientist, entrepreneur, and philanthropist will collaborate with the MIT Schwarzman College of Computing to advance AI and scientific discovery.