Skip to content

Category

computer vision

3,462 papers

#computer vision Preprint Aug 2026

WA-JEPA: Rethinking the Video JEPA Paradigm for World-Action Modeling in Autonomous Driving

WA-JEPA is presented, a V-JEPA-native world-action model designed for autonomous driving planning that employs hybrid future-masked pre-training and recast future prediction as conditional flow matching over latent futures, which substantially improves the model's ability to generate plausible future latents for downst...

Xin-Lin Wang, Yu Xiang, Yuheng Zhou et al. · 6 citations · ⚡1
#computer vision Jul 2026

Do All Visual Tokens Matter Equally? Object-Evidence Preserving Token Merging for Vision-Language Retrieval

SaMer is proposed, an object-aware token merging framework that compresses image-side post-projector tokens into representative centroids while preserving the original late-interaction interface, and outperforms compression baselines and shows stronger phrase-level grounding, suggesting that efficient multi-vector retr...

Suhyeong Park, Junha Jung, Jungwoo Park et al. · 1 citation

Class-Balanced Softmax: A Bayes Theory-Based Method for Long-Tailed Recognition

This work characterises a fundamental phenomenon in models trained on imbalanced data, termed the preference issue, wherein models exhibit higher training error and a larger generalisation gap for classes with limited data and demonstrates that CBS effectively mitigates the preference issue.

Yi-Hang Zhu, Rajeev Raman, Shiqi Su et al. · 0 citations
#machine learning Preprint Aug 2026

Scaling Reinforcement Learning for Diffusion Models via Velocity Matching

This work proposes reward-based velocity matching (RVM), a simple trajectory-free update that acts directly on the velocity field and provides a general framework that recovers recent fine-tuning methods, including RAM and DiffusionNFT, as special cases.

Jaemoo Choi, Wei Guo, Yuchen Zhu et al. · 1 citation
#computer vision Jul 2026

Filling Before Advancing: Capability-Gap-Driven Post-Training for Scenario-Specialized Remote Sensing MLLMs

This work instantiates FBA for coastal harbor understanding, a representative multi-source scenario, by constructing CPRS (Coastal-Port Remote Sensing), a three-layer supervision dataset coupled with three ordered stages: domain-bridge convergence for shared RS priors across target and bridging scenarios under differen...

Yu-Heng Zong, Ming-Hua Wang, Xin Zhao et al. · 0 citations

PepBAN: A Deep Learning Framework with Bilinear Attention and Adversarial Learning for Peptide-Protein Interaction Prediction

PepBAN is introduced, a deep learning framework for modeling PepPI predictions that effectively learns the pattern of pairwise local interactions, enables the identification of key residues participating in the peptide-protein interactions, and offers an intuitive approach to interpret the underlying mechanisms of PepP...

Shuaiyan Li, Xiaorui Wang, Yuchen Zhu et al. · 4 citations

SynGFN: learning across chemical space with generative flow-based molecular discovery

This study proposes SynGFN, which models molecular design as a cascade of simulated chemical reactions, enabling the assembly of molecules from synthesizable building blocks, as a bridge linking molecular design and synthesis, accelerating exploration and producing diverse, synthesizable, high-performance molecules.

Yuchen Zhu, Shuwang Li, Jihong Chen et al. · 3 citations
#computer vision Oct 2025

Allosteric Cooperativity Mechanism Investigation of Orthosteric and Allosteric Ligands in Modulating AR Activity: A Molecular Dynamics Study

Results indicate that BF3 antagonists can synergize with the LBP antagonist to amplify conformational flexibility in H12 and induce anticorrelated dynamics of H12 with H3 and H4, suggesting a promising avenue for enhancing the efficacy and overcoming the resistance in castration-resistant prostate cancer treatment.

Xiaotian Kong, Yushan Zou, Peng Cao et al. · 1 citation

ChargeNet: E(3) Equivariant Graph Attention Network for Atomic Charge Prediction

This work introduces an advanced equivariant graph attention neural network specifically engineered to model long-range atomic electrostatic interactions with high precision, and improves the model's accuracy, generalization, and robustness in complex scenarios.

Qiaolin Gou, Qun Su, Ji-Ke Wang et al. · 1 citation

PepPCBench is a Comprehensive Benchmarking Framework for Protein-Peptide Complex Structure Prediction

PepPCBench enables a robust evaluation of PFNN-based methods and supports their continued development for peptide-protein structure prediction, and highlights the influence of peptide length, conformational flexibility, and training set similarity on prediction accuracy.

Si-Long Zhai, Huifeng Zhao, Ji-Ke Wang et al. · 13 citations · ⚡1
#computer vision May 2025

A Unified Deep Graph Model for Identifying the Molecular Categories of Ligands Targeting Nuclear Receptors

This study established a unified model (NRIGN) based on the deep graphic architecture to discriminate agonists and antagonists targeting 26 successful or in-clinical-trial NR targets and achieves an excellent prediction accuracy and is robust enough to be applied in various real-world scenarios.

Kaimo Yang, Dejun Jiang, Qirui Deng et al. · 2 citations
#computer vision Oct 2025

ECloudGen: leveraging electron clouds as a latent variable to scale up structure-based molecular design

This study presents ECloudGen, which uses latent diffusion to generate electron clouds from protein pockets and decodes them into molecules, and adopts two-stage training, which expands the chemical space accessible to generative drug design.

Odin Zhang, Jieyu Jin, Zhenxing Wu et al. · 4 citations

From tech blogs

See all →
Microsoft Research Blog Oct 6, 2026

What AI gets wrong and what failure teaches us

Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity.  The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.