Jul 2026· Journal of Chemical Information and Modeling· 0 citations· 27 references
MedicineComputer Science
TL;DR
This work develops the Bayesian Class-Attentive Transformer Network, a unified Bayesian framework that integrates classification-to-regression knowledge fusion, uncertainty quantification, and active learning for data-efficient molecular property prediction and establishes a generalizable paradigm for uncertainty-aware molecular modeling.
Abstract
Accurate prediction of molecular bioactivity is a fundamental goal in rational drug design but remains challenging due to data scarcity and label imbalance. To address these limitations, we propose a unified Bayesian framework that integrates classification-to-regression knowledge fusion, uncertainty quantification, and active learning for data-efficient molecular property prediction. Specifically, we develop the Bayesian Class-Attentive Transformer Network (BCATNet). This model learns activity patterns from abundant classification data and incorporates the predicted probabilities as informative priors to guide the subsequent Bayesian regression task. Structurally, BCATNet employs a cross-token attention mechanism to model nonlinear interactions between class-derived semantics and molecular structural features. Comparative experiments against conventional machine learning models, graph neural networks, pretrained molecular models, and classification-guided baselines further demonstrated that explicit classification-to-regression knowledge fusion can provide a competitive and data-efficient alternative to generic molecular pretraining. Under reduced regression supervision, BCATNet maintained lower prediction errors and stronger robustness than competing models, supporting its utility in label-scarce settings. Beyond accuracy, the Bayesian formulation generated uncertainty estimates that were informative for reliability assessment: high-uncertainty predictions showed larger regression errors, and uncertainty-based risk stratification separated low-, medium-, and high-risk molecular predictions. Finally, BCATNet uncertainty served as an effective acquisition signal in active learning, with uncertainty-driven strategies achieving the best final performance in most benchmark tasks. Overall, BCATNet establishes a generalizable paradigm for uncertainty-aware molecular modeling by bridging classification and regression tasks within a Bayesian framework, offering a principled route toward reliable, interpretable, and resource-efficient drug discovery.
Monroe is presented, a new MFM with several innovations over the existing state of the art: increased scale allowing pre-training on over 81 million molecules from the PM6 quantum chemistry dataset; improved graph representation of stereochemistry; improved training losses including conformer denoising and embedding decorrelation; improved multi-task learning; and the use of a prior-data-fitted model (TabPFN) for downstream in-context prediction.
Blazej Banaszewski, Andrew W. Fitzgibbon· 0 citations
EQTri-DTI is designed to integrate three modality-specific networks to encode 1D protein sequences, 2D molecular images, and 3D drug structures and develops a joint uncertainty quantification scheme by calculating the weight summation of evidential uncertainty and prediction entropy from the aforementioned output, enabling a more comprehensive and nuanced assessment of uncertainties.
A trained molecular property model can be refined at test time by correcting each prediction with the measured labels of the most similar training molecules, a retraining-free procedure we call neighbor fusion; evidential neural networks make it principled by using their aleatoric and epistemic uncertainty to parameterize a Bayesian update. Our main contribution, PG-EVIKAL, learns a property-distance metric to re-rank structurally similar neighbors by their property relevance before fusion, building on EVIKAL (scalar Kalman filter) and GP-EVIKAL (Gaussian process variant handling correlated neighbors). Evaluated on 16 molecular datasets, PG-EVIKAL reduces RMSE relative to the evidential model baseline on 14 of them, with a median reduction of 19.4%, and improves calibration; in sequential-assay scenarios it further incorporates newly measured molecules, refining predictions as they arrive without retraining. This work demonstrates that evidential uncertainty decomposition is not merely a calibration objective but an actionable inference resource that enables test-time refinement of molecular property predictions.
Cameron Gruich, Yao Weichi, Yixin Wang et al.· arXiv.org· 0 citations
CoMPASS is presented, a retrieval-calibrated framework for small-large model collaboration that retains a graph attention network as the predictive anchor, retrieves locally relevant training molecules, provides attention-grounded evidence to an LLM, and converts its proposal into a bounded correction through an agreement-aware gate.
Wen-Tao Li, Jiang-Jie Qiu, Yi-Jun Li et al.· 0 citations
A two-stage contrastive learning framework integrating drug structures, protein sequences, and Cell Painting morphological profiles into a unified embedding space, which reveals pathway-specific morphological signatures associated with drug targets, providing biologically interpretable insights into drug mechanisms.
This review provides a systematic overview of recent advances in SSL-based molecular property prediction and analyzes how multimodal molecular representation learning by integrating sequence, graph, three-dimensional structure, and textual information can improve the quality and expressiveness of molecular representations.
Shuning Yang, Lei Deng· Journal of Chemical Informat...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.