Skip to content

HiCLR: Knowledge-Induced Hierarchical Contrastive Learning with Retrosynthesis Prediction Yields a Reaction Foundation Model

Jun 2025 · JACS Au · Vol 5, pp. 3140 - 3155 · 0 citations · 48 references
Medicine

TL;DR

HiCLR is the first foundation model that can be broadly applied to various synthesis-related tasks, and it achieves state-of-the-art performance in reaction classification, reaction condition recommendation, reaction yield prediction, synthesis planning, and even molecular property prediction.

Abstract

Reaction representation learning is of paramount importance for adopting deep-learning-based chemistry modeling to solve real-world tasks such as synthesis planning. Most prevailing models are prestrained by self-supervised objectives that rely solely on the chemical structure information. Since structurally similar reactions could possess entirely distinct properties (e.g., reaction yields) and the synthesis-related tasks are highly heterogeneous, there are inherent limitations in constructing a foundational reaction model within the existing approaches. To tackle this limitation, we propose HiCLR, a knowledge-induced hierarchical contrastive learning framework for chemical reactions, by introducing relational inductive bias to forge chemically meaningful and generally applicable reaction fingerprints. Critically, the pretraining scheme combining both retrosynthesis prediction and contrastive loss enables HiCLR to tackle generation-based and understanding-based tasks simultaneously. Comprehensive experiments demonstrate that HiCLR successfully organizes the reaction space into hierarchical global semantic clusters, aligned well with prior knowledge. Consequently, HiCLR is the first foundation model that can be broadly applied to various synthesis-related tasks, and it achieves state-of-the-art performance in reaction classification, reaction condition recommendation, reaction yield prediction, synthesis planning, and even molecular property prediction. HiCLR demonstrates clear benefits in incorporating domain knowledge to guide the learning of neural networks, expediting AI-driven advancements in chemistry.

Read PDF

Similar papers

Book Open access Aug 2026

Beyond Reaction Data: Learning Chemical Knowledge from Large-Scale Molecules for Retrosynthesis

This work proposes KnowRetro (Knowledge-Guided Retrosynthesis Prediction), a chemically-aware framework that learns chemical knowledge from large-scale unlabeled molecules to enhance the accuracy and diversity of retrosynthesis prediction.

Yujie Chen, Tengfei Ma, Zhou Yu et al. · 0 citations
Preprint Aug 2026

RxnCLF: Contrastive Transformation-Aware Reaction Foundation Model for Improved Reactivity Prediction

The results highlight the promise of CRG-based RxnCLF as a scalable reaction foundation model, with the potential to generalize across broader reaction spaces and support diverse downstream reaction informatics tasks, including regioselectivity prediction, enantioselectivity prediction, and reaction condition optimization.

Yiting Zheng, Cheng Fang, Anthony Donofrio et al. · 0 citations
#artificial intelligence Preprint Aug 2026

Training Chemical Plausibility-Aware Large Language Models for Single-Step Retrosynthesis

This work introduces Top-K prompting as a robust training and inference paradigm to better capture diverse, plausible reaction predictions and establishes Top-K, plausibility-aware training as a practical new direction for robust future LLM-based synthesis planning.

B. Zagribelnyy, Ivan D. Ilin, N. Bondarev et al. · 1 citation
Jul 2026

Relation-Aware Pretraining and Reaction Center Modeling for Chemical Reaction Graph Representation Learning.

Learning informative representations of chemical reactions is crucial for advancing synthesis-related downstream tasks, such as reaction condition prediction and yield prediction. However, existing models often struggle to simultaneously capture the global reactant-product relationships and the localized structural evolutions at the reaction center within a unified framework. To bridge this gap, we propose the Knowledge-Aware Graph Transformer (KAGT), a framework for chemical reaction graph representation learning. KAGT combines a shared graph Transformer encoder with a condition-attributed reaction knowledge graph, in which reactant and product molecular graphs serve as source and target entities and solvent, catalyst, and temperature descriptors define latent relation attributes for relation-aware pretraining. The pretraining strategy further includes masked atom modeling and 3D geometric denoising based on computed molecular conformers. We also introduce an explicit reaction-center modeling mechanism guided by atom mapping to capture fine-grained local transformations. Evaluations across three downstream tasks show that KAGT achieves strong performance relative to existing baselines in reaction classification, reaction condition prediction, and yield prediction. Qualitative case studies further show that the learned center scores concentrate on chemically plausible transformation sites, supporting KAGT as a transferable representation framework for AI-driven chemical synthesis.

Jianbo Qiao, Ke-Fei Li, Junru Jin et al. · 0 citations
Preprint Aug 2026

Generic Vision and Cross-Attention for Reaction Yield Prediction

Traditional reaction yield prediction is constrained by 1D quantum descriptors that lack explicit spatial information. To address this gap, a dual-modal Vision Cross-Attention architecture is proposed, fusing tabular physical-organic data with 2D molecular topologies. Notably, it is demonstrated that a generic computer vision backbone processing simple 2D skeletal structures independently outperforms purely quantum-based baselines. By synergizing both modalities, superior predictive accuracy compared to traditional methodologies is achieved by the optimal cross-attention framework (Test RMSE = 5.27%). Through mechanistic probing, active, descriptor-guided spatial querying is observed, effectively offloading macroscopic steric identification to the visual pathway. Furthermore, a dynamic chemical hierarchy is learned by the network to heavily prioritize critical steric bottlenecks, such as the aryl halide. Concurrently, residual skip connections are utilized to protect non-spatial electronic parameters from destructive attenuation during fusion. Collectively, a scalable and highly interpretable blueprint is provided for augmenting physical chemistry with deep visual learning.

Qiwei Han, Chi Zhou · 0 citations
Jul 2026

Mechanism-Guided Catalyst Discovery for Methane C-H Activation via Structure-Aware Multisource Transfer Learning.

A mechanism-driven approach to alleviate data dependence and develop a multisource transfer learning (MS-TL) framework that leverages the knowledge embedded in abundant adsorption data sets while accurately capturing local structural dependence, enabling a deep fusion of multidimensional thermodynamic knowledge while preserving local structural information.

Wangqiang Lin, Huiyan Zhang, Jinxin Sun et al. · 0 citations

Related blog posts

GPT-Lab Aug 28, 2026

We built an AI factory for HVAC control

What does it take to trust AI-driven HVAC optimization? Our AI Model Factory combines agents, machine learning, reinforcement learning and deterministic checks in a governed workflow designed for messy, real-world building data. The post We built an AI factory for HVAC control appeared first on GPT-Lab.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.