HME is presented, a framework that combines multiple views of molecules to improve molecular understanding and design and enables bidirectional navigation of the chemical-linguistic space, achieving consistent improvements across molecular comprehension and design tasks over strong baselines.
Abstract
Chemical language models are powerful tools for navigating chemical space, but their reliance on linear representations such as molecular strings creates a semantic gap, hindering their ability to bridge natural language with the full complexity of molecular structures. Here we show that chemical language models can gain a comprehensive, multi-modal understanding of molecules through heterogeneous molecular encoding, which integrates one-dimensional sequences, two-dimensional topology, three-dimensional geometry, and statistically derived molecular fragments. We further introduce a query-based module that converts heterogeneous structural information into a unified representation compatible with language models, together with a chain-of-fragment mechanism that guides molecular generation through a hierarchical chemical blueprinting process. To support research in this area, we constructed a million-scale dataset for multi-objective molecular design. Experimentally, the framework enables bidirectional navigation of the chemical-linguistic space, achieving consistent improvements across molecular comprehension and design tasks over strong baselines. Molecular AI models often struggle to connect chemical structures with language. This study presents HME, a framework that combines multiple views of molecules to improve molecular understanding and design.
MolSight is proposed, a graph-aware vision-language model framework designed to enhance the understanding of molecular images by VLMs and significantly outperforms existing VLMs, molecular LLMs, and task-specific models across multiple chemical visual understanding tasks, achieving a new level of molecular image reason...
Wenda Wang, Yihan Tong, Yuwei Hu et al.· 0 citations
FragBERTa is introduced, a molecular fragment-aware transformer-based representation language model pretrained using masked language modeling on Sequential Attachment-based Fragment Embedding (SAFE) representations, suggesting that fragment-based string representations offer advantages over atom-level representations f...
Transformer models have revolutionized natural language processing (NLP), and text-based molecular representations like SMILES have successfully extended these architectures to chemistry. However, domain-adaptive pre-training often causes models to overfit to chemical syntax, catastrophically forgetting their foundatio...
David Ming Segura, Jeremy Goumaz, Joshua W. Sin et al.· 1 citation
This paper proposes UniEdit, a Unified Graph-based Mixture-of-Experts (MoE) Molecular Editing model that offers a robust alternative to LLMs and incorporates a Mixture-of-Experts architecture that dynamically routes tasks to specialized components.
Jiajun Yu, Zhihao Wu, Yizhen Zheng et al.· Proceedings of the 32nd ACM...· 0 citations
This is the first method to expose GNN-derived attributions to an LLM as evidence for property prediction, and achieves the best overall results among generalist models and narrows the gap to specialist models tuned for each task.
Junwoo Park, Minyoung Shin, C. Lee et al.· 0 citations
MolLingua, a token-centric, dual-modal framework designed for native molecular understanding, uses a dual-branch Residual Vector Quantization engine to discretize heterogeneous, high-dimensional spatial 2D and 3D features into compact code sequences rather than relying solely on continuous projections.
Haoyang Liu, Xikang Feng, Fei Guo et al.· IEEE journal of biomedical a...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.