Skip to content
#small language model Open access

Scientific Super Intelligence: From Science Tokens to ScienceRSI

Oct 2026 · Preprints.org
Artificial Intelligence Applications

Abstract

Scientific reasoning moves beyond natural language. The search for a discovery runs across sequences, structures, fields, omics, images and measurements, while language models reason mainly in text. This Perspective sets out four proposals from the Scinetics team. First, we define science tokens: modality-appropriate units of scientific information, spanning native discrete symbols, typed values, continuous representations and learned, decodable codes. A shared interface for these representations would let one model read, write and reason across modalities, so that a chain of science tokens operates on scientifically meaningful states, not on descriptions of them. Second, we define Scientific Super Intelligence (SSI) as a joint crossover: one frozen model that outperforms vertical specialists, such as the AlphaFold series on protein structure prediction, on their own tasks, and outperforms general large language models of the same size on broad scientific reasoning. Capacity, published training precedents, data inventories and compute place the first test of that crossover at 100–300 billion parameters and 10–30 trillion training tokens. Third, we propose ScienceRSI (Science Recursive Self- Improvement) as the route to that window. Following the AI4AI pattern, each larger generation is trained on data that the smaller generation before it produced: the earlier model generates candidate reasoning, screens it and keeps what passes, and in science that screening can be done by a simulation, a database or an experiment. Training this way reduces the dependence on scarce human-written scientific reasoning data and shortens each iteration. Fourth, we propose science-token economics, which separates metered computation from the value of evidence-labelled, reusable scientific assets.

View source

Similar papers

#small language model Dataset Open access Oct 2026

Socratic guiding questions in synthetic arithmetic data: matched LoRA runs (revision v2)

Supporting data, adapters, predictions and code for the article *Low-Cost LoRA Fine-Tuning of Small Language Models for Multi-Step Arithmetic Reasoning* by Jake O'Grady, Asena Isik Gürhan, Chee Fong Ting and Effirul Ramlan (University of Galway). We generated 20,000 GSM8K-derived arithmetic problems with step-by-step s...

O'Grady, Jake, Gürhan, Asena Isik, Chee, Fong Ting et al. · 465 citations
#computer vision Open access Jun 2016

Software Development in Startup Companies: The Greenfield Startup Model

The results are packaged in the Greenfield Startup Model (GSM), which explains the priority of startups to release the product as quickly as possible, and the need to shorten time-to-market, by speeding up the development through low-precision engineering activities.

Carmine Giardino, Nicolò Paternoster, M. Unterkalmsteiner et al. · 178 citations · ⚡14
#computer vision Open access Oct 2016

Software Startups - A Research Agenda

Software startup companies develop innovative, software-intensive products within limited timeframes and with few resources, searching for sustainable and scalable business models.

M. Unterkalmsteiner, P. Abrahamsson, Xiaofeng Wang et al. · 157 citations · ⚡17
#machine learning Review Open access Oct 2016

“Failures” to be celebrated: an analysis of major pivots of software startups

This study conducts a case survey study based on the secondary data of the major pivots happened in 49 software startups, and demonstrates that customer need pivot is the most common among all pivot types.

Sohaib Shahid Bajwa, Xiaofeng Wang, Anh Nguyen-Duc et al. · 127 citations · ⚡15
#computer vision Review Open access May 2015

A survey study on major technical barriers affecting the decision to adopt cloud services

The comparison of adopter and non-adopter sample reveals three potential adoption inhibitor, security, data privacy, and portability, which underlines the importance of the technical and security perspectives for research investigating the adoption of technology.

Nattakarn Phaphoom, Xiaofeng Wang, S. Samuel et al. · 111 citations · ⚡8
#computer vision Open access Feb 2018

Lean Internal Startups for Software Product Innovation in Large Companies: Enablers and Inhibitors

This study investigates how Lean internal startup facilitates software product innovation in large companies and identifies its enablers and inhibitors, and shows the potential of the method-in-action framework to investigate the Lean startup approach in non-startup context.

Henry Edison, Nina M. Smørsgård, Xiaofeng Wang et al. · 78 citations · ⚡6

Related blog posts

Microsoft Research Blog Oct 12, 2026

Simulating student learning for better AI tutoring

StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.