Sep 2026· Zenodo (CERN European Organization for Nuclear Research)
Abstract
Auditing large language models (LLMs) for demographic bias typically relies on analyzing text outputs, which cannot detect cases where a model computes differently across demographic inputs yet produces equivalent output — a phenomenon we term dark bias. We investigate whether such computation-level differences are detectable through carrier current analysis: non-invasive monitoring of a GPU's power-cable current during inference. Building on prior work showing that power and electromagnetic side channels can recover neural network architecture and workload characteristics, we test the novel hypothesis that current traces also carry information about the demographic content of an input prompt. Using counterfactual prompt pairs that vary only a name drawn from validated demographic name sets, under deterministic decoding and token-count-matched conditions, we record current traces via a Hall-effect clamp and classify demographic group from extracted trace features using cross-validated logistic regression. Critically, we assess whether any detected signal persists when text outputs are matched across groups (output-controlled analysis) — the key test that would distinguish computation-level bias from bias already visible at the output. We report classification performance with bootstrapped confidence intervals rather than point estimates, given the small expected effect size and the possibility that the underlying signal does not exist at this level of measurement. A positive result would establish current-based side-channel analysis as a novel bias-detection method; a null result would meaningfully constrain where such bias, if present, is more likely to reside.
Supporting data, adapters, predictions and code for the article *Low-Cost LoRA Fine-Tuning of Small Language Models for Multi-Step Arithmetic Reasoning* by Jake O'Grady, Asena Isik Gürhan, Chee Fong Ting and Effirul Ramlan (University of Galway). We generated 20,000 GSM8K-derived arithmetic problems with step-by-step s...
O'Grady, Jake, Gürhan, Asena Isik, Chee, Fong Ting et al.· Zenodo (CERN European Organi...· 465 citations
The results are packaged in the Greenfield Startup Model (GSM), which explains the priority of startups to release the product as quickly as possible, and the need to shorten time-to-market, by speeding up the development through low-precision engineering activities.
Carmine Giardino, Nicolò Paternoster, M. Unterkalmsteiner et al.· IEEE Transactions on Softwar...· 178 citations· ⚡14
Software startup companies develop innovative, software-intensive products within limited timeframes and with few resources, searching for sustainable and scalable business models.
M. Unterkalmsteiner, P. Abrahamsson, Xiaofeng Wang et al.· e-Informatica Software Engin...· 157 citations· ⚡17
This study conducts a case survey study based on the secondary data of the major pivots happened in 49 software startups, and demonstrates that customer need pivot is the most common among all pivot types.
Sohaib Shahid Bajwa, Xiaofeng Wang, Anh Nguyen-Duc et al.· Empirical Software Engineeri...· 127 citations· ⚡15
The comparison of adopter and non-adopter sample reveals three potential adoption inhibitor, security, data privacy, and portability, which underlines the importance of the technical and security perspectives for research investigating the adoption of technology.
Nattakarn Phaphoom, Xiaofeng Wang, S. Samuel et al.· Journal of Systems and Softw...· 111 citations· ⚡8
This study investigates how Lean internal startup facilitates software product innovation in large companies and identifies its enablers and inhibitors, and shows the potential of the method-in-action framework to investigate the Lean startup approach in non-startup context.
Henry Edison, Nina M. Smørsgård, Xiaofeng Wang et al.· Journal of Systems and Softw...· 78 citations· ⚡6
Related blog posts
Microsoft Research Blog· microsoft.comOct 12, 2026
StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.