The Hidden Cost of Reproducibility: Commercial Software Dependency in Published Research and the Version Accessibility Gap

Abstract

The reproducibility crisis in science has prompted widespread efforts to improve data and code sharing. However, a critical yet underexplored barrier persists: dependency on commercial software whose specific versions are often inaccessible for replication. We conducted a cross-sectional study of 10,000 articles published between 2020 and 2026, sampled from PubMed using stratified random sampling across seven research fields. Among the 2,922 articles in which software use was detected, 1,853 (63.4%) relied on at least one commercial tool, with an estimated mean replication cost of 1,900 United States Dollars (US$) per article for those requiring proprietary software. Only 17.0% of detected software tools had associated version numbers, and the majority of cited commercial software versions were classified as likely unavailable from vendors. A complementary survey of legacy version access policies across major commercial software vendors found that no vendor explicitly offers “reproducibility licences” for verification purposes. We propose a policy framework for addressing this “version accessibility gap” through reproducibility licences, mandatory version archiving, and enhanced reporting standards, and discuss implications for researchers in low- and middle-income countries where the financial burden of commercial licences is disproportionate.