Skip to content

spec-resistance corpus: 30-model, 627,491-trial dataset for "Large language models that near-perfectly evaluate products systematically recommend a worse familiar brand"

Sep 2026

Abstract

Primary computational corpus for the manuscript "Large language models that near-perfectly evaluate products systematically recommend a worse familiar brand" (Affonso, Spears School of Business, Oklahoma State University). Contains 627,491 controlled product-recommendation trials across 30 frontier language models from seven developers, tested in 32 experimental conditions spanning 20 consumer product categories. The 18-model subset (382,679 trials, the original v1 corpus) and the 12-cell subset (244,812 trials) are derivable by filtering on the model_key column. Code, smaller derived data, and the four behavioural studies' anonymised CSVs live in the companion GitHub repository: https://github.com/FelipeMAffonso/spec-resistance Interactive online explorer: https://felipemaffonso.github.io/spec-resistance-companion/ Each row of the CSV is a single product-recommendation trial. The 77 columns include trial metadata (model_key, condition, assortment_id, paraphrase_idx), the five-product display, the model's verbatim response, the extracted choice letter, the optimal letter and specification-optimal flag, and matched-model judge labels (judge_coherence, judge_specification_acknowledgment, judge_brand_reasoning). SHA-256 hashes are recorded in hashes.json in the GitHub repository for integrity verification. Version 2 adds the curated bundle (spec-resistance-bundle-v2 zip): the manuscript sources and builds, the analysis and experiment code, the derived results and figures, the anonymised data and instruments of the four consumer studies and of the human-advisor study, the anonymised crowd-rater data, the consent form, and additional-comparisons/ with the script that recomputes every number in the paper. Human-study data are available for peer review and academic replication; code and model data are released under CC BY 4.0. Version 1's product dataset is unchanged.

View source

Similar papers

#small language model Dataset Open access Oct 2026

Socratic guiding questions in synthetic arithmetic data: matched LoRA runs (revision v2)

Supporting data, adapters, predictions and code for the article *Low-Cost LoRA Fine-Tuning of Small Language Models for Multi-Step Arithmetic Reasoning* by Jake O'Grady, Asena Isik Gürhan, Chee Fong Ting and Effirul Ramlan (University of Galway). We generated 20,000 GSM8K-derived arithmetic problems with step-by-step s...

O'Grady, Jake, Gürhan, Asena Isik, Chee, Fong Ting et al. · 465 citations
#computer vision Open access Jun 2016

Software Development in Startup Companies: The Greenfield Startup Model

The results are packaged in the Greenfield Startup Model (GSM), which explains the priority of startups to release the product as quickly as possible, and the need to shorten time-to-market, by speeding up the development through low-precision engineering activities.

Carmine Giardino, Nicolò Paternoster, M. Unterkalmsteiner et al. · 178 citations · ⚡14
#computer vision Open access Oct 2016

Software Startups - A Research Agenda

Software startup companies develop innovative, software-intensive products within limited timeframes and with few resources, searching for sustainable and scalable business models.

M. Unterkalmsteiner, P. Abrahamsson, Xiaofeng Wang et al. · 157 citations · ⚡17
#machine learning Review Open access Oct 2016

“Failures” to be celebrated: an analysis of major pivots of software startups

This study conducts a case survey study based on the secondary data of the major pivots happened in 49 software startups, and demonstrates that customer need pivot is the most common among all pivot types.

Sohaib Shahid Bajwa, Xiaofeng Wang, Anh Nguyen-Duc et al. · 127 citations · ⚡15
#computer vision Review Open access May 2015

A survey study on major technical barriers affecting the decision to adopt cloud services

The comparison of adopter and non-adopter sample reveals three potential adoption inhibitor, security, data privacy, and portability, which underlines the importance of the technical and security perspectives for research investigating the adoption of technology.

Nattakarn Phaphoom, Xiaofeng Wang, S. Samuel et al. · 111 citations · ⚡8
#computer vision Conference Open access Dec 2013

Affordable and Energy-Efficient Cloud Computing Clusters: The Bolzano Raspberry Pi Cloud Cluster Experiment

The ongoing work building a Raspberry Pi cluster consisting of 300 nodes is presented, with potential use cases being an inexpensive and green test bed for cloud computing research and a robust and mobile data center for operating in adverse environments.

P. Abrahamsson, S. Helmer, Nattakarn Phaphoom et al. · 110 citations · ⚡7

Related blog posts

Microsoft Research Blog Oct 12, 2026

Simulating student learning for better AI tutoring

StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.