Replication Package - Valid but Not Always Runnable: An Open, Reproducible Benchmark of Large Language Models Drafting Gherkin Scenarios

Abstract

Replication package (revised version) for Valid but Not Always Runnable: An Open, Reproducible Benchmark of Large Language Models Drafting Gherkin Scenarios Patrick Deininger (Graz University of Technology; FH JOANNEUM) and Wolfgang Slany (Graz University of Technology).Revised submission to *AI* (MDPI). Concept DOI (all versions): 10.5281/zenodo.21188436. This archive contains the complete code, inputs, raw model outputs, judge caches, humancalibration data, and analysis scripts behind every number, table, and figure in the manuscript.