Skip to content
#small language model Open access

The Dagger in the Garden (Revised Edition) A Narrative Scientific Report on Complex-Valued Attention, Phase Interference, and the Learning of Ambiguity in a Single Poem

Sep 2026 · Preprints.org

Abstract

This paper reports a complete end-to-end experiment in complex-valued language modeling. We take the mathematical theory developed in The Dagger and the Query: A Unified Mathematical Theory of Complex, Unitary, and Quantum Attention (Suansook, 2026) and instantiate it as a working system: a character-level ComplexGPT trained on a single 595-character poem, The Rose Is Not a Rose. The poem was chosen because it exhibits simultaneous lexical, syntactic, semantic, and pragmatic ambiguity --- precisely the structure that the imaginary part of a complex attention score is designed to represent. We make three contributions. First, we prove the mathematical and implementation correctness of the complex attention machinery: all six verification tests pass, including the interference identity \( O_i = 2w\cos\theta \cdot v\ \) for symmetric phases, and the closed-form parameter count \( P_{\mathrm{non\text{-}emb}} = 4Vd + L(4d + 24d^2) + 2d \) matches the observed count of 53,824 for \( V=34,\ d=32,\ L=2 \). Second, we demonstrate trainability: training loss falls from 3.55 to 1.44, and validation loss falls from 3.56 to a minimum of 2.54 before rising mildly --- a signature of overfitting on a small corpus, not of architectural failure. Third, we produce recognizable English with the poem's vocabulary (rose, wind, garden, word, the, and), though not cohesive poetry. We are explicit about what this paper does not show. It does not prove that complex attention outperforms real-valued attention. No real-valued control baseline was trained. It does not measure whether the imaginary part of the attention score is actually used — no diagnostic was instrumented, so we cannot say whether the model has collapsed to real-valued attention or is genuinely exploiting phase. It does not establish that phase carries linguistic meaning. These are empirical questions that remain open. We position the paper as a software and mathematical proof-of-concept, not a machine learning hypothesis paper. Its contribution is correctness and trainability, not benchmark superiority. We close by specifying the experiments that would elevate it to the latter: (1) a real-valued control baseline, (2) an instrumented phase diagnostic, (3) a larger and more diverse corpus, and (4) a comparison of validation loss and sample quality across the two architectures. Until those are run, the paper's central hypothesis — that phase-preserving attention provides an advantage on phase-sensitive tasks — remains unproven.

View source

Similar papers

#small language model Dataset Open access Oct 2026

Socratic guiding questions in synthetic arithmetic data: matched LoRA runs (revision v2)

Supporting data, adapters, predictions and code for the article *Low-Cost LoRA Fine-Tuning of Small Language Models for Multi-Step Arithmetic Reasoning* by Jake O'Grady, Asena Isik Gürhan, Chee Fong Ting and Effirul Ramlan (University of Galway). We generated 20,000 GSM8K-derived arithmetic problems with step-by-step s...

O'Grady, Jake, Gürhan, Asena Isik, Chee, Fong Ting et al. · 465 citations
#computer vision Open access Jun 2016

Software Development in Startup Companies: The Greenfield Startup Model

The results are packaged in the Greenfield Startup Model (GSM), which explains the priority of startups to release the product as quickly as possible, and the need to shorten time-to-market, by speeding up the development through low-precision engineering activities.

Carmine Giardino, Nicolò Paternoster, M. Unterkalmsteiner et al. · 178 citations · ⚡14
#computer vision Open access Oct 2016

Software Startups - A Research Agenda

Software startup companies develop innovative, software-intensive products within limited timeframes and with few resources, searching for sustainable and scalable business models.

M. Unterkalmsteiner, P. Abrahamsson, Xiaofeng Wang et al. · 157 citations · ⚡17
#machine learning Review Open access Oct 2016

“Failures” to be celebrated: an analysis of major pivots of software startups

This study conducts a case survey study based on the secondary data of the major pivots happened in 49 software startups, and demonstrates that customer need pivot is the most common among all pivot types.

Sohaib Shahid Bajwa, Xiaofeng Wang, Anh Nguyen-Duc et al. · 127 citations · ⚡15
#computer vision Review Open access May 2015

A survey study on major technical barriers affecting the decision to adopt cloud services

The comparison of adopter and non-adopter sample reveals three potential adoption inhibitor, security, data privacy, and portability, which underlines the importance of the technical and security perspectives for research investigating the adoption of technology.

Nattakarn Phaphoom, Xiaofeng Wang, S. Samuel et al. · 111 citations · ⚡8
#computer vision Open access Feb 2018

Lean Internal Startups for Software Product Innovation in Large Companies: Enablers and Inhibitors

This study investigates how Lean internal startup facilitates software product innovation in large companies and identifies its enablers and inhibitors, and shows the potential of the method-in-action framework to investigate the Lean startup approach in non-startup context.

Henry Edison, Nina M. Smørsgård, Xiaofeng Wang et al. · 78 citations · ⚡6

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.