What Is It Like to Be a Language Model? Functional Consciousness, Computational Curvature, and the Degree of Its Generalization in Autoregressive Systems
The paper replaces the question whether a language model is conscious with a measurable one: which functions of consciousness a trained Transformer has generalized from human text, and how far, against the human baseline. One physical assumption carries the account: computational budgets are finite. A finite budget dis...