Michael J. Smith

What AstroPT knows about galaxies, and what that can teach us about LLMs

Interpretability research increasingly asks when concepts emerge during training and whether linear probes recover real structure, but in language models these claims are hard to validate because language offers little ground-truth ordering of concepts or relationships among them. We propose the use of astronomical gro...