Machina Mirabilis (GPT-1900)
Machina Mirabilis (GPT-1900) investigates whether a language model trained from scratch on historical text can generate conceptually useful explanations of observations associated with later developments in physics. The project reports a 3.3-billion-parameter transformer and approximately 22 billion tokens of filtered...