Understanding Generalization Requires Universal Induction
Classical statistical theory is insufficient to explain the successes of general-purpose AI models, because it depends on handcrafted inductive biases that it cannot justify. No Free Lunch (NFL) theorems force any learner that beats chance on some environments to underperform on others. We might hope that past experien...
Aram Ebtekar, Marcus Hutter, Danica J. Sutherland
· 1 citation