Neural Language Models Learn the Contextual Distributions of Dependency Structures: a statistical learning theory to compositionality
It is argued that this process provides a statistical-learning account of how NLMs solve the compositionality problem in language, and the possibility that this statistical learning process provides an explanatory theory on how language cognition could emerge from pure distributional statistics.