Everyday human-LLM interaction is not only answer delivery or cognitive offloading; it also contains measurable, selective and conditionally organized behavioural signatures of informal learning, which shift AI evaluation toward the preservation of cognitive opportunities for users to reason, test ideas and construct understanding in the course of everyday problem-solving.
Abstract
As LLMs become increasingly capable of completing tasks for users, a central concern is that everyday AI use may become primarily cognitive offloading, eroding the opportunities through which people develop their own capabilities. We analyse large-scale human-LLM conversations to ask whether informal learning behaviors also emerge in this setting: whether users engage in exchanges in ways that preserve opportunities to learn. Across 128,569 naturalistic conversations, we translated learning-science constructs into turn-level behavioural signatures. Cognitive engagement, users'cognitive effort as reflected in the exchange, appeared in 31.9% of 491,685 user turns, whereas constructive engagement, the deepest observable form of learning-oriented engagement, appeared in 4.9%, showing that deeper sense-making was recurrent but selective. Our study further identifies factors associated with these forms of engagement. Scaffolded assistant support consistently marked richer constructive participation, with associations varying by user framing, task ecology, support form, timing and prior user state. Together, these findings show that everyday human-LLM interaction is not only answer delivery or cognitive offloading; it also contains measurable, selective and conditionally organized behavioural signatures of informal learning. They shift AI evaluation from answer-delivery efficiency toward the preservation of cognitive opportunities for users to reason, test ideas and construct understanding in the course of everyday problem-solving.
As generative artificial intelligence (AI) becomes increasingly used for second language speaking practice, willingness to communicate (WTC) (MacIntyre et al., 1998) needs to be understood not only in relation to task conditions, but also in relation to how learners experience AI as an interactional counterpart. This s...
N. Jindapitak, Munir Laeha· Technology in Language Teach...· 1 citation
The rapid advancement of artificial intelligence (AI) has transformed informal language learning, providing learners with flexible, self-directed opportunities for vocabulary acquisition outside formal classroom instruction. This study examined how AI use, teacher support, and periodic testing influence Chinese EFL lea...
Barry Lee Reynolds, Yang Gao, Chen Ding et al.· Education sciences· 0 citations
Studying the cognitive engagement shown in forum messages of informal online communities can help to associate discussion behaviour with underlying learning processes. The ICAP framework can serve as a theoretical lens for labelling forum messages by distinguishing different levels of cognitive engagement, yet requires...
S. Krukowski, H. U. Hoppe, Daniel Bodemer· Research and Practice in Tec...· 0 citations
This research examined how public communication about emerging technologies is shaped through platform-specific multimodal conventions and engagement dynamics on TikTok to provide insights for stakeholders who seek to promote responsible AI communication on video-sharing platforms where algorithms shape which content i...
Xi-Ran Liu, M. S. Schäfer· Emerging Media· 1 citation
Large Language Models (LLMs) have transformed conversational AI, but an unresolved human-robot interaction question remains: “With conversational agents, does physical embodiment matter?”. This paper compares an embodied Pepper robot with a non-embodied laptop interface driven by the same LLM - Llama 3.2 7B parameter m...
Mriganka Biswas, John Murray· IEEE International Symposium...· 0 citations
This work analyzes ChatGPT and Gemini conversations, using repeated prompting and clarification following misunderstanding as behavioural indicators of cognitive difficulty, and finds that response characteristics such as length, readability and lexical diversity do not have fixed relationships with conversational diff...
Ying-Can Wang, I. Bilal, Q. Zaman· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.