Aug 2026· Education sciences· 0 citations· 25 references
TL;DR
Episode-level findings of students’ ChatGPT (GPT- 4o, OpenAI)-supported programming work and the cognitive complexity of their queries support instructional scaffolding that structures query formulation and reflection.
Abstract
Generative AI tools are now widely used in undergraduate programming, yet most evidence about how students use them comes from self-report rather than from observed behaviour. This study examined the sequential structure of students’ ChatGPT (GPT- 4o, OpenAI)-supported programming work and the cognitive complexity of their queries. Screen recordings of 363 second-year students completing an individual Python 3.12 data-visualisation assignment were coded into 3985 activity episodes and analysed using descriptive statistics, lag-1 sequential analysis, and cognitive network analysis; because recordings capture actions rather than cognition, the coded categories are treated as behavioural indicators interpreted within, rather than as measurements of, the Self-Regulated Learning framework. Programming activities accounted for 63% of coded actions and ChatGPT interactions for 20%. Behaviour was organised around a troubleshooting cycle, the strongest association being between submitting error messages and reviewing ChatGPT responses (PCM → RF, Yule’s Q = 0.84, a descriptive association measure, rather than a transition probability, whose stability across students was not tested). ChatGPT use was concentrated in activities indicative of monitoring and control and was largely absent from planning and reflection. High-achieving students produced a higher proportion of deep-level submissions (32.2% vs. 19.2%) and a lower proportion of surface-level submissions (23.2% vs. 38.4%) than low-achieving students; because submissions are nested within students, this difference is reported as a property of the observed distribution rather than as an inferential finding. Comparisons computed at the level of the student were tested inferentially and reached significance with small effect sizes; comparisons computed at the level of coded actions or query submissions are reported throughout as observed properties of the aggregate distributions rather than as inferentially established differences. These episode-level findings support instructional scaffolding that structures query formulation and reflection.
The results revealed that ChatGPT has the potential to support conceptual clarification and representational enrichment; however, learning outcomes were found to be associated with the quality of students’ questioning as well as their verification and self-regulation behaviors.
Mehmet Gülburnu, Betül B. Oğuz· Mersin Üniversitesi Eğitim F...· 0 citations
This preliminary cross-sectional study examines the association between ChatGPT use frequency and learning motivation among 17 Informatics Engineering students at Universitas Mulia, Balikpapan and identifies requirements for stronger follow-up research.
Muhamad Zulton Praditya, Hafizh Adham Tauhid, Muhammad Ali Hakim et al.· MULTICA SCIENCE AND TECHNOLO...· 0 citations
ChatGPT's potential as a source of academic help during web-programming tasks while emphasising the importance of critically evaluating and adapting AI-generated responses is highlighted.
Fatma Keskinkılıç, F. Kalelioğlu· Journal of Educational Techn...· 0 citations
Novice learners often struggle to engage with the complexity inherent in systems thinking. This study explores how a customised generative artificial intelligence (GenAI) chatbot can scaffold students’ systems thinking processes in a critical thinking and problem-solving skills module at an institute of higher educatio...
The use of Large Language Models to automatically code indicators of complex psychological constructs from student chat logs collected through a conversation-based assessment for middle school mathematics highlights the promise of human-LLM collaboration to enhance qualitative coding efficiency and validity in educatio...
Teresa M. Ober, Shan Zhang, Diego Zapata-Rivera et al.· 4 citations
The growing integration of generative artificial intelligence in higher education has created new opportunities for learning while also raising concerns about students’ increasing reliance on AI-based tools. ChatGPT is widely used to explain complex concepts, generate ideas, support academic tasks, and provide feedback...
Raudhatul S. Firzanah, Zulhajji· Jurnal MediaTIK· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.