Skip to content

Analysis of Types of Inquiries in Student-AI Interaction: A case study of two CS2 tasks

Aug 2026 · 1 citation · 19 references
Computer Science

TL;DR

A few-shot learning approach is developed and a small subset of question types accounts for the majority of student inquiries, and that the types of questions students ask change substantially as the task progresses.

Abstract

Background and Context: Question and inquiry are integral parts of knowledge seeking and learning. Despite their importance, students tend not to ask enough questions in the classroom. However, studies have shown that students interact extensively with generative AI systems for learning and problem solving. Objective: In this paper, we seek to better understand the types of questions that students ask AI systems, and how those questions evolve during problem solving and across tasks. Method: We use the Graesser et al. taxonomy to classify students'inquiries into 18 types. We develop a few-shot learning approach to automatically classify students'interactions with AI into these categories. We use this system to analyze 830 interactions of CS2 students across two programming tasks. Findings: Our results suggest that a small subset of question types accounts for the majority of student inquiries, and that the types of questions students ask change substantially as the task progresses.

View source

Similar papers

Using LLMs to Identify Indicators of Persistence from Students ’ Dialogues with a Pedagogical Agent

The use of Large Language Models to automatically code indicators of complex psychological constructs from student chat logs collected through a conversation-based assessment for middle school mathematics highlights the promise of human-LLM collaboration to enhance qualitative coding efficiency and validity in educatio...

Teresa M. Ober, Shan Zhang, Diego Zapata-Rivera et al. · 2 citations
#human-computer interacti... Preprint Aug 2026

Self-Explanation Tutor for Active Study of CS1 Worked Examples

Worked examples are an important part of introductory programming, but reading their expert explanations is passive. Self explanation, students explaining the problem and its solution to themselves with subgoal level analysis, converts passive reading into an active study of worked example, yet it is hard to scale beca...

Arun-Balajiee Lekshmi-Narayanan, Mohammad Hassany, Kamil Akhuseyinoglu et al. · 0 citations
Review Sep 2026

Student Use of LLMs and the Limits of AI-Generated Question Difficulty in Data Science Courses

This paper presents a multi-source classroom study conducted during a 10-week quarter in data science courses at Drexel University. We first investigate the behaviors of student engagement with large language models (LLMs) using four surveys across three data science courses. Second, we evaluate the construct validity...

Yuan An, Lei Wang · 0 citations
Open access Sep 2026

More than getting the answer: How students engage with generative AI in technical problem solving

Examination of undergraduate students in an operations management course who first solved a linear programming problem manually and then used GenAI on the same task shows that students can position GenAI differently within the same technical task, from receiving answers to verifying existing reasoning or seeking concep...

A. Jaiswal, Gaurav Nanda · 0 citations
Open access Sep 2026

Student Use of and Views on GenAI for Writing

Research on student use of generative artificial intelligence (GenAI) tools to help with coursework and writing is in its incipient stages. In this exploratory mixed-methods study, we draw on data gathered from sociology students to answer three questions: (1) What are students’ views on using GenAI in coursework, both...

A. Kuznetsov, Amanda Sheely, Jayne Baker · 0 citations
Aug 2026

AI Literacy as Experimental Practice: Students as Investigators

A three-week midterm project embedded in an undergraduate “AI-for-all” course investigated whether AI literacy can be taught to undergrads, and shows any user how to test an AI system rather than trust it blindly.

A. Shehu, Adonyas Ababu, Asma Akbary et al. · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.