Oct 2026· Proceedings of the 41st IEEE/ACM International Conference on Automated Software Engineering· pp. 3473-3477· 0 citations· 18 references
TL;DR
The ScratchLog+ extension is proposed, which combines Whisker test suites to collect information about the functional correctness of students’ programs, and code embedding models to estimate structural and semantic progress towards an example solution.
Abstract
While the block-based programming language Scratch is a popular introductory programming environment, gathering information about student progress is challenging since the environment does not expose any kind of analytics. The ScratchLog tool already alleviates this somewhat, but focusses mainly on classroom management and general analytics suited for open-ended tasks. To also provide insights about student progress in goal-oriented exercises, we propose the ScratchLog+ extension in this paper. Our tool combines Whisker test suites to collect information about the functional correctness of students’ programs, and code embedding models to estimate structural and semantic progress towards an example solution. To make these new analytics of ScratchLog+ accessible to teachers, they are directly integrated into the ScratchLog user interface as interpretable visualisations of the typically abstract code embedding vectors. We provide a screencast demonstrating the tool at https://youtu.be/lQSCDqvbpQY.
A dataset of 271 C++ student solutions to eight OOP examination problems is introduced, together with the problem statements and the reference grades produced by the university auto-grader, indicating that agreement with a reference is an insufficient basis for choosing a local grading model, and that compliance, deter...
Adrian-Gabriel Diaconu, Alexandru Guzu, A. Ulmămei· Electronics· 0 citations
While AI has many productive uses, many students now use it to skip the thinking. One instinctive response from institutions and teachers is AI detection, but detection works poorly on code. This session introduces a different approach: instead of assessing just the finished code students submit, make the coding proces...
Badri Adhikari· Proceedings of International...· 0 citations
Existing Parsons problem tools primarily focus on correctness, indicating whether a student solved a problem, but providing limited visibility into the underlying problem-solving process. We address this gap by introducing Pulla, a Parsons problem tool that instruments programming assignments to capture fine-grained in...
Daniel Prol, Juho Leinonen, A. Hellas et al.· 0 citations
Findings indicate that behavioral signals present at the very start of an exercise contain useful clues about whether a student will ultimately solve the problem, and that keystroke-level editing logs provide additional value for early prioritization beyond execution logs alone.
A hybrid conceptual framework that integrates cognitive correctness metrics with behavioral analytics derived from Source Code Management systems, such as GitHub is proposed, which captures authentic student behaviors during assignment development and leverages machine-learning models combined with explainable AI techn...
Amitkumar R. Patel, Jaykumar Patel, Sandipkumar Surati· International journal of com...· 0 citations
Debugging is an immense challenge for novices when learning programming, often causing frustration. Applying a systematic debugging process has a considerable impact on debugging success. As a result, several interventions have been designed to teach this process to students. However, understanding how students actuall...
Elena Spörer, Tilman Michaeli· Proceedings of the 2026 Unit...· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
