Skip to content
#generative ai Dataset Open access

Beyond unstructured use: scaffolded integration of generative AI in assessment for learning

Sep 2026 · Figshare

Abstract

This study examined how scaffolded integration of generative artificial intelligence (GenAI) within an assessment task influenced students’ experience, evaluative engagement, learning, confidence, and competence. A cross-sectional quantitative survey was completed by 164 first-year undergraduate students in a fully online health communication course. The assessment required students to generate, critically evaluate, and revise GenAI-assisted outputs, and reflect on their use. The questionnaire comprised Likert-scale and multiple-response items assessing students’ experiences, learning, confidence, competence, challenges, and perceived skill development. Composite scales were analysed descriptively and compared against neutral midpoints using non-parametric tests. Students reported positive technical experiences (64%) and learning benefits, particularly in critique writing (67%), critical thinking (83%), and responsible GenAI use (82%). Evaluative skills, including critical appraisal (71%) and source verification (69%), were frequently reported. Perceptions of reliability were cautious, and confidence and competence did not differ from neutral. Composite analyses indicated positive experience and learning without corresponding increases in confidence. Scaffolded integration of GenAI within assessment can support assessment for learning by promoting evaluative engagement and critical AI literacy without encouraging uncritical reliance. These findings position assessment design as a central mechanism for guiding responsible and effective GenAI use in higher education. This study shows that structured integration of GenAI within assessment can support critical thinking, evaluative judgement and responsible AI use without encouraging uncritical reliance. By requiring students to evaluate and revise GenAI-generated content rather than simply use it to complete tasks, the findings demonstrate how assessment design can provide a practical mechanism for developing critical GenAI literacy in higher education.

View source

Similar papers

#artificial intelligence Conference Open access Apr 2020

ECCOLA - a Method for Implementing Ethically Aligned AI Systems

The method, ECCOLA, is presented, which aims at making the high-level AI ethics principles more practical, making it possible for developers to more easily implement them in practice.

Ville Vakkuri, Kai-Kristian Kemell, P. Abrahamsson · 64 citations · ⚡6
#computer vision Review Apr 2024

AI-powered Code Review with LLMs: Early Results

The goal is to not only refine the accuracy of the LLM-based tool but also to underscore its potential in streamlining the software development lifecycle through proactive code improvement and education.

Z. Rasheed, Malik Abdul Sami, Muhammad Waseem et al. · 62 citations · ⚡3
#computer vision Open access Mar 2024

LLM-based agents for automating the enhancement of user story quality: An early report

The use of large language models to automatically improve the user story quality in Austrian Post Group IT agile teams is explored, with a reference model for an Autonomous LLM-based Agent System developed and implemented at the company.

Zheying Zhang, M. Rayhan, Tomas Herda et al. · 48 citations · ⚡4
#computer vision Review Mar 2024

System for systematic literature review using multiple AI agents: Concept and an empirical evaluation

This paper introduces a novel multi-AI-agent system designed to fully automate SLRs, and demonstrates how it substantially reduces the time and effort traditionally required for SLRs while maintaining comprehensiveness and precision.

Abdul Malik Sami, Z. Rasheed, Kai-Kristian Kemell et al. · 44 citations · ⚡2
#computer vision Feb 2024

Can Large Language Models Serve as Data Analysts? A Multi-Agent Assisted Approach for Qualitative Data Analysis

The proposed LLM-based multi-agent system automates qualitative data analysis process, creating opportunities for researchers and practitioners, and future improvements focus on enhancing multilingual performance and integrating continuous expert feedback.

Z. Rasheed, Muhammad Waseem, Aakash Ahmad et al. · 41 citations

Related blog posts

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.