Skip to content
Open access

College students' metacognitive awareness of generative-AI reliance: an experimental study of decision confidence and attribution bias

Sep 2026 · Frontiers in Psychology · Vol 17 · 1 citation · ⚡ 1 influential · 35 references
Medicine

TL;DR

Brief metacognitive reflection improved immediate discrimination between useful and misleading AI advice without producing blanket rejection of AI.

Abstract

Introduction Generative AI is increasingly used by college students for explanation, evaluation, and decision support, raising the question of whether perceived reliance accurately tracks the extent to which AI advice shapes final judgments. Methods In a three-condition between-subjects experiment, 342 undergraduate students completed reasoning and information-evaluation tasks under independent decision-making, open multi-turn ChatGPT support, or the same ChatGPT support with a brief metacognitive reflection prompt. Participants reported initial and final answers and confidence, and AI-assisted chat logs were coded for the final recommendation, its correctness, and behavioral reliance. Results Open ChatGPT support increased final confidence and was associated with 62.4% acceptance of incorrect AI advice. Reflection reduced incorrect-advice acceptance to 39.7% (OR = 0.40, 95% CI [0.28, 0.56], p < 0.001), improved awareness calibration (0.59 vs. 0.41, p < 0.001), and reduced the attribution-bias index (0.21 vs. 0.42, p = 0.002). Recommendation accuracy was comparable between the two AI-assisted groups. Discussion Brief metacognitive reflection improved immediate discrimination between useful and misleading AI advice without producing blanket rejection of AI. The exploratory association between calibration and overreliance is not interpreted as causal mediation, and the findings concern bounded academic decision tasks rather than long-term learning.

Read PDF

Similar papers

Open access Oct 2026

The ChatGPT source cue shapes answer acceptance in a reasoning task

As generative AI systems increasingly provide answers in everyday and academic contexts, understanding how source attribution influences evaluative judgment has become critical. In a within-subjects design, 103 participants evaluated 30 pre-generated reflective-correct, intuitive-incorrect, and arithmetic co...

Rosa Angela Fabio, Elisabetta Rantuccio, Francesca Bruno · 0 citations
Review Open access Oct 2026

Community College Students' Perceptions and Use of Generative Artificial Intelligence: Self-Reported AI Understanding, Accuracy Concerns, and Institutional Support Needs

Generative artificial intelligence (GenAI) is increasingly used in higher education, offering new learning opportunities while raising concerns about accuracy, reliability, and responsible use. This study examines community college students' perceptions and use of GenAI, focusing on self-reported AI understanding, accu...

Ye Huo · 0 citations

Beyond "ChatGPT Can Make Mistakes": Designing Interventions to Support Metacognitive Monitoring in AI-Assisted Work

A shared vocabulary, a design space, and evidence that measured monitoring and task performance are separable design targets are contributed, suggesting that measured monitoring and task performance are separable design targets.

M. A. D. Santos, P. Thiesse, Steeven Villa et al. · 0 citations
#human-computer interacti... Preprint Sep 2026

Think Before You Accept: Can Written Justification Reduce Uncritical Uptake of AI Writing Suggestions?

This work examines whether requiring students to justify decisions to accept or reject AI suggestions can mitigate uncritical uptake in academic writing and reveals superficial engagement in the justification task and gaps in metacognitive monitoring and domain knowledge.

Yan Tao, Jennifer Meyer, René F. Kizilcec · 0 citations
Review Open access Oct 2026

AI Literacy and Perceived Reliability as Predictors of Student Trust in Generative AI-Assisted Decision Making

Generative artificial intelligence is increasingly used by university students to compare alternatives, obtain recommendations, and support academic decisions. This study examines whether objective AI literacy and perceived reliability can predict student trust in generative AI-assisted decision-making. A cross-section...

I. Windiarti, Agung Prabowo, Fathimah Azzahra · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.