Brief metacognitive reflection improved immediate discrimination between useful and misleading AI advice without producing blanket rejection of AI.
Abstract
Introduction Generative AI is increasingly used by college students for explanation, evaluation, and decision support, raising the question of whether perceived reliance accurately tracks the extent to which AI advice shapes final judgments. Methods In a three-condition between-subjects experiment, 342 undergraduate students completed reasoning and information-evaluation tasks under independent decision-making, open multi-turn ChatGPT support, or the same ChatGPT support with a brief metacognitive reflection prompt. Participants reported initial and final answers and confidence, and AI-assisted chat logs were coded for the final recommendation, its correctness, and behavioral reliance. Results Open ChatGPT support increased final confidence and was associated with 62.4% acceptance of incorrect AI advice. Reflection reduced incorrect-advice acceptance to 39.7% (OR = 0.40, 95% CI [0.28, 0.56], p < 0.001), improved awareness calibration (0.59 vs. 0.41, p < 0.001), and reduced the attribution-bias index (0.21 vs. 0.42, p = 0.002). Recommendation accuracy was comparable between the two AI-assisted groups. Discussion Brief metacognitive reflection improved immediate discrimination between useful and misleading AI advice without producing blanket rejection of AI. The exploratory association between calibration and overreliance is not interpreted as causal mediation, and the findings concern bounded academic decision tasks rather than long-term learning.
As generative AI systems increasingly provide answers in everyday and academic contexts, understanding how source attribution influences evaluative judgment has become critical.
In a within-subjects design, 103 participants evaluated 30 pre-generated reflective-correct, intuitive-incorrect, and arithmetic co...
Rosa Angela Fabio, Elisabetta Rantuccio, Francesca Bruno· Frontiers in Psychology· 0 citations
Generative artificial intelligence (GenAI) is increasingly used in higher education, offering new learning opportunities while raising concerns about accuracy, reliability, and responsible use. This study examines community college students' perceptions and use of GenAI, focusing on self-reported AI understanding, accu...
Ye Huo· International Journal of Edu...· 0 citations
A shared vocabulary, a design space, and evidence that measured monitoring and task performance are separable design targets are contributed, suggesting that measured monitoring and task performance are separable design targets.
M. A. D. Santos, P. Thiesse, Steeven Villa et al.· arXiv.org· 0 citations
This work examines whether requiring students to justify decisions to accept or reject AI suggestions can mitigate uncritical uptake in academic writing and reveals superficial engagement in the justification task and gaps in metacognitive monitoring and domain knowledge.
Yan Tao, Jennifer Meyer, René F. Kizilcec· 0 citations
These findings show why AI-supported learning requires interaction records to provide a more defensible basis for AI-supported designs than self-reports.
Fatima T. Zahra, Wei Wang, Frances K. Harper et al.· arXiv.org· 0 citations
Generative artificial intelligence is increasingly used by university students to compare alternatives, obtain recommendations, and support academic decisions. This study examines whether objective AI literacy and perceived reliability can predict student trust in generative AI-assisted decision-making. A cross-section...
I. Windiarti, Agung Prabowo, Fathimah Azzahra· JURNAL TEKNIK INFORMATIKA· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.