Skip to content
Open access

Impact of automated scoring on interpreting performance and self-regulated learning: evidence from a pedagogical experiment

Sep 2026 · Frontiers in Psychology · Vol 17 · 0 citations · 63 references
Medicine

Abstract

Confronting the challenges of feedback in traditional interpreting training, this study explores how an automated scoring system affects student interpreters’ performance and self-regulated learning (SRL). Guided by Zimmerman’s cyclical model, the study employed a 14-week quasi-experimental design with two intact classes (N = 46), with data triangulated through pre- and post-test scores, questionnaires, and semi-structured interviews. The experimental group outperformed the control group at post-test (d = 1.03, 95% CI [0.41, 1.64]), with gains concentrated in linguistic accuracy and logical coherence but absent in information fidelity or delivery fluency, pointing to an uneven effect across interpreting dimensions. SRL results reveal an imbalance in both level and function. Although the Execution-and-Monitoring and Evaluation-and-Reflection subscales scored comparatively high, only the former was significantly associated with score gains (r = 0.42, 95% CI [0.02, 0.70], p = 0.041), suggesting that high self-reported reflection cannot be assumed to be productive reflection. Pre-learning Planning and Emotional Motivation remained comparatively underdeveloped. The interviews specify why. Students routinely compared their scores but rarely analyzed why errors had occurred. Planning reversed direction, deriving from the previous session’s score rather than from analysis of the upcoming task, and emotional responses diverged. These findings support the value of automated scoring for sustaining deliberate practice, while highlighting the need to align teacher feedback more closely, in timing and individuation, with automated feedback, to support planning and emotional regulation. The contribution therefore lies in specifying which phase of the SRL cycle automated scoring reaches, and with what consequences.

Read PDF

Similar papers

Sep 2026

Automating Constructive Assessment with Large Language Models: Toward Scalable and Repeated Evaluation of Practical Competence

This study aimed to automate hierarchical diagnostic reasoning (HDR), a constructive method for evaluating practical judgment skills, by developing and testing an evaluation process using a large language model. HDR is a descriptive task that measures higher-order cognitive skills by requiring students to identify and...

Satoshi Takahashi, A. Yoshikawa, Megumi Kose et al. · 0 citations
Open access Sep 2026

THE EFFECTIVENESS OF USING EXPOSURE, GENERALIZATION, REINFORCEMENT, AND APPLICATION (EGRA) TECHNIQUE TO IMPROVE WRITING SKILLS

This study examined the implementation of the Exposure, Generalization, Reinforcement, and Application (EGRA) technique integrated with the Discovery Learning model and evaluated its contribution to enhancing eighth-grade students’ recount text writing proficiency at SMP Negeri 3 Balaesang. Particular attention was giv...

Sasmita Sasmita, Mukrim Mukrim, Afrilia Anggreni et al. · 0 citations
Open access Oct 2026

Improving freshman EFL reading comprehension and self-efficacy through hierarchical questioning

Academic success fundamentally depends on reading comprehension; however, many EFL undergraduates struggle with critical text analysis. To address this deficiency, this study evaluated the impact of the Hierarchical Questioning Strategy (HQS) on the reading comprehension achievement and self-efficacy of English as a Fo...

Endalfer Melese Moges, Dagne Tiruneh Dinsa, Tewodros Zeleke Mendida · 0 citations
Open access Sep 2026

Guided Reading and EFL Comprehension Outcomes: A Cluster-Aware Quasi-Experimental Study among High School Students

Reading comprehension remains a persistent obstacle for EFL high school students, yet rigorous, classroom-level evidence on the Guided Reading Method (GRM), with adequate control for baseline ability and class clustering, remains scarce. This quasi-experimental, pretest–posttest, control-group study compared GRM with c...

N. Huseynova, Zulfiyya Tanriverdiyeva, Nicat Yagubov et al. · 0 citations
Open access Nov 2026

Development of a think-pair-share instructional material in statistics

This study examines the development of think-pair-share (TPS) instructional material in Statistics, using the analysis, design, development, implementation, and evaluation (ADDIE) model, for the grade 11 science, technology, engineering, and mathematics (STEM) students in a parallel learning setup. It addresses the lim...

Larry John D. Sumalpong, Erniel Ghrizcer G. Ecle, Wenceslao A. Coronado et al. · 0 citations
#small language model Open access Aug 2026

What students ask matters: LLM interaction depth, task quality, and immediate recall in higher education

The findings indicate a dissociation between performance quality and short-term recall in LLM-supported study, which aligns with cognitive-psychology evidence that elaboration improves comprehension while retrieval practice consolidates retention.

V. Tsiligkiris · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.