Skip to content
#generative ai Open access

Educator Trust Calibration as Sociotechnical Practice: A Field Study of Generative AI Use in Indian Higher Education

Oct 2026 · ACM Transactions on Social Computing · 16 references
Ethics and Social Impacts of AI

Abstract

Generative AI (GenAI) systems are increasingly used in higher education, yet educator trust in these systems is often treated as an individual attitude rather than as a situated sociotechnical practice. Drawing on a 14-week field study with 42 faculty members at a mid-tier Indian technical university, this paper examines how educators encountered GenAI failures, interpreted system reliability, and developed verification-oriented routines across teaching, assessment, and administrative work. The study combines diaries, prompt logs, interviews, observations, surveys, reflective workshops, and structured red-teaming exercises. We analyze trust calibration as an ongoing process shaped by surface fluency, institutional authority, disciplinary expertise, peer reflection, and the labor of verification. Our findings identify three mechanisms of initial over-reliance: surface fluency deference, authority projection, and confirmation-seeking use. Participants later encountered fabricated citations, unstable answers, and locally specific policy failures that disrupted their mental models of GenAI reliability. We identify four educator trust postures—High-Adoption Uncritical, Low-Adoption Skeptical, Selective Verifiers, and Reflective Collaborators—and synthesize these into the Educator-AI Trust Calibration (EATC) framework. We do not claim that red-teaming caused trust recalibration. Instead, red-teaming functioned as one structured site within a broader field process through which educators made AI failures visible, negotiated verification responsibilities, and reworked use practices. The paper contributes a process-oriented account of educator-AI trust calibration and introduces the local knowledge verification gap as a mechanism through which fluent but unreliable GenAI outputs become difficult to contest in underrepresented institutional and regional contexts.

View source

Similar papers

#artificial intelligence Conference Open access Apr 2020

ECCOLA - a Method for Implementing Ethically Aligned AI Systems

The method, ECCOLA, is presented, which aims at making the high-level AI ethics principles more practical, making it possible for developers to more easily implement them in practice.

Ville Vakkuri, Kai-Kristian Kemell, P. Abrahamsson · 64 citations · ⚡6
#computer vision Review Apr 2024

AI-powered Code Review with LLMs: Early Results

The goal is to not only refine the accuracy of the LLM-based tool but also to underscore its potential in streamlining the software development lifecycle through proactive code improvement and education.

Z. Rasheed, Malik Abdul Sami, Muhammad Waseem et al. · 62 citations · ⚡3
#computer vision Open access Mar 2024

LLM-based agents for automating the enhancement of user story quality: An early report

The use of large language models to automatically improve the user story quality in Austrian Post Group IT agile teams is explored, with a reference model for an Autonomous LLM-based Agent System developed and implemented at the company.

Zheying Zhang, M. Rayhan, Tomas Herda et al. · 48 citations · ⚡4
#computer vision Review Mar 2024

System for systematic literature review using multiple AI agents: Concept and an empirical evaluation

This paper introduces a novel multi-AI-agent system designed to fully automate SLRs, and demonstrates how it substantially reduces the time and effort traditionally required for SLRs while maintaining comprehensiveness and precision.

Abdul Malik Sami, Z. Rasheed, Kai-Kristian Kemell et al. · 44 citations · ⚡2
#computer vision Feb 2024

Can Large Language Models Serve as Data Analysts? A Multi-Agent Assisted Approach for Qualitative Data Analysis

The proposed LLM-based multi-agent system automates qualitative data analysis process, creating opportunities for researchers and practitioners, and future improvements focus on enhancing multilingual performance and integrating continuous expert feedback.

Z. Rasheed, Muhammad Waseem, Aakash Ahmad et al. · 41 citations

Related blog posts

Microsoft Research Blog Oct 7, 2026

Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses

Training AI agents with reinforcement learning can be challenging because their tools, context, and decision-making are managed by complex frameworks. Agent Lightning connects existing agents to RL training, making it easier to improve them without rebuilding them. The post Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.