Trust calibration in human-AI collaborative decision-making: a cross-domain investigation of climate intelligence and organisational governance systems
Sep 2026· Human-Intelligent Systems Integration· 0 citations· 15 references
Ethics and Social Impacts of AI
Abstract
The proliferation of artificial intelligence (AI) in complex decision environments has intensified scholarly and practical interest in how humans calibrate trust when collaborating with intelligent systems. This paper presents a cross-domain empirical investigation of human-AI collaborative decision-making across climate intelligence and organisational governance contexts. Drawing on a mixed-methods synthesis of 68 primary studies, original survey data from 200 industry professionals, and 30 semi-structured interviews, we examine trust calibration dynamics, performance outcomes, and implementation barriers. Our findings reveal a systematic trust calibration paradox: while 75% of organisations reported efficiency gains from AI integration, only 45% perceived their systems as transparent and explainable, and 38% identified persistent algorithmic bias. Effect sizes varied substantially across applications, reaching g = 1.65 for extreme-weather detection, with considerable between-study heterogeneity. Critically, we find that trust exhibited a non-linear association with AI autonomy, with higher observed trust at intermediate than at maximal levels of delegation; turning regions varied by decision context and should not be interpreted as universal autonomy thresholds. These findings advance human-intelligent systems integration theory by demonstrating that effective collaboration depends less on algorithmic performance alone and more on calibrated trust, institutional capacity, and governance frameworks that sustain human agency within hybrid decision architectures.
The method, ECCOLA, is presented, which aims at making the high-level AI ethics principles more practical, making it possible for developers to more easily implement them in practice.
Ville Vakkuri, Kai-Kristian Kemell, P. Abrahamsson· EUROMICRO Conference on Soft...· 64 citations· ⚡6
The goal is to not only refine the accuracy of the LLM-based tool but also to underscore its potential in streamlining the software development lifecycle through proactive code improvement and education.
Z. Rasheed, Malik Abdul Sami, Muhammad Waseem et al.· arXiv.org· 62 citations· ⚡3
The use of large language models to automatically improve the user story quality in Austrian Post Group IT agile teams is explored, with a reference model for an Autonomous LLM-based Agent System developed and implemented at the company.
Zheying Zhang, M. Rayhan, Tomas Herda et al.· International Conference on...· 48 citations· ⚡4
This paper introduces a novel multi-AI-agent system designed to fully automate SLRs, and demonstrates how it substantially reduces the time and effort traditionally required for SLRs while maintaining comprehensiveness and precision.
Abdul Malik Sami, Z. Rasheed, Kai-Kristian Kemell et al.· arXiv.org· 44 citations· ⚡2
The proposed LLM-based multi-agent system automates qualitative data analysis process, creating opportunities for researchers and practitioners, and future improvements focus on enhancing multilingual performance and integrating continuous expert feedback.
Z. Rasheed, Muhammad Waseem, Aakash Ahmad et al.· arXiv.org· 41 citations
StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.
AI is moving beyond impressive demos. After World Summit AI 2026 in Amsterdam, GPT-Lab's Muhammad Waseem reflects on what organizations need to make AI agents reliable, responsible and genuinely useful in everyday work. The post AI Has Grown Up. Have We? appeared first on GPT-Lab.
MIT News · Artificial Intelligence· news.mit.eduOct 8, 2026