Skip to content

When Should Managers Trust Generative AI? Calibrating Human Reliance from Algorithm Aversion to Over-Reliance

Sep 2026 · Zenodo (CERN European Organization for Nuclear Research)
Ethics and Social Impacts of AI

Abstract

Generative artificial intelligence (GenAI) is increasingly embedded in managerial decision-making, where it can summarize information, generate alternatives, evaluate scenarios, and provide recommendations. Yet the managerial value of GenAI depends not only on the quality of its outputs but also on how humans respond to them. Prior research presents an apparent tension. Studies of algorithm aversion show that decision-makers may reject useful algorithmic advice after observing algorithmic error, whereas research on algorithm appreciation shows that people may sometimes rely more heavily on algorithmic than human advice. More recent work raises the opposite concern: managers may over-rely on GenAI because fluent, confident, or authoritative outputs can appear credible even when they are incomplete, biased, or incorrect. This article integrates research on algorithm aversion, algorithm appreciation, human-AI collaboration, managerial expertise, information processing, and GenAI-enabled decision support to develop a framework of calibrated human reliance. The central argument is that effective human-GenAI decision-making requires neither greater trust nor greater skepticism, but alignment between the degree of human reliance and the reliability and decision context of AI advice. The framework distinguishes four reliance states: under-reliance, appropriate rejection, appropriate reliance, and over-reliance. It further proposes that reliance calibration is influenced by four contextual dimensions: managerial expertise, output verifiability, uncertainty, and decision consequences. The article contributes to the emerging literature by distinguishing trust as an attitude from reliance as decision behavior and by shifting managerial attention from whether GenAI should be trusted to when and how much managers should rely on its outputs. Keywords: generative artificial intelligence; trust in AI; reliance; algorithm aversion; algorithm appreciation; over-reliance; human-AI collaboration; managerial decision-making; calibration

View source

Similar papers

#artificial intelligence Open access May 2023

Evaluating the Performance of Large Language Models on GAOKAO Benchmark

GAOKAO-Bench is introduced, an intuitive benchmark that employs questions from the Chinese GAOKAO examination as test samples, including both subjective and objective questions that contribute a robust evaluation benchmark for future large language models and offers valuable insights into the advantages and limitations of such models.

Xiaotian Zhang, Chun-yan Li, Yi Zong et al. · 216 citations · ⚡17
#artificial intelligence Open access Jul 2024

Gender, Race, and Intersectional Bias in Resume Screening via Language Model Retrieval

This work investigates the possibilities of using LLMs in a resume screening setting via a document retrieval framework that simulates job candidate selection and finds that the MTEs are biased, significantly favoring White-associated names in 85% of cases and female-associated names in only 11.1% of cases.

Kyra Wilson, Aylin Caliskan · 131 citations · ⚡8

PRISM: Self-Pruning Intrinsic Selection Method for Training-Free Multimodal Data Selection

Empirically, PRISM reduces the end-to-end time for data selection and model tuning to just 30% of conventional pipelines, and achieves this efficiency while simultaneously enhancing performance, surpassing models fine-tuned on the full dataset across eight multimodal and three language understanding benchmarks.

Jinhe Bi, Yifan Wang, Danqi Yan et al. · 73 citations · ⚡4
#artificial intelligence Conference Open access Apr 2020

ECCOLA - a Method for Implementing Ethically Aligned AI Systems

The method, ECCOLA, is presented, which aims at making the high-level AI ethics principles more practical, making it possible for developers to more easily implement them in practice.

Ville Vakkuri, Kai-Kristian Kemell, P. Abrahamsson · 64 citations · ⚡6
#computer vision Review Apr 2024

AI-powered Code Review with LLMs: Early Results

The goal is to not only refine the accuracy of the LLM-based tool but also to underscore its potential in streamlining the software development lifecycle through proactive code improvement and education.

Z. Rasheed, Malik Abdul Sami, Muhammad Waseem et al. · 62 citations · ⚡3

Let the Flows Tell: Solving Graph Combinatorial Optimization Problems with GFlowNets

This paper designs Markov decision processes (MDPs) for different combinatorial problems and proposes to train conditional GFlowNets to sample from the solution space and demonstrates that GFlowNet policies can efficiently find high-quality solutions.

Dinghuai Zhang, H. Dai, Esmeralda S. Whitammer et al. · 59 citations · ⚡8

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.