Skip to content
#explainable ai Open access

Behavioural Decision-Making in the Age of AI: Minds vs. Models

Sep 2026 · UNSWorks (UNSW Sydney)
Ethics and Social Impacts of AI

Abstract

The emergence of LLMs has accelerated AI’s embedding into everyday decision-making at an unprecedented pace. Yet fundamental questions remain unresolved, when and why do people resist AI advice, do AI systems evaluate information in ways that align with human judgement, and what interventions can improve human-AI alignment? This thesis investigates both sides of the human-AI relationship through four empirical studies, advancing a behavioural understanding of how minds and models diverge. On the human side, this thesis demonstrates that psychological resistance to algorithmic advice is not culturally uniform. Although aggregate levels of algorithm aversion do not differ across cultures, the mechanisms underlying that aversion vary systematically. Individualistic cultures are primarily driven by uniqueness neglect, the belief that algorithms cannot account for personal circumstances, while collectivistic cultures are more strongly influenced by familiarity with the technology. These findings challenge the generalisability of algorithm aversion research built almost exclusively on Western samples and suggest that cultural values shape the pathways through which people trust or resist AI advice. On the AI side, this thesis documents a recurring evaluative tendency across GPT models covering forecasting, hotel review evaluation, and product recommendation contexts. GPT systematically amplifies positive signals, places less weight on negative and feasibility-related cues, and favours description format features such as length and technicality that diverge substantially from human judgement. We term this finding information-format-sensitivity bias, whereby GPT produces preferences that diverge from those of human consumers. A theoretical framework bridging RLHF-induced sycophancy with CLT is also developed to explain why GPT's evaluative behaviour is consistently ends-driven and desirability-oriented, while human decision-makers in consequential contexts attend more closely to concrete risks, diagnostic negative information, and substantive quality. Overall, this thesis establishes human-AI misalignment as a two-sided phenomenon shaped by cultural, training, and processing mechanisms, with implications for AI deployment, bias-aware evaluation, platform governance, and ongoing human benchmarking.

View source

Similar papers

#artificial intelligence Conference Open access Apr 2020

ECCOLA - a Method for Implementing Ethically Aligned AI Systems

The method, ECCOLA, is presented, which aims at making the high-level AI ethics principles more practical, making it possible for developers to more easily implement them in practice.

Ville Vakkuri, Kai-Kristian Kemell, P. Abrahamsson · 64 citations · ⚡6
#computer vision Review Apr 2024

AI-powered Code Review with LLMs: Early Results

The goal is to not only refine the accuracy of the LLM-based tool but also to underscore its potential in streamlining the software development lifecycle through proactive code improvement and education.

Z. Rasheed, Malik Abdul Sami, Muhammad Waseem et al. · 62 citations · ⚡3
#computer vision Open access Mar 2024

LLM-based agents for automating the enhancement of user story quality: An early report

The use of large language models to automatically improve the user story quality in Austrian Post Group IT agile teams is explored, with a reference model for an Autonomous LLM-based Agent System developed and implemented at the company.

Zheying Zhang, M. Rayhan, Tomas Herda et al. · 48 citations · ⚡4
#computer vision Review Mar 2024

System for systematic literature review using multiple AI agents: Concept and an empirical evaluation

This paper introduces a novel multi-AI-agent system designed to fully automate SLRs, and demonstrates how it substantially reduces the time and effort traditionally required for SLRs while maintaining comprehensiveness and precision.

Abdul Malik Sami, Z. Rasheed, Kai-Kristian Kemell et al. · 44 citations · ⚡2
#computer vision Feb 2024

Can Large Language Models Serve as Data Analysts? A Multi-Agent Assisted Approach for Qualitative Data Analysis

The proposed LLM-based multi-agent system automates qualitative data analysis process, creating opportunities for researchers and practitioners, and future improvements focus on enhancing multilingual performance and integrating continuous expert feedback.

Z. Rasheed, Muhammad Waseem, Aakash Ahmad et al. · 41 citations
#artificial intelligence Conference Open access Jun 2018

The Key Concepts of Ethics of Artificial Intelligence

It is suggested that the focus on finding keywords is the first step in guiding and providing direction for future research in the AI ethics field.

Ville Vakkuri, P. Abrahamsson · 39 citations · ⚡2

Related blog posts

Microsoft Research Blog Oct 12, 2026

Simulating student learning for better AI tutoring

StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.

GPT-Lab Oct 12, 2026

AI Has Grown Up. Have We?

AI is moving beyond impressive demos. After World Summit AI 2026 in Amsterdam, GPT-Lab's Muhammad Waseem reflects on what organizations need to make AI agents reliable, responsible and genuinely useful in everyday work. The post AI Has Grown Up. Have We? appeared first on GPT-Lab.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.