Skip to content
#explainable ai Open access

When AI Recommends, Who Decides? Exploring User Control and Decision-Making in AI-Generated Financial Recommendations

Sep 2026 · Zenodo (CERN European Organization for Nuclear Research)
Explainable Artificial Intelligence (XAI)

Abstract

This study examines how AI-generated financial recommendations and digital interface design influence users’ trust, perceived control, decision confidence, and willingness to follow financial guidance. The study begins from a simple but important question: when an AI system recommends what a person should do with their money, who still feels responsible for the final decision? AI can process large amounts of information quickly and can present users with recommendations that appear clear and useful. However, the ease of following a recommendation does not necessarily mean that the recommendation has been understood, evaluated, or consciously accepted by the user. This makes the interface through which an AI recommendation is communicated an important part of the decision-making experience. The proposed study uses a user-centered experimental approach with prototype digital interfaces that present the same type of AI-generated financial recommendation in different ways. Participants will complete simulated financial decision-making tasks and will be asked to evaluate the recommendation and make a final choice. Their experience will be examined through measures related to trust, perceived control, decision confidence, clarity, usability, and willingness to act on the recommendation. The study is designed to compare how different presentation approaches affect the movement from receiving AI guidance to making an independent decision. The study does not assume that the purpose of an AI interface should be to increase acceptance of its recommendation. Instead, it considers appropriate decision support as an interaction in which the user can understand the recommendation, question it when necessary, compare it with alternatives, and retain a meaningful sense of control. Existing research has separately examined trust in AI, over-reliance, recommendation acceptance, autonomy, explainability, and financial AI adoption. This research brings these concerns together from an interface and user-experience perspective. The expected contribution is a clearer understanding of how interface choices can support AI as a helpful guide without making the user feel that the decision has already been made for them.

View source

Similar papers

#artificial intelligence Conference Open access Apr 2020

ECCOLA - a Method for Implementing Ethically Aligned AI Systems

The method, ECCOLA, is presented, which aims at making the high-level AI ethics principles more practical, making it possible for developers to more easily implement them in practice.

Ville Vakkuri, Kai-Kristian Kemell, P. Abrahamsson · 64 citations · ⚡6
#computer vision Review Apr 2024

AI-powered Code Review with LLMs: Early Results

The goal is to not only refine the accuracy of the LLM-based tool but also to underscore its potential in streamlining the software development lifecycle through proactive code improvement and education.

Z. Rasheed, Malik Abdul Sami, Muhammad Waseem et al. · 62 citations · ⚡3
#computer vision Open access Mar 2024

LLM-based agents for automating the enhancement of user story quality: An early report

The use of large language models to automatically improve the user story quality in Austrian Post Group IT agile teams is explored, with a reference model for an Autonomous LLM-based Agent System developed and implemented at the company.

Zheying Zhang, M. Rayhan, Tomas Herda et al. · 48 citations · ⚡4
#computer vision Review Mar 2024

System for systematic literature review using multiple AI agents: Concept and an empirical evaluation

This paper introduces a novel multi-AI-agent system designed to fully automate SLRs, and demonstrates how it substantially reduces the time and effort traditionally required for SLRs while maintaining comprehensiveness and precision.

Abdul Malik Sami, Z. Rasheed, Kai-Kristian Kemell et al. · 44 citations · ⚡2
#computer vision Feb 2024

Can Large Language Models Serve as Data Analysts? A Multi-Agent Assisted Approach for Qualitative Data Analysis

The proposed LLM-based multi-agent system automates qualitative data analysis process, creating opportunities for researchers and practitioners, and future improvements focus on enhancing multilingual performance and integrating continuous expert feedback.

Z. Rasheed, Muhammad Waseem, Aakash Ahmad et al. · 41 citations
#artificial intelligence Conference Open access Jun 2018

The Key Concepts of Ethics of Artificial Intelligence

It is suggested that the focus on finding keywords is the first step in guiding and providing direction for future research in the AI ethics field.

Ville Vakkuri, P. Abrahamsson · 39 citations · ⚡2

Related blog posts

Microsoft Research Blog Oct 7, 2026

Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses

Training AI agents with reinforcement learning can be challenging because their tools, context, and decision-making are managed by complex frameworks. Agent Lightning connects existing agents to RL training, making it easier to improve them without rebuilding them. The post Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.