Skip to content
Open access

Why We Need Epistemically, Not Morally, Trustworthy AI: Decision Support and the Need for Collective Accountability

Sep 2026 · Philosophy & Technology · Vol 39 · 0 citations · 65 references

TL;DR

It is argued that once moral trustworthiness is set aside, the central normative question shifts from whether AI systems can be trusted to how their epistemic influence on human decision-making ought to be justified and governed.

Abstract

Calls for “trustworthy AI” have become ubiquitous in policy and industry, yet the term remains conceptually underspecified. In earlier work (Dorsch & Deroy, 2024), we argued that moral trustworthiness is neither possible nor necessary for AI decision-support systems (AI-DSS), and indeed unethical to pursue, since it risks the category mistake of attributing benevolence to systems that lack it. This paper revisits that claim in light of recent critiques and developments, arguing that once moral trustworthiness is set aside, the central normative question shifts from whether AI systems can be trusted to how their epistemic influence on human decision-making ought to be justified and governed. We begin by situating our earlier thesis alongside complementary arguments that converge on the dangers of anthropomorphising AI. Second, we respond to critics who seek residual roles for moral trustworthiness and who clarify the epistemic conditions of trust. Third, we advance an account of epistemic trustworthiness as a property of AI outputs, rather than a property of the systems themselves. We contend that guaranteeing epistemic trustworthiness depends on human institutions, and is necessary to mitigate vulnerabilities introduced by integrating AI-DSS into hybrid decision-making. We connect this property to legal frameworks, showing how the EU AI Act’s ‘Right to Explanation’ codifies it as a necessary condition for deploying AI in high-risk domains.

Read PDF

Similar papers

#explainable ai Review Sep 2026

Designing for disagreement: epistemic friction, sycophancy, and the ethics of human–AI advice—a critical integrative review

This critical integrative review synthesizes research on automation bias, algorithm appreciation and aversion, large-language-model sycophancy, persuasive dialogue, anthropomorphic interaction, explainable AI, and human autonomy to reposition productive disagreement as a positive safety and autonomy property of human–A...

Connor Nitchals · 0 citations
Open access Sep 2026

A dilemma for skeptics of trustworthy AI

Can artificial intelligence (AI) ever be (un)trustworthy? A growing number of philosophers argue that it cannot, because AI lacks some feature deemed essential for the trust relation, such as moral agency or being responsive to reasons. Here we propose a dilemma for these skeptics, based on the assumption that such the...

Madeleine Ransom, Nicole L. Menard · 0 citations
#generative ai Open access Sep 2026

Simulated Morality, Misplaced Trust: The Risks of Treating AI as a Moral Partner

The article proposes a reframing of alignment from an ethical-pedagogical project to an institutional one: instead of presuming or attempting to cultivate artificial moral agents on the basis of behavioral proxies, governance should focus on designing legal, technical, and organizational structures that constrain and r...

Saša Josifović · 0 citations
Open access Sep 2026

Hegemonikon and AI

The Stoic concept of the hegemonikon—the capacity for assent that directs the mind—is used as a framework for understanding intellectual creation and decision-making, clarifying when AI supports human judgment and when it replaces decision-making authority.

Christos A. Koutsotasios, Elias Vavouras · 0 citations
Open access Sep 2026

When responsibility cannot arise: algorithmic mediation and the preconditions of moral imputability

This paper argues that moral responsibility can fail under technologically mediated conditions in two structurally connected ways. First, agents may act from motivational states significantly shaped by external formative processes whose influence remains partially opaque to reflective awareness. Second, institutions ma...

Åke Elden · 0 citations

Understanding Perceived Trustworthiness as a Basis for Human Oversight in the Wild

It is argued that understanding how perceived trustworthiness is formed and expressed by users can provide a basis for human oversight of AI systems in the wild and how capturing, measuring, and aggregating perceived trustworthiness can be incorporated into oversight processes without substituting accountability mechan...

Evgenia Christoforou, Jahna Otterbacher, S. Kleanthous · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.