Skip to content
Open access

Does AI undermine democratic deliberation? How engagement algorithms hijack epistemic agency

Sep 2026 · Synthese · Vol 208 · 2 citations · 73 references

TL;DR

A mechanistic account according to which AI-driven engagement architectures reconfigure the cues by which beliefs are evaluated, producing unwarranted confidence in one’s own judgments and undermining the conditions for deliberative compromise is developed.

Abstract

Does artificial intelligence (AI) threaten deliberative democracy? This paper argues that it does, not because it isolates citizens in simplistic “filter bubbles” understood as ideologically homogeneous silos, but because it hijacks the capacities through which beliefs are evaluated. While early accounts emphasized algorithmically induced informational isolation, we argue that the more fundamental mechanism lies in the operation of engagement algorithms that shape how both one’s own views and those of political opponents are evaluated. By optimizing for engagement, these algorithms also optimize the conditions under which information is processed, increasing cognitive fluency and generating metacognitive feelings of confidence that are easily mistaken for epistemic justification. Drawing on research in metacognition and epistemology, we develop a mechanistic account according to which AI-driven engagement architectures reconfigure the cues by which beliefs are evaluated, producing unwarranted confidence in one’s own judgments and undermining the conditions for deliberative compromise. We conclude by outlining how deliberative AI could counteract these effects.

Read PDF

Similar papers

AI Should Facilitate Democratic Deliberation at Scale

This position paper argues that AI-assisted deliberation offers a more promising path by lowering barriers to meaningful engagement without substituting machine judgment for human choice.

José Ramón Enríquez, Jia-Xin Pei, A. Pentland · 0 citations
Open access Sep 2026

Plausible nonsense and deliberative reasoning: Benchmarking LLMs against human judgment.

Large Language Models (LLMs) are entering democratic contexts as instruments of governance, where the challenges at hand are ill-structured, marked by ambiguity and contestation. Ill-structured democratic problems demand more than factual precision; they call for intersubjective reasoning: context-sensitive judgments t...

F. Veri, Gustavo Kreia Umbelino · 0 citations
Open access Sep 2026

As-If Agents: Misrecognition and the Ethics of Non-Agentive AI

An ethics of non-agentive AI is sketched: the authors should see these systems as powerful, instrument-like extensions of human cognition, not as knowers in their own right, and design institutions, interfaces and norms of trust accordingly.

Neumann Saskia Janina · 0 citations
#explainable ai Review Sep 2026

Designing for disagreement: epistemic friction, sycophancy, and the ethics of human–AI advice—a critical integrative review

This critical integrative review synthesizes research on automation bias, algorithm appreciation and aversion, large-language-model sycophancy, persuasive dialogue, anthropomorphic interaction, explainable AI, and human autonomy to reposition productive disagreement as a positive safety and autonomy property of human–A...

Connor Nitchals · 0 citations
Review Open access Aug 2026

AI and Democracy: Mapping Notions, Debates and Challenges

It is suggested that progress in research on democracy and AI depends not only on further empirical investigation or technical refinement, but also on sustained conceptual work that makes democratic assumptions explicit and thus open to scrutiny.

Joachim S. Wiewiura, A. Jørgensen, Thomas Ploug · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.