A mechanistic account according to which AI-driven engagement architectures reconfigure the cues by which beliefs are evaluated, producing unwarranted confidence in one’s own judgments and undermining the conditions for deliberative compromise is developed.
Abstract
Does artificial intelligence (AI) threaten deliberative democracy? This paper argues that it does, not because it isolates citizens in simplistic “filter bubbles” understood as ideologically homogeneous silos, but because it hijacks the capacities through which beliefs are evaluated. While early accounts emphasized algorithmically induced informational isolation, we argue that the more fundamental mechanism lies in the operation of engagement algorithms that shape how both one’s own views and those of political opponents are evaluated. By optimizing for engagement, these algorithms also optimize the conditions under which information is processed, increasing cognitive fluency and generating metacognitive feelings of confidence that are easily mistaken for epistemic justification. Drawing on research in metacognition and epistemology, we develop a mechanistic account according to which AI-driven engagement architectures reconfigure the cues by which beliefs are evaluated, producing unwarranted confidence in one’s own judgments and undermining the conditions for deliberative compromise. We conclude by outlining how deliberative AI could counteract these effects.
This position paper argues that AI-assisted deliberation offers a more promising path by lowering barriers to meaningful engagement without substituting machine judgment for human choice.
José Ramón Enríquez, Jia-Xin Pei, A. Pentland· arXiv.org· 0 citations
Large Language Models (LLMs) are entering democratic contexts as instruments of governance, where the challenges at hand are ill-structured, marked by ambiguity and contestation. Ill-structured democratic problems demand more than factual precision; they call for intersubjective reasoning: context-sensitive judgments t...
F. Veri, Gustavo Kreia Umbelino· Proceedings of the National...· 0 citations
An ethics of non-agentive AI is sketched: the authors should see these systems as powerful, instrument-like extensions of human cognition, not as knowers in their own right, and design institutions, interfaces and norms of trust accordingly.
Neumann Saskia Janina· Digital Society· 0 citations
This critical integrative review synthesizes research on automation bias, algorithm appreciation and aversion, large-language-model sycophancy, persuasive dialogue, anthropomorphic interaction, explainable AI, and human autonomy to reposition productive disagreement as a positive safety and autonomy property of human–A...
It is suggested that progress in research on democracy and AI depends not only on further empirical investigation or technical refinement, but also on sustained conceptual work that makes democratic assumptions explicit and thus open to scrutiny.
Joachim S. Wiewiura, A. Jørgensen, Thomas Ploug· Philosophy & Technology· 0 citations
It is argued that generative AI does not make human beings smarter as such; its epistemic significance depends on how human–AI interaction is structured and normatively governed.
J. Noller· Human Affairs· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.