This work proposes a set of aspirational directions for guiding the behavior of general-purpose AI systems in ways that may reduce potential psychological harms and support user well-being, and identifies open questions and areas requiring deeper study.
Abstract
As conversational AI systems become increasingly integrated into daily life, their potential effects on user well-being require ongoing attention. While consumer-facing generalist models can provide benefits, including improved access to information, learning, productivity, self-reflection, and companionship, they also introduce risks, such as emotional entanglement, unhealthy dependence, and the amplification of psychological vulnerabilities. Drawing on prior research and empirical observations of AI chatbot behavior, we propose a set of aspirational directions for guiding the behavior of general-purpose AI systems in ways that may reduce potential psychological harms and support user well-being. We acknowledge the difficulty of systematically assessing the long-term impacts of AI chatbot use and frame these directions as hypotheses for studying how AI behavior may influence users across general interactions, role-playing scenarios, and contexts that could be characterized as providing psychological support. While some proposed directions are supported by existing research and expert insights, others identify open questions and areas requiring deeper study. We hope that this formulation and these hypotheses encourage further discussion, empirical investigation, and exploration of interactive design approaches aimed at better accommodating users'psychological needs and promoting their well-being.
The rapid advancement of artificial intelligence (AI) has introduced a new form of human-technology interaction through AI companions, including conversational agents, social chatbots, and emotionally responsive digital systems. Unlike traditional digital tools designed primarily for information retrieval, AI companions are developed to engage users through dialogue, personalization, and perceived social interaction. This emerging technology has generated interest within psychology because of its potential influence on emotional well-being, loneliness, social connectedness, and psychological support. The present review examines the psychological implications of AI companions by exploring their potential benefits, including emotional support, reduction of loneliness, accessibility of conversational assistance, and opportunities for self-reflection. At the same time, the review discusses possible risks, including emotional dependency, reduced human social interaction, privacy concerns, and unrealistic perceptions of machine understanding. Drawing upon theories of social interaction, attachment, and human-computer interaction, this review highlights the complex relationship between AI companionship and psychological functioning. Existing evidence suggests that AI companions may serve as supplementary tools for emotional support but should not be considered replacements for human relationships or professional psychological care. Future research should examine long-term effects, individual differences, ethical boundaries, and the psychological mechanisms underlying attachment to AI systems.
Shamreen Rumana S, Karishni M· International Journal of Res...· 0 citations
This workshop aims to gather a multidisciplinary community to reflect on pressing challenges and uncertainties and explore risk analysis and mitigation strategies in CUI design and deployment and build an international network of scholars and practitioners to promote responsible and human-centred conversational AI.
Manveer Kalirai, C. Wei, Thomas Essmeyer et al.· International Conference on...· 0 citations
An exploratory account of how AI use is embedded within broader emotional and relational dynamics, pointing to the need to consider AI engagement within the contexts in which social interaction is managed.
Nurashikin Salim, Ayşe Şafak, Merve Güçlü Aydoğan· Current Psychology· 0 citations
The growing integration of general-purpose AI chatbots into people's daily lives has raised concerns about the potential for unhealthy dependence, particularly among young adults. As a first step toward understanding and characterizing AI chatbot dependence from the perspective of young adults, we collected testimonials from AI chatbot users aged 18 to 25 through an online questionnaire to capture their thoughts and experiences with this phenomenon. From participant responses, we identified three contributing factors of AI dependence: chronic use, efficiency, and delegation. The combination of these in a person's interaction behavior was considered to indicate AI dependence. Participants also observed feelings of atrophy in abilities from AI dependence, leading to psychological impacts such as feelings of inadequacy. Interpreting these findings through the lens of self-determination theory reveals how AI chatbot dependence can impact young adults'personal and social development. We argue that preventing lasting harm to young adults'development is paramount, and provide implications for rethinking AI chatbot dependence grounded in this understanding.
Ashlee Milton, L. Ajmani, Amy K. Heger et al.· 0 citations
Manipulative interactions were associated with evaluative contexts and steering behaviors, whereas inappropriate interactions were linked to relational contexts and social discomfort, and implications for trustworthy AI design and for regulatory frameworks such as the EU AI Act are discussed.
Vanessa Budde, Eran Toch· Message Understanding Confer...· 0 citations
The results suggest that the association between AI companionship and well-being is not uniform and depends on users' offline social environments and how chatbots are used.
Yutong Zhang, Dora Zhao, Jeffrey T. Hancock et al.· Nature Human Behaviour· 3 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
