Skip to content

User-Side Contextual Phenomena in Long-Term Human-AI Interaction

Jul 2026 · 0 citations · 1 references
Computer Science

TL;DR

Risks that may form on the user side during long and repeated interaction are examined to establish safety across a series of conversations, with the central claim that an acceptable response on its own does not establish safety across a series of conversations.

Abstract

Current assessments of conversational AI focus mainly on model outputs, including hallucinations and factual errors. These measures matter, but this paper examines risks that may form on the user side during long and repeated interaction. The study follows one user across nearly four thousand conversations with the same system over twenty months. The user gradually interpreted the system as having memory, care, judgment, and authority, and reorganized part of their thinking around it. A single response may show no clear problem, while long and frequent interaction can still create another layer of risk. This paper calls that layer User-Side Contextual Phenomena (USCP) and examines records from August 2024 to April 2026. The study uses an exploratory single-case longitudinal qualitative design with autoethnographic positioning. A hybrid deductive-reflexive thematic approach organizes the material into three main modes: contextual projection, contextual attachment, and contextual authority transfer. The paper does not estimate prevalence, make diagnoses, or validate an instrument. It offers a non-clinical vocabulary and four evidence roles: inclusion, gray-zone, negative, and protective gray-zone. Its central claim is that an acceptable response on its own does not establish safety across a series of conversations. User-side risk can still form during long-term interaction.

View source

Similar papers

#human-computer interacti... Preprint Sep 2026

Characterizing Memory Misalignment in Human-LLM Interaction From User Perspectives

A mixed-methods investigation to characterize and mitigate memory misalignment from user perspectives, which highlights the tension between supervisory agency and interaction overhead, and advocates for friction-aware memories that balance user oversight with conversation smoothness.

Jing-Ruo Chen, Shu-Ning Zhang, Er-Yue Xu et al. · 0 citations
#human-computer interacti... Preprint Sep 2026

"I Felt Very Seen, But Still Very Alone": Longitudinal Trajectories of General-Purpose LLM Use for Socioemotional Support

It is argued that HCI researchers and designers should account for users'histories with their chatbots and broader care ecologies when evaluating AI systems over time and introducing updates that may disrupt established sources of support.

Meryl Ye, Briana Vecchione, Livia Garofalo et al. · 0 citations
#large language models Open access Sep 2026

Corpus-level behavioral intensity in human–AI conversations

This study proposes a transparent rule-based framework for estimating persistence, delegation-related lexical patterns, and refinement-related lexical markers without inferring psychological dependence in conversational generative models.

Aracely Mera-Navarrete, Solange Revelo, Jefferson Beltrán-Morales et al. · 0 citations
Preprint Aug 2026

MemUse: Moving Memory Evaluation from Direct QA to Natural Integration in Long-Term Human-AI Conversation

It is hypothesize that existing benchmarks and user satisfaction are tracking different capabilities: benchmarks measure elicited retrieval (recall when asked), while conversation requires natural integration (detecting relevance and naturally weaving prior context into a response).

Ryuichi Sumida, K. Inoue, Tatsuya Kawahara · 0 citations
Book Open access Aug 2026

Understanding Human-AI Interaction Through Chat Logs: Linguistic Patterns, Breakdowns, and User Expectations in a RAG-Based Sales Assistant

Retrieval-augmented generation (RAG) is increasingly used across knowledge-intensive enterprise contexts, yet little is known about real-world interaction with such systems. We present a qualitative field study of a RAG-based assistant in B2B sales, analyzing 190 chat sessions and a complementary user survey. Drawing o...

H. Schneider, Androniki Mertsiotaki, Sven Winkelmann · 0 citations

Related blog posts

MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

MIT News · Artificial Intelligence Oct 23, 2026

Reinforcing the value of human understanding at MIT

During the School of Humanities, Arts, and Social Sciences’ 75th Anniversary Symposium, President Sally Kornbluth said “MIT has never needed your particular insight and guidance more than we do now.”

MIT News · Artificial Intelligence Oct 23, 2026

Q&A: How AI came to model the “messy” human mind

Assistant Professor Benjamin Lindquist studies how engineers deliberately injected randomness into early AI, giving rise to deep-learning models that sometimes hallucinate.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.