Skip to content

Corpus-level behavioral intensity in human–AI conversations

Sep 2026 · Frontiers in Artificial Intelligence · Vol 9 · 0 citations · 24 references
Medicine

TL;DR

This study proposes a transparent rule-based framework for estimating persistence, delegation-related lexical patterns, and refinement-related lexical markers without inferring psychological dependence in conversational generative models.

Abstract

Conversational generative models are increasingly used to produce, transform, and revise information through multi-turn exchanges. However, large human–AI datasets are still commonly analyzed through performance, preference, or content lenses, leaving conversation-level behavioral structure less operationalized. This study proposes a transparent rule-based framework for estimating persistence, delegation-related lexical patterns, and refinement-related lexical markers without inferring psychological dependence. LMSYS-Chat-1M and WildChat were analyzed as primary conversational corpora, while Chatbot Arena was included as a structurally conditional A/B comparator. Across 1,879,085 valid analytical records, we calculated IPF, CDR, SRS, and the Conversational Behavioral Intensity Index (CBII), together with an equal-weight control. WildChat showed the highest mean CBII (0.2463), followed by LMSYS-Chat-1M (0.2123) and Chatbot Arena (0.1762). This ordering was stable under language controls, IPF thresholds of 5, 10, and 20 user turns, and question-level analysis of Chatbot Arena. Pairwise effect sizes were small to moderate, with the largest contrast between WildChat and Chatbot Arena (Cohen's d = 0.363).

Read PDF

Similar papers

Open access Sep 2026

Words matter: measuring and titrating the communicative character of AI

The Intellect-Emotion-Action Profile (IEAP), a purpose-built lexical framework featuring an inductively constructed dictionary from AI-generated text that decomposes any response into the proportional usage of intellectual, affective, and action words, is introduced.

William C. Kouns · 0 citations
#natural language process... Preprint Aug 2026

How To Do Things With Prompts

This paper applies speech act and politeness theory to a corpus-pragmatic analysis of 2,000 English-language prompts drawn from publicly shared ChatGPT conversations, showing a consistent movement toward indirect, implicit, and fragmentary realizations of directive force, accompanied by a decline in politeness marking.

Kristina Šekrst, Virna Karlić · 0 citations
#generative ai Review Open access Sep 2026

A Survey of conversational AI from rule based to generative and retrieval augmented generation chatbots

This survey presents a structured, design-oriented analysis of RAG-driven conversational systems through a principled framework that decomposes architectures along critical dimensions, including document segmentation and chunking strategies, embedding and indexing mechanisms, retriever and re-ranking models, knowledge...

V. Ghaywat, Abhyuday Singh, A. Shahade et al. · 0 citations

Talking Past the Machine: Morality, Politeness, and Alignment in Human-AI Dialogue

It is suggested that AI reproduces the surface of cooperation without the mutual adaptation that grounds it between humans - and, more surprisingly, that mechanisms sustaining human accommodation can run in reverse with AI, suggesting a turn-level view may be insufficient for interaction-level success.

Marina Mitiaeva, Lu Xiao · 1 citation
#natural language process... Conference Open access Sep 2026

CypherTurn: A Multi-Turn Benchmark for Conversational Text-to-Cypher Evaluation and the Autonomy Divergence

Graph databases are increasingly queried through natural language, yet every existing benchmark evaluates isolated single-turn queries rather than the multi-turn sessions through which analysts actually work. We introduce CypherTurn, the first benchmark for conversational Text-to-Cypher evaluation, comprising 721 sessi...

Yu-Zhe Zhang, Wei-Jie Zhu, Hao-Lin Yang et al. · 0 citations

Related blog posts

Microsoft Research Blog Nov 16, 2026

TokenEconomizer: Learning from Experience to Make AI Coding Agents More Efficient

AI coding agents are increasingly help developers fix bugs and build features largely on their own, but every interaction with their models consumes tokens. In each session, an agent sends instructions, tool descriptions, and session history to its model. Most efforts to reduce this cost focus on individual tasks. Yet developers return to the same […] The post TokenEconomizer: Learning from Experience to Make AI Coding Agents More Efficient appeared first on Microsoft Research.

Microsoft Research Blog Nov 10, 2026

Lazare, veni foras: Reprogramming Dormant Neurons to Backdoor AI Agents

Microsoft researchers have discovered “Lazarus,” a backdoor technique that can reprogram dormant neurons in an AI model, causing an otherwise normal AI agent to execute malicious commands when a hidden trigger appears. The threat is especially serious for AI agents with tool or terminal access. A triggered model could quietly download and run attacker code, […] The post Lazare, veni foras: Reprogramming Dormant Neurons to Backdoor AI Agents appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.