Skip to content
Preprint

Calling the Bluff: Detecting Ever-Shifting Harmful Chat Dialogue via Ordered Reasoning Chain Regularization

Aug 2026 · 0 citations · 33 references
Computer Science

TL;DR

BRACE is proposed, which encodes the ORC as four differentiable stages (Topic ->Indicator ->Severity ->Type) with intermediate supervision, serving as a structured regularizer blended with direct heads, and supported by prototype-based feature augmentation and feature path disentanglement.

Abstract

Harmful chat dialogues are ever-shifting through type-shifting and lexical evasion, yet we find they share invariant principles, i.e., an Ordered Reasoning Chain (ORC) of recurring topics, harm language indicators, severity hierarchies, and type characteristics, which can help us capture the key information in the frequently changing lexical expressions. We propose BRACE, which encodes the ORC as four differentiable stages (Topic ->Indicator ->Severity ->Type) with intermediate supervision, serving as a structured regularizer blended with direct heads, and supported by prototype-based feature augmentation and feature path disentanglement. The evaluation results show that, across 4 domains and 5 harm categories, BRACE achieves harm-type macro F1 of 0.934 (RoBERTa-wwm-ext, 3-seed mean), with decoder backbones (Qwen3-1.7B LoRA) reaching 0.949. Ablation studies show that all components contribute to BRACE, and the structural decomposition of ORC enables BRACE to distinguish harmful types with semantic ambiguity. Disclaimer: This paper may contain content that is disturbing to some readers.

View source

Similar papers

#natural language process... Preprint Oct 2026

Stance Drift: How AI-mediated Communication Distorts Our Message

Large language models (LLMs) increasingly mediate human communication, from drafting emails to summarizing scientific reports, yet whether they faithfully preserve a speaker's position remains largely untested. We model AI-mediated communication as a two-step generation-extraction pipeline: one LLM produces an argument...

Ling-Chong Liu, Yan-Fei Zhou, Jacob Bien et al. · 0 citations
#human-computer interacti... Preprint Sep 2026

Targeted and Traceable Investigation of Multi-Agent LLM Dialogue via Semantic Bundling of Knowledge Graphs

This work presents a targeted and traceable approach to investigating multi-agent LLM dialogue, applied to the VAST Challenge 2026 MC1 dataset, and finds that the KG structure enables users to identify actors worth investigating faster and summarizing only the region surrounding an actor of interest better supports per...

Ze-Yu Hua, Adam Coscia, Alex Endert · 0 citations
#large language models Open access Sep 2026

Corpus-level behavioral intensity in human–AI conversations

This study proposes a transparent rule-based framework for estimating persistence, delegation-related lexical patterns, and refinement-related lexical markers without inferring psychological dependence in conversational generative models.

Aracely Mera-Navarrete, Solange Revelo, Jefferson Beltrán-Morales et al. · 0 citations
#generative ai Review Open access Sep 2026

A Survey of conversational AI from rule based to generative and retrieval augmented generation chatbots

This survey presents a structured, design-oriented analysis of RAG-driven conversational systems through a principled framework that decomposes architectures along critical dimensions, including document segmentation and chunking strategies, embedding and indexing mechanisms, retriever and re-ranking models, knowledge...

V. Ghaywat, Abhyuday Singh, Aniket K. Shahade et al. · 0 citations
#machine learning Preprint Sep 2026

Beyond Scores: Understanding LLM-as-a-Judge Mechanisms in Summarization Evaluation

This work investigates LLM-based evaluators of natural language generation quality mechanistically through an eight-attack perturbation taxonomy across the Readability and Adequacy dimensions of NLG quality, a generation pipeline that produces paired clean and corrupt summaries with controlled error intensity and expli...

Himil Vasava, Ming-Zhou Jiang · 0 citations
Open access 2026

Response Stability of Large Language Models Under Meaning-Preserving Prompt Variation

Single-prompt assessments provide limited evidence about whether task-relevant response properties remain stable when the same communicative intention is reformulated. This study examined response stability under controlled, meaning-preserving English prompt variation using 648 responses from 12 researcher-selected arg...

Idrees, Yong-Zhi Liu · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.