Skip to content

Designing a human-in-the-loop AI iterative process for research writing: a framework for preserving productive struggle

Sep 2026 · Frontiers in Computer Science · Vol 8 · 46 references

Abstract

This Hypothesis and Theory paper addresses a design problem at the center of AI-assisted research writing: which cognitive demands should AI reduce, and which must remain the writer’s own work. Generative AI can absorb the effort of drafting, organizing, and synthesizing prose, but that same effort is where understanding takes shape. Recent empirical work documents reduced neural engagement, weaker recall of one’s own writing, and a diminished sense of authorship among writers who rely heavily on AI assistance. The paper grounds this problem in cognitive load theory, which distinguishes intrinsic load (the element interactivity a task inherently requires) from extraneous load (demands that do not contribute to learning), and which treats germane processes as the working memory resources a writer allocates to intrinsic load. It draws on productive struggle and generative processing to explain why germane processing cannot be offloaded: when a tool performs the work, the processing does not transfer to the writer; it does not occur. Two research questions are posed. First, which cognitive demands in research writing constitute extraneous load that AI could reduce, and which require germane processing that must remain the writer’s own. Second, how can human-in-the-loop AI collaboration be designed across the phases of research writing so that this distinction is operationalized through human judgment? The contribution is a nine-phase conceptual framework mapped to the sections of a research paper, from curiosity and inquiry through references and submission. Each phase specifies the dominant cognitive demand, the AI role (ranging from minimal involvement to full collaboration), and design guidelines for tools and interactions. The framework addresses research writing from secondary school (grades 9–12) through postdoctoral and professional research, across disciplines. It treats phase-aware AI use as responsive pedagogy applied to research writing: instruction and tool design that respond to the cognitive demands of the task rather than to the tool’s capabilities. The paper draws implications for the design of responsive digital education, including tool selection, assessment, equity, and support for writers with cognitive differences. The framework is intended to preserve the cognitive work that makes research meaningful.

View source

Similar papers

#artificial intelligence Conference Open access Apr 2020

ECCOLA - a Method for Implementing Ethically Aligned AI Systems

The method, ECCOLA, is presented, which aims at making the high-level AI ethics principles more practical, making it possible for developers to more easily implement them in practice.

Ville Vakkuri, Kai-Kristian Kemell, P. Abrahamsson · 64 citations · ⚡6
#computer vision Review Apr 2024

AI-powered Code Review with LLMs: Early Results

The goal is to not only refine the accuracy of the LLM-based tool but also to underscore its potential in streamlining the software development lifecycle through proactive code improvement and education.

Z. Rasheed, Malik Abdul Sami, Muhammad Waseem et al. · 62 citations · ⚡3
#computer vision Open access Mar 2024

LLM-based agents for automating the enhancement of user story quality: An early report

The use of large language models to automatically improve the user story quality in Austrian Post Group IT agile teams is explored, with a reference model for an Autonomous LLM-based Agent System developed and implemented at the company.

Zheying Zhang, M. Rayhan, Tomas Herda et al. · 48 citations · ⚡4
#computer vision Review Mar 2024

System for systematic literature review using multiple AI agents: Concept and an empirical evaluation

This paper introduces a novel multi-AI-agent system designed to fully automate SLRs, and demonstrates how it substantially reduces the time and effort traditionally required for SLRs while maintaining comprehensiveness and precision.

Abdul Malik Sami, Z. Rasheed, Kai-Kristian Kemell et al. · 44 citations · ⚡2
#computer vision Feb 2024

Can Large Language Models Serve as Data Analysts? A Multi-Agent Assisted Approach for Qualitative Data Analysis

The proposed LLM-based multi-agent system automates qualitative data analysis process, creating opportunities for researchers and practitioners, and future improvements focus on enhancing multilingual performance and integrating continuous expert feedback.

Z. Rasheed, Muhammad Waseem, Aakash Ahmad et al. · 41 citations

Related blog posts

Microsoft Research Blog Oct 7, 2026

Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses

Training AI agents with reinforcement learning can be challenging because their tools, context, and decision-making are managed by complex frameworks. Agent Lightning connects existing agents to RL training, making it easier to improve them without rebuilding them. The post Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.