Jul 2026· International Conference on the Theory of Information Retrieval· pp. 392-402· 0 citations· 48 references
Computer Science
TL;DR
This perspectives paper introduces the Collaborative Information Retrieval Configurations (CIRC) framework, organized around three dimensions -- composition, coordination, and adaptation -- that provide systematic guidance for designing and evaluating human-agent teams in IR.
Abstract
Multi-agent information retrieval is not a future prospect -- it is an operational reality. Existing frameworks for multi-agent coordination -- including comprehensive taxonomies of collaboration mechanisms and adaptive orchestration architectures for modular generative IR systems -- address the agent-only case: they configure AI components that interact with each other to serve a passive human end-user. The heterogeneous case -- teams in which humans and AI agents serve as joint cognitive participants with complementary capabilities -- remains without a principled design foundation. This perspectives paper introduces the Collaborative Information Retrieval Configurations (CIRC) framework, organized around three dimensions -- composition, coordination, and adaptation -- that provide systematic guidance for designing and evaluating human-agent teams in IR. Situated within the design science research paradigm, CIRC is prescriptive where prior taxonomies are descriptive: it specifies when collaborative configurations outperform single-agent approaches, which coordination patterns suit which task types, and how to evaluate team-level performance rather than individual agent output. We ground the framework in simulation experiments on TREC Deep Learning 2020 that demonstrate the framework's discriminative capacity: collaborative configurations produce measurably distinct quality profiles, and collaborative advantages concentrate at higher task complexity in ways that standard IR metrics fail to capture. We outline a three-dimensional evaluation framework and a concrete research agenda to advance the science of collaborative IR configurations.
A semantic-uncertainty-guided orchestration approach, HASSUM is introduced as a general framework for uncertainty-aware coordination in multi-agent systems and suggests that semantic uncertainty is a practical and general-purpose signal for improving robustness and trustworthiness in agentic AI systems.
John Knowlton, Aritra Guha, Risto Miikkulainen· 0 citations
Multi-agent frameworks built on large language models (LLMs) routinely entangle three logically distinct concerns: who is on the team (organization), how members align (coordination), and which algorithm fuses their work (collaboration protocol). IMACS (Intelligent Multi-Agent Collaboration System) separates the three into orthogonal, independently swappable layers. Classic organizational theory (Belbin roles, Mintzberg coordination, RACI accountability) becomes executable, validated configuration, and the framework places six published collaboration algorithms behind a common interface while exposing roles, coordination, and accountability as independently configurable factors. We use this separation to conduct controlled comparisons in which organizational assignments vary while the collaboration protocol is held fixed. It also turns protocol choice into a variable that can be learned: Adaptive Org Routing, a contextual-bandit meta-protocol, selects a protocol per task under an explicit quality-cost tradeoff, outperforms every fixed protocol in a controlled study, and trains online on real benchmark and LLM-judge rewards. The ablations expose a mechanism. Accountability placement changes outcomes exactly when the protocol routes the deliverable through the accountable agent, and the winning placement flips across model families, so organizational design cannot be hard-coded; it must be revalidated, or learned, for each model binding.
Huan-Wei Chen, Xiang Song, Jian Jin et al.· arXiv.org· 2 citations
A unified, taxonomy-driven, and deployment-oriented survey of agentic AI systems, synthesizing recent advances through a modular reference architecture and a four-dimensional taxonomy that characterizes agents along the axes of autonomy, tool use, collaboration, and safety–governance is presented.
Sparsh Bajoria, Shreyanshu Ranjan, Adhitya M et al.· Cognitive Computation· 0 citations
Agentic AI systems that reason, plan, and act on complex goals have advanced rapidly across software engineering, scientific discovery, drug development, healthcare, finance, and social simulation. Across these domains a single failure pattern recurs: current systems can execute tasks competently but often struggle to determine when to act, when to pause, when to change strategy, and when to involve a human. Existing reviews catalog agentic architectures, taxonomies, and limitations, but none specify what capabilities these systems must acquire to support dynamic human-AI collaboration. We address that gap. We define collaborative AI as a class of systems that combine generative exploration with autonomous action and calibrate between them based on context, uncertainty, and task demands. We identify four required capabilities: metacognition, contextual mode-switching, uncertainty-aware action, and adaptive human collaboration. We relate these capabilities to established multi-agent systems foundations, including belief-desire-intention architectures, adjustable autonomy, mixed-initiative interaction, and decentralized decision-theoretic control, while specifying the distinct challenges that LLM-based agents introduce. Across the six domains reviewed here, these gaps appear repeatedly and are not solved by current architectures, which positions collaborative AI as a concrete near-term research objective.
Nalan Karunanayake, Savindu Nanayakkara, Kasun Gayashan Hettihewa et al.· International Journal of Net...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.