Code in Space: How Multimodal Human-AI Experience Can Reshape the Future of Tech Creation

Abstract

Advances in artificial intelligence (AI) continue to reshape digital product development, yet the day-to-day tools for developers and designers remain bound to flat screens and 2D inputs. The intersection of AI and Extended Reality (AI-XR) introduces powerful multimodal interaction channels, such as gaze, motion, or spatial computing, that can enrich the existing Human-AI experience. A critical challenge for utilizing this multimodal opportunities lies in the understanding of how to combine these elements into a cohesive, high-level creative environment. Our study maps this territory through a thematic analysis of semi-structured interviews with 13 AI-XR experts. Categorizing over 150 topics through thematic analysis, we outline five core dimensions of this evolving landscape: professional creation, AI as a contextual layer, new interaction paradigms, adoption frictions, and ethics and human position. Our analysis reveals that besides the critical hardware constraints, the future of AI-XR for tech creation is dependent on addressing human cognitive limits. Ultimately, succeeding in the new multimodal Human-AI experience paradigm requires moving past flat-screen metaphors to design new types of interactions that selectively manage human attention while protecting user agency.