Skip to content
#generative ai Open access

How Instrument Ontologies Shape the Embodied Learning of Generative AI in Creative Work

Sep 2026 · Repository@Nottingham (University of Nottingham)
Music Technology and Sound Studies

Abstract

AI shifts musical creation by changing how performers and composers engage with instruments. Interviews with nine composers show three ways AI becomes embodied knowledge, moving resistance from physical effort to probabilistic navigation and reshaping affect and understanding.Composing and playing acoustic instruments demands embodied and cognitive investment; creating music with generative AI more often involves prompting, steering, and iterating outputs. Making with GenAI seldom feels like composing at an acoustic piano. Drawing on nine in-depth interviews with artistic composers across classical, experimental, and digital practices, we identify three instrument onto-epistemologies that shape how AI is understood, embodied, and learned. Interviewing both AI users and non-users, we trace how generative systems enter (or are rejected in) situated creative work.First, a resistance-anchored onto-epistemology treats the acoustic instrument as a partner that “pushes back.” Skill emerges through bodily struggle, repetition, and material constraint; GenAI can feel frictionless, even irritating, because it lacks weight, resistance, and energetic reciprocity. Second, reconfiguration welcomes AI’s rearrangement of musicianship. Instead of motor mastery grounded in tactile feedback, practice becomes probabilistic navigation: parameter tuning, exploratory search, and curatorial selection amid algorithmic abundance. The body does not disappear; it relocates from physical calibration to attentiveness and evaluative listening. Third, integration, most common among our respondents, reorients embodiment from resisting materials to engaging outputs, where aesthetic judgment, pattern recognition, and iterative curation become central sites of skilful participation.We suggest that GenAI can reorganize what counts as “resistance” in musical work and, with it, the forms of embodied attention and affect that structure playing and composing. These onto-epistemologies generate distinct encounters with AI, such as irritation, playfulness, or ambivalence and broadly frame creativity as embodied negotiation of constraints and possibilities rather than abstract algorithmic procedures.

View source

Similar papers

#artificial intelligence Conference Open access Apr 2020

ECCOLA - a Method for Implementing Ethically Aligned AI Systems

The method, ECCOLA, is presented, which aims at making the high-level AI ethics principles more practical, making it possible for developers to more easily implement them in practice.

Ville Vakkuri, Kai-Kristian Kemell, P. Abrahamsson · 64 citations · ⚡6
#computer vision Review Apr 2024

AI-powered Code Review with LLMs: Early Results

The goal is to not only refine the accuracy of the LLM-based tool but also to underscore its potential in streamlining the software development lifecycle through proactive code improvement and education.

Z. Rasheed, Malik Abdul Sami, Muhammad Waseem et al. · 62 citations · ⚡3
#computer vision Open access Mar 2024

LLM-based agents for automating the enhancement of user story quality: An early report

The use of large language models to automatically improve the user story quality in Austrian Post Group IT agile teams is explored, with a reference model for an Autonomous LLM-based Agent System developed and implemented at the company.

Zheying Zhang, M. Rayhan, Tomas Herda et al. · 48 citations · ⚡4
#computer vision Review Mar 2024

System for systematic literature review using multiple AI agents: Concept and an empirical evaluation

This paper introduces a novel multi-AI-agent system designed to fully automate SLRs, and demonstrates how it substantially reduces the time and effort traditionally required for SLRs while maintaining comprehensiveness and precision.

Abdul Malik Sami, Z. Rasheed, Kai-Kristian Kemell et al. · 44 citations · ⚡2
#computer vision Feb 2024

Can Large Language Models Serve as Data Analysts? A Multi-Agent Assisted Approach for Qualitative Data Analysis

The proposed LLM-based multi-agent system automates qualitative data analysis process, creating opportunities for researchers and practitioners, and future improvements focus on enhancing multilingual performance and integrating continuous expert feedback.

Z. Rasheed, Muhammad Waseem, Aakash Ahmad et al. · 41 citations

Related blog posts

GPT-Lab Sep 17, 2026

Beyond Prompt Engineering: The Role of Tacit Knowledge in Software Engineering

AI is making software generation faster, but speed does not remove the need for expertise. As more work is delegated to AI, tacit knowledge may become one of the most important human advantages in software engineering. The post Beyond Prompt Engineering: The Role of Tacit Knowledge in Software Engineering appeared first on GPT-Lab.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.