Findings indicate different profiles of evaluated ideation output rather than a uniform advantage for either condition, as perceived support in the AI-assisted workflow did not translate into a uniform advantage across originality-related ratings or into superior expert-rated preliminary design refinement.
Abstract
Generative artificial intelligence is increasingly used in creative practice, but controlled evidence on its role in early-stage design ideation remains limited. This study examined whether a combined text-and-image AI-assisted workflow differed from human-only brainstorming in expert-rated ideation outputs, preliminary design refinement, and subjective task experience. A counterbalanced within-subjects experiment was conducted with 32 undergraduate design students, each of whom completed both conditions using the same design brief. Ideation outputs were evaluated by three expert raters across six task-specific analytic criteria, participant-matched concept sheets were assessed across five design attributes, and participants completed a task-specific post-task questionnaire after each condition. After Holm–Bonferroni correction within each outcome family, AI-assisted outputs received higher ratings for problem framing, mechanism, creator perspective, and evaluator perspective, whereas human-only outputs received higher ratings for innovation and proposed solution strategies. No statistically robust condition differences were found for the five design attributes. Participants reported higher ratings for perceived cognitive processing, self-rated ideation skills, and affective response in the AI-assisted condition. These findings indicate different profiles of evaluated ideation output rather than a uniform advantage for either condition. Perceived support in the AI-assisted workflow did not translate into a uniform advantage across originality-related ratings or into superior expert-rated preliminary design refinement.
The method, ECCOLA, is presented, which aims at making the high-level AI ethics principles more practical, making it possible for developers to more easily implement them in practice.
Ville Vakkuri, Kai-Kristian Kemell, P. Abrahamsson· EUROMICRO Conference on Soft...· 64 citations· ⚡6
The goal is to not only refine the accuracy of the LLM-based tool but also to underscore its potential in streamlining the software development lifecycle through proactive code improvement and education.
Z. Rasheed, Malik Abdul Sami, Muhammad Waseem et al.· arXiv.org· 62 citations· ⚡3
A comprehensive overview of how enhanced sampling methods are reshaping the field, with a particular focus on the data-driven construction of collective variables, is provided.
Kai Zhu, Enrico Trizio, Jintu Zhang et al.· Chemical Reviews· 58 citations
The use of large language models to automatically improve the user story quality in Austrian Post Group IT agile teams is explored, with a reference model for an Autonomous LLM-based Agent System developed and implemented at the company.
Zheying Zhang, M. Rayhan, Tomas Herda et al.· International Conference on...· 48 citations· ⚡4
This paper introduces a novel multi-AI-agent system designed to fully automate SLRs, and demonstrates how it substantially reduces the time and effort traditionally required for SLRs while maintaining comprehensiveness and precision.
Abdul Malik Sami, Z. Rasheed, Kai-Kristian Kemell et al.· arXiv.org· 44 citations· ⚡2
The proposed LLM-based multi-agent system automates qualitative data analysis process, creating opportunities for researchers and practitioners, and future improvements focus on enhancing multilingual performance and integrating continuous expert feedback.
Z. Rasheed, Muhammad Waseem, Aakash Ahmad et al.· arXiv.org· 41 citations
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduOct 15, 2026
A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.
MIT News · Artificial Intelligence· news.mit.eduOct 15, 2026
AI is moving beyond impressive demos. After World Summit AI 2026 in Amsterdam, GPT-Lab's Muhammad Waseem reflects on what organizations need to make AI agents reliable, responsible and genuinely useful in everyday work. The post Building trustworthy AI: The role of AI harnesses, intent contracts and evals appeared first on GPT-Lab.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.