ABSTRACT This study examines how the choice of AI model and its architecture influences distributional fidelity in silicon sampling. Silicon samples, AI‐generated synthetic respondents used to simulate human survey responses, are increasingly proposed as substitutes for traditional market research participants, yet evidence regarding their accuracy remains mixed. Across four studies, we benchmark two AI models with distinct architectures, generative AI (GenAI) and neuro‐symbolic AI (NSAI), against human data. Our findings show that the evaluated GenAI models introduce systematic distributional distortions, including demographic bias, compressed variability, and divergence from human response patterns, even when enriched with statistical data. In contrast, the evaluated NSAI system demonstrates substantially closer correspondence with human benchmarks across the examined tasks. The findings suggest that distributional fidelity in silicon sampling is not architecture‐neutral: it depends in part on the alignment between AI architecture and the statistical demands of respondent‐level simulation. Rather than asking whether AI can replace human respondents in general, the study argues that the accuracy of silicon samples depends on which AI models are used, for which research tasks, and under what validation conditions.
The method, ECCOLA, is presented, which aims at making the high-level AI ethics principles more practical, making it possible for developers to more easily implement them in practice.
Ville Vakkuri, Kai-Kristian Kemell, P. Abrahamsson· EUROMICRO Conference on Soft...· 64 citations· ⚡6
The goal is to not only refine the accuracy of the LLM-based tool but also to underscore its potential in streamlining the software development lifecycle through proactive code improvement and education.
Z. Rasheed, Malik Abdul Sami, Muhammad Waseem et al.· arXiv.org· 62 citations· ⚡3
A comprehensive overview of how enhanced sampling methods are reshaping the field, with a particular focus on the data-driven construction of collective variables, is provided.
Kai Zhu, Enrico Trizio, Jintu Zhang et al.· Chemical Reviews· 58 citations
The use of large language models to automatically improve the user story quality in Austrian Post Group IT agile teams is explored, with a reference model for an Autonomous LLM-based Agent System developed and implemented at the company.
Zheying Zhang, M. Rayhan, Tomas Herda et al.· International Conference on...· 48 citations· ⚡4
This paper introduces a novel multi-AI-agent system designed to fully automate SLRs, and demonstrates how it substantially reduces the time and effort traditionally required for SLRs while maintaining comprehensiveness and precision.
Abdul Malik Sami, Z. Rasheed, Kai-Kristian Kemell et al.· arXiv.org· 44 citations· ⚡2
The proposed LLM-based multi-agent system automates qualitative data analysis process, creating opportunities for researchers and practitioners, and future improvements focus on enhancing multilingual performance and integrating continuous expert feedback.
Z. Rasheed, Muhammad Waseem, Aakash Ahmad et al.· arXiv.org· 41 citations
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduOct 13, 2026
StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.
AI is moving beyond impressive demos. After World Summit AI 2026 in Amsterdam, GPT-Lab's Muhammad Waseem reflects on what organizations need to make AI agents reliable, responsible and genuinely useful in everyday work. The post AI Has Grown Up. Have We? appeared first on GPT-Lab.
MIT News · Artificial Intelligence· news.mit.eduOct 8, 2026