Skip to content
Open access

Designing for all? Accessibility of native android interfaces from large language models

Jul 2026 · Universal Access in the Information Society · Vol 25 · 0 citations · 78 references

TL;DR

This research investigates how LLMs, such as ChatGPT, can support the creation of accessible native Android applications, and evaluates whether the generated code aligns with established accessibility guidelines, considering variations in screen layouts, prompt styles, and interface design methods.

Abstract

The emergence of large language models (LLMs) has significantly impacted the automation of software development tasks, including the generation of mobile application code. This research investigates how LLMs, such as ChatGPT, can support the creation of accessible native Android applications. Specifically, it evaluates whether the generated code aligns with established accessibility guidelines, considering variations in screen layouts, prompt styles, and interface design methods. Four empirical studies were carried out to assess accessibility in seven different types of mobile UI. The first study assessed screens built with various layout techniques, while the second focused on Jetpack Compose and compared outputs from multiple LLMs (e.g., Sabiá, GPT). The third experiment explored the influence of English-language prompts on accessibility outcomes, and the fourth involved an evaluation of Github Copilot. In all studies, 702 accessibility-related issues were identified. Jetpack Compose consistently led to more accessible interfaces compared to other layout options, and prompts in English resulted in fewer errors. Surprisingly, prompts that explicitly asked for accessibility often introduced more problems, suggesting that current models struggle to accurately interpret and implement accessibility directives. These findings underscore the need for improved prompt engineering and more robust LLM-generated code to improve accessibility in AI-assisted mobile development.

Read PDF

Similar papers

Preprint Jul 2026

Exploring the Potential of Program Flowcharts on Code Generation Using Multimodal LLMs

In recent years, Large Language Models (LLMs) have made significant strides, leading to the emergence of multimodal LLMs capable of processing diverse inputs such as images and audio. Previous research indicates that the supply of multimodal LLMs with combined textual and visual information improves the automatic code generation capabilities. In software development, diagrams such as flowcharts are widely employed to facilitate tasks like code comprehension. While existing studies investigated the impact of visual inputs on LLMs and the usage of software diagrams, the potential influence of providing flowcharts on multimodal LLM performance remains underexplored. In this study, we generated flowcharts from example solution code for AtCoder problems and provided these visual aids alongside problem statements to GPT-4o for code generation. Our findings demonstrate that integrating flowcharts with problem statements yields performance improvements of up to 10%. Furthermore, when employing abstracted flowcharts, we observed a trend indicating that increasing levels of flowchart detail correlate with enhanced performance. Additionally, we compared the effectiveness of flowchart provision to Few-Shot Learning approaches. The findings suggest that one-shot learning provides sustainable improvements, whereas two-shot learning results in only minor improvements. Our work highlights the importance of software diagrams in supporting multimodal LLM-driven code generation.

Yuki Toi, Tao Xiao, Kazushi Tomoto et al. · 0 citations
Preprint Aug 2026

Unreliable in Practice? A Comprehensive Study of Errors in LLM-Generated Code

It is observed that generated code often omits basic input validation or memory-safety checks, which can lead to overflows, resource exhaustion, or other reliability/security issues, and even the largest models frequently make simple mistakes.

Rodrigo Pato Nogueira, Marco Vieira, João R. Campos · 0 citations
Open access Jul 2026

PROBE: Benchmarking code generation in large language models

The findings show that, while LLMs achieve promising results, they struggle with harder problems and with programming languages that have fewer available resources for training, and they often fail due to fundamental and easily avoidable errors that underscore the unreliability of automatically generated code.

Rodrigo Pato Nogueira, Marco Vieira, João R. Campos · 1 citation
Book Open access Aug 2026

From Design to Code: Exploring LLM-Supported Workflows in Figma Dev Mode

Design systems are widely used to ensure consistency and scalability in modern UI development, yet translating design artifacts into system-aligned code remains challenging. Developers must interpret visual designs and map them to appropriate components and implementation details, often relying on external documentation. While AI-assisted coding tools can accelerate development, they often lack structured design-system context, limiting their effectiveness in design-to-code workflows. In this paper, we investigate how a structured design context can influence developer experience. We present an empirical within-subject study with N=30 frontend developers comparing a traditional documentation-driven workflow to an MCP-supported workflow integrating Figma Dev Mode, Code Connect, and AI-assisted coding tools. The results show significant improvements in implementation accuracy, task efficiency, and perceived usability when a structured design context is available. Our findings suggest that AI-supported workflows can improve developer experience by reducing ambiguity in design interpretation while maintaining the need for human validation and documentation support.

Surbhi Rajpal, Andreas Riener · 0 citations
Jul 2026

An Empirical Study for Android-to-OpenHarmony GUI Test Migration

An enhanced approach based on ITeM is proposed, referred as ITeM-HM, which incorporates specific OpenHarmony system features and achieves a 214% success-rate relative improvement over the original ITeM, which is primarily hindered by OpenHarmony-specific characteristics.

Ya-Kun Zhang, Xinjia Chen, Yiyun Chen et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.