Skip to content

Trustworthy Reinforcement Learning for AI-Driven Urban Decision-Making: Sustainable Dynamic Pricing and Resource Optimization for Smart City Operations

Žydrūnas Bautronis Robertas Alzbutas
Sep 2026 · Sustainability · 0 citations · 20 references

Abstract

Rapid urbanization, increasing demand variability, and digitalisation of urban infrastructure require intelligent decision-support systems that can improve sustainability, resilience, and operational efficiency in smart city operations. Artificial intelligence (AI) and data-driven optimization offer strong potential for adaptive urban services, including dynamic pricing, demand response, resource allocation, and energy-aware management. However, many reinforcement learning applications still focus mainly on short-term performance while giving limited attention to transparency, fairness, stability, and accountability. This study proposes a trustworthy reinforcement learning framework for AI-driven urban decision-making, using sustainable dynamic pricing and resource optimization as mechanisms for adaptive and responsible decision-making. A custom reinforcement learning environment was developed using historical e-commerce transactional data as a methodological proxy to simulate interactions among demand, resource or inventory availability, service categories, price elasticity, and changing market conditions. Three reinforcement learning algorithms, namely Deep Q-Network, Proximal Policy Optimization, and Advantage Actor–Critic, were evaluated under comparable experimental conditions. Performance was assessed using profitability, decision stability, fairness-oriented pricing behavior, decision consistency, and interpretability. To improve transparency, trajectory-based policy audits and SHapley Additive exPlanations were applied to identify the main factors influencing pricing decisions. The results show that the Deep Q-Network agent achieved the most balanced performance, increasing total profit by 12.58% while recording no unethical price increases under low-demand conditions. Explainability analysis showed that stock or resource levels, demand shifts, and price elasticity were the strongest positive drivers of pricing actions, whereas inventory hoarding and unfavorable price increases reduced decision quality. The findings indicate that reinforcement learning can support sustainable and resilient urban decision-making when optimization objectives are combined with trustworthy AI principles. The proposed framework provides a practical basis for accountable AI-based decision-support systems in smart city operations, including demand-responsive services, resource optimization, sustainable dynamic pricing, and energy-aware management.

Read PDF

Similar papers

#machine learning Review Open access Oct 2014

Software development in startup companies: A systematic mapping study

The results indicate that software engineering work practices are chosen opportunistically, adapted and configured to provide value under the constrains imposed by the startup context.

Nicolò Paternoster, Carmine Giardino, M. Unterkalmsteiner et al. · 394 citations · ⚡54
#machine learning Review Open access Jun 2014

Why Early-Stage Software Startups Fail: A Behavioral Framework

This state-of-practice investigation was performed using a literature review followed by a multiple-case study approach and presents how inconsistency between managerial strategies and execution can lead to failure by means of a behavioral framework.

Carmine Giardino, Xiaofeng Wang, P. Abrahamsson · 175 citations · ⚡19
#machine learning Review Open access Oct 2016

“Failures” to be celebrated: an analysis of major pivots of software startups

This study conducts a case survey study based on the secondary data of the major pivots happened in 49 software startups, and demonstrates that customer need pivot is the most common among all pivot types.

Sohaib Shahid Bajwa, Xiaofeng Wang, Anh Nguyen-Duc et al. · 127 citations · ⚡15
#artificial intelligence Conference Open access Apr 2020

ECCOLA - a Method for Implementing Ethically Aligned AI Systems

The method, ECCOLA, is presented, which aims at making the high-level AI ethics principles more practical, making it possible for developers to more easily implement them in practice.

Ville Vakkuri, Kai-Kristian Kemell, P. Abrahamsson · 64 citations · ⚡6
#computer vision Review Apr 2024

AI-powered Code Review with LLMs: Early Results

The goal is to not only refine the accuracy of the LLM-based tool but also to underscore its potential in streamlining the software development lifecycle through proactive code improvement and education.

Z. Rasheed, Malik Abdul Sami, Muhammad Waseem et al. · 62 citations · ⚡3

Related blog posts

GPT-Lab Aug 28, 2026

We built an AI factory for HVAC control

What does it take to trust AI-driven HVAC optimization? Our AI Model Factory combines agents, machine learning, reinforcement learning and deterministic checks in a governed workflow designed for messy, real-world building data. The post We built an AI factory for HVAC control appeared first on GPT-Lab.

Microsoft Research Blog Aug 11, 2026

Introducing CARE-X: Towards Clinically Useful Radiology VLMs with Auxiliary Supervision, Reward-Aligned Learning, and Tool-Augmented Measurement

Radiology AI is evolving beyond report generation. CARE-X explores a unified approach that combines flexible reasoning, calibrated predictions, and measurement-based tools for chest X-ray interpretation. The post Introducing CARE-X: Towards Clinically Useful Radiology VLMs with Auxiliary Supervision, Reward-Aligned Learning, and Tool-Augmented Measurement appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.