Research Article

Transformer-Based Reinforcement Learning for Adaptive Traffic Signal Control in Smart City Environments to Reduce Congestion and Emissions

109 reads
J Ong Artific Int Innov, 2026, 1 (2), 66-72, ISSN

Abstract

Rapid urbanization and escalating vehicular volumes present critical challenges to modern metropolitan mobility, exacerbating street-level congestion and driving up transportation-related greenhouse gas emissions. Traditional adaptive traffic signal control heuristics frequently fail to capture high-order, non-linear spatio-temporal correlations across interconnected arterial networks. In this study, we propose a novel Spatio-Temporal Transformer-based Multi-Agent Reinforcement Learning (ST-TARL) framework tailored for decentralized adaptive traffic signal control in smart city ecosystems. By integrating self-attention mechanisms across both temporal sequence horizons and dynamic inter-intersection spatial graphs, each signal agent learns cooperative control policies that explicitly optimize vehicular throughput while mitigating stop-and-go driving patterns. Furthermore, we incorporate an emissions-aware multi-objective reward formulation derived from instantaneous vehicular energy consumption dynamics. Extensive microscopic traffic simulations conducted in SUMO (Simulation of Urban MObility) across both synthetic grid topologies and real-world urban road networks demonstrate that ST-TARL significantly outperforms state-of-the-art baselines. Specifically, our model achieves a 26.4% reduction in average vehicular delay, a 31.8% decrease in cumulative intersection queue lengths, and an 18.2% drop in tailpipe carbon dioxide (CO2) emissions compared to leading deep multi-agent reinforcement learning approaches. These findings underscore the viability of transformer-driven policy optimization as an enabling methodology for sustainable, responsive, and eco-friendly urban intelligent transportation infrastructures.

Keywords smart cities Adaptive Traffic Signal Control Multi-Agent Reinforcement Learning Spatio-Temporal Transformers Urban Emission Reduction
Authors 2

The team behind this paper

2 authors, 2 institutions.

This paper Tsinghua University — China Tsinghua University 1 author National Polytechnic Institute — Mexico National Polytechnic In… 1 author Prof. Mei-Ling Zhou — corresponding author MZ Prof. Mei-Ling Zhou ✉ Dr. Alejandro Morales-Vega AM Dr. Alejandro Morales-Vega

Readership

109 reads over 3 months.

#8 most read in this journal this month
September 2026 November 2026

Bibliographic Information

Prof. Mei-Ling Zhou, Dr. Alejandro Morales-Vega, (2026). Transformer-Based Reinforcement Learning for Adaptive Traffic Signal Control in Smart City Environments to Reduce Congestion and Emissions, Journal of Ongoing Artificial Intelligence Innovations, 1(2): 66-72
Bibtex Citation
@article{prof._mei-ling_zhou2026joaii,
author = {Prof. Mei-Ling Zhou and Dr. Alejandro Morales-Vega},
title = {Transformer-Based Reinforcement Learning for Adaptive Traffic Signal Control in Smart City Environments to Reduce Congestion and Emissions},
journal = {Journal of Ongoing Artificial Intelligence Innovations},
year = {2026},
volume = {1},
number = {2},
pages = {66-72},
doi = {},
url = {https://scimatic.org/show_manuscript/10164}
}
APA Citation
Zhou, P.M., Morales-Vega, D.A., (2026). Transformer-Based Reinforcement Learning for Adaptive Traffic Signal Control in Smart City Environments to Reduce Congestion and Emissions. Journal of Ongoing Artificial Intelligence Innovations, 1(2), 66-72. https://doi.org/

Author Information

  • To change your profile photo, login to scimatic.org, go to your profile and change the photo.
  • Any photo that shows your face will do: we crop it to your head and shoulders and give it a plain background automatically.
  • To sign in, go to Sign in and enter the e-mail address registered with the article: we e-mail you a one-time sign-in link (there is no password).
  • In case of any other problem, contact your editor directly or write to us at info @ scimatic.org