← All projects

Multi-Agent Deep RL for Traffic Signal Optimisation

Urban traffic congestion is a multi-intersection coordination problem: optimising one junction in isolation can shift delays elsewhere. This project develops cooperative multi-agent deep reinforcement learning (MARL) controllers that jointly optimise throughput across networks of intersections.

Research has progressed from single-intersection baseline agents through to multi-agent systems that communicate implicit state representations, operating in real time from live camera feeds rather than ground-truth simulation data. Experiments on the Traffic3D platform demonstrate consistent reductions in average waiting time and emissions compared to fixed-cycle and single-agent baselines.

Related Publications

  1. Robust Information Design for Multi-Agent Systems with Complementarities: Smallest-Equilibrium Threshold Policies

    Farhadi, Farzaneh, Chli, Maria · Zenodo (CERN European Organization for Nuclear Research) · 2026 · Preprint

  2. Sustainable Urban Mobility: Co-Designing a Responsible AI Recommender System

    Alina Patelli, Anikó Ekárt, Maria Chli, Lavinia-Eugenia Ferariu, John Hamilton, Mercy Kanyi, Richard Lee, Peter Lewis, Joanna Lumsden, Stephen Owen · 2025 · Journal Article

  3. Deep Reinforcement Learning Traffic Signal Controller for Large, Real-World Traffic Networks

    Yingyi Kuang, Maria Chli, George Vogiatzis · Women in engineering and science · 2025 · Book Chapter

  4. Synthesizing Traffic Datasets Using Graph Neural Networks

    Daniel Rodriguez-Criado, Maria Chli, Luis J. Manso, George Vogiatzis · 2023 · Journal Article

  5. Traffic3D: A Rich 3D-Traffic Environment to Train Intelligent Agents

    Deepeka Garg, Maria Chli, George Vogiatzis · Lecture notes in computer science · 2019 · Conference Paper

  6. A Deep Reinforcement Learning Agent for Traffic Intersection Control Optimization

    Deepeka Garg, Maria Chli, George Vogiatzis · 2019 · Journal Article

  7. Domain Adaptation for Reinforcement Learning on the Atari

    Thomas Carr, Maria Chli, George Vogiatzis · 2019 · Journal Article

  8. Traffic3D: A New Traffic Simulation Paradigm

    Deepeka Garg, Maria Chli, George Vogiatzis · 2019 · Journal Article

  9. Deep Reinforcement Learning for Autonomous Traffic Light Control

    Deepeka Garg, Maria Chli, George Vogiatzis · 2018 · Journal Article

  10. An Efficient Knowledge Transfer Solution to a Novel SMDP Formalization of a Broker’s Decision Problem

    Rodrigue T. Kuate, Maria Chli, Hai Wang · Adaptive Agents and Multi-Agents Systems · 2015 · Journal Article

  11. An intelligent broker agent for energy trading: an MDP approach

    Rodrigue T. Kuate, Minghua He, Maria Chli, Hai Wang · Aston Publications Explorer (Aston University) · 2013 · Journal Article

  12. The Emergence of Knowledge Exchange: An Agent-Based Model of a Software Market

    Maria Chli, Philippe De Wilde · IEEE Transactions on Systems Man and Cybernetics – Part A Systems and Humans · 2008 · Journal Article

  13. The emergence of knowledge exchange: an agent-based model of a software market

    Maria Chli, Philippe De Wilde · RePEc: Research Papers in Economics · 2006 · Journal Article

  14. Stability of multi-agent systems

    Maria Chli, Philippe De Wilde, J.B.M. Goossenaerts, Valery Abramov, Nick Szirbik, Luís Correia, P. Mariar, Richardson Ribeiro · 2004 · Journal Article

  15. Stability of multi-agent systems : systems, man and cybernetics

    Maria Chli, Philippe De Wilde, J.B.M. Goossenaerts, Vladimir Abramov, Nick Szirbik, Luís Correia, P. Mariar, Richardson Ribeiro · TU/e Research Portal · 2003 · Journal Article