PDE Control, Optimization and Reinforcement Learning of Intelligent Traffic Flow System

Date: 2021/04/21 - 2021/04/21

Academic Seminar: PDE Control, Optimization and Reinforcement Learning of Intelligent Traffic Flow System

Speaker: Dr. Huan Yu, postdoc researcher at University of California, San Diego

Time: 10:00 a.m.-11:00 a.m., April 21st, 2021 (Beijing Time)

Location: via Zoom

Abstract

Studies on transportation management systems have undergone several waves of advancement in both theory and practice. One challenge inhibiting the development of the next-generation intelligent transportation system is the disparity in two relevant academic fields: control system engineering and transportation science. My research bridged this gap by applying advanced Partial Differential Equation control, optimization, and reinforcement learning techniques to various traffic problems that are modeled by the macroscopic traffic flow model. My research focused on studying the intelligent traffic flow system with connected and automated vehicles and developing control algorithms for traffic management infrastructures. In this talk, I will start with control problem of stop-and-go traffic, a common phenomenon that has drawn a lot of research interests over the years since it leads to acceleration-deceleration activities of drivers, increased fuel consumption, and greater risk. I will show a methodological PDE model-based control framework for boundary actuation and estimation of such a problem. To optimize the traffic performance that cannot be described with models, I will apply Extremum Seeking design which is a real-time, model-free, adaptive optimization approach. Reinforcement Learning (RL) approach will also be introduced to enable model-free control of traffic flow system through a complete data-driven process and will then be compared with the model-based control approaches with rigorous theoretical guarantees.

Biography

Huan Yu is a postdoc researcher at University of California, San Diego.  She received her B.S. degree in Aerospace Engineering from Northwestern Polytechnical University, China in 2013 and the M.S. and Ph.D. degree in Mechanical and Aerospace Engineering from University of California, San Diego in 2015 and 2019. She was a visiting researcher at University of California, Berkeley in 2018 and Massachusetts Institute of Technology in 2019. Her research focuses on the control and estimation of distributed parameter system, intelligent transportation system, extremum seeking and reinforcement learning.