2011 Poster Sessions : An Explicit Solution for Optimal Two-Player Decentralized Control over a TCP Erasure Channel with State Feedback

Student Name : Chung-Ching Chang
Advisor : Sanjay Lall
Research Areas: Information Systems
An increasing number of systems and applications are envisioned to be built on top of communication networks, such as vehicle coordination systems, sensor networks, and the smart grid. The distributed nature of these systems demands a decentralized controller design, a design that takes network topology and packet loss into consideration. Here we consider a decentralized system consists of two interconnected systems with unidirectional information communication from system 1 to system 2. The control actions are transmitted through a TCP-like Bernoulli distributed erasure channel. We recast the problem into a centralized Partially Observed Markov Decision Process (POMDP) under the fictitious player framework. Finally, we construct explicit state space formulae for the optimal decentralized controller using belief states and value function recursions.

Chung-Ching Chang is a Ph.D. candidate working with Professor Sanjay Lall in the Networked Systems and Control Lab at Stanford University. He received a B.S. in Electrical Engineering from National Taiwan University in 2003, and a M.S. in Electrical Engineering from Stanford University in 2007. His research interests include stochastic decentralized control, communication networks, and optimization.