A Probabilistic Particle-Control Approximation of Chance-Constrained Stochastic Predictive Control
Top Cited Papers
- 3 June 2010
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Robotics
- Vol. 26 (3), 502-517
- https://doi.org/10.1109/tro.2010.2044948
Abstract
Robotic systems need to be able to plan control actions that are robust to the inherent uncertainty in the real world. This uncertainty arises due to uncertain state estimation, disturbances, and modeling errors, as well as stochastic mode transitions such as component failures. Chance-constrained control takes into account uncertainty to ensure that the probability of failure, due to collision with obstacles, for example, is below a given threshold. In this paper, we present a novel method for chance-constrained predictive stochastic control of dynamic systems. The method approximates the distribution of the system state using a finite number of particles. By expressing these particles in terms of the control variables, we are able to approximate the original stochastic control problem as a deterministic one; furthermore, the approximation becomes exact as the number of particles tends to infinity. This method applies to arbitrary noise distributions, and for systems with linear or jump Markov linear dynamics, we show that the approximate problem can be solved using efficient mixed-integer linear-programming techniques. We also introduce an important weighting extension that enables the method to deal with low-probability mode transitions such as failures. We demonstrate in simulation that the new method is able to control an aircraft in turbulence and can control a ground vehicle while being robust to brake failures.Keywords
This publication has 33 references indexed in Scilit:
- Stochastic programming approach to optimization under uncertaintyMathematical Programming, 2007
- The Scenario Approach to Robust Control DesignIEEE Transactions on Automatic Control, 2006
- Stochastic Constraint Programming: A Scenario-Based ApproachConstraints, 2006
- Primal-dual Subgradient Methods for Convex ProblemsSSRN Electronic Journal, 2005
- On some recent aspects of stochastic control and their applicationsProbability Surveys, 2005
- Particle Methods for Change Detection, System Identification, and ControlProceedings of the IEEE, 2004
- Chance‐constrained model predictive controlAIChE Journal, 1999
- Robust model predictive control: A surveyPublished by Springer Science and Business Media LLC ,1998
- Minorization Conditions and Convergence Rates for Markov Chain Monte CarloJournal of the American Statistical Association, 1995
- The Robust Control of Robot ManipulatorsThe International Journal of Robotics Research, 1985