Motion Coordination and Adaptation Using Deception and Human Interactions

This research develops tools for coordinating mobile robot teams, focusing on injecting user intent into swarms and creating deception-based motion control strategies

This research aims at delivering fundamental new tools and techniques for how to structure the coordination and control strategies in teams of mobile robots. In particular, two general thrust areas are identified, focusing on human-swarm interactions and deception-based motion control strategies. Although interesting in their own right, the unifying theme behind these two different thrusts is the notion of intent, where the first thrust, which can be thought of as evolving at a higher level of abstraction, focuses on how user intent can be injected into a network of mobile agents in a fundamentally sound manner. The second thrust, in turn, focuses on how the intent can be hidden in order to produce effective, deception-based coordination and pursuit strategies.

Much of the work carried out under this project concerned pursuit and evasion when the agents do not move through still air or water. Once a flow field acts on the players, the set of points each can reach within a given time is no longer a disk centered on its current position, and the geometric constructions that underpin the classical theory stop applying. We built the strategies instead on Zermelo’s navigation problem, which gives the minimum-time steering law in a drift field, and on the partition of the plane it induces: the Zermelo-Voronoi diagram, in which each cell collects the points a given pursuer can reach sooner than any of the others. Because the diagram moves as the flow and the players move, assigning pursuers to targets becomes a matter of tracking a partition that is changing under the agents’ feet. We gave sequential assignment algorithms for this setting, together with conditions on the strength of the flow relative to the pursuers’ speed advantage under which every target is guaranteed to be captured in finite time, and showed that they capture faster than the naive line-of-sight strategy.

Trajectories of twelve pursuers and three targets in a wind field. The red curves are the Zermelo-Voronoi partition at the initial time, each cell collecting the points its pursuer can reach sooner than any other; the colored curves are the resulting pursuer and target paths A sequential assignment of twelve pursuers to three moving targets in a wind field, computed on the Zermelo-Voronoi diagram. The partition itself moves with the flow and the players, so the assignment is recomputed as the pursuit unfolds.

For several pursuers against one evader in realistic, time-varying flows, we took a reachability view of the same problem. Rather than solving for feedback strategies directly, the forward reachable front of each player is propagated under the flow using a level-set formulation, and the capture time and the optimal paths are read off the first contact between the fronts. This makes the method indifferent to how complicated the flow is: it handles arbitrary spatiotemporal fields, including ones computed from ocean models, and obstacles are accommodated simply by stopping the parts of a front that would otherwise pass through them, so that the recovered paths are collision-free by construction. The approach extends to three dimensions and to flows in which the evader, being slower than its pursuers, can nonetheless escape by exploiting the field. This part of the work was carried out in collaboration with the MSEAS group at MIT.

A pursuer and an evader in a vortical flow field, with the background arrows showing the flow, the red and blue curves the optimal paths, and the dotted red contours the evolving reachability fronts that meet at the capture point Optimal pursuer (red) and evader (blue) paths in a vortex, obtained from the evolving reachability fronts. Both players ride the field rather than heading straight for one another, and capture occurs where the two fronts first meet.

Alongside these, we studied the underlying two-player games and the computational tools needed to solve them. We solved an asymmetric version of the two-car game, in which the players differ in speed and turning radius, and the suicidal pedestrian differential game, whose barrier surface we then turned into a collision-avoidance law for a UAV facing an agent whose intentions are unknown. On the computational side, we extended continuous-time differential dynamic programming to problems with terminal constraints, and then to game-theoretic and stochastic settings, which yields a practical way of computing saddle-point trajectories for nonlinear systems without discretizing the state space.

This project is in collaboration with Magnus Egerstedt.

Sponsors

This project is supported by AFOSR.

Selected Publications and Presentations

1.

Bakolas, E. and Tsiotras, P., “Optimal Synthesis of the Zermelo-Markov-Dubins Problem in a Constant Drift Field,” Journal of Optimization Theory and Applications, Vol. 155, No. 2, Nov. 2012.

2.

Bakolas, E. and Tsiotras, P., “Optimal Partitioning for Spatiotemporal Coverage in a Drift Field,” Automatica, Vol. 49, No. 7, pp. 2064-2073, July 2013.

3.

Anderson, R., Bakolas, E., Milutinovic, D., and Tsiotras, P., “Optimal Feedback Guidance of a Small Aerial Vehicle in a Stochastic Wind,” AIAA Journal of Guidance, Control, and Dynamics, Vol. 36, No. 4, pp. 975-985, Jul.-Aug. 2013.

4.

Sun, W., and Tsiotras, P., “A Sequential Pursuer-Target Assignment Problem Under External Disturbances,” 52nd IEEE Conference on Decision and Control Conference, Florence, Italy, Dec. 10-13, 2013, pp. 3994-3999.

5.

Exarchos, I., and Tsiotras, P., “An Asymmetric Version of the Two Car Pursuit-Evasion Game,” 53rd IEEE Conference on Decision and Control, Los Angeles, CA, Dec. 15-17, 2014, pp. 4272-4277.

6.

Sun, W. and Tsiotras, P., “An Optimal Evader Strategy in a Two-Pursuer One-Evader Problem,” 53rd IEEE Conference on Decision and Control, Los Angeles, CA, Dec. 15-17, 2014, pp. 4266-4271.

7.

Sun, W., Theodorou, E., and Tsiotras, P., “Continuous-Time Differential Dynamic Programming with Terminal Constraints,” IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning, Orlando, FL, Dec. 9-12, 2014, pp. 289-294.

8.

Exarchos, I., and Tsiotras, P., and Pachter, M., “On the Suicidal Pedestrian Differential Game,” Dynamic Games and Applications, Vol. 5, No. 3, pp 297-317, September 2015.

9.

Sun, W., and Tsiotras, P., “Pursuit Evasion Game of Two Players under an External Flow Field,” American Control Conference, Chicago, IL, July 1-3, 2015, pp. 5617-5622.

10.

Sun, W., Theodorou, E. and Tsiotras, P., “Game Theoretic Continuous Time Differential Dynamic Programming,” American Control Conference, Chicago, IL, July 1-3, 2015, pp. 5593-5598.

11.

Exarchos, I., Tsiotras, P., and Pachter, M., “UAV Collision Avoidance based on the Solution of the Suicidal Pedestrian Differential Game,” AIAA Guidance, Navigation, and Control Conference, San Diego, CA, January 4-8, 2016.

12.

Exarchos, I., Theodorou, E., and Tsiotras, P., “Game-Theoretic and Risk-Sensitive Stochastic Optimal Control via Forward and Backward Stochastic Differential Equations,” 55th IEEE Conference on Decision and Control, Las Vegas, NV, Dec. 12-14, 2016, pp. 6154-6160.

13.

Sun, W., Theodorou, E., and Tsiotras, P., “Stochastic Game Theoretic Trajectory Optimization in Continuous Time,” 55th IEEE Conference on Decision and Control, Las Vegas, NV, Dec. 12-14, 2016, pp. 6167-6172.

14.

Sun, W., Tsiotras, P., Lolla, T., Subramani, D. N., and Lermusiaux, P. F. J., “Pursuit-Evasion Games in Dynamic Flow Fields via Reachability Set Analysis,” American Control Conference, Seattle, WA, May 24-26, 2017, pp. 4595-4600.

15.

Sun, W., Tsiotras, P., Lolla, T., Subramani, D., and Lermusiaux, P., “Multiple-Pursuer-One-Evader Pursuit Evasion Game in Dynamic Flow Fields,” AIAA Journal of Guidance, Control, and Dynamics, Vol. 40, No. 7, pp. 1627-1637, July 2017.

16.

Sun, W., and Tsiotras, P., “Sequential Pursuit of Multiple Targets Under External Disturbances via Zermelo-Voronoi Diagrams ,” Automatica, Vol. 81, pp. 253-260, July 2017.

17.

Sun, W., Pan, Y., Theodorou, E., and Tsiotras, P., “Min-Max Differential Dynamic Programming: Continuous and Discrete Time Formulations,” AIAA Journal of Guidance, Control, and Dynamics, Vol. 41, No. 12, pp. 2568-2580, 2018.

18.

Sun, W., Tsiotras, P., and Yezzi, A., “Multiplayer Pursuit Evasion Games in 3-Dimensional Flow Fields,” Dynamic Games and Applications, Vol. 9, No. 4, pp. 1188-1207, 2019.