Research Scientist

 
Dr. Antonio Franchi
Phone: +49 7071 601 218
Fax: +49 7071 601-616
antonio.franchi[at]tuebingen.mpg.de
website
institute webpage

 

Bilateral teleoperation of multiple UAVs

We address the problem of the interaction (see below) between humans and groups of robots whose local synergy is exploited to accomplish complex tasks. Multi-robot systems possess several advantages w.r.t. single robots, e.g., higher performance in simultaneous spatial domain coverage, better affordability as compared to a single/bulky system, robustness against single point failures. As multi-robot platform, we considered the case of a group of Unmanned Aerial Vehicles (UAVs), because of their high motion flexibility and potential pervasivity in dangerous or unaccessible locations. We envision a scenario where the UAVs possess some level of local autonomy and act as a group, e.g., by maintaining a desired formation, by avoiding obstacles, and by performing additional local tasks. At the same time, the remote human operator is in control of the overall UAV motion and receives, through haptic feedback, suitable cues informative enough of the remote UAV/environment state. We addressed two distinct possibilities for the human/multi-robot teleoperation: a top-down approach, and a bottom-up approach, mainly differing in the way the local robot interactions and desired formation shape are treated.

 

Top-down Approach

In [1] the N UAVs are abstracted as 3-DOF first-order kinematic VPs (virtual points): the remote human user teleoperates a subset of these N VPs, while the real UAV's position tracks the trajectory of its own VP. The VPs collectively move as an N-nodes deformable flying object, whose shape (chosen beforehand) autonomously deforms, rotates and translates reacting to the presence of obstacles (to avoid them), and the operator commands (to follow them). The operator receives a haptic feedback informing him about the motion state of the real UAVs, and about the presence of obstacles via their collective effects on the VPs. Passivity theory is exploited to prove stability of the overall teleoperation system. A video showing the top-down approach is here.

In [2],[3] the approach has been extended to the case where bearing measurements are the only available. The main focus in that case have been the design of a novel decentralized and minimum-complexity bearing-only formation controller for the slave side.

An updated and comprehensive collection of videos is available at this video page

 

top-down_cube

The figure shows an example of 8 UAVs arranged in a cubic shape controlled with an haptic device. 

Bottom-up approach

In [4]  the N UAVs are abstracted as 3-DOF second-order VPs: the remote human user teleoperates a single leader, while the remaining followers motion is determined by local interactions (modeled as spring/damper couplings) among themselves and the leader, and repulsive interactions with the obstacles. The overall formation shape is not chosen beforehand but is a result of the UAVs motion. Split and rejoin decisions are allowed depending on any criterion, e.g., the UAVs relative distance and their relative visibility (i.e., when two UAVs are not close enough or obstructed by an obstacle, they split their visco-elastic coupling). The operator receives a haptic feedback informing him about the motion state of the leader which is also influenced by the motion of its followers and their interaction with the obstacles. Passivity theory is exploited to prove stability of the overall teleoperation system. A journal paper about the bottom-up approach has been recently submitted and it is currently under revision [5].

In  [6] we present a decentralized passivity-based control strategy for the bilateral teleoperation of a fleet of Unmanned Aerial Vehicles (UAVs). The human operator at the master side can command the fleet motion and receive suitable force cues informative about the remote environment. By properly controlling the energy exchanged within the slave side (the UAV fleet), we guarantee that the connectivity of the fleet is preserved and we prevent inter-agent and obstacle collisions. At the same time, we allow the behavior of the UAVs to be as flexible as possible with arbitrary split and join maneuvers. The results of the paper are validated through semi-experiments.

An experimental validation of the bottom-up approach has been presented in [7], while in [8] an extension of the approach where the group autonomously changes the leader in order to maximize the performances is presented.

Watch this video page to have an updated and comprehensive collection of videos about this topic.

 

bottom-up_obs

The figure shows an example of 6 UAVs among 4 obstacles and relative connectivity graph. The leader UAV is surrounded by a transparent red sphere.

Bibliography

  1. Lee, D.A. FranchiP. Robuffo GiordanoH I. Son, and H. H. Bülthoff"Haptic Teleoperation of Multiple Unmanned Aerial Vehicles over the Internet", 2011 IEEE Int. Conf. on Robotics and Automation, Shanghai, China, pp. 1341-1347, 05/2011.
  2. Franchi, A.C. MasoneH. H. Bülthoff, and P. Robuffo Giordano"Bilateral Teleoperation of Multiple UAVs with Decentralized Bearing-only Formation Control", 2011 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, San Francisco, CA, pp. 2215-2222, 09/2011.
  3. Franchi, A.C. MasoneV. GrabeM. RyllH. H. Bülthoff, and P. Robuffo GiordanoBilateral Control of UAV Bearing-Formations, Submitted.
  4. Franchi, A.P. Robuffo GiordanoC. SecchiH I. Son, and H. H. Bülthoff"A Passivity-Based Decentralized Approach for the Bilateral Teleoperation of a Group of UAVs with Switching Topology", 2011 IEEE Int. Conf. on Robotics and Automation, Shanghai, China, pp. 898-905, 05/2011.
  5. Franchi, A.C. SecchiH I. SonH. H. Bülthoff, and P. Robuffo GiordanoBilateral Teleoperation of Groups of Mobile Robots with Time-Varying Topology, Submitted.
  6. Robuffo Giordano, P.A. FranchiC. Secchi, and H. H. Bülthoff"Passivity-Based Decentralized Connectivity Maintenance in the Bilateral Teleoperation of Multiple UAVs", 2011 Robotics: Science and Systems Conference, Los Angeles, CA, 06/2011.
  7. Robuffo Giordano, P.A. FranchiC. Secchi, and H. H. Bülthoff"Experiments of Passivity-Based Bilateral Aerial Teleoperation of a Group of UAVs with Decentralized Velocity Synchronization",2011 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, San Francisco, CA, pp. 163-170, 09/2011.
  8. Franchi, A.H. H. Bülthoff, and P. Robuffo Giordano"Distributed Online Leader Selection in the Bilateral Teleoperation of Multiple UAVs", 50th IEEE Conference on Decision and Control , Orlando, FL, 12/2011.
  9. Robuffo Giordano, P.A. FranchiH I. SonC. SecchiD. Lee, and H. H. Bülthoff"Towards Bilateral Teleoperation of Multi-Robot Systems", 3rd Work. for Young Researchers on Human-Friendly Robotics, Tuebingen, Germany, 10/2010.

Top-down approach video

Bottom-up approach video

Last updated: Tuesday, 07.10.2014