Multi-robot geometric task-and-motion planning for collaborative manipulation tasks

Hejia Zhang, Shao Hung Chan, Jie Zhong, Jiaoyang Li, Peter Kolapo, Sven Koenig, Zach Agioutantis, Steven Schafrik, Stefanos Nikolaidis

Research output: Contribution to journalArticlepeer-review


We address multi-robot geometric task-and-motion planning (MR-GTAMP) problems in synchronous, monotone setups. The goal of the MR-GTAMP problem is to move objects with multiple robots to goal regions in the presence of other movable objects. We focus on collaborative manipulation tasks where the robots have to adopt intelligent collaboration strategies to be successful and effective, i.e., decide which robot should move which objects to which positions, and perform collaborative actions, such as handovers. To endow robots with these collaboration capabilities, we propose to first collect occlusion and reachability information for each robot by calling motion-planning algorithms. We then propose a method that uses the collected information to build a graph structure which captures the precedence of the manipulations of different objects and supports the implementation of a mixed-integer program to guide the search for highly effective collaborative task-and-motion plans. The search process for collaborative task-and-motion plans is based on a Monte-Carlo Tree Search (MCTS) exploration strategy to achieve exploration-exploitation balance. We evaluate our framework in two challenging MR-GTAMP domains and show that it outperforms two state-of-the-art baselines with respect to the planning time, the resulting plan length and the number of objects moved. We also show that our framework can be applied to underground mining operations where a robotic arm needs to coordinate with an autonomous roof bolter. We demonstrate plan execution in two roof-bolting scenarios both in simulation and on robots.

Original languageEnglish
Pages (from-to)1537-1558
Number of pages22
JournalAutonomous Robots
Issue number8
StatePublished - Dec 2023

Bibliographical note

Publisher Copyright:
© 2023, The Author(s).


  • Collaborative manipulation
  • Mining robotics
  • Multi-robot collaboration
  • Task-and-motion planning

ASJC Scopus subject areas

  • Artificial Intelligence


Dive into the research topics of 'Multi-robot geometric task-and-motion planning for collaborative manipulation tasks'. Together they form a unique fingerprint.

Cite this