Multi-robot geometric task-and-motion planning for collaborative manipulation tasks

Hejia Zhang, Shao Hung Chan, Jie Zhong, Jiaoyang Li, Peter Kolapo, Sven Koenig, Zach Agioutantis, Steven Schafrik, Stefanos Nikolaidis

Research output: Contribution to journalArticlepeer-review

2 Scopus citations

Abstract

We address multi-robot geometric task-and-motion planning (MR-GTAMP) problems in synchronous, monotone setups. The goal of the MR-GTAMP problem is to move objects with multiple robots to goal regions in the presence of other movable objects. We focus on collaborative manipulation tasks where the robots have to adopt intelligent collaboration strategies to be successful and effective, i.e., decide which robot should move which objects to which positions, and perform collaborative actions, such as handovers. To endow robots with these collaboration capabilities, we propose to first collect occlusion and reachability information for each robot by calling motion-planning algorithms. We then propose a method that uses the collected information to build a graph structure which captures the precedence of the manipulations of different objects and supports the implementation of a mixed-integer program to guide the search for highly effective collaborative task-and-motion plans. The search process for collaborative task-and-motion plans is based on a Monte-Carlo Tree Search (MCTS) exploration strategy to achieve exploration-exploitation balance. We evaluate our framework in two challenging MR-GTAMP domains and show that it outperforms two state-of-the-art baselines with respect to the planning time, the resulting plan length and the number of objects moved. We also show that our framework can be applied to underground mining operations where a robotic arm needs to coordinate with an autonomous roof bolter. We demonstrate plan execution in two roof-bolting scenarios both in simulation and on robots.

Original languageEnglish
Pages (from-to)1537-1558
Number of pages22
JournalAutonomous Robots
Volume47
Issue number8
DOIs
StatePublished - Dec 2023

Bibliographical note

Publisher Copyright:
© 2023, The Author(s).

Funding

This work was supported by the National Science Foundation NRI # 2024936 and the Alpha Foundation for the Improvement of Mine Safety and Health # AFC820-68.

FundersFunder number
National Science Foundation (NSF)2024936
Alpha Foundation For The Improvement of Mine Safety and Health, Inc.AFC820-68

    Keywords

    • Collaborative manipulation
    • Mining robotics
    • Multi-robot collaboration
    • Task-and-motion planning

    ASJC Scopus subject areas

    • Artificial Intelligence

    Fingerprint

    Dive into the research topics of 'Multi-robot geometric task-and-motion planning for collaborative manipulation tasks'. Together they form a unique fingerprint.

    Cite this