Representing Multi-Robot Structure through Multimodal Graph Embedding for the Selection of Robot Teams

  title={Representing Multi-Robot Structure through Multimodal Graph Embedding for the Selection of Robot Teams},
  author={Brian Reily and Christopher M. Reardon and Hao Zhang},
  journal={2020 IEEE International Conference on Robotics and Automation (ICRA)},
Multi-robot systems of increasing size and complexity are used to solve large-scale problems, such as area exploration and search and rescue. A key decision in human-robot teaming is dividing a multi-robot system into teams to address separate issues or to accomplish a task over a large area. In order to address the problem of selecting teams in a multi-robot system, we propose a new multimodal graph embedding method to construct a unified representation that fuses multiple information… Expand
Team Assignment for Heterogeneous Multi-Robot Sensor Coverage through Graph Representation Learning
This paper proposes a principled approach based on the mathematical framework of regularized optimization to learn a unified representation of the multi-robot system from the graphs describing the heterogeneous relationships and to identify the learned representation's underlying structure in order to assign the robots to teams. Expand
Adaptation to Team Composition Changes for Heterogeneous Multi-Robot Sensor Coverage
This work introduces a novel formulation for sensor coverage by multi-robot teams with heterogeneous sensing capabilities that maximizes each robot's sensing quality, balancing the varying sensing capabilities of individual robots based on the overall team composition. Expand
Simultaneous View and Feature Selection for Collaborative Multi-Robot Recognition
This paper proposes a novel approach to collaborative multi-robot perception that simultaneously integrates view selection, feature selection, and object recognition into a unified regularized optimization formulation, which uses sparsity-inducing norms to identify the robots with themost representative views and the modalities with the most discriminative features. Expand
Leading Multi-Agent Teams to Multiple Goals While Maintaining Communication
This paper proposes the problem of multiple robot teammates tasked with leading a multi-agent team to multiple goal positions while maintaining the ability to communicate with one another and introduces a novel regularized optimization formulation that balances these utilities. Expand
Regularized Graph Matching for Correspondence Identification under Uncertainty in Collaborative Perception
A principled approach of regularized graph matching that addresses perception uncertainties and non-covisible objects in a unified mathematical framework to perform correspondence identification in collaborative perception and outperforms the previous techniques and achieves the state-of-the-art performance. Expand
Bayesian Deep Graph Matching for Correspondence Identification in Collaborative Perception
  • Peng Gao, Hao Zhang
  • Computer Science
  • Robotics: Science and Systems
  • 2021
This work introduces a novel deep graph matching network under the Bayesian framework to explicitly quantify uncertainty in the identified correspondences and designs a novel loss function that explicitly reduces correspondence uncertainty and perceptual non-covisibility during learning. Expand
Multi-modal sensor fusion and selection for enhanced situational awareness
The proposed system displays observations based on the physical locations of the sensors, enabling a human operator to better understand where observations are located in the environment, and uses the optimal sensor fusion weights to scale the display of observations. Expand
Learning Robot Structure and Motion Embeddings using Graph Neural Networks
  • J. Taery Kim, Jeongeun Park, Sungjoon Choi, Sehoon Ha
  • Computer Science
  • 2021
We propose a learning framework to find the representation of a robot’s kinematic structure and motion embedding spaces using graph neural networks (GNN). Finding a compact and low-dimensionalExpand


Teams organization and performance in multi-human/multi-robot teams
The interaction between automation and organization of human teams in controlling large robot teams performing an Urban Search and Rescue (USAR) task is addressed. Expand
Multi-robot Task Allocation: A Review of the State-of-the-Art
This chapter provides a comprehensive review on challenging aspects of MRTA problem, recent approaches to tackle this problem and the future directions. Expand
Limited communication, multi-robot team based coverage
The new multi-robot coverage algorithm uses the same planar cell-based decomposition as the single robot approach, but provides extensions to handle how teams of robots cover a single cell and how teams are allocated among cells. Expand
A Graph Theoretic Approach for Modeling Mobile Robot Team Formations
This paper addresses a new approach for modeling and control of multiple teams of mobile robots navigating in a terrain with obstacles, while maintaining a desired formation and changing formationsExpand
Modeling multiple teams of mobile robots: a graph theoretic approach
  • J. P. Desai
  • Computer Science
  • Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180)
  • 2001
This work addresses the control of a team of robots navigating in a terrain with obstacles, while maintaining a desired formation and changing formations when required using an underlying graph theoretic framework and describes an algorithm that allows the team of Robots to move between any two formations, while avoiding obstacles. Expand
Chapter 1 Experience in System Design for Human-Robot Teaming in Urban Search & Rescue ?
The paper describes experience with applying a user-centric design methodology in developing systems for human-robot teaming in Urban Search & Rescue. A human-robot team consists of severalExpand
Stability on multi-robot formation with dynamic interaction topologies
  • Yangmin Li, X. Chen
  • Mathematics, Computer Science
  • 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems
  • 2005
It has been proved that under an assumption of adjacency matrices associated with interaction graph being always connected, the system will converge based on the individual control strategy and multiple robots can construct an unique formation even if interaction topology is variant. Expand
Self-organized task allocation to sequentially interdependent tasks in swarm robotics
A self-organized method for allocating the individuals of a robot swarm to tasks that are sequentially interdependent, which allows a swarm to reach a near-optimal allocation in the studied environments, can be transferred to a real robot setting, and is adaptive to changes in the properties of the tasks such as their duration. Expand
Territorial multi-robot task division
The paper studies a territorial approach to the task in which the robots are assigned individual territories that can be dynamically resized if one of the robots malfunctions, permitting the completion of the task. Expand
A modular architecture for formation control
  • R. Fierro, A. Das
  • Engineering
  • Proceedings of the Third International Workshop on Robot Motion and Control, 2002. RoMoCo '02.
  • 2002
We present a four layer architecture for coordinating a team of mobile robots equipped with range sensors and wireless network cards, and the task of navigating to a desired location in a desiredExpand