An Intelligent Multi-Robot System Using Higher-Order Mobile Agents

Author(s):  
Yasushi Kambayashi ◽  
Munehiro Takimoto

This chapter presents a framework for controlling intelligent robots connected by communication networks. This framework provides novel methods to control coordinated systems using higher-order mobile agents. Higher-order mobile agents are hierarchically structured agents that can contain other mobile agents. By using higher-order mobile agents, intelligent robots in action can acquire new functionalities dynamically as well as exchange their roles with other colleague robots. The higher-order property of the mobile agents enables them to be organized hierarchically and dynamically. In addition to the advantages described above, higher-order mobile agents require minimum communication. They only need connection to be established when they perform migration.

Author(s):  
Yasushi Kambayashi ◽  
Yasuhiro Tsujimura ◽  
Hidemi Yamachi ◽  
Munehiro Takimoto

This chapter presents a framework using novel methods for controlling mobile multiple robots directed by mobile agents on a communication networks. Instead of physical movement of multiple robots, mobile software agents migrate from one robot to another so that the robots more efficiently complete their task. In some applications, it is desirable that multiple robots draw themselves together automatically. In order to avoid excessive energy consumption, we employ mobile software agents to locate robots scattered in a field, and cause them to autonomously determine their moving behaviors by using a clustering algorithm based on the Ant Colony Optimization (ACO) method. ACO is the swarm-intelligence-based method that exploits artificial stigmergy for the solution of combinatorial optimization problems. Preliminary experiments have provided a favorable result. Even though there is much room to improve the collaboration of multiple agents and ACO, the current results suggest a promising direction for the design of control mechanisms for multi-robot systems. In this chapter, we focus on the implementation of the controlling mechanism of the multi-robot system using mobile agents.


2021 ◽  
Vol 11 (2) ◽  
pp. 546
Author(s):  
Jiajia Xie ◽  
Rui Zhou ◽  
Yuan Liu ◽  
Jun Luo ◽  
Shaorong Xie ◽  
...  

The high performance and efficiency of multiple unmanned surface vehicles (multi-USV) promote the further civilian and military applications of coordinated USV. As the basis of multiple USVs’ cooperative work, considerable attention has been spent on developing the decentralized formation control of the USV swarm. Formation control of multiple USV belongs to the geometric problems of a multi-robot system. The main challenge is the way to generate and maintain the formation of a multi-robot system. The rapid development of reinforcement learning provides us with a new solution to deal with these problems. In this paper, we introduce a decentralized structure of the multi-USV system and employ reinforcement learning to deal with the formation control of a multi-USV system in a leader–follower topology. Therefore, we propose an asynchronous decentralized formation control scheme based on reinforcement learning for multiple USVs. First, a simplified USV model is established. Simultaneously, the formation shape model is built to provide formation parameters and to describe the physical relationship between USVs. Second, the advantage deep deterministic policy gradient algorithm (ADDPG) is proposed. Third, formation generation policies and formation maintenance policies based on the ADDPG are proposed to form and maintain the given geometry structure of the team of USVs during movement. Moreover, three new reward functions are designed and utilized to promote policy learning. Finally, various experiments are conducted to validate the performance of the proposed formation control scheme. Simulation results and contrast experiments demonstrate the efficiency and stability of the formation control scheme.


2021 ◽  
Vol 11 (4) ◽  
pp. 1448
Author(s):  
Wenju Mao ◽  
Zhijie Liu ◽  
Heng Liu ◽  
Fuzeng Yang ◽  
Meirong Wang

Multi-robots have shown good application prospects in agricultural production. Studying the synergistic technologies of agricultural multi-robots can not only improve the efficiency of the overall robot system and meet the needs of precision farming but also solve the problems of decreasing effective labor supply and increasing labor costs in agriculture. Therefore, starting from the point of view of an agricultural multiple robot system architectures, this paper reviews the representative research results of five synergistic technologies of agricultural multi-robots in recent years, namely, environment perception, task allocation, path planning, formation control, and communication, and summarizes the technological progress and development characteristics of these five technologies. Finally, because of these development characteristics, it is shown that the trends and research focus for agricultural multi-robots are to optimize the existing technologies and apply them to a variety of agricultural multi-robots, such as building a hybrid architecture of multi-robot systems, SLAM (simultaneous localization and mapping), cooperation learning of robots, hybrid path planning and formation reconstruction. While synergistic technologies of agricultural multi-robots are extremely challenging in production, in combination with previous research results for real agricultural multi-robots and social development demand, we conclude that it is realistic to expect automated multi-robot systems in the future.


Author(s):  
Mirko Daniele Comparetti ◽  
Elena De Momi ◽  
Alberto Vaccarella ◽  
Matthias Riechmann ◽  
Giancarlo Ferrigno
Keyword(s):  

Sign in / Sign up

Export Citation Format

Share Document