Method classification in forming the multi-agent systems of a group of objects

Authors: Zhuravlev E.E.
Published in issue: #5(94)/2024
DOI:
Category: Informatics, Computer Engineering and Control | Chapter: Information Technology. Computer techologies. Theory of computers and systems
Keywords: simulation, information, automated systems, multi-agent systems, information exchange, synchronization, spatial configuration management, coordination
Published: 17.11.2024

The paper analyzes methods in forming the multi-agent systems (MAS) from a group of objects. It identifies the main groups of methods making it possible to solve problems in the information exchange between the agents, synchronization of the agents’ timestamps, formation and control of the MAS spatial configuration, and the agents’ coordination. All methods are divided into those centralized and decentralized. They are using the absolute and relative coordinates, the machine learning methods, and based on the swarm and evolutionary algorithms. Besides, they are reflecting features of the agent spatial temporal position. The comparative analysis result demonstrates advantages and disadvantages of the considered methods. It is evident that disadvantages of a certain method could be compensated by advantages of others when using the combined methods. The paper shows that the existing classification methods do not reflect completeness of the existing research in forming the MAS from a group of objects. The proposed classification and comparison are systematizing knowledge on main aspects in forming the MAS.

References

[1] Ruch C. et al. The+ 1 method: model-free adaptive repositioning policies for robotic multi-agent systems. IEEE Transactions on Network Science and Engineering, 2020, vol. 7, no. 4, pp. 3171–3184. https://doi.org/10.1109/TNSE.2020.3017526

[2] Geihs K. Engineering challenges ahead for robot teamwork in dynamic environments. Applied Sciences, 2020, vol. 10, no. 4, art. 1368. https://doi.org/10.3390/app10041368

[3] Salzman O., Stern R. Research challenges and opportunities in multi-agent pathfinding and multi-agent pickup and delivery problems. Proceedings of the 19th International Conference on Autonomous Agents and MultiAgent Systems, New Zealand, 2020, pp. 1711–1715.

[4] Sigurdson D. et al. Multi-agent pathfinding with real-time heuristic search. IEEE Conference on Computational Intelligence and Games (CIG). IEEE, 2018, pp. 1–8. https://doi.org/10.1109/CIG.2018.8490436

[5] Janovska K., Surynek P. Combining Conflict-based Search and Agent-based Modeling for Evacuation Problems. Proceedings of the International Symposium on Combinatorial Search, 2022, vol. 15, no. 1, pp. 294–296. https://doi.org/10.1609/socs.v15i1.21790

[6] Pantelimon G. et al. Survey of multi-agent communication strategies for information exchange and mission control of drone deployments. Journal of Intelligent & Robotic Systems, 2019, vol. 95, pp. 779–788. https://doi.org/10.1007/s10846-018-0812-x

[7] Ristevski S., Yucelen T., Muse J. A. An event-triggered distributed control architecture for scheduling information exchange in networked multiagent systems. IEEE Transactions on Control Systems Technology, 2021, vol. 30, no. 3, pp. 1090–1101. https://doi.org/ 10.1109/TCST.2021.3089911

[8] Alsolami F. et al. Development of self-synchronized drones’ network using cluster-based swarm intelligence approach. IEEE Access, 2021, vol. 9, pp. 48010–48022. https://doi.org/10.1109/ACCESS.2021.3064905

[9] Liu Y. et al. A Survey of Multi-Agent Systems on Distributed Formation Control. Unmanned Systems, 2023, pp. 1–14. https://doi.org/10.1142/S2301385024500274

[10] Poudel S., Moh S. Task assignment algorithms for unmanned aerial vehicle networks: A comprehensive survey. Vehicular Communications, 2022, vol. 35, art. 100469. https://doi.org/10.1016/j.vehcom.2022.100469

[11] Sargolzaei A., Abbaspour A., Crane C. D. Control of cooperative unmanned aerial vehicles: review of applications, challenges, and algorithms. Optimization, Learning, and Control for Interdependent Complex Networks, 2020, pp. 229–255. https://doi.org/10.48550/arXiv.1908.02789

[12] Tang J., Duan H., Lao S. Swarm intelligence algorithms for multiple unmanned aerial vehicles collaboration: A comprehensive review. Artificial Intelligence Review, 2023, vol. 56, no. 5, pp. 4295–4327. https://doi.org/10.1007/s10462-022-10281-7

[13] Azar A.T. et al. Drone deep reinforcement learning: A review. Electronics, 2021, vol. 10, no. 9, art. 999. https://doi.org/10.3390/electronics10090999

[14] Luong P. et al. Deep reinforcement learning-based resource allocation in cooperative UAV-assisted wireless networks. IEEE Transactions on Wireless Communications, 2021, vol. 20, no. 11, pp. 7610–7625. https://doi.org/10.1109/TWC.2021.3086503

[15] Taha B., Shoufan A. Machine learning-based drone detection and classification: State-of-the-art in research. IEEE access, 2019, vol. 7, pp. 138669–138682. https://doi.org/10.1109/ACCESS.2019.2942944

[16] Soori M., Arezoo B., Dastres R. Artificial intelligence, machine learning and deep learning in advanced robotics, a review. Cognitive Robotics, 2023. https://doi.org/10.1016/j.cogr.2023.04.001

[17] Zhang K., Yang Z., Ba?ar T. Multi-agent reinforcement learning: A selective overview of theories and algorithms. Handbook of Reinforcement Learning and Control, 2021, pp. 321–384. https://doi.org/10.48550/arXiv.1911.10635