A Multi-Objective Scheme for Collision Avoidance, Swarm Cohesion, and Target Tracking for Smart UAVs

Authors: Jawad Mahmood, Muhammad Adil Raja, John Loane, Fergal McCaffery
Publication type: Journal Article

This research introduces a Reinforcement Learning (RL) based testbed designed for real-time coordination among multiple Unmanned Aerial Vehicles (UAVs) using actor-critic models to control a randomly manoeuvring target UAV, and a swarm of tracking UAVs. The system simulates realistic multi-agent interactions within a scalable and distributed architecture built on FlightGear and JSBSim. A key feature is the ability of multiple agents to learn independently yet collaboratively, enabling synchronized behaviors and adaptive tracking in dynamic environments. Collision avoidance, swarm cohesion, and target tracking efficiency are ensured through a 3D ellipsoidal spatial model and a Gaussian reward function, which guide agents to maintain optimal relative positions. The integration of an Intrinsic Curiosity Module (ICM) enhances exploration in sparse-reward settings. Experimental results show that the multi