CARLOS SALVADOR CARBONE LORIO

Dottore di ricerca

ciclo: XXXIV


supervisore: Daniele Nardi

Titolo della tesi: Aerial Swarm Robotics for Precision Agriculture

Aerial swarm robotics represents a highly scalable solution to autonomous systems with collaborative Unmanned Aerial Vehicles (UAVs) by means of decentralized decision making. The deployment of such system leads to numerous challenges and most of the developed research is limited to validation within simplified simulation environments. This produces solutions that cannot be readily applied to real world applications despite the promising features and demonstrated advantages of swarm robotics as shown in laboratory settings. In this thesis, our interest lies on the application of aerial swarm robotics in precision agriculture, with the purpose of using collaborative UAVs to optimize data gathering and resources utilisation in farms. Moreover, we focus on the active monitoring and mapping of crop fields implementing on board data analysis decision making. The overall goal is to deploy swarms of UAVs and achieve an overall error reduction of weed detection over time that is faster than baselines approaches based on pre-determined mission plans, where UAVs are exploited as passive sensors. In this thesis, we seek to bring a significant step into the transition from simulation to real world deployment. To this end, we develop simulation tools that provide photo-realistic rendering and high fidelity UAV dynamics. An experimental setup is presented for validation of all simulation components which are eventually combined into a comprehensive simulation environment. Deployment of real world hardware is considered to replicate realistic parameters to the developed simulators. We first focus on validation of a photo-realistic simulation based on the Unity video game engine to ensure adequate UAV perception of crop fields. The results are validated by comparing classification performance of Convolutional Neural Networks (CNNs) on real data after being trained separately on synthetic and real images. We considered the simulation of sugar beets, sunflowers and potatoes crops and simulation of Near Infrared Sensor (NIR) data for the sugar beets and sunflowers crops. The implemented CNNs trained with synthetic data achieve an Intersection Over Union (IoU) classification performance similar to the one obtained with real data. Secondly, we develop a simplified a simulation environment to validate a novel swarm strategy for monitoring and mapping of crop fields. This strategy is based on exploiting the available knowledge about the field to measure the Information Gain (IG) from visiting new areas, that is, the expected reduction of uncertainty from further observation of a given area. This results is a parameter-free control system achieving a significant improvement over the state of the art Reinforced Random Walk (RRW) approach. Finally, we implement an information-based monitoring and mapping strategy into a combined simulation with highly-realistic UAV perception and motion dynamics. The final simulation environment allowed us to simulate a swarm of UAVs within a field while doing online image classification and collaborative decision making. The previously developed strategy is adapted to fit into the new realistic conditions of the simulator and experimental setup. Furthermore, we seek to exploit the information available by observing areas of interest from multiple Point of view (POV). Thus, the UAVs prioritize positions where residual uncertainty of information of observation is maximal. This results in a better performance than a simplified random walk and the pre-planned optimal trajectory. Preliminary testing with real world UAVs is made to provide validation of the parameters established on the final simulation environment.

Produzione scientifica

11573/1616225 - 2022 - Monitoring and Mapping of Crop Fields with UAV Swarms Based on Information Gain
Carbone, Carlos; Albani, Dario; Magistri, Federico; Ognibene, Dimitri; Stachniss, Cyrill; Kootstra, Gert; Nardi, Daniele; Trianni, Vito - 04b Atto di convegno in volume
congresso: 15th International Symposium on Distributed Autonomous Robotic Systems, DARS 2021 and 4th International Symposium on Swarm Behavior and Bio-Inspired Robotics, SWARM 2021 (Kyoto; Japan)
libro: International Symposium Distributed Autonomous Robotic Systems - (978-3-030-92789-9; 978-3-030-92790-5)

11573/1616179 - 2022 - Augmentation of Sunflower-Weed Segmentation Classification with Unity Generated Imagery Including Near Infrared Sensor Data
Carbone, Carlos; Potena, Ciro; Nardi, Daniele - 04b Atto di convegno in volume
congresso: 10th International Conference on Simulation and Modeling Methodologies, Technologies and Applications, SIMULTECH 2020 (Virtual, Online)
libro: Simulation and Modeling Methodologies, Technologies and Applications. - (978-3-030-84810-1; 978-3-030-84811-8)

11573/1486949 - 2020 - Simulation of near infrared sensor in unity for plant-weed segmentation classification
Carbone, Carlos; Potena, C.; Nardi, D. - 04b Atto di convegno in volume
congresso: 10th International Conference on Simulation and Modeling Methodologies, Technologies and Applications, SIMULTECH 2020 (Parigi; Francia)
libro: 10th International Conference on Simulation and Modeling Methodologies, Technologies and Applications, SIMULTECH 2020 - (978-989-758-444-2)

11573/1609160 - 2019 - Robotics for Precision Agriculture @DIAG
Potena, Ciro; Fawakherji, Mulham; Carlos, Carbone; Imperoli, Marco; Nardi, Daniele; Pretto, Alberto - 04b Atto di convegno in volume
congresso: Italian Conference on Robotics and Intelligent Machines(I-RIM), (Rome, Italy)
libro: Robotics for Precision Agriculture @DIAG - ()

11573/1400336 - 2018 - Swarm robotics as a solution to crops inspection for precision agriculture
Carlos, Carbone; Oscar, Garibaldi; Zohre, Kurt - 04b Atto di convegno in volume
congresso: Engineering, Science and Technology Conference (ESTEC) - 2017 (Panama City; Panama)
libro: 6th Engineering, science and technology conference - Panama 2017 (ESTEC 2017) - ()

© Università degli Studi di Roma "La Sapienza" - Piazzale Aldo Moro 5, 00185 Roma