Human Detection for Search and Rescue Applications with UAVs and Mixed Reality Interfaces

Author(s):  
Raul Llasag ◽  
Diego Marcillo ◽  
Carlos Grilo ◽  
Catarina Silva
Sensors ◽  
2019 ◽  
Vol 19 (16) ◽  
pp. 3542 ◽  
Author(s):  
Eleftherios Lygouras ◽  
Nicholas Santavas ◽  
Anastasios Taitzoglou ◽  
Konstantinos Tarchanidis ◽  
Athanasios Mitropoulos ◽  
...  

Unmanned aerial vehicles (UAVs) play a primary role in a plethora of technical and scientific fields owing to their wide range of applications. In particular, the provision of emergency services during the occurrence of a crisis event is a vital application domain where such aerial robots can contribute, sending out valuable assistance to both distressed humans and rescue teams. Bearing in mind that time constraints constitute a crucial parameter in search and rescue (SAR) missions, the punctual and precise detection of humans in peril is of paramount importance. The paper in hand deals with real-time human detection onboard a fully autonomous rescue UAV. Using deep learning techniques, the implemented embedded system was capable of detecting open water swimmers. This allowed the UAV to provide assistance accurately in a fully unsupervised manner, thus enhancing first responder operational capabilities. The novelty of the proposed system is the combination of global navigation satellite system (GNSS) techniques and computer vision algorithms for both precise human detection and rescue apparatus release. Details about hardware configuration as well as the system’s performance evaluation are fully discussed.


2021 ◽  
Vol 13 (23) ◽  
pp. 4903
Author(s):  
Tomasz Niedzielski ◽  
Mirosława Jurecka ◽  
Bartłomiej Miziński ◽  
Wojciech Pawul ◽  
Tomasz Motyl

Recent advances in search and rescue methods include the use of unmanned aerial vehicles (UAVs), to carry out aerial monitoring of terrains to spot lost individuals. To date, such searches have been conducted by human observers who view UAV-acquired videos or images. Alternatively, lost persons may be detected by automated algorithms. Although some algorithms are implemented in software to support search and rescue activities, no successful rescue case using automated human detectors has been reported on thus far in the scientific literature. This paper presents a report from a search and rescue mission carried out by Bieszczady Mountain Rescue Service near the village of Cergowa in SE Poland, where a 65-year-old man was rescued after being detected via use of SARUAV software. This software uses convolutional neural networks to automatically locate people in close-range nadir aerial images. The missing man, who suffered from Alzheimer’s disease (as well as a stroke the previous day) spent more than 24 h in open terrain. SARUAV software was allocated to support the search, and its task was to process 782 nadir and near-nadir JPG images collected during four photogrammetric flights. After 4 h 31 min of the analysis, the system successfully detected the missing person and provided his coordinates (uploading 121 photos from a flight over a lost person; image processing and verification of hits lasted 5 min 48 s). The presented case study proves that the use of an UAV assisted by SARUAV software may quicken the search mission.


Author(s):  
Muhammad Shahir Hakimy Salem ◽  
Fadhlan Hafizhelmi Kamaru Zaman ◽  
Nooritawati Md Tahir

Sensors ◽  
2019 ◽  
Vol 19 (3) ◽  
pp. 652 ◽  
Author(s):  
Abdulla Al-Kaff ◽  
María Gómez-Silva ◽  
Francisco Moreno ◽  
Arturo de la Escalera ◽  
José Armingol

The automation of the Wilderness Search and Rescue (WiSAR) task aims for high levels of understanding of various scenery. In addition, working in unfriendly and complex environments may cause a time delay in the operation and consequently put human lives at stake. In order to address this problem, Unmanned Aerial Vehicles (UAVs), which provide potential support to the conventional methods, are used. These vehicles are provided with reliable human detection and tracking algorithms; in order to be able to find and track the bodies of the victims in complex environments, and a robust control system to maintain safe distances from the detected bodies. In this paper, a human detection based on the color and depth data captured from onboard sensors is proposed. Moreover, the proposal of computing data association from the skeleton pose and a visual appearance measurement allows the tracking of multiple people with invariance to the scale, translation and rotation of the point of view with respect to the target objects. The system has been validated with real and simulation experiments, and the obtained results show the ability to track multiple individuals even after long-term disappearances. Furthermore, the simulations present the robustness of the implemented reactive control system as a promising tool for assisting the pilot to perform approaching maneuvers in a safe and smooth manner.


Author(s):  
Golande Avinash L, Et. al.

In this Technological advancement period, advanced construction improvements lead the formation of skyscrapers and homes which expanded the dangers of losing life because of natural and manmade catastrophes. In this system, we are proposing a radio-controlled bot that can identify live human beings from which are in the inaccessible region.  Python libraries are used in Raspberry Pi microcontroller having Camera module to catch pictures of objects around it. This paper discusses about the mentioned system. The project takes live image samples and sends it to a network where this images can be accessed through a device. This images can be used for human detection. PIR sensor is used for the detection of human being trapped under debris. Whenever a human is detected the bot will send GPS co-ordinates to the device.


Author(s):  
P. J. Baeck ◽  
N. Lewyckyj ◽  
B. Beusen ◽  
W. Horsten ◽  
K. Pauly

<p><strong>Abstract.</strong> Detection of humans, e.g. for search and rescue operations has been enabled by the availability of compact, easy to use cameras and drones. On the other hand, aerial photogrammetry techniques for inspection applications allow for precise geographic localization and the generation of an overview orthomosaic and 3D terrain model. The proposed solution is based on nadir drone imagery and combines both deep learning and photogrammetric algorithms to detect people and position them with geographical coordinates on an overview orthomosaic and 3D terrain map. The drone image processing chain is fully automated and near real-time and therefore allows search and rescue teams to operate more efficiently in difficult to reach areas.</p>


2006 ◽  
Vol 39 (3) ◽  
pp. 267-272 ◽  
Author(s):  
Frauke Driewer ◽  
Markus Sauer ◽  
Klaus Schilling

Sign in / Sign up

Export Citation Format

Share Document