Assessment of Structure from Motion for reconnaissance augmentation and bandwidth usage reduction

2019 ◽  
Vol 17 (2) ◽  
pp. 213-225
Author(s):  
Jonathan Roeber ◽  
Scott Nykl ◽  
Scott Graham
Keyword(s):  
Structure From Motion ◽  
Virtual World ◽  
3D Model ◽  
Three Dimensional ◽  
Video Stream ◽  
Image Sensors ◽  
Processing Unit ◽  
Aerial Vehicle ◽  
3D Virtual World ◽  
Remote System

Modern militaries rely upon remote image sensors for real-time intelligence. A typical remote system consists of an unmanned aerial vehicle, or UAV, with an attached camera. A video stream is sent from the UAV, through a bandwidth-constrained satellite connection, to an intelligence processing unit. In this research, an upgrade to this remote-video-stream method of collection is proposed. A set of synthetic images of a scene captured by an UAV in a virtual environment is sent to a pipeline of computer vision algorithms, collectively known as Structure from Motion. The output of Structure from Motion, a three-dimensional (3D) model, is then assessed in a 3D virtual world as a possible replacement for the images from which it was created. This study shows Structure from Motion results from a modifiable spiral flight path and compares the geoaccuracy of each result. A flattening of height is observed, and an automated compensation for this flattening is proposed and performed. Each reconstruction is also compressed, and the size of the compression is compared with the compressed size of the images from which it was created. A reduction of 49–60% of required space, or bandwidth, is shown. A corresponding video demonstrating this technique is available online.

scholarly journals REPRESENTATION AND DIGITALIZATION OF STONE THEATRES IN EASTERN SICILY: THE PALAZZOLO ACREIDE THEATER

2019 ◽  
Vol XLII-2/W11 ◽  
pp. 475-479
Author(s):  
G. Di Gregorio
Keyword(s):  
Structure From Motion ◽  
3D Model ◽  
Southern Italy ◽  
Three Dimensional ◽  
Cultural Value ◽  
Geometric Conditions ◽  
Dense Matching ◽  
Laser Scanners ◽  
First Results ◽  
Quality And Reliability

<p><strong>Abstract.</strong> The ancient theatres in Sicily, in southern Italy and along the countries facing the Mediterranean Sea basin, constitute a reality of incomparable cultural value. Regarding the research on the ancient theatres of eastern Sicily, few studies have been recently dealt with different methodologies. In the last years some practices have been done using 3D laser scanners for the theatres of Syracuse, Taormina and Morgantina, as well as the Syracuse amphitheatre and Taormina Odeon, just obtaining very interesting results. Lately the theatre of Palazzolo Acreide (Syracuse) has been studied, with Structure From Motion (SFM) and Dense Matching methodologies. From these experience, conclusions could be drawn on the quality and reliability of the elaborations realised with the SFM methodologies. We really know that these systems are today representing one of the fastest growing areas of examination, on which several software houses are investing. The study was chosen both for the small size of the building, and for the particular geometric conditions typical of the architecture of ancient theatres. This because their three-dimensional trend varies continually in the three variables X, Y, Z. The purpose of the work was to check whether the latest releases of these systems of survey allow today more than yesterday, a rapid digitalization and representation of the enormous archaeological cultural heritage. Various software were used, to verify the practicality and operation, the choice then fell on the Zephyr of 3DFlow, kindly available by the manufacturer, whose results were quite agreeable. The possibility offered by the program of a graphical tracing of polylines on the textured 3D model, has been a considerable advantage. Therefore the results obtained by modeling and surveying of the Palazzolo Acreide theatre have been compared, with the survey of the Syracuse, Taormina and Morgantina theatre performed using 3D laser scanners. First results of the research are matter of the following work.</p>

scholarly journals GazeGuide: An Eye-Gaze-Guided Active Immersive UAV Camera

2020 ◽  
Vol 10 (5) ◽  
pp. 1668 ◽  
Author(s):  
Pavan Kumar B. N. ◽  
Adithya Balasubramanyam ◽  
Ashok Kumar Patil ◽  
Chethana B. ◽  
Young Ho Chai
Keyword(s):  
User Study ◽  
Eye Gaze ◽  
Three Dimensional ◽  
Video Stream ◽  
Eye Tracker ◽  
Input Devices ◽  
Input Modality ◽  
Head Mounted Display ◽  
Aerial Vehicle ◽  
Remote Controller

Over the years, gaze input modality has been an easy and demanding human–computer interaction (HCI) method for various applications. The research of gaze-based interactive applications has advanced considerably, as HCIs are no longer constrained to traditional input devices. In this paper, we propose a novel immersive eye-gaze-guided camera (called GazeGuide) that can seamlessly control the movements of a camera mounted on an unmanned aerial vehicle (UAV) from the eye-gaze of a remote user. The video stream captured by the camera is fed into a head-mounted display (HMD) with a binocular eye tracker. The user’s eye-gaze is the sole input modality to maneuver the camera. A user study was conducted considering the static and moving targets of interest in a three-dimensional (3D) space to evaluate the proposed framework. GazeGuide was compared with a state-of-the-art input modality remote controller. The qualitative and quantitative results showed that the proposed GazeGuide performed significantly better than the remote controller.

Instructional Design Applied to TCN5 Virtual World

2019 ◽  
pp. 147-175
Author(s):  
Andressa Falcade ◽  
Aliane Loureiro Krassmann ◽  
Roseclea Duarte Medina ◽  
Vania Cristina Bordin Freitas
Keyword(s):  
Instructional Design ◽  
Cognitive Style ◽  
Hybrid Model ◽  
Virtual World ◽  
Three Dimensional ◽  
Educational Resources ◽  
Web Pages ◽  
Media Objects ◽  
3D Virtual World ◽  
Immersive Environment

This chapter presents the development and implementation of an instructional design (ID) for computer networks learning within a three-dimensional (3D) virtual world (VW) that considers characteristics of cognitive style and level of expertise of the student, titled TCN5. For this purpose, a hybrid model of ID was created based on ADDIE and Dick and Carey models. To facilitate the inclusion and management of didactic materials, an educational resources manager called GRECx was developed, which was allocated to the VW through web pages inserted in 3D media objects. The approach was submitted to the evaluation of a sample of students, who pointed out that it allows greater use of didactic materials within the immersive environment, and that GRECx can actually help teachers in the inclusion of resources, avoiding the need to deal with VW settings.

scholarly journals Digital Documentation and a 3-D Model of Beaufort Castle via RTK GNSS, Terrestrial Laser Scanner and UAS-based Photogrammetry

2021 ◽  
Vol 310 ◽  
pp. 05002
Author(s):  
Yousef Naanouh ◽  
Vasyutinskaya Stanislava
Keyword(s):  
Laser Scanning ◽  
3D Model ◽  
Three Dimensional ◽  
Laser Scanner ◽  
Terrestrial Laser Scanning ◽  
Three Dimensional Model ◽  
South Lebanon ◽  
Aerial Vehicle ◽  
Digital Documentation ◽  
D Model

Three-dimensional digital technology is important in the maintenance and monitoring of archeological sites. This paper focuses on using a combination of terrestrial laser scanning and unmanned aerial vehicle (Phantom 4 pro) photogrammetry to establish a three-dimensional model and associated digital documentation of Beaufort castle (Arnoun, South Lebanon). The overall discrepancy between the two technologies was sufficient for the generation of convergent data. Thus, the terrestrial laser scanning and phantom 4 photogrammetry data were aligned and merged post-conversion into compatible extensions. A three-D dimensional (3D) model, with planar and perpendicular geometries, based on the hybrid datapoint cloud was developed. This study demonstrates the potential of using the integration of terrestrial laser scanning and photogrammetry in 3D digital documentation and spatial analysis of the Lebanese archeological sites.

scholarly journals Three-Dimensional Pathology Specimen Modeling Using “Structure-From-Motion” Photogrammetry: A Powerful New Tool for Surgical Pathology

2018 ◽  
Vol 142 (11) ◽  
pp. 1415-1420 ◽  
Author(s):  
John Turchini ◽  
Michael E. Buckland ◽  
Anthony J. Gill ◽  
Shane Battye
Keyword(s):  
Medical Education ◽  
Structure From Motion ◽  
3D Model ◽  
Digital Pathology ◽  
Three Dimensional ◽  
Surgical Pathology ◽  
Single Lens ◽  
Data Points ◽  
3D Photogrammetry ◽  
Pathology Specimen

Context.— Three-dimensional (3D) photogrammetry is a method of image-based modeling in which data points in digital images, taken from offset viewpoints, are analyzed to generate a 3D model. This modeling technique has been widely used in the context of geomorphology and artificial imagery, but has yet to be used within the realm of anatomic pathology. Objective.— To describe the application of a 3D photogrammetry system capable of producing high-quality 3D digital models and its uses in routine surgical pathology practice as well as medical education. Design.— We modeled specimens received in the 2 participating laboratories. The capture and photogrammetry process was automated using user control software, a digital single-lens reflex camera, and digital turntable, to generate a 3D model with the output in a PDF file. Results.— The entity demonstrated in each specimen was well demarcated and easily identified. Adjacent normal tissue could also be easily distinguished. Colors were preserved. The concave shapes of any cystic structures or normal convex rounded structures were discernable. Surgically important regions were identifiable. Conclusions.— Macroscopic 3D modeling of specimens can be achieved through Structure-From-Motion photogrammetry technology and can be applied quickly and easily in routine laboratory practice. There are numerous advantages to the use of 3D photogrammetry in pathology, including improved clinicopathologic correlation for the surgeon and enhanced medical education, revolutionizing the digital pathology museum with virtual reality environments and 3D-printing specimen models.

scholarly journals A Concept for Three-Dimensional Particle Metrology Based on Scanning Electron Microscopy and Structure-from-Motion Photogrammetry

2020 ◽  
Vol 125 ◽  
Author(s):  
Vipin N. Tondare
Keyword(s):  
Electron Microscopy ◽  
Scanning Electron Microscopy ◽  
Structure From Motion ◽  
3D Model ◽  
Three Dimensional ◽  
Sem Images ◽  
Shape Information ◽  
Size And Shape ◽  
Future Work ◽  
Scanning Electron

Scanning electron microscopy (SEM) has been frequently used for size and shape measurements of particles. SEM images offer two-dimensional (2D) information about a particle’s lateral dimensions. Unfortunately, information about the particle’s three-dimensional (3D) size and shape remains unavailable. To resolve this issue, I propose a new concept in SEM: 3D particle metrology obtained by applying structure-from-motion (SfM) algorithms to multiple rotational SEM images of particles deposited onto a cylindrical substrate to generate a 3D model from which size and shape information can be extracted. Particles can have any size that is suitable for SEM imaging. SEM images of the sample can be acquired from 0° to 360° using a rotational-tip SEM substage. Here, I will discuss the concept and, for clarity, illustrate it with aquarium gravel particles that are glued onto a craft roll and imaged optically before generating the 3D model of that handmade craft. Future work will include the experimental SEM realization, as well as further development of the SfM algorithms. In my view, this proposed concept may become an integral part of SEM-based particle metrology.

scholarly journals THREE-DIMENSIONAL RECONSTRUCTION OF OBJECTS IN A DYNAMIC SCENE ON VIDEO STREAM

2020 ◽  
Author(s):  
В.А. Бобков ◽  
А.П. Кудряшов
Keyword(s):  
3D Model ◽  
Three Dimensional ◽  
Video Stream ◽  
Reconstruction Method ◽  
Three Dimensional Reconstruction ◽  
Dynamic Scene ◽  
Structure And Motion ◽  
Dimensional Reconstruction ◽  
Point Representation ◽  
Dynamic Objects

Представлен метод 3D реконструкции объектов в динамической сцене в рамках общего подхода к решению проблемы восстановления структуры и движения по изображениям. Подход в целом основывается на точечном представлении объектов и применении метода визуальной одометрии для расчета движения динамических объектов по стереовидеопотоку. На этапе подготовки входных данных для метода реконструкции выполняются идентификация динамических объектов и вычисление траекторий их движения. Согласно предлагаемому методу 3D модель динамического объекта строится посредством объединения его видов, получаемых из разных позиций камеры. Проведенные эксперименты с виртуальными сценами подтвердили работоспособность предложенных алгоритмов. The article presents the method of three-dimensional reconstruction of objects on a dynamic scene in the framework of a common approach to solving the problem of restoring the structure and motion by images. In general, the proposed approach is based on point representation of the object and utilization of the visual odometry method to calculate the motion of dynamic objects by stereo video stream. The stage of preparation of input data for the reconstruction method consists of the identification of dynamic objects and calculating trajectories of its motion. According to the proposed method, the 3D model of a dynamic object is reconstructed by combining its views received from different camera positions. Conducted experimental research with virtual scenes proved the performance capabilities of proposed algorithms.

Position-Based Visual Servoing of a Micro-Aerial Vehicle Operating Indoor

2018 ◽  
Vol 141 (1) ◽  
Author(s):  
Hanoch Efraim ◽  
Amir Shapiro ◽  
Moshe Zohar ◽  
Gera Weiss
Keyword(s):  
Visual Servoing ◽  
3D Model ◽  
Closed Loop ◽  
Specific Problem ◽  
Three Dimensional ◽  
Adaptive Controller ◽  
Single Image ◽  
Micro Aerial Vehicle ◽  
Aerial Vehicle ◽  
Gain Scheduled

In this work, we suggest a novel solution to a very specific problem—calculating the pose (position and attitude) of a micro-aerial vehicle (MAV) operating inside corridors and in front of windows. The proposed method makes use of a single image captured by a front facing camera, of specific features whose three-dimensional (3D) model is partially known. No prior knowledge regarding the size of the corridor or the window is needed, nor is the ratio between their width and height. The position is calculated up to an unknown scale using a gain scheduled iterative algorithm. In order to compensate for the unknown scale, an adaptive controller that ensures consistent closed loop behavior is suggested. The attitude calculation can be used as is, or the results can be fused with angular velocity sensors to achieve better estimation. In this paper, the algorithm is presented and the approach is demonstrated with simulations and experiments.

scholarly journals THE INTEGRATED 3D SURVEY FOR UNDERGROUND ARCHAEOLOGICAL ENVIRONMENT

2019 ◽  
Vol XLII-2/W9 ◽  
pp. 311-317 ◽  
Author(s):  
D. Ebolese ◽  
M. Lo Brutto ◽  
G. Dardanelli
Keyword(s):  
Cultural Heritage ◽  
Unmanned Aerial Vehicle ◽  
Laser Scanning ◽  
3D Model ◽  
Southern Italy ◽  
Three Dimensional ◽  
Point Of View ◽  
Articulated Structures ◽  
Aerial Vehicle

<p><strong>Abstract.</strong> The task of documentation and conservation of Cultural Heritage defines the challenges that geomatics techniques have to overtake in order to provide different solutions that combine the automation of processes with accurate results. The employment of integrated technologies allows improving the documentation of Cultural Heritage from a quantitative and qualitative point of view. The use of range and image-based techniques ensures the possibility to completely record articulated structures such as building with underground environments. The latter present often problematic survey conditions that imposed well planned and appropriate solutions. In this context, the paper presents the results of a 3D survey of the underground “Sybil hypogeum” and the related overhead church located in the Archaeological Park of Lilibeo (Marsala, Southern Italy). An integrated survey was planned in order to combine laser scanning technology with terrestrial-based and Unmanned Aerial Vehicle (UAV)-based photogrammetry to acquire the three-dimensional data of the whole complex (underground environments and overhead church). The aims of the work are related to test a topographic approach by a traverse method for scans registration and to archive a complete and detailed 3D model of the whole area. This model could be used to prevent the risk of information’s loss and to improve the knowledge of the site.</p>

Sign in / Sign up

Export Citation Format

Share Document