Measurement of Three-Dimensional Environment with a Fish-Eye Camera Based on Structure from Motion - Error Analysis

2009 ◽  
Vol 21 (6) ◽  
pp. 680-688 ◽  
Author(s):  
Kenji Terabayashi ◽  
◽  
Hisanori Mitsumoto ◽  
Toru Morita ◽  
Yohei Aragaki ◽  
...  
Keyword(s):  
Structure From Motion ◽  
Measurement Accuracy ◽  
Three Dimensional ◽  
Simultaneous Estimation ◽  
3D Measurement ◽  
Motion Error ◽  
3 Dimensional ◽  
Wide Range ◽  
Large Distortion ◽  
Fish Eye

This paper proposes a method for measuring 3-dimensional (3D) environment and estimating camera movement with two fish-eye images. This method deals with large distortion of images from a fish-eye camera to calibrate internal and external camera parameters precisely by simultaneous estimation. In this paper, we analyze 3D measurement accuracy based on a theoretical model and evaluate it in practical analysis in experimental and real environments. These analyses show that the theoretical measurement error model works over a wide range of fish-eye views.

3D Measurement Using a Fish-Eye Camera Based on EPI Analysis

2012 ◽  
Vol 24 (4) ◽  
pp. 677-685
Author(s):  
Kenji Terabayashi ◽  
◽  
Toru Morita ◽  
Hiroya Okamoto ◽  
Kazunori Umeda ◽  
...  
Keyword(s):  
Mobile Robots ◽  
Three Dimensional ◽  
3D Measurement ◽  
Feature Points ◽  
3D Environment ◽  
Wide Range ◽  
Plane Image ◽  
3D Environments ◽  
Car Driving ◽  
Fish Eye

In car driving support systems and mobile robots, it is important to understand three-dimensional environment widely at once. In this paper, we use a fish-eye camera as a sensor to measure three-dimensional (3D) environments. This camera can take a wide-range and distortional image and can be easily mounted on cars. We propose a method for reconstructing 3D environment using fish-eye images based on Epipolar-Plane Image (EPI) analysis. This method enables easy and stable matching of feature points. The effectiveness of the proposed method is verified by experiments.

scholarly journals Experimental Study on 3D Measurement Accuracy Detection of Low Altitude UAV for Repeated Observation of an Invariant Surface

Processes ◽  
2021 ◽  
Vol 10 (1) ◽  
pp. 4
Author(s):  
Sha Gao ◽  
Shu Gan ◽  
Xiping Yuan ◽  
Rui Bi ◽  
Raobo Li ◽  
...  
Keyword(s):  
Experimental Study ◽  
Unmanned Aerial Vehicle ◽  
Structure From Motion ◽  
Measurement Accuracy ◽  
Test Plot ◽  
3D Measurement ◽  
Difference Model ◽  
Repeated Observations ◽  
Aerial Vehicle ◽  
Low Altitude

Low-altitude unmanned aerial vehicle (UAV) photogrammetry combined with structure-from-motion (SFM) algorithms is the latest technological approach to imaging 3D stereo constructions. At present, derivative products have been widely used in landslide monitoring, landscape evolution, glacier movement, volume measurement, and landscape change detection. However, there is still a lack of research into the accuracy of 3D data positioning based on the structure-from-motion of unmanned aerial vehicle (UAV-SFM) technology, itself, which can affect the measurable effectiveness of the results in further applications of this technological approach. In this paper, validation work was carried out for the DJI Phantom 4 RTK UAV, for earth observation data related to 3D positioning accuracy. First, a test plot with a relatively stable surface was selected for repeated flight imaging observations. Specifically, three repeated flights were performed on the test plot to obtain three sorties of images; the structure from motion and multi-view stereo (SFM-MVS) key technology was used to process and construct a 3D scene model, and based on this model the digital surface model (DSM) and digital orthophoto map (DOM) data of the same plot with repeated observations were obtained. In order to check the level of 3D measurement accuracy of the UAV technology itself, a window selection-based method was used to sample the point cloud set data from the three-sortie repeat observation 3D model. The DSM and DOM data obtained from three repeated flights over the surface invariant test plots were used to calculate the repeat observation 3D point errors, taking into account the general methodology of redundant observation error analysis for topographic surveys. At the same time, to further analyze the limits of the UAV measurement technique, possible under equivalent observation conditions with the same processing environment, a difference model (DOD) was constructed for the DSM data from three sorties, to deepen the overall characterization of the differences between the DSMs obtained from repeated observations. The results of the experimental study concluded that both the analysis of the 3D point set measurements based on window sampling and the accuracy evaluation using the difference model were generally able to achieve a centimeter level of planimetric accuracy and vertical accuracy. In addition, the accuracy of the surface-stabilized hardened ground was better, overall, than the accuracy of the non-hardened ground. The results of this paper not only probe the measurement limits of this type of UAV, but also provide a quantitative reference for the accurate control and setting of an acquisition scheme of the UAV-based SfM-MVS method for geomorphological data acquisition and 3D reconstruction.

scholarly journals 3-DIMENSIONAL GEOLOGICAL MAPPING AND MODELING ACTIVITIES AT THE GEOLOGICAL SURVEY OF NORWAY

2015 ◽  
Vol XL-2/W4 ◽  
pp. 11-16 ◽  
Author(s):  
A. Jarna ◽  
A. Bang-Kittilsen ◽  
C. Haase ◽  
I. H. C. Henderson ◽  
F. Høgaas ◽  
...  
Keyword(s):  
3D Visualization ◽  
Three Dimensional ◽  
Mineral Resources ◽  
Geological Mapping ◽  
Geological Survey ◽  
Marine Geology ◽  
Data Infrastructure ◽  
3 Dimensional ◽  
3D Data ◽  
Wide Range

Geology and all geological structures are three-dimensional in space. Geology can be easily shown as four-dimensional when time is considered. Therefore GIS, databases, and 3D visualization software are common tools used by geoscientists to view, analyse, create models, interpret and communicate geological data. The NGU (Geological Survey of Norway) is the national institution for the study of bedrock, mineral resources, surficial deposits and groundwater and marine geology. The interest in 3D mapping and modelling has been reflected by the increase of number of groups and researches dealing with 3D in geology within NGU. This paper highlights 3D geological modelling techniques and the usage of these tools in bedrock, geophysics, urban and groundwater studies at NGU, same as visualisation of 3D online. The examples show use of a wide range of data, methods, software and an increased focus on interpretation and communication of geology in 3D. The goal is to gradually expand the geospatial data infrastructure to include 3D data at the same level as 2D.

scholarly journals Studies on Three-Dimensional (3D) Accuracy Optimization and Repeatability of UAV in Complex Pit-Rim Landforms As Assisted by Oblique Imaging and RTK Positioning

Sensors ◽  
2021 ◽  
Vol 21 (23) ◽  
pp. 8109
Author(s):  
Rui Bi ◽  
Shu Gan ◽  
Xiping Yuan ◽  
Raobo Li ◽  
Sha Gao ◽  
...  
Keyword(s):  
Measurement Accuracy ◽  
Three Dimensional ◽  
Surface Model ◽  
Observation Data ◽  
3D Measurement ◽  
Oblique View ◽  
Mountain Environments ◽  
Repeated Observation ◽  
Order Of Magnitude ◽  
Oblique Images

Unmanned Aerial Vehicles (UAVs) are a novel technology for landform investigations, monitoring, as well as evolution analyses of long−term repeated observation. However, impacted by the sophisticated topographic environment, fluctuating terrain and incomplete field observations, significant differences have been found between 3D measurement accuracy and the Digital Surface Model (DSM). In this study, the DJI Phantom 4 RTK UAV was adopted to capture images of complex pit-rim landforms with significant elevation undulations. A repeated observation data acquisition scheme was proposed for a small amount of oblique-view imaging, while an ortho-view observation was conducted. Subsequently, the 3D scenes and DSMs were formed by employing Structure from Motion (SfM) and Multi-View Stereo (MVS) algorithms. Moreover, a comparison and 3D measurement accuracy analysis were conducted based on the internal and external precision by exploiting checkpoint and DSM of Difference (DoD) error analysis methods. As indicated by the results, the 3D scene plane for two imaging types could reach an accuracy of centimeters, whereas the elevation accuracy of the orthophoto dataset alone could only reach the decimeters (0.3049 m). However, only 6.30% of the total image number of oblique images was required to improve the elevation accuracy by one order of magnitude (0.0942 m). (2) An insignificant variation in internal accuracy was reported in oblique imaging-assisted datasets. In particular, SfM-MVS technology exhibited high reproducibility for repeated observations. By changing the number and position of oblique images, the external precision was able to increase effectively, the elevation error distribution was improved to become more concentrated and stable. Accordingly, a repeated observation method only including a few oblique images has been proposed and demonstrated in this study, which could optimize the elevation and improve the accuracy. The research results could provide practical and effective technology reference strategies for geomorphological surveys and repeated observation analyses in sophisticated mountain environments.

scholarly journals 3D Measurement of Discontinuous Objects with Optimized Dual-frequency Grating Profilometry

2021 ◽  
Vol 21 (6) ◽  
pp. 197-204
Author(s):  
Jun Che ◽  
Yanxia Sun ◽  
Xiaojun Jin ◽  
Yong Chen
Keyword(s):  
Light Intensity ◽  
Measurement Accuracy ◽  
High Reliability ◽  
Three Dimensional ◽  
Fringe Projection ◽  
Intensity Difference ◽  
3D Measurement ◽  
Dual Frequency ◽  
Processing Scheme ◽  
Blind Spots

Abstract Three-dimensional profilometry tends to be less effective at measuring discontinuous surfaces. To overcome this problem, an optimized profilometry based on fringe projection is proposed in this paper. Due to the limitation of the shooting angle, there are projection blind spots on the surface of discontinuous objects. Since the noises and unwrapping errors are always localized at the projection blind spots, an algorithm is designed to determine the blind spots automatically with the light intensity difference information. Besides, in order to improve the measurement accuracy, a processing scheme is introduced to deal with the local height distortion introduced by the dual-frequency grating profilometry. Lots of measurement tests on various surfaces are carried out to assess the optimized profilometry, and experimental results indicate that the modified profilometry system works more robust with high reliability and accuracy in measuring different kinds of surfaces, especially discontinuous ones.

Three-Dimensional Analysis of Morphological Aspects of the Human Utricular Macula

2003 ◽  
Vol 112 (5) ◽  
pp. 419-424 ◽  
Author(s):  
Hideaki Naganuma ◽  
Koji Tokumasu ◽  
Shinichiro Hashimoto ◽  
Makito Okamoto ◽  
Shohei Yamashina
Keyword(s):  
Three Dimensional ◽  
Semicircular Canals ◽  
Linear Acceleration ◽  
Entire Area ◽  
3 Dimensional ◽  
Utricular Macula ◽  
Morphological Aspects ◽  
Wide Range ◽  
Dimensional Shape ◽  
Temporal Bones

The 3-dimensional shape of the human utricular macula and its orientation in the skull are quantitated in this report, which is one of a series. The semicircular canals and utricular macula were reconstructed in 3 dimensions on a computer from 3 human temporal bones. The 238 to 279 triangles in the entire area of the utricular macula were made by drawing lines between 2 adjacent points every 200-μm width of the utricular macula in each section. We calculated the angles between each triangle and each estimated standard axis in the skull. This study provides standard data regarding the 3-dimensional morphological aspects of the utricular macula for further investigation of the function of the utriculus. We determined that the 3-dimensional shape of the utricular macula was not a plane, but was a curved surface like that of an ellipsoid. We believe this shape is necessary for the utricular macula to detect wide-range linear acceleration.

Hand-Held Blue Light 3D Measurement Technology and its Application in Hot Stamping

2014 ◽  
Vol 1063 ◽  
pp. 362-366 ◽  
Author(s):  
Guo Min Zhan ◽  
Zhong Wei Li ◽  
Xing Jian Liu ◽  
Kai Zhong
Keyword(s):  
Blue Light ◽  
Measurement Accuracy ◽  
Hot Stamping ◽  
Three Dimensional ◽  
High Strength ◽  
Measurement Technology ◽  
3D Measurement ◽  
Single Measurement ◽  
Reflectance Measurement ◽  
3D Measurement System

Over the last few years hot stamping for its high strength, lightweight characteristics has developed at an alarming rate, At the same time the measurement process a higher demand. Compared with the traditional three-dimensional coordinate measurement, Hand-held Blue structured Light 3D measurement technology for its fast, high precision, good flexibility, etc., has become the best choice of high-strength steel stamping in non-contact 3D measurement and accuracy detection. This paper developed a set of holding blue light 3D measurement system. The system project blue structured pattern to the surface of the object, and captured by two high-speed cameras synchronized. Then using the grabbed pictures reconstruct 3D topography of the object. Blue light projection technology can eliminate the use of influence of different surface reflectance measurement accuracy, So that a single measurement accuracy of 0.02mm, overall measurement accuracy of 0.05mm / m, Single measurement time is less than 0.12 seconds. This measuring system can be widely used in the rapid detection of various types of three-dimensional measurement and precision casting.

Three-Dimensional Reconstruction Using Stereo Pairs from Serial Thick Sections

1977 ◽  
Vol 35 ◽  
pp. 562-563
Author(s):  
Robert Glaeser ◽  
Thomas Bauer ◽  
David Grano
Keyword(s):  
Three Dimensional ◽  
Dimensional Structure ◽  
Serial Sections ◽  
Thin Sections ◽  
3 Dimensional ◽  
Transmission Electron ◽  
Freeze Dried ◽  
Dimensional Reconstruction ◽  
Stereo Imagery ◽  
Whole Mounts

In transmission electron microscopy, the 3-dimensional structure of an object is usually obtained in one of two ways. For objects which can be included in one specimen, as for example with elements included in freeze- dried whole mounts and examined with a high voltage microscope, stereo pairs can be obtained which exhibit the 3-D structure of the element. For objects which can not be included in one specimen, the 3-D shape is obtained by reconstruction from serial sections. However, without stereo imagery, only detail which remains constant within the thickness of the section can be used in the reconstruction; consequently, the choice is between a low resolution reconstruction using a few thick sections and a better resolution reconstruction using many thin sections, generally a tedious chore. This paper describes an approach to 3-D reconstruction which uses stereo images of serial thick sections to reconstruct an object including detail which changes within the depth of an individual thick section.

Design and calibration of an IVEM for general 3-dimensional imaging of non-diffracting materials

1992 ◽  
Vol 50 (2) ◽  
pp. 1040-1041
Author(s):  
Neil Rowlands ◽  
Jeff Price ◽  
Michael Kersker ◽  
Seichi Suzuki ◽  
Steve Young ◽  
...  
Keyword(s):  
3D Imaging ◽  
Tomographic Reconstruction ◽  
Three Dimensional ◽  
3 Dimensional ◽  
3D Microstructure ◽  
Image Translation ◽  
Digital Correlation ◽  
On Line ◽  
Mechanical Stage ◽  
Projection Angle

Three-dimensional (3D) microstructure visualization on the electron microscope requires that the sample be tilted to different positions to collect a series of projections. This tilting should be performed rapidly for on-line stereo viewing and precisely for off-line tomographic reconstruction. Usually a projection series is collected using mechanical stage tilt alone. The stereo pairs must be viewed off-line and the 60 to 120 tomographic projections must be aligned with fiduciary markers or digital correlation methods. The delay in viewing stereo pairs and the alignment problems in tomographic reconstruction could be eliminated or improved by tilting the beam if such tilt could be accomplished without image translation.A microscope capable of beam tilt with simultaneous image shift to eliminate tilt-induced translation has been investigated for 3D imaging of thick (1 μm) biologic specimens. By tilting the beam above and through the specimen and bringing it back below the specimen, a brightfield image with a projection angle corresponding to the beam tilt angle can be recorded (Fig. 1a).

Counterfeit Parts Recognition and Detection for Failure Analysts

2010 ◽  
Author(s):  
Katherine V. Whittington
Keyword(s):  
Thermal Cycle ◽  
Visual Inspection ◽  
Acoustic Microscopy ◽  
Scanning Acoustic Microscopy ◽  
3D Measurement ◽  
X Ray ◽  
Wide Range ◽  
Electronic Parts ◽  
Testing Awareness

Abstract The electronics supply chain is being increasingly infiltrated by non-authentic, counterfeit electronic parts, whose use poses a great risk to the integrity and quality of critical hardware. There is a wide range of counterfeit parts such as leads and body molds. The failure analyst has many tools that can be used to investigate counterfeit parts. The key is to follow an investigative path that makes sense for each scenario. External visual inspection is called for whenever the source of supply is questionable. Other methods include use of solvents, 3D measurement, X-ray fluorescence, C-mode scanning acoustic microscopy, thermal cycle testing, burn-in technique, and electrical testing. Awareness, vigilance, and effective investigations are the best defense against the threat of counterfeit parts.

Sign in / Sign up

Export Citation Format

Share Document