Landmark-Based Re-topology of Stereo-Pair Acquired Face Meshes

Author(s):  
Eric Patterson ◽  
Jessica Baron ◽  
Devin Simpson
Keyword(s):  
Author(s):  
Lee D. Peachey ◽  
Lou Fodor ◽  
John C. Haselgrove ◽  
Stanley M. Dunn ◽  
Junqing Huang

Stereo pairs of electron microscope images provide valuable visual impressions of the three-dimensional nature of specimens, including biological objects. Beyond this one seeks quantitatively accurate models and measurements of the three dimensional positions and sizes of structures in the specimen. In our laboratory, we have sought to combine high resolution video cameras with high performance computer graphics systems to improve both the ease of building 3D reconstructions and the accuracy of 3D measurements, by using multiple tilt images of the same specimen tilted over a wider range of angles than can be viewed stereoscopically. Ultimately we also wish to automate the reconstruction and measurement process, and have initiated work in that direction.Figure 1 is a stereo pair of 400 kV images from a 1 micrometer thick transverse section of frog skeletal muscle stained with the Golgi stain. This stain selectively increases the density of the transverse tubular network in these muscle cells, and it is this network that we reconstruct in this example.


Author(s):  
M. Marko ◽  
A. Leith ◽  
D. Parsons

The use of serial sections and computer-based 3-D reconstruction techniques affords an opportunity not only to visualize the shape and distribution of the structures being studied, but also to determine their volumes and surface areas. Up until now, this has been done using serial ultrathin sections.The serial-section approach differs from the stereo logical methods of Weibel in that it is based on the Information from a set of single, complete cells (or organelles) rather than on a random 2-dimensional sampling of a population of cells. Because of this, it can more easily provide absolute values of volume and surface area, especially for highly-complex structures. It also allows study of individual variation among the cells, and study of structures which occur only infrequently.We have developed a system for 3-D reconstruction of objects from stereo-pair electron micrographs of thick specimens.


Author(s):  
William P. Wergin ◽  
Eric F. Erbe

The eye-brain complex allows those of us with normal vision to perceive and evaluate our surroundings in three-dimensions (3-D). The principle factor that makes this possible is parallax - the horizontal displacement of objects that results from the independent views that the left and right eyes detect and simultaneously transmit to the brain for superimposition. The common SEM micrograph is a 2-D representation of a 3-D specimen. Depriving the brain of the 3-D view can lead to erroneous conclusions about the relative sizes, positions and convergence of structures within a specimen. In addition, Walter has suggested that the stereo image contains information equivalent to a two-fold increase in magnification over that found in a 2-D image. Because of these factors, stereo pair analysis should be routinely employed when studying specimens.Imaging complementary faces of a fractured specimen is a second method by which the topography of a specimen can be more accurately evaluated.


Author(s):  
W. Lin ◽  
J. Gregorio ◽  
T.J. Holmes ◽  
D. H. Szarowski ◽  
J.N. Turner

A low-light level video microscope with long working distance objective lenses has been built as part of our integrated three-dimensional (3-D) light microscopy workstation (Fig. 1). It allows the observation of living specimens under sufficiently low light illumination that no significant photobleaching or alternation of specimen physiology is produced. The improved image quality, depth discrimination and 3-D reconstruction provides a versatile intermediate resolution system that replaces the commonly used dissection microscope for initial image recording and positioning of microelectrodes for neurobiology. A 3-D image is displayed on-line to guide the execution of complex experiments. An image composed of 40 optical sections requires 7 minutes to process and display a stereo pair.The low-light level video microscope utilizes long working distance objective lenses from Mitutoyo (10X, 0.28NA, 37 mm working distance; 20X, 0.42NA, 20 mm working distance; 50X, 0.42NA, 20 mm working distance). They provide enough working distance to allow the placement of microelectrodes in the specimen.


2020 ◽  
Vol 12 (3) ◽  
pp. 371 ◽  
Author(s):  
Sahar Dehnavi ◽  
Yasser Maghsoudi ◽  
Klemen Zakšek ◽  
Mohammad Javad Valadan Zoej ◽  
Gunther Seckmeyer ◽  
...  

Due to the considerable impact of clouds on the energy balance in the atmosphere and on the earth surface, they are of great importance for various applications in meteorology or remote sensing. An important aspect of the cloud research studies is the detection of cloudy pixels from the processing of satellite images. In this research, we investigated a stereographic method on a new set of Meteosat images, namely the combination of the high resolution visible (HRV) channel of the Meteosat-8 Indian Ocean Data Coverage (IODC) as a stereo pair with the HRV channel of the Meteosat Second Generation (MSG) Meteosat-10 image at 0° E. In addition, an approach based on the outputs from stereo analysis was proposed to detect cloudy pixels. This approach is introduced with a 2D-scatterplot based on the parallax value and the minimum intersection distance. The mentioned scatterplot was applied to determine/detect cloudy pixels in various image subsets with different amounts of cloud cover. Apart from the general advantage of the applied stereography method, which only depends on geometric relationships, the cloud detection results are also improved because: (1) The stereo pair is the HRV bands of the Spinning Enhanced Visible and InfraRed Imager (SEVIRI) sensor, with the highest spatial resolution available from the Meteosat geostationary platform; and (2) the time difference between the image pairs is nearly 5 s, which improves the matching results and also decreases the effect of cloud movements. In order to prove this improvement, the results of this stereo-based approach were compared with three different reflectance-based target detection techniques, including the adaptive coherent estimator (ACE), constrained energy minimization (CEM), and matched filter (MF). The comparison of the receiver operating characteristics (ROC) detection curves and the area under these curves (AUC) showed better detection results with the proposed method. The AUC value was 0.79, 0.90, 0.90, and 0.93 respectively for ACE, CEM, MF, and the proposed stereo-based detection approach. The results of this research shall enable a more realistic modelling of down-welling solar irradiance in the future.


2021 ◽  
Vol 13 (4) ◽  
pp. 593
Author(s):  
Lorenzo Lastilla ◽  
Valeria Belloni ◽  
Roberta Ravanelli ◽  
Mattia Crespi

DSM generation from satellite imagery is a long-lasting issue and it has been addressed in several ways over the years; however, expert and users are continuously searching for simpler but accurate and reliable software solutions. One of the latest ones is provided by the commercial software Agisoft Metashape (since version 1.6), previously known as Photoscan, which joins other already available open-source and commercial software tools. The present work aims to quantify the potential of the new Agisoft Metashape satellite processing module, considering that to the best knowledge of the authors, only two papers have been published, but none considering cross-sensor imagery. Here we investigated two different case studies to evaluate the accuracy of the generated DSMs. The first dataset consists of a triplet of Pléiades images acquired over the area of Trento and the Adige valley (Northern Italy), which is characterized by a great variety in terms of geomorphology, land uses and land covers. The second consists of a triplet composed of a WorldView-3 stereo pair and a GeoEye-1 image, acquired over the city of Matera (Southern Italy), one of the oldest settlements in the world, with the worldwide famous area of Sassi and a very rugged morphology in the surroundings. First, we carried out the accuracy assessment using the RPCs supplied by the satellite companies as part of the image metadata. Then, we refined the RPCs with an original independent terrain technique able to supply a new set of RPCs, using a set of GCPs adequately distributed across the regions of interest. The DSMs were generated both in a stereo and multi-view (triplet) configuration. We assessed the accuracy and completeness of these DSMs through a comparison with proper references, i.e., DSMs obtained through LiDAR technology. The impact of the RPC refinement on the DSM accuracy is high, ranging from 20 to 40% in terms of LE90. After the RPC refinement, we achieved an average overall LE90 <5.0 m (Trento) and <4.0 m (Matera) for the stereo configuration, and <5.5 m (Trento) and <4.5 m (Matera) for the multi-view (triplet) configuration, with an increase of completeness in the range 5–15% with respect to stereo pairs. Finally, we analyzed the impact of land cover on the accuracy of the generated DSMs; results for three classes (urban, agricultural, forest and semi-natural areas) are also supplied.


2021 ◽  
Vol 13 (11) ◽  
pp. 2185
Author(s):  
Yu Tao ◽  
Sylvain Douté ◽  
Jan-Peter Muller ◽  
Susan J. Conway ◽  
Nicolas Thomas ◽  
...  

We introduce a novel ultra-high-resolution Digital Terrain Model (DTM) processing system using a combination of photogrammetric 3D reconstruction, image co-registration, image super-resolution restoration, shape-from-shading DTM refinement, and 3D co-alignment methods. Technical details of the method are described, and results are demonstrated using a 4 m/pixel Trace Gas Orbiter Colour and Stereo Surface Imaging System (CaSSIS) panchromatic image and an overlapping 6 m/pixel Mars Reconnaissance Orbiter Context Camera (CTX) stereo pair to produce a 1 m/pixel CaSSIS Super-Resolution Restoration (SRR) DTM for different areas over Oxia Planum on Mars—the future ESA ExoMars 2022 Rosalind Franklin rover’s landing site. Quantitative assessments are made using profile measurements and the counting of resolvable craters, in comparison with the publicly available 1 m/pixel High-Resolution Imaging Experiment (HiRISE) DTM. These assessments demonstrate that the final resultant 1 m/pixel CaSSIS DTM from the proposed processing system has achieved comparable and sometimes more detailed 3D reconstruction compared to the overlapping HiRISE DTM.


2021 ◽  
Vol 87 (5) ◽  
pp. 363-373
Author(s):  
Long Chen ◽  
Bo Wu ◽  
Yao Zhao ◽  
Yuan Li

Real-time acquisition and analysis of three-dimensional (3D) human body kinematics are essential in many applications. In this paper, we present a real-time photogrammetric system consisting of a stereo pair of red-green-blue (RGB) cameras. The system incorporates a multi-threaded and graphics processing unit (GPU)-accelerated solution for real-time extraction of 3D human kinematics. A deep learning approach is adopted to automatically extract two-dimensional (2D) human body features, which are then converted to 3D features based on photogrammetric processing, including dense image matching and triangulation. The multi-threading scheme and GPU-acceleration enable real-time acquisition and monitoring of 3D human body kinematics. Experimental analysis verified that the system processing rate reached ∼18 frames per second. The effective detection distance reached 15 m, with a geometric accuracy of better than 1% of the distance within a range of 12 m. The real-time measurement accuracy for human body kinematics ranged from 0.8% to 7.5%. The results suggest that the proposed system is capable of real-time acquisition and monitoring of 3D human kinematics with favorable performance, showing great potential for various applications.


1980 ◽  
Vol 19 (3) ◽  
Author(s):  
T. W. Ryan ◽  
R. T. Gray ◽  
B. R. Hunt
Keyword(s):  

Sign in / Sign up

Export Citation Format

Share Document