scholarly journals Simulation-Based Estimation of the Number of Cameras Required for 3D Reconstruction in a Narrow-Baseline Multi-Camera Setup

2021 ◽  
Vol 7 (5) ◽  
pp. 87
Author(s):  
Andreas Wachter ◽  
Jan Kost ◽  
Werner Nahm

Graphical visualization systems are a common clinical tool for displaying digital images and three-dimensional volumetric data. These systems provide a broad spectrum of information to support physicians in their clinical routine. For example, the field of radiology enjoys unrestricted options for interaction with the data, since information is pre-recorded and available entirely in digital form. However, some fields, such as microsurgery, do not benefit from this yet. Microscopes, endoscopes, and laparoscopes show the surgical site as it is. To allow free data manipulation and information fusion, 3D digitization of surgical sites is required. We aimed to find the number of cameras needed to add this functionality to surgical microscopes. For this, we performed in silico simulations of the 3D reconstruction of representative models of microsurgical sites with different numbers of cameras in narrow-baseline setups. Our results show that eight independent camera views are preferable, while at least four are necessary for a digital surgical site. In most cases, eight cameras allow the reconstruction of over 99% of the visible part. With four cameras, still over 95% can be achieved. This answers one of the key questions for the development of a prototype microscope. In future, such a system can provide functionality which is unattainable today.

Author(s):  
V. Mousavi ◽  
M. Khosravi ◽  
M. Ahmadi ◽  
N. Noori ◽  
A. Hosseini Naveh ◽  
...  

Today, multi-image 3D reconstruction is an active research field and generating three dimensional model of the objects is one the most discussed issues in Photogrammetry and Computer Vision that can be accomplished using range-based or image-based methods. Very accurate and dense point clouds generated by range-based methods such as structured light systems and laser scanners has introduced them as reliable tools in the industry. Image-based 3D digitization methodologies offer the option of reconstructing an object by a set of unordered images that depict it from different viewpoints. As their hardware requirements are narrowed down to a digital camera and a computer system, they compose an attractive 3D digitization approach, consequently, although range-based methods are generally very accurate, image-based methods are low-cost and can be easily used by non-professional users. One of the factors affecting the accuracy of the obtained model in image-based methods is the software and algorithm used to generate three dimensional model. These algorithms are provided in the form of commercial software, open source and web-based services. Another important factor in the accuracy of the obtained model is the type of sensor used. Due to availability of mobile sensors to the public, popularity of professional sensors and the advent of stereo sensors, a comparison of these three sensors plays an effective role in evaluating and finding the optimized method to generate three-dimensional models. Lots of research has been accomplished to identify a suitable software and algorithm to achieve an accurate and complete model, however little attention is paid to the type of sensors used and its effects on the quality of the final model. The purpose of this paper is deliberation and the introduction of an appropriate combination of a sensor and software to provide a complete model with the highest accuracy. To do this, different software, used in previous studies, were compared and the most popular ones in each category were selected (Arc 3D, Visual SfM, Sure, Agisoft). Also four small objects with distinct geometric properties and especial complexities were chosen and their accurate models as reliable true data was created using ATOS Compact Scan 2M 3D scanner. Images were taken using Fujifilm Real 3D stereo camera, Apple iPhone 5 and Nikon D3200 professional camera and three dimensional models of the objects were obtained using each of the software. Finally, a comprehensive comparison between the detailed reviews of the results on the data set showed that the best combination of software and sensors for generating three-dimensional models is directly related to the object shape as well as the expected accuracy of the final model. Generally better quantitative and qualitative results were obtained by using the Nikon D3200 professional camera, while Fujifilm Real 3D stereo camera and Apple iPhone 5 were the second and third respectively in this comparison. On the other hand, three software of Visual SfM, Sure and Agisoft had a hard competition to achieve the most accurate and complete model of the objects and the best software was different according to the geometric properties of the object.


Author(s):  
J. K. Samarabandu ◽  
R. Acharya ◽  
D. R. Pareddy ◽  
P. C. Cheng

In the study of cell organization in a maize meristem, direct viewing of confocal optical sections in 3D (by means of 3D projection of the volumetric data set, Figure 1) becomes very difficult and confusing because of the large number of nucleus involved. Numerical description of the cellular organization (e.g. position, size and orientation of each structure) and computer graphic presentation are some of the solutions to effectively study the structure of such a complex system. An attempt at data-reduction by means of manually contouring cell nucleus in 3D was reported (Summers et al., 1990). Apart from being labour intensive, this 3D digitization technique suffers from the inaccuracies of manual 3D tracing related to the depth perception of the operator. However, it does demonstrate that reducing stack of confocal images to a 3D graphic representation helps to visualize and analyze complex tissues (Figure 2). This procedure also significantly reduce computational burden in an interactive operation.


Author(s):  
Jose-Maria Carazo ◽  
I. Benavides ◽  
S. Marco ◽  
J.L. Carrascosa ◽  
E.L. Zapata

Obtaining the three-dimensional (3D) structure of negatively stained biological specimens at a resolution of, typically, 2 - 4 nm is becoming a relatively common practice in an increasing number of laboratories. A combination of new conceptual approaches, new software tools, and faster computers have made this situation possible. However, all these 3D reconstruction processes are quite computer intensive, and the middle term future is full of suggestions entailing an even greater need of computing power. Up to now all published 3D reconstructions in this field have been performed on conventional (sequential) computers, but it is a fact that new parallel computer architectures represent the potential of order-of-magnitude increases in computing power and should, therefore, be considered for their possible application in the most computing intensive tasks.We have studied both shared-memory-based computer architectures, like the BBN Butterfly, and local-memory-based architectures, mainly hypercubes implemented on transputers, where we have used the algorithmic mapping method proposed by Zapata el at. In this work we have developed the basic software tools needed to obtain a 3D reconstruction from non-crystalline specimens (“single particles”) using the so-called Random Conical Tilt Series Method. We start from a pair of images presenting the same field, first tilted (by ≃55°) and then untilted. It is then assumed that we can supply the system with the image of the particle we are looking for (ideally, a 2D average from a previous study) and with a matrix describing the geometrical relationships between the tilted and untilted fields (this step is now accomplished by interactively marking a few pairs of corresponding features in the two fields). From here on the 3D reconstruction process may be run automatically.


2007 ◽  
Vol 3 (1) ◽  
pp. 89-113
Author(s):  
Zoltán Gillay ◽  
László Fenyvesi

There was a method developed that generates the three-dimensional model of not axisymmetric produce, based on an arbitrary number of photos. The model can serve as a basis for calculating the surface area and the volume of produce. The efficiency of the reconstruction was tested on bell peppers and artificial shapes. In case of bell peppers 3-dimensional reconstruction was created from 4 images rotated in 45° angle intervals. The surface area and the volume were estimated on the basis of the reconstructed area. Furthermore, a new and simple reference method was devised to give precise results for the surface area of bell pepper. The results show that this 3D reconstruction-based surface area and volume calculation method is suitable to determine the surface area and volume of definite bell peppers with an acceptable error.


2020 ◽  
Vol 64 (2) ◽  
pp. 20506-1-20506-7
Author(s):  
Min Zhu ◽  
Rongfu Zhang ◽  
Pei Ma ◽  
Xuedian Zhang ◽  
Qi Guo

Abstract Three-dimensional (3D) reconstruction is extensively used in microscopic applications. Reducing excessive error points and achieving accurate matching of weak texture regions have been the classical challenges for 3D microscopic vision. A Multi-ST algorithm was proposed to improve matching accuracy. The process is performed in two main stages: scaled microscopic images and regularized cost aggregation. First, microscopic image pairs with different scales were extracted according to the Gaussian pyramid criterion. Second, a novel cost aggregation approach based on the regularized multi-scale model was implemented into all scales to obtain the final cost. To evaluate the performances of the proposed Multi-ST algorithm and compare different algorithms, seven groups of images from the Middlebury dataset and four groups of experimental images obtained by a binocular microscopic system were analyzed. Disparity maps and reconstruction maps generated by the proposed approach contained more information and fewer outliers or artifacts. Furthermore, 3D reconstruction of the plug gauges using the Multi-ST algorithm showed that the error was less than 0.025 mm.


2021 ◽  
Vol 11 (8) ◽  
pp. 3635
Author(s):  
Ioannis Liritzis ◽  
Pantelis Volonakis ◽  
Spyros Vosinakis

In the field of cultural heritage, three-dimensional (3D) reconstruction of monuments is a usual activity for many professionals. The aim in this paper focuses on the new technology educational application combining science, history, and archaeology. Being involved in almost all stages of implementation steps and assessing the level of participation, university students use tools of computer gaming platform and participate in ways of planning the virtual environment which improves their education through e-Learning. The virtual 3D environment is made with different imaging methods (helium-filled balloon, Structure for motion, 3D repository models) and a developmental plan has been designed for use in many future applications. Digital tools were used with 3D reconstructed buildings from the museum archive to Unity 3D for the design. The pilot study of Information Technology work has been employed to introduce cultural heritage and archaeology to university syllabuses. It included students with a questionnaire which has been evaluated accordingly. As a result, the university students were inspired to immerse themselves into the virtual lab, aiming to increasing the level of interaction. The results show a satisfactory learning outcome by an easy to use and real 3D environment, a step forward to fill in needs of contemporary online sustainable learning demands.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Javier Caviedes-Bucheli ◽  
Nestor Rios-Osorio ◽  
Diana Usme ◽  
Cristian Jimenez ◽  
Adriana Pinzon ◽  
...  

Abstract Background The purpose of this study was to evaluate the changes in canal volume after root canal preparation in vivo with 3 different single-file techniques (Reciproc-Blue®, WaveOne-Gold® and XP-EndoShaper®), with a new method using CBCT and 3D reconstruction. Methods In this prospective study, thirty human lower premolars from healthy patients were used, in which extraction was indicated for orthodontic reasons. All the teeth used were caries- and restoration-free with complete root development, without signs of periodontal disease or traumatic occlusion, and with only one straight canal (up to 25º curvature). Teeth were randomly divided into three different groups: Reciproc-Blue, WaveOne-Gold and XP-EndoShaper. CBCT scans before root canal preparation were used to create a 3D reconstruction with RHINOCEROS 5.0 software to assess the initial canal volume, and then compared with 3D reconstructions after canal preparation to measure the increase in canal volume. Student’s t test for paired data were used to determine statistically significant differences between the before and after canal volumes. Anova test was used to determine statistically significant differences in the percentage of canal volume increase between the groups and Tukey's post-hoc test were used to paired comparison. Results Reciproc-Blue showed the higher increase in canal volume, followed by WaveOne-Gold and XP-EndoShaper (p = 0.003). XP-EndoShaper did not show a statistically significant increase in canal volume after root canal preparation (p = 0.06). Conclusion With this model, Reciproc-Blue showed higher increase in root canal volume, followed by WaveOne-Gold, while XP-EndoShaper did not significantly increase root canal volume during preparation.


Sensors ◽  
2019 ◽  
Vol 19 (18) ◽  
pp. 4001 ◽  
Author(s):  
Shuhe Chang ◽  
Haoyu Zhang ◽  
Haiying Xu ◽  
Xinghua Sang ◽  
Li Wang ◽  
...  

In the process of electron beam freeform fabrication (EBF3), due to the continuous change of thermal conditions and variability in wire feeding in the deposition process, geometric deviations are generated in the deposition of each layer. In order to prevent the layer-by-layer accumulation of the deviation, it is necessary to perform online geometry measurement for each deposition layer, based on which the error compensation can be done for the previous deposition layer in the next deposition layer. However, the traditional three-dimensional reconstruction method that employs structured laser cannot meet the requirements of long-term stable operation in the manufacturing process of EBF3. Therefore, this paper proposes a method to measure the deposit surfaces based on the position information of electron beam speckle, in which an electron beam is used to bombard the surface of the deposit to generate the speckle. Based on the structured information of the electron beam in the vacuum chamber, the three-dimensional reconstruction of the surface of the deposited parts is realized without need of additional structured laser sensor. In order to improve the detection accuracy, the detection error is theoretically analyzed and compensated. The absolute error after compensation is smaller than 0.1 mm, and the precision can reach 0.1%, which satisfies the requirements of 3D reconstruction of the deposited parts. An online measurement system is built for the surface of deposited parts in the process of electron beam freeform fabrication, which realizes the online 3D reconstruction of the surface of the deposited layer. In addition, in order to improve the detection stability of the whole system, the image processing algorithm suitable for this scene is designed. The reliability and speed of the algorithm are improved by ROI extraction, threshold segmentation, and expansion corrosion. In addition, the speckle size information can also reflect the thermal conditions of the surface of the deposited parts. Hence, it can be used for online detection of defects such as infusion and voids.


2012 ◽  
Vol 424-425 ◽  
pp. 598-602 ◽  
Author(s):  
You Min Wang ◽  
Chun Zhao ◽  
Jian Hua Zhang

In order to improve design performance, shorten development cycles, reduce production cost, we design and research the forklift hydraulic system, developed forklift hydraulic system diagram. Forklift virtual prototype’s 3-D solid modeling is designed by Pro / E three-dimensional software, and imported into the ADAMS environment. Add constraints and drivers exert the control function separately to the tilting cylinder and lifting cylinder, carry on the kinematics simulation. Through the analysis to the compound motion actuation control functional arrangement、the compound motion speed graph、the gate’s tilt angle graph、the tilting cylinder stress graph and the lifting cylinder stress graph, he simulation result indicated: each cylinder design is reasonable, the movement without interference,the reasonable work scope satisfied to the work size request


Sign in / Sign up

Export Citation Format

Share Document