Heads-Up Lidar Imaging with Sensor Fusion

2020 ◽  
Vol 2020 (13) ◽  
pp. 338-1-338-7
Author(s):  
Yang Cai ◽  
Sean Hackett ◽  
Ben Graham ◽  
Florian Alber ◽  
Mel Siegel

In this paper, we present a novel Lidar imaging system for heads-up display. The imaging system consists of the onedimensional laser distance sensor and IMU sensors, including an accelerometer and gyroscope. By fusing the sensory data when the user moves their head, it creates a three-dimensional point cloud for mapping the space around. Compared to prevailing 2D and 3D Lidar imaging systems, the proposed system has no moving parts; it’s simple, light-weight, and affordable. Our tests show that the horizontal and vertical profile accuracy of the points versus the floor plan is 3 cm on average. For the bump detection the minimal detectable step height is 2.5 cm. The system can be applied to first responses such as firefighting, and to detect bumps on pavement for lowvision pedestrians.

Author(s):  
Daniel L. Barton ◽  
Jeremy A. Walraven ◽  
Edward R. Dowski ◽  
Rainer Danz ◽  
Andreas Faulstich ◽  
...  

Abstract A new imaging technique called Wavefront Coding allows real-time imaging of three-dimensional structures over a very large depth. Wavefront Coding systems combine aspheric optics and signal processing to achieve depth of fields ten or more times greater than that possible with traditional imaging systems. Understanding the relationships between traditional and modern imaging system design through Wavefront Coding is very challenging. In high performance imaging systems nearly all aspects of the system that could reduce image quality are carefully controlled. Modifying the optics and using signal processing can increase the amount of image information that can be recorded by microscopes. For a number of applications this increase in information can allow a single image to be used where a number of images taken at different object planes had been used before. Having very large depth of field and real-time imaging capability means that very deep structures such as surface micromachined MEMS can be clearly imaged with one image, greatly simplifying defect and failure analysis.


2021 ◽  
Author(s):  
Nitin Dubey ◽  
Joseph Rosen

Abstract Interferenceless coded aperture correlation holography (I-COACH) is an incoherent digital holographic technique with lateral and axial resolution similar to a regular lens-based imaging system. The properties of I-COACH are dictated by the shape of the system’s point response termed point spread hologram (PSH). As previously shown, chaotic PSHs which are continuous over some area on the image sensor enable the system to perform three-dimensional (3D) holographic imaging. We also showed that a PSH of an ensemble of sparse dots improves the system’s signal-to-noise ratio (SNR) but reduces the dimensionality of the imaging from three to two dimensions. In this study, we test the midway shape of PSH, an ensemble of sparse islands distributed over the sensor plane. A PSH of isolated chaotic islands improves the SNR of the system compared to continuous chaotic PSH without losing the capability to perform 3D imaging. Reconstructed images of this new system are compared with images of continuous PSH, dot-based PSH, and direct images of a lens-based system. Visibility, SNR, and the product of visibility with SNR are the parameters used in the study. We also demonstrate the imaging capability of a system with partial annular apertures. The reconstruction results have better SNR and visibility than lens-based imaging systems with the same annular apertures.


Author(s):  
Tibor A. Zwimpfer ◽  
Claudine Wismer ◽  
Bernhard Fellmann-Fischer ◽  
James Geiger ◽  
Andreas Schötzau ◽  
...  

AbstractLaparoscopic surgery provides well-known benefits, but it has technological limitations. Depth perception is particularly crucial, with three-dimensional (3D) imaging being superior to two-dimensional (2D) HD imaging. However, with the introduction of 4K resolution monitors, 2D rendering is capable of providing higher-quality visuals. Therefore, this study aimed to compare 3D HD and 2D 4K imaging using a pelvitrainer model. Eight experts and 32 medical students were performing the same four standardized tasks using 2D 4K and 3D HD imaging systems. Task completion time and the number of errors made were recorded. The Wilcoxon test and mixed-effects models were used to analyze the results. Students were significantly faster in all four tasks when using the 3D HD perspective. The median difference ranged from 18 s in task 3 (P < 0.003) up to 177.5 s in task 4 (P < 0.001). With the exception of task 4, students demonstrated significantly fewer errors in all tasks involving 3D HD imaging. The experts’ results confirmed these findings, as they were also faster in all four tasks using 3D HD, which was significant for task 1 (P < 0.001) and task 4 (P < 0.006). The expert group also achieved better movement accuracy using the 3D HD system, with fewer mistakes made in all four tasks, which was significant in task 4 (P < 0.001). Participants in both groups achieved better results with the 3D HD imaging system than with the 2D 4K system. The 3D HD image system should be used when available. Trial registration: this trial is registered at research registry under the identifier researchregistry6852.


2020 ◽  
Vol 140 (11) ◽  
pp. 1264-1269
Author(s):  
Tatsuya Ohba ◽  
Daisuke Mizushima ◽  
Keishiro Goshima ◽  
Norio Tsuda ◽  
Jun Yamada

2019 ◽  
Vol 14 (1) ◽  
Author(s):  
Wu-zhou Li ◽  
Zhi-wen Liang ◽  
Yi Cao ◽  
Ting-ting Cao ◽  
Hong Quan ◽  
...  

Abstract Background Tumor motion may compromise the accuracy of liver stereotactic radiotherapy. In order to carry out a precise planning, estimating liver tumor motion during radiotherapy has received a lot of attention. Previous approach may have difficult to deal with image data corrupted by noise. The iterative closest point (ICP) algorithm is widely used for estimating the rigid registration of three-dimensional point sets when these data were dense or corrupted. In the light of this, our study estimated the three-dimensional (3D) rigid motion of liver tumors during stereotactic liver radiotherapy using reconstructed 3D coordinates of fiducials based on the ICP algorithm. Methods Four hundred ninety-five pairs of orthogonal kilovoltage (KV) images from the CyberKnife stereo imaging system for 12 patients were used in this study. For each pair of images, the 3D coordinates of fiducial markers inside the liver were calculated via geometric derivations. The 3D coordinates were used to calculate the real-time translational and rotational motion of liver tumors around three axes via an ICP algorithm. The residual error was also investigated both with and without rotational correction. Results The translational shifts of liver tumors in left-right (LR), anterior-posterior (AP),and superior-inferior (SI) directions were 2.92 ± 1.98 mm, 5.54 ± 3.12 mm, and 16.22 ± 5.86 mm, respectively; the rotational angles in left-right (LR), anterior-posterior (AP), and superior-inferior (SI) directions were 3.95° ± 3.08°, 4.93° ± 2.90°, and 4.09° ± 1.99°, respectively. Rotational correction decreased 3D fiducial displacement from 1.19 ± 0.35 mm to 0.65 ± 0.24 mm (P<0.001). Conclusions The maximum translational movement occurred in the SI direction. Rotational correction decreased fiducial displacements and increased tumor tracking accuracy.


2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Kiyoshi Masuyama ◽  
Tomoaki Higo ◽  
Jong-Kook Lee ◽  
Ryohei Matsuura ◽  
Ian Jones ◽  
...  

AbstractIn contrast to hypertrophic cardiomyopathy, there has been reported no specific pattern of cardiomyocyte array in dilated cardiomyopathy (DCM), partially because lack of alignment assessment in a three-dimensional (3D) manner. Here we have established a novel method to evaluate cardiomyocyte alignment in 3D using intravital heart imaging and demonstrated homogeneous alignment in DCM mice. Whilst cardiomyocytes of control mice changed their alignment by every layer in 3D and position twistedly even in a single layer, termed myocyte twist, cardiomyocytes of DCM mice aligned homogeneously both in two-dimensional (2D) and in 3D and lost myocyte twist. Manipulation of cultured cardiomyocyte toward homogeneously aligned increased their contractility, suggesting that homogeneous alignment in DCM mice is due to a sort of alignment remodelling as a way to compensate cardiac dysfunction. Our findings provide the first intravital evidence of cardiomyocyte alignment and will bring new insights into understanding the mechanism of heart failure.


2021 ◽  
pp. 000370282110133
Author(s):  
Rohit Bhargava ◽  
Yamuna Dilip Phal ◽  
Kevin Yeh

Discrete frequency infrared (DFIR) chemical imaging is transforming the practice of microspectroscopy by enabling a diversity of instrumentation and new measurement capabilities. While a variety of hardware implementations have been realized, considerations in the design of all-IR microscopes have not yet been compiled. Here we describe the evolution of IR microscopes, provide rationales for design choices, and the major considerations for each optical component that together comprise an imaging system. We analyze design choices in illustrative examples that use these components to optimize performance, under their particular constraints. We then summarize a framework to assess the factors that determine an instrument’s performance mathematically. Finally, we summarize the design and analysis approach by enumerating performance figures of merit for spectroscopic imaging data that can be used to evaluate the capabilities of imaging systems or suitability for specific intended applications. Together, the presented concepts and examples should aid in understanding available instrument configurations, while guiding innovations in design of the next generation of IR chemical imaging spectrometers.


Sign in / Sign up

Export Citation Format

Share Document