Design and Measurement of a Dual FBG High-Precision Shape Sensor for Wing Shape Reconstruction

FBG shape sensors based on soft substrates are currently one of the research focuses of wing shape reconstruction, where soft substrates and torque are two important factors affecting the performance of shape sensors, but the related analysis is not common. A high-precision soft substrates shape sensor based on dual FBGs is designed. First, the FBG soft substrate shape sensor model is established to optimize the sensor size parameters and get the optimal solution. The two FBG cross-laying method is adopted to effectively reduce the influence of torque, the crossover angle between the FBGs is 2α, and α = 30° is selected as the most sensitive angle to the torquer response. Second, the calibration test platform of this shape sensor is built to obtain the linear relationship among the FBG wavelength drift and curvature, rotation radian loaded vertical force and torque. Finally, by using the test specimen shape reconstruction test, it is verified that this shape sensor can improve the shape reconstruction accuracy, and that its reconstruction error is 6.13%, which greatly improves the fit of shape reconstruction. The research results show that the dual FBG high-precision shape sensor successfully achieves high accuracy and reliability in shape reconstruction.

Axially rigid steerable needle with compliant active tip control

Steerable instruments allow for precise access to deeply-seated targets while sparing sensitive tissues and avoiding anatomical structures. In this study we present a novel omnidirectional steerable instrument for prostate high-dose-rate (HDR) brachytherapy (BT). The instrument utilizes a needle with internal compliant mechanism, which enables distal tip steering through proximal instrument bending while retaining high axial and flexural rigidity. Finite element analysis evaluated the design and the prototype was validated in experiments involving tissue simulants and ex-vivo bovine tissue. Ultrasound (US) images were used to provide visualization and shape-reconstruction of the instrument during the insertions. In the experiments lateral tip steering up to 20 mm was found. Manually controlled active needle tip steering in inhomogeneous tissue simulants and ex-vivo tissue resulted in mean targeting errors of 1.4 mm and 2 mm in 3D position, respectively. The experiments show that steering response of the instrument is history-independent. The results indicate that the endpoint accuracy of the steerable instrument is similar to that of the conventional rigid HDR BT needle while adding the ability to steer along curved paths. Due to the design of the steerable needle sufficient axial and flexural rigidity is preserved to enable puncturing and path control within various heterogeneous tissues. The developed instrument has the potential to overcome problems currently unavoidable with conventional instruments, such as pubic arch interference in HDR BT, without major changes to the clinical workflow.

Joint 3D facial shape reconstruction and texture completion from a single image

Recent years have witnessed significant progress in image-based 3D face reconstruction using deep convolutional neural networks. However, current reconstruction methods often perform improperly in self-occluded regions and can lead to inaccurate correspondences between a 2D input image and a 3D face template, hindering use in real applications. To address these problems, we propose a deep shape reconstruction and texture completion network, SRTC-Net, which jointly reconstructs 3D facial geometry and completes texture with correspondences from a single input face image. In SRTC-Net, we leverage the geometric cues from completed 3D texture to reconstruct detailed structures of 3D shapes. The SRTC-Net pipeline has three stages. The first introduces a correspondence network to identify pixel-wise correspondence between the input 2D image and a 3D template model, and transfers the input 2D image to a U-V texture map. Then we complete the invisible and occluded areas in the U-V texture map using an inpainting network. To get the 3D facial geometries, we predict coarse shape (U-V position maps) from the segmented face from the correspondence network using a shape network, and then refine the 3D coarse shape by regressing the U-V displacement map from the completed U-V texture map in a pixel-to-pixel way. We examine our methods on 3D reconstruction tasks as well as face frontalization and pose invariant face recognition tasks, using both in-the-lab datasets (MICC, MultiPIE) and in-the-wild datasets (CFP). The qualitative and quantitative results demonstrate the effectiveness of our methods on inferring 3D facial geometry and complete texture; they outperform or are comparable to the state-of-the-art.

Monocular 3D Body Shape Reconstruction under Clothing

Estimating the 3D shape of objects from monocular images is a well-established and challenging task in the computer vision field. Further challenges arise when highly deformable objects, such as human faces or bodies, are considered. In this work, we address the problem of estimating the 3D shape of a human body from single images. In particular, we provide a solution to the problem of estimating the shape of the body when the subject is wearing clothes. This is a highly challenging scenario as loose clothes might hide the underlying body shape to a large extent. To this aim, we make use of a parametric 3D body model, the SMPL, whose parameters describe the body pose and shape of the body. Our main intuition is that the shape parameters associated with an individual should not change whether the subject is wearing clothes or not. To improve the shape estimation under clothing, we train a deep convolutional network to regress the shape parameters from a single image of a person. To increase the robustness to clothing, we build our training dataset by associating the shape parameters of a “minimally clothed” person to other samples of the same person wearing looser clothes. Experimental validation shows that our approach can more accurately estimate body shape parameters with respect to state-of-the-art approaches, even in the case of loose clothes.

Influence of Two-Plane Position and Stress on Intensity-Variation-Based Sensors: Towards Shape Sensing in Polymer Optical Fibers

Shape reconstruction is growing as an important real-time monitoring strategy for applications that require rigorous control. Polymer optical fiber sensors (POF) have mechanical properties that allow the measurement of large curvatures, making them appropriate for shape sensing. They are also lightweight, compact and chemically stable, meaning they are easy to install and safer in risky environments. This paper presents a sensor system to detect angles in multiple planes using a POF-intensity-variation-based sensor and a procedure to detect the angular position in different planes. Simulations are performed to demonstrate the correlation between the sensor’s mechanical bending response and their optical response. Cyclic flexion experiments are performed at three test frequencies to obtain the sensitivities and the calibration curves of the sensor at different angular positions of the lateral section. A Fast Fourier Transform (FFT) analysis is tested as a method to estimate angular velocities using POF sensors. The experimental results show that the prototype had high repeatability since its sensitivity was similar using different test frequencies at the same lateral section position. The proposed approach proved itself feasible considering that all linear calibration curves presented a coefficient of determination (R2) higher than 0.9.

Efficient and Stable Voxel-Based Algorithm for Computing 3D Zernike Moments and Shape Reconstruction

3D Zernike moments based on 3D Zernike polynomials have been successfully applied to the field of voxelized 3D shape retrieval and have attracted more attention in biomedical image processing. As the order of 3D Zernike moments increases, both computational efficiency and numerical accuracy decrease. Due to this phenomenon, a more efficient and stable method for computing high-order 3D Zernike moments was proposed in this study. The proposed recursive formula for computing 3D Zernike radial polynomials combines the recursive calculation of spherical harmonics to develop a voxel-based algorithm for the calculation of 3D Zernike moments. The algorithm was applied to the 3D shape Michelangelo's David with a size of 150×150×150 voxels. As compared to the method without additional acceleration, the proposed method uses a group action of order sixteen orthogonal group and saving unnecessary iterations, the factor of speed-up is 56.783±3.999 when the order of Zernike moments is between 10 and 450. The proposed method also obtained an accurate reconstructed shape with the error rate (normalized mean square error) of 0.00 (4.17×10^-3) when the reconstruction was computed for all moments up to order 450.

Shape Reconstruction Processes for Interventional Application Devices: State of the Art, Progress, and Future Directions

Soft and continuum robots are transforming medical interventions thanks to their flexibility, miniaturization, and multidirectional movement abilities. Although flexibility enables reaching targets in unstructured and dynamic environments, it also creates challenges for control, especially due to interactions with the anatomy. Thus, in recent years lots of efforts have been devoted for the development of shape reconstruction methods, with the advancement of different kinematic models, sensors, and imaging techniques. These methods can increase the performance of the control action as well as provide the tip position of robotic manipulators relative to the anatomy. Each method, however, has its advantages and disadvantages and can be worthwhile in different situations. For example, electromagnetic (EM) and Fiber Bragg Grating (FBG) sensor-based shape reconstruction methods can be used in small-scale robots due to their advantages thanks to miniaturization, fast response, and high sensitivity. Yet, the problem of electromagnetic interference in the case of EM sensors, and poor response to high strains in the case of FBG sensors need to be considered. To help the reader make a suitable choice, this paper presents a review of recent progress on shape reconstruction methods, based on a systematic literature search, excluding pure kinematic models. Methods are classified into two categories. First, sensor-based techniques are presented that discuss the use of various sensors such as FBG, EM, and passive stretchable sensors for reconstructing the shape of the robots. Second, imaging-based methods are discussed that utilize images from different imaging systems such as fluoroscopy, endoscopy cameras, and ultrasound for the shape reconstruction process. The applicability, benefits, and limitations of each method are discussed. Finally, the paper draws some future promising directions for the enhancement of the shape reconstruction methods by discussing open questions and alternative methods.