Relative Pose Determination of Uncooperative Spacecraft Based on Circle Feature

This paper investigates the problem of spacecraft relative navigation with respect to an unknown target during the close-proximity operations in the on-orbit service system. The serving spacecraft is equipped with a Time-of-Flight (ToF) camera for object recognition and feature detection. A fast and robust relative navigation strategy for acquisition is presented without any extra information about the target by using the natural circle features. The architecture of the proposed relative navigation strategy consists of three ingredients. First, a point cloud segmentation method based on the auxiliary gray image is developed for fast extraction of the circle feature point cloud of the target. Secondly, a new parameter fitting method of circle features is proposed including circle feature calculation by two different geometric models and results’ fusion. Finally, a specific definition of the coordinate frame system is introduced to solve the relative pose with respect to the uncooperative target. In order to validate the efficiency of the segmentation, an experimental test is conducted based on real-time image data acquired by the ToF camera. The total time consumption is saved by 94%. In addition, numerical simulations are carried out to evaluate the proposed navigation algorithm. It shows good robustness under the different levels of noises.

Contactless Vital Sign Monitoring System for Heart and Respiratory Rate Measurements with Motion Compensation Using a Near-Infrared Time-of-Flight Camera

This study describes a contactless vital sign monitoring (CVSM) system capable of measuring heart rate (HR) and respiration rate (RR) using a low-power, indirect time-of-flight (ToF) camera. The system takes advantage of both the active infrared illumination as well as the additional depth information from the ToF camera to compensate for the motion-induced artifacts during the HR measurements. The depth information captures how the user is moving with respect to the camera and, therefore, can be used to differentiate where the intensity change in the raw signal is from the underlying heartbeat or motion. Moreover, from the depth information, the system can acquire respiration rate by directly measuring the motion of the chest wall during breathing. We also conducted a pilot human study using this system with 29 participants of different demographics such as age, gender, and skin color. Our study shows that with depth-based motion compensation, the success rate (system measurement within 10% of reference) of HR measurements increases to 75%, as compared to 35% when motion compensation is not used. The mean HR deviation from the reference also drops from 21 BPM to −6.25 BPM when we apply the depth-based motion compensation. In terms of the RR measurement, our system shows a mean deviation of 1.7 BPM from the reference measurement. The pilot human study shows the system performance is independent of skin color but weakly dependent on gender and age.

Real-Time Capture of Snowboarder’s Skiing Motion Using a 3D Vision Sensor

Due to the influence of environmental interference and too fast speed, there are some problems in ski motion capture, such as inaccurate motion capture, motion delay, and motion loss, resulting in the inconsistency between the actual motion of later athletes and the motion of virtual characters. To solve the above problems, a real-time skiing motion capture method of snowboarders based on a 3D vision sensor is proposed. This method combines the Time of Fight (TOF) camera and high-speed vision sensor to form a motion acquisition system. The collected motion images are fused to form a complete motion image, and the pose is solved. The pose data is bound with the constructed virtual character model to drive the virtual model to synchronously complete the snowboarding motion and realize the real-time capture of skiing motion. The results show that the motion accuracy of the system is as high as 98.6%, which improves the capture effect, and the motion matching proportion is better and more practical. It is also excellent in the investigation of motion delay and motion loss.

Application of Nanooptics in Photographic Imagery and Medical Imaging

Background. At present, with the continuous development of nanotechnology, great changes have taken place in people’s lives in medical treatment, production, daily leisure, and so on. Nanooptical technology is entirely based on nanotechnology that laser and visible light are limited to submicron structures (nanopores, nanoslits, and nanoneedles). Due to the great development potential of nanooptical technology in nanoscale sensors, TOF camera applications, THz imaging technology, and other imaging equipment materials and applications, people have been interested in it, recently. Scope and Approach. In this review, the importance of good practices for nanooptical technology used in equipment as both nanometer scale sensors and optical auxiliary equipment is described. Based on recent reports, this work discussed the development of nanooptical technology in daily photography and medical imaging from both the positive and the negative sides and compared the engineering techniques. Key Findings and Conclusions. As a kind of new optical technology, nanooptical technology can produce the plasmonic effect under the intense collision of atoms and electrons in nanostructures. It has significant effects in superresolution nanolithography, high-density data storage, near-field optics, and other fields. Although the current nanooptic technology is not extremely mature, the results obtained from current works are pointing out that nanooptical technology is the future of daily imaging and medical imaging, and it also will play a positive role in the improvement of people’s health and ecological environment quality. As a trend, nanooptical technology is developing in the direction of energy-saving, portability, high efficiency, and low pollution, and in the upsurge of environmental protection in the world, nanooptical technology will surely achieve amazing development in the field of daily photography and medical imaging. Under the huge market demand and innovation power, nanophotonics technology will cover all emerging technologies that share the same research field with it and take advantage of each technology (terahertz, cell and molecular microscopy, and nanoscale probes) to develop an unprecedented new century in nanoscience. The future trends of research contain finding new imaging equipment with nanostructure, designing nanooptical products, and improving engineering techniques.

Three-Dimensional Particle Tracking Velocimetry using a Single Time-of-Flight Camera

Time of Flight (ToF) cameras are a type of range-imaging camera that provides three-dimensional scene information from a single camera. This paper assesses the ability of ToF technology to be used for threedimensional particle tracking velocimetry (3D-PTV). Using a commercially available ToF camera various aspects of 3D-PTV are considered, including: minimum resolvable particle size, environmental factors (reflections and refractive index changes) and time resolution. Although it is found that an off-the-shelf ToF camera is not a viable alternative to traditional 3D-PTV measurement systems, basic 3D-PTV measurements are shown with large (6mm) particles in both air and water to demonstrate future potential use as this technology develops. A summary of necessary technological advances is also discussed.

Methodology for Olive Pruning Windrow Assessment Using 3D Time-of-Flight Camera

The management of olive pruning residue has shifted from burning to shredding, laying residues on soil, or harvesting residues for use as a derivative. The objective of this research is to develop, test, and validate a methodology to measure the dimensions, outline, and bulk volume of pruning residue windrows in olive orchards using both a manual and a 3D Time-of-Flight (ToF) camera. Trees were pruned using trunk shaker targeted pruning, from which two different branch sizes were selected to build two separate windrow treatments with the same pruning residue dose. Four windrows were built for each treatment, and four sampling points were selected along each windrow to take measurements using both manual and 3D ToF measurements. Windrow section outline could be defined using a polynomial or a triangular function, although manual measurement required processing with a polynomial function, especially for high windrow volumes. Different branch sizes provided to be significant differences for polynomial function coefficients, while no significant differences were found for windrow width. Bigger branches provided less bulk volume, which implied that these branches formed less porous windrows that smaller ones. Finally, manual and 3D ToF camera measurements were validated, giving an adequate performance for olive pruning residue windrow in-field assessment.

Automated Non-Contact Respiratory Rate Monitoring of Neonates Based on Synchronous Evaluation of a 3D Time-of-Flight Camera and a Microwave Interferometric Radar Sensor

This paper introduces an automatic non-contact monitoring method based on the synchronous evaluation of a 3D time-of-flight (ToF) camera and a microwave interferometric radar sensor for measuring the respiratory rate of neonates. The current monitoring on the Neonatal Intensive Care Unit (NICU) has several issues which can cause pressure marks, skin irritations and eczema. To minimize these risks, a non-contact system made up of a 3D time-of-flight camera and a microwave interferometric radar sensor is presented. The 3D time-of-flight camera delivers 3D point clouds which can be used to calculate the change in distance of the moving chest and from it the respiratory rate. The disadvantage of the ToF camera is that the heartbeat cannot be determined. The microwave interferometric radar sensor determines the change in displacement caused by the respiration and is even capable of measuring the small superimposed movements due to the heartbeat. The radar sensor is very sensitive towards movement artifacts due to, e.g., the baby moving its arms. To allow a robust vital parameter detection the data of both sensors was evaluated synchronously. In this publication, we focus on the first step: determining the respiratory rate. After all processing steps, the respiratory rate determined by the radar sensor was compared to the value received from the 3D time-of-flight camera. The method was validated against our gold standard: a self-developed neonatal simulation system which can simulate different breathing patterns. In this paper, we show that we are the first to determine the respiratory rate by evaluating the data of an interferometric microwave radar sensor and a ToF camera synchronously. Our system delivers very precise breaths per minute (BPM) values within the norm range of 20–60 BPM with a maximum difference of 3 BPM (for the ToF camera itself at 30 BPM in normal mode). Especially in lower respiratory rate regions, i.e., 5 and 10 BPM, the synchronous evaluation is required to compensate the drawbacks of the ToF camera. In the norm range, the ToF camera performs slightly better than the radar sensor.