An automatic approach and grip method of micro-particle in 3D space

2017 ◽  
Vol 31 (07) ◽  
pp. 1741013
Author(s):  
Juan Zhang ◽  
Wenrong Wu ◽  
Lie Bi

Micro-particle is hard to be observed as small scale and hard to be gripped as micro-force from substrate, an automatic approach and grip method of micro-particle in the guide of microscopic vision systems is proposed in the paper to grip micro-particle. First, the micro-gripper driven by electrostatic force is introduced and forces in gripping process are analyzed. Second, a micro-assembly robot composed of two microscopic vision systems is established to monitor micro-operation process and to operate micro-particle. Image features of micro-particle and micro-gripper end-effector are extracted by image feature extraction method to calculate relative position of micro-particle and micro-gripper in image space. Last, a movement control strategy in 3D space based on image Jacobian matrix is studied to control micro-gripper approach and align with micro-particle. Experimental results verified the effectiveness of proposed methods.

Sensors ◽  
2021 ◽  
Vol 21 (16) ◽  
pp. 5312
Author(s):  
Yanni Zhang ◽  
Yiming Liu ◽  
Qiang Li ◽  
Jianzhong Wang ◽  
Miao Qi ◽  
...  

Recently, deep learning-based image deblurring and deraining have been well developed. However, most of these methods fail to distill the useful features. What is more, exploiting the detailed image features in a deep learning framework always requires a mass of parameters, which inevitably makes the network suffer from a high computational burden. We propose a lightweight fusion distillation network (LFDN) for image deblurring and deraining to solve the above problems. The proposed LFDN is designed as an encoder–decoder architecture. In the encoding stage, the image feature is reduced to various small-scale spaces for multi-scale information extraction and fusion without much information loss. Then, a feature distillation normalization block is designed at the beginning of the decoding stage, which enables the network to distill and screen valuable channel information of feature maps continuously. Besides, an information fusion strategy between distillation modules and feature channels is also carried out by the attention mechanism. By fusing different information in the proposed approach, our network can achieve state-of-the-art image deblurring and deraining results with a smaller number of parameters and outperform the existing methods in model complexity.


Author(s):  
Guobing Yan ◽  
◽  
Qiang Sun ◽  
Jianying Huang ◽  
Yonghong Chen

Image recognition is one of the key technologies for worker’s helmet detection using an unmanned aerial vehicle (UAV). By analyzing the image feature extraction method for workers’ helmet detection based on convolutional neural network (CNN), a double-channel convolutional neural network (DCNN) model is proposed to improve the traditional image processing methods. On the basis of AlexNet model, the image features of the worker can be extracted using two independent CNNs, and the essential image features can be better reflected considering the abstraction degree of the features. Combining a traditional machine learning method and random forest (RF), an intelligent recognition algorithm based on DCNN and RF is proposed for workers’ helmet detection. The experimental results show that deep learning (DL) is closely related to the traditional machine learning methods. Moreover, adding a DL module to the traditional machine learning framework can improve the recognition accuracy.


2011 ◽  
Vol 88-89 ◽  
pp. 116-121
Author(s):  
Su Qun Cao ◽  
Ge Lan Yang ◽  
Quan Yin Zhu ◽  
Hai Fei Zhai

Mechanical part recognition has great significance in automated sorting and processing. The core of mechanical part recognition is the part image feature extraction. Thus, how to extract part features to meet the real time requirements for the automated production line has a crucial role. A novel feature extraction algorithm is presented for part image features in this paper. It aims to optimize the fuzzy Fisher criterion function to figure out two orthogonal optimal discriminant vectors in an unsupervised way. Based on these two vectors, the linear transformation from d-dimension to 2-dimension can be obtained. Experimental results on three mechanical parts show its effectiveness.


Author(s):  
W. Krakow ◽  
D. A. Smith

The successful determination of the atomic structure of [110] tilt boundaries in Au stems from the investigation of microscope performance at intermediate accelerating voltages (200 and 400kV) as well as a detailed understanding of how grain boundary image features depend on dynamical diffraction processes variation with specimen and beam orientations. This success is also facilitated by improving image quality by digital image processing techniques to the point where a structure image is obtained and each atom position is represented by a resolved image feature. Figure 1 shows an example of a low angle (∼10°) Σ = 129/[110] tilt boundary in a ∼250Å Au film, taken under tilted beam brightfield imaging conditions, to illustrate the steps necessary to obtain the atomic structure configuration from the image. The original image of Fig. 1a shows the regular arrangement of strain-field images associated with the cores of ½ [10] primary dislocations which are separated by ∼15Å.


2016 ◽  
Vol 20 (2) ◽  
pp. 191-201 ◽  
Author(s):  
Wei Lu ◽  
Yan Cui ◽  
Jun Teng

To decrease the cost of instrumentation for the strain and displacement monitoring method that uses sensors as well as considers the structural health monitoring challenges in sensor installation, it is necessary to develop a machine vision-based monitoring method. For this method, the most important step is the accurate extraction of the image feature. In this article, the edge detection operator based on multi-scale structure elements and the compound mathematical morphological operator is proposed to provide improved image feature extraction. The proposed method can not only achieve an improved filtering effect and anti-noise ability but can also detect the edge more accurately. Furthermore, the required image features (vertex of a square calibration board and centroid of a circular target) can be accurately extracted using the extracted image edge information. For validation, the monitoring tests for the structural local mean strain and in-plane displacement were designed accordingly. Through analysis of the error between the measured and calculated values of the structural strain and displacement, the feasibility and effectiveness of the proposed edge detection operator are verified.


Sensors ◽  
2019 ◽  
Vol 19 (2) ◽  
pp. 291 ◽  
Author(s):  
Hamdi Sahloul ◽  
Shouhei Shirafuji ◽  
Jun Ota

Local image features are invariant to in-plane rotations and robust to minor viewpoint changes. However, the current detectors and descriptors for local image features fail to accommodate out-of-plane rotations larger than 25°–30°. Invariance to such viewpoint changes is essential for numerous applications, including wide baseline matching, 6D pose estimation, and object reconstruction. In this study, we present a general embedding that wraps a detector/descriptor pair in order to increase viewpoint invariance by exploiting input depth maps. The proposed embedding locates smooth surfaces within the input RGB-D images and projects them into a viewpoint invariant representation, enabling the detection and description of more viewpoint invariant features. Our embedding can be utilized with different combinations of descriptor/detector pairs, according to the desired application. Using synthetic and real-world objects, we evaluated the viewpoint invariance of various detectors and descriptors, for both standalone and embedded approaches. While standalone local image features fail to accommodate average viewpoint changes beyond 33.3°, our proposed embedding boosted the viewpoint invariance to different levels, depending on the scene geometry. Objects with distinct surface discontinuities were on average invariant up to 52.8°, and the overall average for all evaluated datasets was 45.4°. Similarly, out of a total of 140 combinations involving 20 local image features and various objects with distinct surface discontinuities, only a single standalone local image feature exceeded the goal of 60° viewpoint difference in just two combinations, as compared with 19 different local image features succeeding in 73 combinations when wrapped in the proposed embedding. Furthermore, the proposed approach operates robustly in the presence of input depth noise, even that of low-cost commodity depth sensors, and well beyond.


Atmosphere ◽  
2021 ◽  
Vol 12 (7) ◽  
pp. 828
Author(s):  
Wai Lun Lo ◽  
Henry Shu Hung Chung ◽  
Hong Fu

Estimation of Meteorological visibility from image characteristics is a challenging problem in the research of meteorological parameters estimation. Meteorological visibility can be used to indicate the weather transparency and this indicator is important for transport safety. This paper summarizes the outcomes of the experimental evaluation of a Particle Swarm Optimization (PSO) based transfer learning method for meteorological visibility estimation method. This paper proposes a modified approach of the transfer learning method for visibility estimation by using PSO feature selection. Image data are collected at fixed location with fixed viewing angle. The database images were gone through a pre-processing step of gray-averaging so as to provide information of static landmark objects for automatic extraction of effective regions from images. Effective regions are then extracted from image database and the image features are then extracted from the Neural Network. Subset of Image features are selected based on the Particle Swarming Optimization (PSO) methods to obtain the image feature vectors for each effective sub-region. The image feature vectors are then used to estimate the visibilities of the images by using the Multiple Support Vector Regression (SVR) models. Experimental results show that the proposed method can give an accuracy more than 90% for visibility estimation and the proposed method is effective and robust.


2011 ◽  
Vol 2011 ◽  
pp. 1-14 ◽  
Author(s):  
Jinjun Li ◽  
Hong Zhao ◽  
Chengying Shi ◽  
Xiang Zhou

A stereo similarity function based on local multi-model monogenic image feature descriptors (LMFD) is proposed to match interest points and estimate disparity map for stereo images. Local multi-model monogenic image features include local orientation and instantaneous phase of the gray monogenic signal, local color phase of the color monogenic signal, and local mean colors in the multiscale color monogenic signal framework. The gray monogenic signal, which is the extension of analytic signal to gray level image using Dirac operator and Laplace equation, consists of local amplitude, local orientation, and instantaneous phase of 2D image signal. The color monogenic signal is the extension of monogenic signal to color image based on Clifford algebras. The local color phase can be estimated by computing geometric product between the color monogenic signal and a unit reference vector in RGB color space. Experiment results on the synthetic and natural stereo images show the performance of the proposed approach.


2019 ◽  
Vol 2019 ◽  
pp. 1-9 ◽  
Author(s):  
Yang Zhang ◽  
Chaoyue Chen ◽  
Zerong Tian ◽  
Yangfan Cheng ◽  
Jianguo Xu

Objectives. To differentiate pituitary adenoma from Rathke cleft cyst in magnetic resonance (MR) scan by combing MR image features with texture features. Methods. A total number of 133 patients were included in this study, 83 with pituitary adenoma and 50 with Rathke cleft cyst. Qualitative MR image features and quantitative texture features were evaluated by using the chi-square tests or Mann–Whitney U test. Binary logistic regression analysis was conducted to investigate their ability as independent predictors. ROC analysis was conducted subsequently on the independent predictors to assess their practical value in discrimination and was used to investigate the association between two types of features. Results. Signal intensity on the contrast-enhanced image was found to be the only significantly different MR image feature between the two lesions. Two texture features from the contrast-enhanced images (Histo-Skewness and GLCM-Correlation) were found to be the independent predictors in discrimination, of which AUC values were 0.80 and 0.75, respectively. Besides, the above two texture features (Histo-Skewness and GLCM-Contrast) were suggested to be associated with signal intensity on the contrast-enhanced image. Conclusion. Signal intensity on the contrast-enhanced image was the most significant MR image feature in differentiation between pituitary adenoma and Rathke cleft cyst, and texture features also showed promising and practical ability in discrimination. Moreover, two types of features could be coordinated with each other.


Panorama development is the basically method of integrating multiple images captured of the same scene under consideration to get high resolution image. This process is useful for combining multiple images which are overlapped to obtain larger image. Usefulness of Image stitching is found in the field related to medical imaging, data from satellites, computer vision and automatic target recognition in military applications. The goal objective of this research paper is basically for developing an high improved resolution and its quality panorama having with high accuracy and minimum computation time. Initially we compared different image feature detectors and tested SIFT, SURF, ORB to find out the rate of detection of the corrected available key points along with processing time. Later on, testing is done with some common techniques of image blending or fusion for improving the mosaicing quality process. In this experimental results, it has been found out that ORB image feature detection and description algorithm is more accurate, fastest which gives a higher performance and Pyramid blending method gives the better stitching quality. Lastly panorama is developed based on combination of ORB binary descriptor method for finding out image features and pyramid blending method.


Sign in / Sign up

Export Citation Format

Share Document